-- Logs begin at Sat 2021-11-20 20:01:12 UTC, end at Sat 2021-11-20 22:10:15 UTC. -- Nov 20 20:35:48.651371 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 20 20:35:48.664616 ncdv-master-1 devstack@n-api.service[125531]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 20 20:35:48 2021] *** Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: nodename: ncdv-master-1 Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: machine: x86_64 Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: clock source: unix Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: pcre jit disabled Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: detected number of CPU cores: 4 Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: current working directory: / Nov 20 20:35:48.666764 ncdv-master-1 devstack@n-api.service[125531]: detected binary path: /usr/bin/uwsgi-core Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: your processes number limit is 47680 Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: your memory page size is 4096 bytes Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: detected max file descriptor number: 2048 Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: lock engine: pthread robust mutexes Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: thunder lock: enabled Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 20 20:35:48.667342 ncdv-master-1 devstack@n-api.service[125531]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 20 20:35:48.714540 ncdv-master-1 devstack@n-api.service[125531]: Python main interpreter initialized at 0x559bf1a309c0 Nov 20 20:35:48.714540 ncdv-master-1 devstack@n-api.service[125531]: python threads support enabled Nov 20 20:35:48.714540 ncdv-master-1 devstack@n-api.service[125531]: your server socket listen backlog is limited to 100 connections Nov 20 20:35:48.714540 ncdv-master-1 devstack@n-api.service[125531]: your mercy for graceful operations on workers is 90 seconds Nov 20 20:35:48.714900 ncdv-master-1 devstack@n-api.service[125531]: mapped 403077 bytes (393 KB) for 2 cores Nov 20 20:35:48.714966 ncdv-master-1 devstack@n-api.service[125531]: *** Operational MODE: preforking *** Nov 20 20:35:48.715196 ncdv-master-1 devstack@n-api.service[125531]: *** uWSGI is running in multiple interpreter mode *** Nov 20 20:35:48.715196 ncdv-master-1 devstack@n-api.service[125531]: spawned uWSGI master process (pid: 125531) Nov 20 20:35:48.715400 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 20 20:35:48.717021 ncdv-master-1 devstack@n-api.service[125531]: spawned uWSGI worker 1 (pid: 125532, cores: 1) Nov 20 20:35:48.717021 ncdv-master-1 devstack@n-api.service[125531]: spawned uWSGI worker 2 (pid: 125533, cores: 1) Nov 20 20:35:48.717021 ncdv-master-1 devstack@n-api.service[125531]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 20 20:35:50.364807 ncdv-master-1 devstack@n-api.service[125532]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:35:50.364807 ncdv-master-1 devstack@n-api.service[125532]: from cryptography.utils import int_from_bytes Nov 20 20:35:50.365560 ncdv-master-1 devstack@n-api.service[125532]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:35:50.365560 ncdv-master-1 devstack@n-api.service[125532]: from cryptography.utils import int_from_bytes Nov 20 20:35:50.372787 ncdv-master-1 devstack@n-api.service[125533]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:35:50.372787 ncdv-master-1 devstack@n-api.service[125533]: from cryptography.utils import int_from_bytes Nov 20 20:35:50.373284 ncdv-master-1 devstack@n-api.service[125533]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:35:50.373284 ncdv-master-1 devstack@n-api.service[125533]: from cryptography.utils import int_from_bytes Nov 20 20:35:52.833359 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 20:35:52.833871 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 20:35:52.834014 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 20:35:52.834395 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 20:35:52.834647 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 20:35:52.835027 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.835351 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.835668 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.835986 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.836309 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.836614 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.836931 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.837246 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.837569 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.837825 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.838196 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.838522 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.838842 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.839147 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.839364 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 20:35:52.839748 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.839844 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 20:35:52.839929 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.840042 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.840132 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 20:35:52.840358 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.840459 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 20:35:52.840657 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.841252 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 20:35:52.841748 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.841863 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.842147 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.842482 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.842581 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.842791 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.842879 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843103 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843206 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843446 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843545 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843749 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.843860 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844062 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844224 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844468 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844566 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844645 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844727 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.844951 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845047 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845275 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845359 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845598 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845737 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.845910 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846011 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846283 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846390 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846600 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846691 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846905 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.846989 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.847233 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.847372 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.847546 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.847650 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.847894 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848054 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848224 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848368 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848531 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848659 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848852 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.848969 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849169 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849307 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849482 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849624 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849799 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.849933 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850119 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850281 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850427 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850592 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850731 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.850916 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851046 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851225 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851352 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851625 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851719 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851883 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.851973 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852186 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852283 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852502 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852593 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852818 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.852947 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853136 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853383 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853576 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853695 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.853901 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854009 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854253 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854353 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854557 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854651 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854862 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.854952 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855164 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855259 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855464 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855555 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855765 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.855874 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.856066 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.856214 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.856437 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857038 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857362 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857593 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857802 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.857891 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858210 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858314 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858464 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858573 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858774 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.858866 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859142 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859247 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859423 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859515 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859746 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859833 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.859999 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860092 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860251 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860374 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860575 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860690 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860899 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.860991 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861210 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861301 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861520 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861617 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861830 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.861923 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862160 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862250 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862471 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862575 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862781 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.862866 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863088 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863175 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863397 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863506 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863641 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863734 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.863939 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864026 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864240 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864382 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864566 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864690 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864855 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.864947 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865155 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865313 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865457 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865569 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865752 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.865879 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866090 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866247 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866376 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866574 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866682 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866880 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.866979 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867204 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867290 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867532 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867623 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867835 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.867932 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868134 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868221 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868433 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868524 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868747 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.868834 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869061 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869146 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869362 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869453 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869613 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869704 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.869916 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870002 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870249 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870337 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870572 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870672 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870870 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.870995 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871172 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871261 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871477 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871562 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871778 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.871897 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872117 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872228 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872426 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872608 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872736 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.872907 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873044 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873210 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873352 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873523 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873655 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873819 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.873962 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874146 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874293 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874462 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874598 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874764 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.874919 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875065 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875240 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875362 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875548 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875659 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875854 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.875948 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876161 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876252 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876468 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876567 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876788 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.876886 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877089 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877179 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877393 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877483 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877706 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.877802 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878009 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878130 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878336 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878422 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878639 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878738 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.878948 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.879032 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.879255 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.879341 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.879574 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.879666 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.879874 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.879960 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.880181 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.880266 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.880500 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.880587 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.880808 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.880893 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.881113 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.881206 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.881416 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.881502 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.881721 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.881806 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.882025 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.882153 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.882351 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.882445 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.882658 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.882744 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.882962 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.883057 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.883263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.883354 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.883579 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.883670 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.883900 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.883994 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.884210 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.884296 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.884517 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.884609 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.884826 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.884921 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.885131 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.885224 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:35:52.885445 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.885531 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.885770 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.885863 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886117 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886217 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886426 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886549 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886764 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.886851 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887099 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887204 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887406 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887496 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887763 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.887910 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888074 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888223 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888409 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888544 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888691 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888863 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.888999 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889183 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889307 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889503 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889629 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889829 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.889939 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890177 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890270 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890517 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890621 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890842 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.890931 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891161 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891255 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891487 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891646 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891788 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.891873 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892091 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892178 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892399 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892486 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892700 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.892797 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893015 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893111 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893343 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893437 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893651 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893738 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.893982 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894089 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894314 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894415 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894624 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894710 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.894933 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895018 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895237 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895330 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895547 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895639 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895855 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.895957 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896157 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896243 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896480 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896604 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896789 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.896917 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897093 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897186 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897411 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897488 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897714 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.897808 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898016 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898124 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898351 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898437 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898658 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898754 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.898965 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899051 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899272 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899357 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899589 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899681 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899900 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.899993 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900206 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900292 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900535 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900630 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900844 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.900936 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901153 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901238 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901465 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901556 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901773 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.901860 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902113 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902213 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902417 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902505 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902725 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.902814 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.903029 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.903124 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.903864 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904133 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904228 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904314 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904461 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904583 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904761 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.904896 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905061 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905206 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905363 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905526 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905664 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905842 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.905964 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.906180 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.906309 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.906497 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.906870 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907085 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907176 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907402 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907519 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907721 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.907807 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908060 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908146 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908369 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908463 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908688 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.908774 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909018 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909111 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909331 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909425 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909651 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909738 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.909957 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910041 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910295 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910396 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910604 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910696 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.910913 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911005 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911219 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911304 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911533 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911642 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911841 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.911935 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912149 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912241 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912455 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912540 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912759 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.912843 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913064 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913150 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913375 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913466 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913691 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913779 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.913994 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914111 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914327 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914413 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914635 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914721 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.914984 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915073 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915294 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915387 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915611 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915708 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.915918 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916004 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916227 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916312 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916533 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916627 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916840 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.916935 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917156 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917446 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917542 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917759 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.917845 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918091 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918204 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918405 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918515 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918711 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.918803 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.919584 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.919687 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.919889 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.919979 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920204 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920290 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920505 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920593 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920813 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.920903 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921137 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921222 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921442 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921526 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921762 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.921850 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922087 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922223 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922410 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922508 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922716 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.922804 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923020 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923106 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923328 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923423 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923629 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923715 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.923928 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924014 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924235 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924334 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924549 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924641 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924854 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.924940 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925160 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925258 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925460 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925546 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925771 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.925857 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926097 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926202 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926415 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926501 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926706 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.926792 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927015 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927114 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927330 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927441 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927635 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927739 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.927953 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928049 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928270 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928364 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928572 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928672 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928873 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.928968 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929191 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929291 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929497 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929597 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929797 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.929891 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930128 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930235 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930427 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930521 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930733 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.930824 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931048 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931141 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931355 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931459 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931665 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931756 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.931977 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932071 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932284 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932384 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932594 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932687 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932903 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.932994 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933210 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933315 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933517 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933616 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933832 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.933924 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934166 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934275 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934499 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934598 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934810 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.934904 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935122 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935275 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935432 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935590 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935754 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.935901 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936063 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936231 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936372 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936547 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936679 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936858 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.936981 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.937166 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.937290 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.937475 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.937603 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.937828 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938168 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938307 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938480 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938578 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938802 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.938898 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939115 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939200 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939431 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939517 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939746 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.939839 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940057 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940143 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940371 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940471 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940682 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940776 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.940985 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941072 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941297 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941384 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941616 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941713 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941904 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.941997 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942241 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942339 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942549 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942643 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942856 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.942942 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943158 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943245 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943465 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943554 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943768 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.943854 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944072 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944164 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944387 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944474 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944707 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.944806 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945017 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945272 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945359 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945607 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945694 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945907 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.945991 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946252 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946389 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946562 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946650 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946865 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.946959 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947168 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947468 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947611 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947807 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.947894 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948111 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948287 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948422 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948508 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948732 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.948818 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949040 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949137 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949353 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949439 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949661 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949746 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.949969 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.950116 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.950321 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.950502 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.950694 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.950822 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951011 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951132 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951325 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951442 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951631 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951781 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.951931 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952093 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952239 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952412 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952546 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952718 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.952853 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953033 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953159 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953341 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953459 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953668 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953754 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.953983 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954103 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954316 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954402 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954625 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954712 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.954930 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955017 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955242 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955329 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955550 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955642 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955855 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.955942 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956154 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956240 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956459 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956554 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956759 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.956845 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957069 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957155 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957369 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957463 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957675 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957791 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.957972 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958117 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958302 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958403 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958607 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958694 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958908 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.958994 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959227 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959323 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959534 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959621 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959834 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.959927 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960133 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960220 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960436 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960522 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960734 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.960820 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961039 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961126 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961342 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961434 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961659 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961751 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.961969 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962090 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962296 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962393 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962599 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962691 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962898 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.962990 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963200 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963286 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963500 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963595 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963804 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.963890 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964103 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964195 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964401 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964496 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964698 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964826 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.964998 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.965091 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.965297 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.965395 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.965608 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.966236 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.966504 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.966593 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.966855 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.966955 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967160 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967273 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967461 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967595 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967807 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.967907 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968110 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968197 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968467 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968594 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968773 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.968868 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969087 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969173 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969400 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969486 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969707 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.969799 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970015 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970150 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970351 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970439 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970656 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970765 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.970963 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971054 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971268 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971368 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971573 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971662 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971871 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.971974 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972174 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972273 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972477 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972563 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972785 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.972872 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973089 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973183 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973395 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973480 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973712 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.973796 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974023 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974186 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974356 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974444 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974657 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974743 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.974961 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975049 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975264 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975362 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975569 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975662 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975873 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.975960 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976178 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976276 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976487 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976575 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976794 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.976881 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977100 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977188 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977406 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977493 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977713 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.977867 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978007 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978116 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978366 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978476 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978641 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978728 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.978960 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979053 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979266 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979365 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979567 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979653 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979873 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.979981 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980174 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980269 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980480 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980566 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980781 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.980866 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981112 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981210 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981499 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981597 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981912 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.981999 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.982299 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.982406 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.982611 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.982696 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.982921 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983007 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983232 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983318 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983542 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983629 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983842 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.983927 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984158 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984251 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984474 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984561 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984787 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.984889 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985099 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985193 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985408 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985500 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985704 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.985790 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986010 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986117 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986343 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986430 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986642 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986736 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.986941 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987029 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987240 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987326 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987560 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987655 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987861 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.987948 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988170 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988259 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988483 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988579 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988873 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.988970 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989173 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989260 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989510 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989603 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989820 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.989913 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990156 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990247 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990472 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990560 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990804 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.990929 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991112 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991199 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991417 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991503 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991728 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.991820 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992035 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992121 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992356 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992450 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992678 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992764 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.992987 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993085 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993294 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993381 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993594 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993686 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.993912 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994016 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994249 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994336 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994555 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994643 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994861 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.994959 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995186 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995280 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995494 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995581 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995818 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.995912 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996167 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996259 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996491 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996576 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996792 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.996879 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.997636 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.997768 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998119 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998226 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998382 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998466 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998686 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.998772 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999007 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999092 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999308 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999404 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999615 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999701 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:52.999921 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000028 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000228 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000315 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000530 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000617 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000832 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.000919 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001151 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001241 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001451 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001539 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001770 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.001856 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002108 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002200 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002431 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002526 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002749 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.002835 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003049 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003142 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003369 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003477 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003675 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003802 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.003978 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004116 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004279 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004441 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004580 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004774 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.004923 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005084 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005227 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005390 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005547 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005703 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.005874 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006010 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006225 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006345 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006534 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006672 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006867 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.006981 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007191 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007278 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007506 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007593 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007820 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.007908 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008143 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008230 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008445 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008532 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008745 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.008834 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009050 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009136 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009353 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009448 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009657 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009751 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.009959 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010070 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010290 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010389 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010591 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010677 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010889 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.010975 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011189 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011284 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011511 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011604 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011813 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.011901 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.012138 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.012234 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.012445 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.012531 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.013336 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.013511 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.013776 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.013931 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014019 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014301 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014392 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014605 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014703 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.014939 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015028 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015256 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015349 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015577 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015680 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.015901 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016030 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016209 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016308 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016528 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016624 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016842 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.016929 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017152 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017239 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017461 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017553 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017770 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.017855 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018098 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018242 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018412 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018501 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018723 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.018818 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019030 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019123 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019337 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019423 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019645 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019732 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.019956 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020048 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020272 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020473 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020600 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020806 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.020916 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021124 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021319 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021442 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021530 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021755 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.021850 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022092 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022184 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022411 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022498 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022724 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.022826 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023037 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023125 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023349 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023447 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023660 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023751 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.023988 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024075 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024307 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024401 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024631 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024772 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.024966 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025054 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025284 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025371 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025599 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025704 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.025914 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026001 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026256 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026347 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026574 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026672 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026888 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.026976 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027208 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027304 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027521 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027608 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027837 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.027929 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.028151 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.028488 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.028652 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.028797 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.028921 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029112 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029247 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029422 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029572 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029731 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.029894 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030039 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030243 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030373 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030566 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030684 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.030886 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.031004 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.031204 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.031337 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.031522 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.031921 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032100 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032237 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032436 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032552 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032761 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.032868 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.033093 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.033382 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.033484 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.033695 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.033782 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034025 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034135 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034372 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034474 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034691 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.034777 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035002 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035088 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035316 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035404 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035641 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035736 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.035947 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036041 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036249 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036337 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036558 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036645 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036865 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.036952 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037167 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037263 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037485 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037570 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037790 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.037887 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038113 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038216 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038432 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038525 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038740 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.038839 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039062 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039262 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039392 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039606 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039733 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.039919 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040059 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040245 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040377 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040567 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040695 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.040882 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041016 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041187 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041510 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041648 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041815 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.041903 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042143 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042245 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042463 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042554 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042772 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.042860 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043075 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043162 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043391 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043479 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043685 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.043774 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044021 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044125 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044319 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044408 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044627 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044715 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.044927 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045015 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045249 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045344 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045551 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045638 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045853 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.045940 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046177 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046287 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046487 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046574 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046787 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.046874 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047088 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047322 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047410 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047673 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047760 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.047980 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048067 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048281 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048372 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048587 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048673 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048886 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.048981 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049194 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049280 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049495 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049589 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049800 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.049895 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050122 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050210 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050444 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050543 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050745 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.050840 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051047 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051140 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051359 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051445 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051666 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051763 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.051976 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052068 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052284 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052371 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052590 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052679 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052896 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.052982 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.053224 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.053311 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.053533 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.053749 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.053851 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054147 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054240 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054469 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054569 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054774 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.054870 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055083 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055180 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055389 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055487 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055695 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.055782 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056002 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056099 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056305 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056396 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056617 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056704 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.056922 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057008 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057229 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057322 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057531 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057616 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057836 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.057929 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058153 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058243 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058464 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058551 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058772 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.058858 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.059075 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.059161 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.059384 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060017 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060226 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060342 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060620 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060706 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.060952 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061039 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061270 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061366 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061585 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061725 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061894 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.061982 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.062227 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.062485 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.062618 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.062836 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.062922 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063151 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063239 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063480 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063569 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063792 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.063887 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064095 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064190 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064450 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064535 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064761 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.064849 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065090 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065184 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065407 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065493 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065711 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.065796 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066023 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066144 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066364 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066452 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066674 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066764 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.066987 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067083 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067293 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067386 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067605 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067697 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.067918 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068006 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068237 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068323 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068559 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068653 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068862 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.068953 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069162 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069248 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069463 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069566 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069770 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.069857 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070117 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070209 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070446 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070547 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070757 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.070844 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071069 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071153 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071375 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071470 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071694 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.071824 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072001 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072088 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072309 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072395 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072631 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072728 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.072944 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073031 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073250 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073338 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073577 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073664 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073883 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.073970 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074217 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074307 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074525 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074612 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074833 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.074922 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.075188 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.075366 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.075498 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.075810 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.075905 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.076134 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.076272 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.076435 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.076757 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.076844 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.077069 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.077241 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.077386 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.077698 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.077783 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078005 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078170 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078355 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078530 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078663 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078847 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.078974 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079174 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079282 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079513 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079601 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079855 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.079942 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080179 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080273 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080500 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080585 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080818 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.080904 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081137 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081224 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081453 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081546 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081782 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.081926 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082117 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082255 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082445 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082532 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082763 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.082857 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083076 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083162 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083427 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083520 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083686 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083782 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.083925 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125532) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 20:35:53.084094 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.084411 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.084727 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.085043 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.085378 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.085709 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.086021 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.086375 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.086697 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.087023 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.087344 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.087661 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.087996 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.088315 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.088637 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.088961 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.089278 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.089599 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.089919 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.090283 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.090617 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.091583 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.091920 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.092272 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.092594 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.092945 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.093281 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.093601 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.093920 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.094258 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:35:53.094507 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125533) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 20:35:53.106271 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.119764 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_db.sqlalchemy.engines [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.172856 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.context [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=125532) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 20:35:53.177040 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:35:53.178779 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:35:53.179599 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:35:53.181539 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_concurrency.lockutils [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125532) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:35:53.186459 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.context [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=125533) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 20:35:53.190678 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:35:53.192294 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:35:53.192513 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.193115 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:35:53.194554 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.195137 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:35:53.208424 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_db.sqlalchemy.engines [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.210843 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_db.sqlalchemy.engines [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.449525 ncdv-master-1 devstack@n-api.service[125532]: DEBUG oslo_db.sqlalchemy.engines [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125532) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.467566 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_db.sqlalchemy.engines [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125533) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:35:53.798099 ncdv-master-1 devstack@n-api.service[125533]: WARNING keystonemiddleware.auth_token [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:35:53.799263 ncdv-master-1 devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:35:53.804654 ncdv-master-1 devstack@n-api.service[125533]: WARNING keystonemiddleware.auth_token [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:35:53.805632 ncdv-master-1 devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:35:54.026961 ncdv-master-1 devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:35:54.031324 ncdv-master-1 devstack@n-api.service[125533]: WARNING keystonemiddleware.auth_token [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:35:54.032554 ncdv-master-1 devstack@n-api.service[125532]: WARNING keystonemiddleware.auth_token [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:35:54.036724 ncdv-master-1 devstack@n-api.service[125533]: WARNING keystonemiddleware.auth_token [None req-549ab01b-f45a-496b-b7d1-787804172657 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:35:54.037846 ncdv-master-1 devstack@n-api.service[125532]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bf1a309c0 pid: 125532 (default app) Nov 20 20:35:54.039905 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:35:54.041066 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001690 Nov 20 20:35:54.041491 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Sat Nov 20 20:35:54 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:35:54.041982 ncdv-master-1 devstack@n-api.service[125533]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559bf1a309c0 pid: 125533 (default app) Nov 20 20:37:16.841218 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:16.842437 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Nov 20 20:37:16.842932 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:17.385176 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7707d4cd-16be-47b2-b881-0b3583327f39 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:17.413865 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7707d4cd-16be-47b2-b881-0b3583327f39 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.563970 Nov 20 20:37:17.418208 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:37:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:19.788789 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:19.789770 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eb25c88f-e09e-45dc-b1c7-84348b957f34 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Nov 20 20:37:19.794360 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:19 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:19.849134 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-c86f6991-5112-4c1c-b83f-c165665d5966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:19.870044 ncdv-master-1 devstack@n-api.service[125533]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:37:19.870044 ncdv-master-1 devstack@n-api.service[125533]: warnings.warn(msg) Nov 20 20:37:19.909958 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-c86f6991-5112-4c1c-b83f-c165665d5966 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112563 Nov 20 20:37:19.914092 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:20.248759 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-9bf3119a-47e3-4802-85c4-989d68c621e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:20.251376 ncdv-master-1 devstack@n-api.service[125532]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:37:20.251376 ncdv-master-1 devstack@n-api.service[125532]: warnings.warn(msg) Nov 20 20:37:20.301580 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-9bf3119a-47e3-4802-85c4-989d68c621e5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.381752 Nov 20 20:37:20.302476 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Sat Nov 20 20:37:19 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:22.701037 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-c86f6991-5112-4c1c-b83f-c165665d5966 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:22.702423 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-c86f6991-5112-4c1c-b83f-c165665d5966 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Nov 20 20:37:22.703036 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:22 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:22.828792 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6c50a1ef-1e6f-47e6-b039-87b0bf4645d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "ram": 512, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:22.847541 ncdv-master-1 devstack@n-api.service[125532]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:37:22.847541 ncdv-master-1 devstack@n-api.service[125532]: warnings.warn(msg) Nov 20 20:37:22.870156 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6c50a1ef-1e6f-47e6-b039-87b0bf4645d6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159610 Nov 20 20:37:22.871028 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:22.884999 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-c6860ece-cee7-49ed-8e4d-1f4406424160 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:22.889606 ncdv-master-1 devstack@n-api.service[125533]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:37:22.889606 ncdv-master-1 devstack@n-api.service[125533]: warnings.warn(msg) Nov 20 20:37:22.930649 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-c6860ece-cee7-49ed-8e4d-1f4406424160 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049147 Nov 20 20:37:22.935948 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Sat Nov 20 20:37:22 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:25.451676 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-6c50a1ef-1e6f-47e6-b039-87b0bf4645d6 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:25.453891 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-6c50a1ef-1e6f-47e6-b039-87b0bf4645d6 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002581 Nov 20 20:37:25.461031 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:25 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:25.530961 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-6294a7cd-21ec-4bb9-9f9d-59b377b60981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "disk": 10}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:25.586883 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-6294a7cd-21ec-4bb9-9f9d-59b377b60981 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.124595 Nov 20 20:37:25.588972 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:25.606900 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-59b842a8-7996-49d7-b9b8-ec38059ea808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:25.660299 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-59b842a8-7996-49d7-b9b8-ec38059ea808 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.060949 Nov 20 20:37:25.660881 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Sat Nov 20 20:37:25 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:28.349403 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-6294a7cd-21ec-4bb9-9f9d-59b377b60981 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:28.351023 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-6294a7cd-21ec-4bb9-9f9d-59b377b60981 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002114 Nov 20 20:37:28.358452 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:28 2021] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:28.426410 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f2e93b53-e908-44e1-a68a-82235805b7ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:28.448054 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f2e93b53-e908-44e1-a68a-82235805b7ba admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083777 Nov 20 20:37:28.448884 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:28.461469 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-e8dad28f-c571-4b2f-b41b-09fe1698558b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:28.490247 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-e8dad28f-c571-4b2f-b41b-09fe1698558b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032312 Nov 20 20:37:28.491820 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Sat Nov 20 20:37:28 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:30.929448 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-f2e93b53-e908-44e1-a68a-82235805b7ba admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:30.930556 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-f2e93b53-e908-44e1-a68a-82235805b7ba admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Nov 20 20:37:30.930999 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:30.998408 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:31.018494 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080259 Nov 20 20:37:31.019152 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:31.032298 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-59487006-e1be-439c-9b1a-7c678d8a3ac6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:31.056491 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-59487006-e1be-439c-9b1a-7c678d8a3ac6 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028078 Nov 20 20:37:31.057563 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Sat Nov 20 20:37:31 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:33.449696 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:33.450739 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 20 20:37:33.451133 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:33.510697 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e1dae90b-2a7f-4997-9c97-2d1c93da69e4 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:33.537850 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e1dae90b-2a7f-4997-9c97-2d1c93da69e4 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080296 Nov 20 20:37:33.538555 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:37:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:37:35.930719 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:35.931852 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-b802f457-8241-4065-94b1-98f871140429 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 20 20:37:35.932569 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:35.998246 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ecffd1a4-1dcf-48ae-9f7d-fc39b529b101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "vcpus": 1, "ram": 512}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:36.018781 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ecffd1a4-1dcf-48ae-9f7d-fc39b529b101 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079707 Nov 20 20:37:36.019438 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:35 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:36.041768 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-d17ac8fc-eed9-46c9-a9a4-04916f4445c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:36.072487 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-d17ac8fc-eed9-46c9-a9a4-04916f4445c3 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043705 Nov 20 20:37:36.082778 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Sat Nov 20 20:37:36 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:37:38.864882 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ecffd1a4-1dcf-48ae-9f7d-fc39b529b101 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:38.866226 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ecffd1a4-1dcf-48ae-9f7d-fc39b529b101 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001890 Nov 20 20:37:38.866791 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:38.932355 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-e78bc2bf-e3eb-4640-9069-2d19cd689ced admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "disk": 20, "ram": 2048}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:38.950464 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-e78bc2bf-e3eb-4640-9069-2d19cd689ced admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074879 Nov 20 20:37:38.951048 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:38 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:38.967664 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a463df7f-4482-4322-b40d-44df4a31a8cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:38.994910 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a463df7f-4482-4322-b40d-44df4a31a8cc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032032 Nov 20 20:37:38.995633 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Sat Nov 20 20:37:38 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:42.484664 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-e78bc2bf-e3eb-4640-9069-2d19cd689ced admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:42.485697 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-e78bc2bf-e3eb-4640-9069-2d19cd689ced admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 20 20:37:42.486125 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:42.549229 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bf8c36d4-e64a-4c34-87bd-52c9e9cd87b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "vcpus": 2, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:42.568001 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bf8c36d4-e64a-4c34-87bd-52c9e9cd87b5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075460 Nov 20 20:37:42.568762 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:42 2021] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:42.580724 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-05c75c25-7a60-4eeb-bc48-45682cacb305 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:42.604952 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-05c75c25-7a60-4eeb-bc48-45682cacb305 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027812 Nov 20 20:37:42.605523 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Sat Nov 20 20:37:42 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:44.994566 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-bf8c36d4-e64a-4c34-87bd-52c9e9cd87b5 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:44.995591 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-bf8c36d4-e64a-4c34-87bd-52c9e9cd87b5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Nov 20 20:37:44.996320 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:45.056406 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-01605c8f-9f6c-44b6-8b5c-93b9150a6c3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:45.075518 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-01605c8f-9f6c-44b6-8b5c-93b9150a6c3b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072220 Nov 20 20:37:45.076361 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:45.089114 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-efb86e76-f329-4b7d-b7d6-b72d64dda38a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:45.109365 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-efb86e76-f329-4b7d-b7d6-b72d64dda38a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024373 Nov 20 20:37:45.109937 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Sat Nov 20 20:37:45 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:37:47.678080 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-01605c8f-9f6c-44b6-8b5c-93b9150a6c3b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:37:47.679100 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-01605c8f-9f6c-44b6-8b5c-93b9150a6c3b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 20 20:37:47.679497 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:37:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:37:47.738652 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "swap": 0}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:47.764759 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078869 Nov 20 20:37:47.765317 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Sat Nov 20 20:37:47 2021] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:37:47.778620 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-88b304db-6ab7-46ae-820c-212e06ac001c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:37:47.802586 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-88b304db-6ab7-46ae-820c-212e06ac001c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028055 Nov 20 20:37:47.803250 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Sat Nov 20 20:37:47 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:38:12.391930 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:12.393321 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Nov 20 20:38:12.393824 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:38:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:12.452252 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-8b6c20b4-8c0f-4ec6-9c27-78af9af1f153 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:12.469204 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-8b6c20b4-8c0f-4ec6-9c27-78af9af1f153 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068121 Nov 20 20:38:12.469732 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:38:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:38:14.051309 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:14.052312 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-eab6c205-7307-4912-a832-d96d437a673b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Nov 20 20:38:14.052713 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:14.317384 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-aa972daa-13f8-4261-9e34-b370524fdb5d admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:14.322894 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.wsgi [None req-aa972daa-13f8-4261-9e34-b370524fdb5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 20 20:38:14.323450 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-aa972daa-13f8-4261-9e34-b370524fdb5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:14.324232 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-aa972daa-13f8-4261-9e34-b370524fdb5d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058239 Nov 20 20:38:14.324739 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:38:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:38:14.334484 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-32e9596d-f33a-45b2-a878-6ed2cf9ef5cf admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:14.355583 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-32e9596d-f33a-45b2-a878-6ed2cf9ef5cf admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024574 Nov 20 20:38:14.356116 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:38:14.372103 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-17fa351b-d6e3-4900-b7d9-7e41f234a9af admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:14.392601 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-17fa351b-d6e3-4900-b7d9-7e41f234a9af admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024566 Nov 20 20:38:14.393112 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:14 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:38:14.402710 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-372337e0-a07b-4d0f-8600-38a1302b2aa0 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:14.408341 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-372337e0-a07b-4d0f-8600-38a1302b2aa0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 20 20:38:14.408901 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-372337e0-a07b-4d0f-8600-38a1302b2aa0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:14.409674 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-372337e0-a07b-4d0f-8600-38a1302b2aa0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010448 Nov 20 20:38:14.410202 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:38:14 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:38:15.904122 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-17fa351b-d6e3-4900-b7d9-7e41f234a9af admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:15.905377 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-17fa351b-d6e3-4900-b7d9-7e41f234a9af admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 20 20:38:15.905764 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:38:16.105287 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c7dceee7-8635-494d-9784-7cba2b1baf16 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:16.110661 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-c7dceee7-8635-494d-9784-7cba2b1baf16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 20 20:38:16.111160 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-c7dceee7-8635-494d-9784-7cba2b1baf16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:16.111939 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-c7dceee7-8635-494d-9784-7cba2b1baf16 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057851 Nov 20 20:38:16.112443 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:38:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:38:16.122847 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-abe14ad5-0e49-489d-b0ab-8aab705fdf8b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:16.136861 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-abe14ad5-0e49-489d-b0ab-8aab705fdf8b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017609 Nov 20 20:38:16.137392 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:38:16.147039 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e8dd7102-9a39-4133-8249-50edcdf9bf58 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:16.160516 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e8dd7102-9a39-4133-8249-50edcdf9bf58 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016871 Nov 20 20:38:16.161032 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:38:16.170726 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-b6408caf-c6af-42dc-9821-3fd912403cbb admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:16.175770 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.wsgi [None req-b6408caf-c6af-42dc-9821-3fd912403cbb admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 20 20:38:16.176322 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-b6408caf-c6af-42dc-9821-3fd912403cbb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=125533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:16.177085 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-b6408caf-c6af-42dc-9821-3fd912403cbb admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009788 Nov 20 20:38:16.177564 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:38:16 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 20 20:38:17.671320 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-e8dd7102-9a39-4133-8249-50edcdf9bf58 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:17.673261 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-e8dd7102-9a39-4133-8249-50edcdf9bf58 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Nov 20 20:38:17.682250 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:17.880231 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-ad4b03dd-a059-4464-ba99-3070343b2a98 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:17.885781 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.wsgi [None req-ad4b03dd-a059-4464-ba99-3070343b2a98 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 20 20:38:17.886376 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-ad4b03dd-a059-4464-ba99-3070343b2a98 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125533) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:17.887161 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-ad4b03dd-a059-4464-ba99-3070343b2a98 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058658 Nov 20 20:38:17.887662 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:38:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:38:17.897579 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-22402796-465b-4403-b056-1326caf54a3a admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:17.911225 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-22402796-465b-4403-b056-1326caf54a3a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017204 Nov 20 20:38:17.911776 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:38:17.922408 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:17.935895 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017299 Nov 20 20:38:17.936406 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:38:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:38:17.945859 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-77b2c0eb-5c13-4a5a-8370-2e083ff9e468 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:17.950925 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.wsgi [None req-77b2c0eb-5c13-4a5a-8370-2e083ff9e468 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 20 20:38:17.951481 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-77b2c0eb-5c13-4a5a-8370-2e083ff9e468 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=125532) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:38:17.952252 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-77b2c0eb-5c13-4a5a-8370-2e083ff9e468 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009842 Nov 20 20:38:17.952771 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:38:17 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:38:19.400182 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:19.401193 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Nov 20 20:38:19.401618 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:19.599669 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-503550f4-075f-4e79-bc6c-d44d78de95a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:38:19.618562 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-503550f4-075f-4e79-bc6c-d44d78de95a2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069113 Nov 20 20:38:19.619105 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Sat Nov 20 20:38:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:38:21.079381 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:21.080569 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Nov 20 20:38:21.080975 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:21 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:21.278332 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-45b6a157-b009-4d68-bbb2-366fe4a92b83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:38:21.296098 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-45b6a157-b009-4d68-bbb2-366fe4a92b83 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069318 Nov 20 20:38:21.296573 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Sat Nov 20 20:38:21 2021] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:38:22.766170 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:22.767166 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 20 20:38:22.767585 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:22.968357 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-33318045-3e60-49f3-8994-2739d62f4e9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:38:22.985619 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-33318045-3e60-49f3-8994-2739d62f4e9f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069115 Nov 20 20:38:22.986190 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Sat Nov 20 20:38:22 2021] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:38:24.440925 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:24.441915 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Nov 20 20:38:24.442335 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:24.642622 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-b2ba16de-2f7f-4686-8bd3-a5dfdf900502 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:38:24.660113 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-b2ba16de-2f7f-4686-8bd3-a5dfdf900502 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069194 Nov 20 20:38:24.660585 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Sat Nov 20 20:38:24 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:38:26.129796 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:26.130841 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 20 20:38:26.131227 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:38:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:38:26.328812 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-a4545045-f94d-4713-a5ea-d7c3c5b51468 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:38:26.347320 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-a4545045-f94d-4713-a5ea-d7c3c5b51468 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069392 Nov 20 20:38:26.347764 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Sat Nov 20 20:38:26 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:39:14.798037 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.798960 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d609c4f-b4ca-4a74-be0d-6fb8c890d04b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 20 20:39:14.799684 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:39:14.856422 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-ece7acf2-2383-43d1-bc80-25263d9cae62 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.875627 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-ece7acf2-2383-43d1-bc80-25263d9cae62 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069720 Nov 20 20:39:14.876148 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:39:14.899816 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7dbe78c9-97cc-46a9-aafa-ad2ec06ddcbe admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.908853 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7dbe78c9-97cc-46a9-aafa-ad2ec06ddcbe admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013716 Nov 20 20:39:14.909705 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:39:14.922132 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-d31cc4f9-b519-46e4-95a9-2841c27af551 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.929878 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-d31cc4f9-b519-46e4-95a9-2841c27af551 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011243 Nov 20 20:39:14.930419 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:39:14.941874 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-376680c0-7b4b-4721-8594-1a0ab0e4650f admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.949931 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-376680c0-7b4b-4721-8594-1a0ab0e4650f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011543 Nov 20 20:39:14.950480 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:39:14.962403 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:39:14.970418 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012128 Nov 20 20:39:14.970930 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Sat Nov 20 20:39:14 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:40:38.432471 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-7d265541-024e-48f7-bff5-adbd022b313e tempest-verify_tempest_config-757441174 tempest-verify_tempest_config-757441174-project] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:40:38.434537 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-7d265541-024e-48f7-bff5-adbd022b313e tempest-verify_tempest_config-757441174 tempest-verify_tempest_config-757441174-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107427 Nov 20 20:40:38.435096 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1133 bytes} [Sat Nov 20 20:40:38 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:44:18.699363 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:44:18.700354 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 20 20:44:18.700746 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:44:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:44:18.968879 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:44:18.970114 ncdv-master-1 devstack@n-api.service[125533]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:44:18.970114 ncdv-master-1 devstack@n-api.service[125533]: warnings.warn(msg) Nov 20 20:44:18.971661 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:44:18.972120 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:44:18.972925 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:44:18.973343 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:44:19.012764 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-8dfd17cf-9d9a-46a7-ab86-4916454342a2 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.163671 Nov 20 20:44:19.013519 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:44:18 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:44:20.472126 ncdv-master-1 devstack@n-api.service[125532]: DEBUG nova.api.openstack.wsgi [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] Calling method '>' {{(pid=125532) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:44:20.473131 ncdv-master-1 devstack@n-api.service[125532]: INFO nova.api.openstack.requestlog [None req-92cc6ad2-419c-4739-82e4-2b24744f9626 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Nov 20 20:44:20.473528 ncdv-master-1 devstack@n-api.service[125532]: [pid: 125532|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1074 bytes} [Sat Nov 20 20:44:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:44:20.679768 ncdv-master-1 devstack@n-api.service[125533]: DEBUG nova.api.openstack.wsgi [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] Calling method '>' {{(pid=125533) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:44:20.680841 ncdv-master-1 devstack@n-api.service[125533]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:44:20.680841 ncdv-master-1 devstack@n-api.service[125533]: warnings.warn(msg) Nov 20 20:44:20.683654 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:44:20.684093 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:44:20.684883 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:44:20.685308 ncdv-master-1 devstack@n-api.service[125533]: DEBUG oslo_concurrency.lockutils [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125533) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:44:20.707243 ncdv-master-1 devstack@n-api.service[125533]: INFO nova.api.openstack.requestlog [None req-ad81dd74-1351-42b1-b7f9-b8346f2cc866 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079827 Nov 20 20:44:20.707786 ncdv-master-1 devstack@n-api.service[125533]: [pid: 125533|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:44:20 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:45:07.194215 ncdv-master-1 devstack@n-api.service[125531]: Sat Nov 20 20:45:07 2021 - graceful shutdown triggered... Nov 20 20:45:07.194774 ncdv-master-1 devstack@n-api.service[125532]: Gracefully killing worker 1 (pid: 125532)... Nov 20 20:45:07.194339 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 20 20:45:07.195728 ncdv-master-1 devstack@n-api.service[125533]: Gracefully killing worker 2 (pid: 125533)... Nov 20 20:45:08.195406 ncdv-master-1 devstack@n-api.service[125531]: worker 1 buried after 1 seconds Nov 20 20:45:08.195406 ncdv-master-1 devstack@n-api.service[125531]: worker 2 buried after 1 seconds Nov 20 20:45:08.195406 ncdv-master-1 devstack@n-api.service[125531]: goodbye to uWSGI. Nov 20 20:45:08.196936 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Nov 20 20:45:08.197516 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 20 20:45:08.200299 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Nov 20 20:45:08.249695 ncdv-master-1 devstack@n-api.service[140930]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Nov 20 20:45:08 2021] *** Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: nodename: ncdv-master-1 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: machine: x86_64 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: clock source: unix Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: pcre jit disabled Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: detected number of CPU cores: 4 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: current working directory: / Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: detected binary path: /usr/bin/uwsgi-core Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: your processes number limit is 47680 Nov 20 20:45:08.268261 ncdv-master-1 devstack@n-api.service[140930]: your memory page size is 4096 bytes Nov 20 20:45:08.269223 ncdv-master-1 devstack@n-api.service[140930]: detected max file descriptor number: 2048 Nov 20 20:45:08.269223 ncdv-master-1 devstack@n-api.service[140930]: lock engine: pthread robust mutexes Nov 20 20:45:08.269223 ncdv-master-1 devstack@n-api.service[140930]: thunder lock: enabled Nov 20 20:45:08.269223 ncdv-master-1 devstack@n-api.service[140930]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 20 20:45:08.269223 ncdv-master-1 devstack@n-api.service[140930]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 20 20:45:08.317553 ncdv-master-1 devstack@n-api.service[140930]: Python main interpreter initialized at 0x5578a68099c0 Nov 20 20:45:08.317553 ncdv-master-1 devstack@n-api.service[140930]: python threads support enabled Nov 20 20:45:08.317553 ncdv-master-1 devstack@n-api.service[140930]: your server socket listen backlog is limited to 100 connections Nov 20 20:45:08.317553 ncdv-master-1 devstack@n-api.service[140930]: your mercy for graceful operations on workers is 90 seconds Nov 20 20:45:08.317980 ncdv-master-1 devstack@n-api.service[140930]: mapped 403077 bytes (393 KB) for 2 cores Nov 20 20:45:08.317980 ncdv-master-1 devstack@n-api.service[140930]: *** Operational MODE: preforking *** Nov 20 20:45:08.318240 ncdv-master-1 devstack@n-api.service[140930]: *** uWSGI is running in multiple interpreter mode *** Nov 20 20:45:08.318240 ncdv-master-1 devstack@n-api.service[140930]: spawned uWSGI master process (pid: 140930) Nov 20 20:45:08.318471 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Nov 20 20:45:08.318986 ncdv-master-1 devstack@n-api.service[140930]: spawned uWSGI worker 1 (pid: 140941, cores: 1) Nov 20 20:45:08.319500 ncdv-master-1 devstack@n-api.service[140930]: spawned uWSGI worker 2 (pid: 140942, cores: 1) Nov 20 20:45:08.319788 ncdv-master-1 devstack@n-api.service[140930]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 20 20:45:10.193189 ncdv-master-1 devstack@n-api.service[140942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:45:10.193189 ncdv-master-1 devstack@n-api.service[140942]: from cryptography.utils import int_from_bytes Nov 20 20:45:10.193881 ncdv-master-1 devstack@n-api.service[140942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:45:10.193881 ncdv-master-1 devstack@n-api.service[140942]: from cryptography.utils import int_from_bytes Nov 20 20:45:10.207026 ncdv-master-1 devstack@n-api.service[140941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:45:10.207026 ncdv-master-1 devstack@n-api.service[140941]: from cryptography.utils import int_from_bytes Nov 20 20:45:10.207572 ncdv-master-1 devstack@n-api.service[140941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 20 20:45:10.207572 ncdv-master-1 devstack@n-api.service[140941]: from cryptography.utils import int_from_bytes Nov 20 20:45:12.546020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 20:45:12.546489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 20:45:12.546800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 20:45:12.547164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 20:45:12.547424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 20:45:12.547812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.548142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.548475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.548800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.549132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.549446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.549772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.550115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.550449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.550711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.551030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.551355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.551677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.551987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.552300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.552622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.552931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.553255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.553562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.554086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.554746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.555327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.555816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.556327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.556840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.557328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.557657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.558163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.558500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.558816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.559389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.559869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.560350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.560668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.561297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.561853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.562267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.562694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.563071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.563458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.563868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.564206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.564536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.564867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.565204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.565493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.565812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.566162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.566480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.566797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.567054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.567370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.567702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.568035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.568363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.568620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.568955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.569204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.569530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.569847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.570183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.570498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.570814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.571126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.571439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.571751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.572063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.572421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.572742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.573069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.573382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.573704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.574138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.574396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.574708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.575054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.575380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.575693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.576020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.576345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.576657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.576969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.577281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.577606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.577950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.578285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.578542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.578846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.579157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.579481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.579794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.580101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.580410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.580714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.581025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.581335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.581644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.581952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.582296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.582785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.583251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.583726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.584248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.584745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.585234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.585707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.586031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.586369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.586685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.587018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.587334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.587650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.588488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.588806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.589117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.589440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.589755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.590275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.590394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 20 20:45:12.590804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.590885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 20 20:45:12.590966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.591051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.591126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 20 20:45:12.591315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.591553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 20 20:45:12.591821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 20 20:45:12.592148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.592284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.592472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.592573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.592791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.592903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.593851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.594945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.595894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.596829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.597048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.597149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.597361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.597467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.597689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.597793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.598002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.598141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.598453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.598555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.598792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.598899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.599119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.599221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.599440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.599607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.599758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.599904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.600061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.600383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.600531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.600681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.600830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.600971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.601110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.601259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.601404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.601585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.601852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.601998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.602190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.602342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.603041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.603281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.603434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.604387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.604653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.604958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.605127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.605362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.605569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.605785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.605932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.606113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.606278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.606429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.606578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.606719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.606868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.607008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.607155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.607296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.607435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.607595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.607742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.607896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.608062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.608602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.608754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.608902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.609043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.609193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.609343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.609491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.609643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.609797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.609946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.610134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.610280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.610477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.610646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.610890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.611049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.611198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.611345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.611493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.611640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.611789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.612074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.612233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.612233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.612524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.612672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.612851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.613004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.613153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.613301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.613441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.613579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.613732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.613892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.614031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.614207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.614348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.614486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.614651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.614893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.615046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.615193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.615340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.615486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.615639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.615815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.616033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.616189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.616329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.616483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.616624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.616770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.616912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.617058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.617197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.617350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.617491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.617630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.617779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.617926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.618087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.618320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.618466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.618606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.618745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.618884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.619023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.619203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.619857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.619997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.620145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.620295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.620450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.620591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.620729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.620893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.621134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.621134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.621420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.621568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.621714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.621859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.622016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.622306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.622478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.622626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.622774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.622921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.623062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.623209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.623363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.623510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.623651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.623789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.623928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.624075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.624240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.624393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.624534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.624680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.624829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.625074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.625245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.625439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.625593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.625741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.625888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.626072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.626299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.626470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.626620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.626772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.626913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.627096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.627255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.627404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.627545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.627692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.627839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.627985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.628139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.628280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.628430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.628569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.628717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.628864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.629017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.629768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.629923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.630093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.630252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.630403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.630546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.630686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.630832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.630996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.631157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.631403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.631557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.631707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.631926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.632069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.632209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.632448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.632595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.632744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.632744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.633029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.633185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.633326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.633465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.633615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.633790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.633969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.634173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.634329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.634477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.634625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.634781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.634976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.635724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.635871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.636018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.636172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.636530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.637597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.637597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.637873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.638020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.638184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.638325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.638473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.638635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.638783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.638931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.639079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.639225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.639371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.639532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.639682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.639822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.639962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.640168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.640322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.640473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.640620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.640788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.640788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.641147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 20 20:45:12.641336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.641626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.641829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.642878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.643901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.644933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.645960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.646124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.646287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.646539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.646693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.646863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.647914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.648903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.649779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.650244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.650415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.650593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.650735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.650881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.651944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.652230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.652386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.652534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.652838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.652838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.653990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.654924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.655619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.655778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.655945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.656190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.656354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.656521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.656742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.656890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.657924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.658856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.659987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.660925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.661998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.662967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.663970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.664911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.665859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.666515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.666919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.667091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.667238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.667387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.667558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.667900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.668933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.669961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.670862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.671998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.672246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.672424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.672599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.672906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.673910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.674956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.675958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.676098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.676098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.676423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.676587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.676587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.677992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.678925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.679086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.679228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.679534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.679696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.679838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.680127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.680283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.680431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.680726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.680874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.681022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.681352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.681511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.682260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.682561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.682945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.683120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.683351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.683560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.683706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.683873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.684183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.684338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.684493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.684785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.684930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.685093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.685400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.685546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.685710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.685994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.686178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.686359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.686666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.686829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.687075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.687264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.687410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.687610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.687893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.688976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.689957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.690247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.690407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.690567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.690717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.690864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.691990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.692975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.693990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.694917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.695967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.696987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.697127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.697291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.698267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.698423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.698719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.699926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.700976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.701892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.702832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.703136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.703299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.703447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.703679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.703842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.704914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.705982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.706938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.707961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.708909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.709997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.710184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.710335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.710490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.710651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.710864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.711850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.712808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.713229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.713397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.713723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.713899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.714977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.715884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.716948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.717992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.718187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.718338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.718550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.718718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.718887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.719943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.720938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.721864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.722920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.723834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.724842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.725889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.726846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.727906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.728159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.728322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.728478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.729159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.729453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.729609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.729768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.729922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.730898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.731971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.732266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.732266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.732568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.732568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.732857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.733892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.734931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.735989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.736921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.737996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.738221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.738469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.738623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.738770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.738925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.739763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.740053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.740053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.740402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.740559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.740559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.741975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.742918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.743074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.743229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.743229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.743764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.744077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.744413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.745985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.746976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.747946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.748891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.749980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.750967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.751912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.752913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.753111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.753299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.753548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.753638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.753938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.754947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.755975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.756914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.757861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.758873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.759187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.759277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.759508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.759605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.759897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.760982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.761979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.762302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.762405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.762624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.762723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.762938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.763875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.764893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.765840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.766977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.767912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.768921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.769833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.770785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.771949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.772900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.773906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.774260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.774428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.774599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.774822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.775223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.775413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.775578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.775899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.776029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.776272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.776554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.776651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.776874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.777976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.778991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.779960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.780083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.780338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.780435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.780696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.780839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.781989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.782978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.783923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.784987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.785194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.785286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.785620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.785710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.785937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.786956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.787054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.787290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.787460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.787602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.787921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.788993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.789959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.790968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.791747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.791862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.792964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.793900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.794912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.795872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.796825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.797993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.798982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.799936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.800912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.801926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.802864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.803867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.804802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.805987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.806105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.806259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 20:45:12.806364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.806641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.807661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.808077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.808429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.808756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.809088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.809413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.809733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.810090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.810406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.810728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.811049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.811370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.811687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.812008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.812338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.812680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.813010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.813330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.813651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.813976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.814530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.814853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.815192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.815525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.815864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.816275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.816511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.816843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.817158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.817474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.817794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.818137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.818454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.818786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.819109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.819424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.819752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.820069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.820650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.821006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.821339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.821675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.822011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.822453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.822774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.823109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.823625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.823943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.824270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.824593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.824907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.825221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.825543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.825860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.826199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.826519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.826832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.827169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.827483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.827798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.828110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.828431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.828746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.829066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.829381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.829694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.830016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.830355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.830671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.830986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.831305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.831620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.831934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.832247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.832587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.832901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.833213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.833543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.833861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.834215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.834541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.834890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.835254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.835578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.836177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.836582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.836912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.837269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.837615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.838461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.838808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.839127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.839469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.839791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.840111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.840431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.840750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.841069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.841389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.841710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.842026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.842368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.842695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.843055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.843386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.843712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.844035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.844361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.844685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.845002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.845321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.845641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.845963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.846330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.846657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.846974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.847424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.847748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.848077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.848408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.848729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.849061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.849400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.849723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.850077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.850398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.850741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.851120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.851437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.851823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.852229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.852552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.852868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.853189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.854141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.854486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.854815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.855148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.855477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.855805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.856123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.856452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.856782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.857112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.857431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.857771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.858119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.858443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.858763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.859082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.859402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.859721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.860443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.860443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.860975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.861107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.861337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.861668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.862000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.862340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.862679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.862981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.863308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.863765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.863939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.864295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.864575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.864952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.865238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.865570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.865910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.866299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.866623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.866978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.867315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.867638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.867959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.868275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 20 20:45:12.868527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 20 20:45:12.918914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_db.sqlalchemy.engines [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:12.979606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_db.sqlalchemy.engines [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:12.990629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.context [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140942) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 20:45:12.995983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:12.997766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:12.998812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:13.000760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:13.011320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_db.sqlalchemy.engines [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.012146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_db.sqlalchemy.engines [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.050024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.context [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140941) load_cells /opt/stack/nova/nova/context.py:464}} Nov 20 20:45:13.054487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:13.056055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:13.057604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:13.059573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:13.070532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_db.sqlalchemy.engines [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.074684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_db.sqlalchemy.engines [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.185225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_db.sqlalchemy.engines [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.255212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_db.sqlalchemy.engines [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 20 20:45:13.523382 ncdv-master-1 devstack@n-api.service[140942]: WARNING keystonemiddleware.auth_token [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:45:13.530886 ncdv-master-1 devstack@n-api.service[140942]: WARNING keystonemiddleware.auth_token [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:45:13.588573 ncdv-master-1 devstack@n-api.service[140941]: WARNING keystonemiddleware.auth_token [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:45:13.595320 ncdv-master-1 devstack@n-api.service[140941]: WARNING keystonemiddleware.auth_token [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:45:13.887179 ncdv-master-1 devstack@n-api.service[140942]: WARNING keystonemiddleware.auth_token [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:45:13.892464 ncdv-master-1 devstack@n-api.service[140942]: WARNING keystonemiddleware.auth_token [None req-39b3ef80-0a8c-43c7-8bc1-20ec8a5894b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:45:13.897888 ncdv-master-1 devstack@n-api.service[140942]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578a68099c0 pid: 140942 (default app) Nov 20 20:45:13.939776 ncdv-master-1 devstack@n-api.service[140941]: WARNING keystonemiddleware.auth_token [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 20 20:45:13.944962 ncdv-master-1 devstack@n-api.service[140941]: WARNING keystonemiddleware.auth_token [None req-b9496858-cb40-4968-b37d-babf032eb35d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 20 20:45:13.950327 ncdv-master-1 devstack@n-api.service[140941]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578a68099c0 pid: 140941 (default app) Nov 20 20:45:52.970270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c1037ac-0529-4d43-8e05-667220631916 tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-824682297", "id": 745084887, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:52.988596 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:52.988596 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:53.026788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c1037ac-0529-4d43-8e05-667220631916 tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 1.361167 Nov 20 20:45:53.027370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1/1] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:45:51 2021] POST /compute/v2.1/flavors => generated 464 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:45:53.503298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa434054-16bc-425f-b979-f1873462312f tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:53.527092 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa434054-16bc-425f-b979-f1873462312f tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] 10.222.0.41 "GET /compute/v2.1/flavors/745084887" status: 200 len: 464 microversion: 2.61 time: 0.491449 Nov 20 20:45:53.527885 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2/2] 10.222.0.41 () {60 vars in 1195 bytes} [Sat Nov 20 20:45:53 2021] GET /compute/v2.1/flavors/745084887 => generated 464 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:45:53.540598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9cb1be1-adda-48f1-b606-328e8034903e tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] Action: 'update', calling method: .version_select at 0x7f3f9608d9d0>, body: {"flavor": {"description": "new"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:53.550633 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:53.550633 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:53.588104 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9cb1be1-adda-48f1-b606-328e8034903e tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] 10.222.0.41 "PUT /compute/v2.1/flavors/745084887" status: 200 len: 465 microversion: 2.61 time: 0.052091 Nov 20 20:45:53.588844 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3/3] 10.222.0.41 () {62 vars in 1215 bytes} [Sat Nov 20 20:45:53 2021] PUT /compute/v2.1/flavors/745084887 => generated 465 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:45:53.933993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95cca4c0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:53.935375 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:53.935375 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:53.941854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140941) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 20 20:45:53.942534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:53.942926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:53.998704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:53.999454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.015127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.015572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.019851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3caac21-a56a-4d32-a57f-4159720754cf tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1924511441", "id": 423200994, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:54.022728 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83fcfe41-0e72-4bd6-a901-fee6d0a76855 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.135158 Nov 20 20:45:54.030447 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1/4] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:52 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:45:54.036053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e6fcba6-38a5-470b-87d7-b7169d4c7522 tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.043672 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3caac21-a56a-4d32-a57f-4159720754cf tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.453527 Nov 20 20:45:54.051075 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4/5] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:45:53 2021] POST /compute/v2.1/flavors => generated 428 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:54.056197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95bae820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.057538 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.057538 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:54.064638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140942) load_cells /opt/stack/nova/nova/compute/api.py:302}} Nov 20 20:45:54.065719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.066401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.082881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e6fcba6-38a5-470b-87d7-b7169d4c7522 tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.050414 Nov 20 20:45:54.083818 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2/6] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:45:54.098303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.098816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8402cf6-0f37-44d2-91a5-8569c805060c tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5097ce36e0b34ec1b66aa928d4f5a81b"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:54.099241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.104242 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.104242 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.115946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.116673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.124683 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ac60125-7b70-4b7d-86d4-0bcf3ef6794a tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.072450 Nov 20 20:45:54.125578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 5/7] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:54.421052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f8f2da6-4071-4634-8c3f-f620189c2b5a tempest-InstanceUsageAuditLogTestJSON-2000231880 tempest-InstanceUsageAuditLogTestJSON-2000231880-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.421886 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.421886 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:54.443178 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f8f2da6-4071-4634-8c3f-f620189c2b5a tempest-InstanceUsageAuditLogTestJSON-2000231880 tempest-InstanceUsageAuditLogTestJSON-2000231880-project-admin] 10.222.0.41 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-20 20:45:54" status: 200 len: 318 microversion: 2.1 time: 0.316302 Nov 20 20:45:54.451887 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 6/8] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-20%2020%3A45%3A54 => generated 318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:54.451887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86ce5d16-acc2-411f-9a03-975a83e215e6 tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.472063 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8402cf6-0f37-44d2-91a5-8569c805060c tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/423200994/action" status: 200 len: 96 microversion: 2.1 time: 0.386912 Nov 20 20:45:54.473069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3/9] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:45:54 2021] POST /compute/v2.1/flavors/423200994/action => generated 96 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:45:54.478227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95c52af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.479111 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.479111 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.480884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.481480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.482950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86ce5d16-acc2-411f-9a03-975a83e215e6 tempest-FlavorsV261TestJSON-722513109 tempest-FlavorsV261TestJSON-722513109-project] 10.222.0.41 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.038055 Nov 20 20:45:54.483811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 7/10] 10.222.0.41 () {60 vars in 1165 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/flavors => generated 3153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:45:54.497514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.497991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.507951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.508401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.515534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c87bd9e0-4820-4aaa-b6c0-f70e83179e52 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041263 Nov 20 20:45:54.521202 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4/11] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:54.603842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.605058 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.605058 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:54.606591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.607030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.607823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.608251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.627865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '.version_select at 0x7f3f95b43430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.628770 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.628770 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.630397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.630855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.645840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.646321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.647263 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aeae692f-a737-493e-b902-d384974f1bf4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.162193 Nov 20 20:45:54.647861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 8/12] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:54.664863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.665482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.671843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d1bf0375-e81f-40bb-b0b5-5a3cca00a29f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.152024 Nov 20 20:45:54.672600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 5/13] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:54.677094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a7e6840-c7a0-45ba-879d-ef13193a3b16 tempest-InstanceUsageAuditLogTestJSON-2000231880 tempest-InstanceUsageAuditLogTestJSON-2000231880-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.678060 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.678060 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.695806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a7e6840-c7a0-45ba-879d-ef13193a3b16 tempest-InstanceUsageAuditLogTestJSON-2000231880 tempest-InstanceUsageAuditLogTestJSON-2000231880-project-admin] 10.222.0.41 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.022021 Nov 20 20:45:54.697019 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 6/14] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:54.749034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1396051814", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:54.804542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6622b4fc-df27-440d-9846-0a53ec538021 tempest-FlavorsAccessTestJSON-51802567 tempest-FlavorsAccessTestJSON-51802567-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.825252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6622b4fc-df27-440d-9846-0a53ec538021 tempest-FlavorsAccessTestJSON-51802567 tempest-FlavorsAccessTestJSON-51802567-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5823 microversion: 2.1 time: 0.127221 Nov 20 20:45:54.826031 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 7/15] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/flavors/detail => generated 5823 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:54.835285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-059e9298-1f67-4dc9-ae45-0b294b50a587 tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.836359 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.836359 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.867138 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-059e9298-1f67-4dc9-ae45-0b294b50a587 tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/745084887" status: 202 len: 0 microversion: 2.61 time: 0.035693 Nov 20 20:45:54.867801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 8/16] 10.222.0.41 () {60 vars in 1198 bytes} [Sat Nov 20 20:45:54 2021] DELETE /compute/v2.1/flavors/745084887 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:45:54.872789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95b26940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:54.873589 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:54.873589 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:54.875439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.875904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.896384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:54.896839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:54.904286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e13f7046-1e67-4f0d-b594-2ea5aabc0d6e tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.035204 Nov 20 20:45:54.912612 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 9/17] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.001533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:45:55.106879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.108761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.109201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.109998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.110444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.149830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79f952a9-caf6-42e0-bb4a-8d02fcb32869 tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] 10.222.0.41 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.243270 Nov 20 20:45:55.150430 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 10/18] 10.222.0.41 () {58 vars in 1163 bytes} [Sat Nov 20 20:45:54 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:45:55.155037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e5b59fe-181c-4a46-bffb-55caefd37375 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-589359214"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:55.172921 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.172921 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:55.174249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-2e5b59fe-181c-4a46-bffb-55caefd37375 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid d7985e85-2584-45a0-b00a-645f5fb63303 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:55.253507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e5b59fe-181c-4a46-bffb-55caefd37375 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.101848 Nov 20 20:45:55.254173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 11/19] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:55 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.259784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c282482-ba69-49d0-b444-8cc224c37768 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5097ce36e0b34ec1b66aa928d4f5a81b"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:55.261426 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.261426 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:55.419326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c282482-ba69-49d0-b444-8cc224c37768 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/423200994/action" status: 200 len: 21 microversion: 2.1 time: 0.163579 Nov 20 20:45:55.420226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 12/20] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:45:55 2021] POST /compute/v2.1/flavors/423200994/action => generated 21 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:45:55.428163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e784f62-4c3d-46c0-b155-d82cc4bc121d tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.458021 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e784f62-4c3d-46c0-b155-d82cc4bc121d tempest-FlavorsV261TestJSON-1631707160 tempest-FlavorsV261TestJSON-1631707160-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.036183 Nov 20 20:45:55.459316 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 13/21] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:45:55.464921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65d89e0f-5942-4b67-99e4-d0990b0584d0 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f9524a280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.465564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:45:55.466832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:45:55.467086 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.467086 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:55.467881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:45:55.468549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65d89e0f-5942-4b67-99e4-d0990b0584d0 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.468802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:45:55.469439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:45:55.471484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65d89e0f-5942-4b67-99e4-d0990b0584d0 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.488375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.489047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.490094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.490548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.496596 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65d89e0f-5942-4b67-99e4-d0990b0584d0 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.035994 Nov 20 20:45:55.497193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 14/22] 10.222.0.41 () {58 vars in 1178 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.503320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.504490 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.504490 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:55.506800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.507408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.509206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.509873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.536904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Getting quotas for project 5bb3936f93d04a32a65cf0e613991002. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:45:55.546276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Getting quotas for user 116d6eee94c64ac092e2442f0e2f1ddc and project 5bb3936f93d04a32a65cf0e613991002. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:45:55.560237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:45:55.563154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:45:55.580596 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-64adfab2-aa34-494a-b910-f34f433ecccd tempest-AZAdminV2TestJSON-805075018 tempest-AZAdminV2TestJSON-805075018-project-admin] 10.222.0.41 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.081605 Nov 20 20:45:55.582089 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 15/23] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.591051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfb37ba5-0c32-4204-bd8f-fd4ce343f2db tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:55.591604 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.591604 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:55.602154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb37ba5-0c32-4204-bd8f-fd4ce343f2db tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.602804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb37ba5-0c32-4204-bd8f-fd4ce343f2db tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.678816 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed116e98-2522-4d54-abf0-e5c478abfb81 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029702 Nov 20 20:45:55.679904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 9/24] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:45:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:45:55.686811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b55053f-a477-4d51-b667-c660d79cefc3 tempest-FlavorsAccessTestJSON-51802567 tempest-FlavorsAccessTestJSON-51802567-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.710329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b55053f-a477-4d51-b667-c660d79cefc3 tempest-FlavorsAccessTestJSON-51802567 tempest-FlavorsAccessTestJSON-51802567-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027915 Nov 20 20:45:55.718289 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 10/25] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:55.723010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95208f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.723926 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.723926 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:55.725717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.726148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.748184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.748626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.766156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.766504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.772939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7413f61-8551-4dfe-b021-04d3c2549ed5 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060918 Nov 20 20:45:55.773891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 11/26] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.779857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c63c324-5d9a-4e21-b456-01180bde61b6 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.780449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c63c324-5d9a-4e21-b456-01180bde61b6 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:45:55.863428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c63c324-5d9a-4e21-b456-01180bde61b6 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:55.880453 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c63c324-5d9a-4e21-b456-01180bde61b6 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1220 microversion: 2.1 time: 0.104600 Nov 20 20:45:55.881038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 12/27] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:55.892624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49fe261e-7745-4371-8f9a-7597c9e514e2 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.892624 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.892624 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:55.918741 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49fe261e-7745-4371-8f9a-7597c9e514e2 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/423200994" status: 202 len: 0 microversion: 2.1 time: 0.036605 Nov 20 20:45:55.922467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 13/28] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:45:55 2021] DELETE /compute/v2.1/flavors/423200994 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:45:55.924692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f95208f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.925551 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:55.925551 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:55.927264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.927772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.948295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:55.948753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:55.956474 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0db5e8e0-2840-4cd8-9632-1aed6dca6f44 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.035783 Nov 20 20:45:55.957242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 14/29] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:55.964613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aad9953-a91d-4c90-b153-20cdfb1d19c4 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:55.991380 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7aad9953-a91d-4c90-b153-20cdfb1d19c4 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032007 Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 15/30] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f949d3af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.002090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.016649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.017039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.024873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2d8994c-5b5e-4564-a7c7-246c9703fff9 tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.031608 Nov 20 20:45:56.026137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 16/31] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:55 2021] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:56.035306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f00f99d7-f643-4404-bc9e-1a7b980adcb5 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-213336330", "id": 182217254, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:56.036803 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.036803 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.059716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f00f99d7-f643-4404-bc9e-1a7b980adcb5 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.032330 Nov 20 20:45:56.060940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 17/32] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:45:56 2021] POST /compute/v2.1/flavors => generated 427 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:56.068124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Calling method '.version_select at 0x7f3f94987280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.070133 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.070133 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.072678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.073531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.093248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.094903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.108624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.109857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.118757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-286bbe73-8d4f-4dd8-9459-1f5342c6663f tempest-HypervisorAdminTestJSON-1091489111 tempest-HypervisorAdminTestJSON-1091489111-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:45:56.120017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.120536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.121451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.122142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.132252 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.rpcapi [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 20 20:45:56.133318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] Releasing lock "compute-rpcapi-router" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:45:56.204044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dff4ba36-21f8-4303-a56a-ec565321d93f None None] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.141783 Nov 20 20:45:56.204940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 18/33] 10.222.0.41 () {58 vars in 1172 bytes} [Sat Nov 20 20:45:56 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:56.211549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d64c9859-b994-41b5-9021-145ee1b75f73 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.212687 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.212687 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.255749 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d64c9859-b994-41b5-9021-145ee1b75f73 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/182217254/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.049109 Nov 20 20:45:56.259397 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 19/34] 10.222.0.41 () {58 vars in 1205 bytes} [Sat Nov 20 20:45:56 2021] GET /compute/v2.1/flavors/182217254/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:45:56.271337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e5149f82-36dc-4130-acf9-5ebe77138f1e tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.272884 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.272884 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.317694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e5149f82-36dc-4130-acf9-5ebe77138f1e tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/182217254" status: 202 len: 0 microversion: 2.1 time: 0.052593 Nov 20 20:45:56.326990 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 20/35] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:45:56 2021] DELETE /compute/v2.1/flavors/182217254 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:45:56.338518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e952089-fc8a-4e68-ab2a-3b716328ab40 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.362586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e952089-fc8a-4e68-ab2a-3b716328ab40 tempest-FlavorsAccessTestJSON-1085294932 tempest-FlavorsAccessTestJSON-1085294932-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030570 Nov 20 20:45:56.375627 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 21/36] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:45:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:45:56.525105 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfb37ba5-0c32-4204-bd8f-fd4ce343f2db tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.940758 Nov 20 20:45:56.526408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 16/37] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:55 2021] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:56.536140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:56.537606 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.537606 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:56.611945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.613497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.684415 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Nov 20 20:45:56.685158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:56.686403 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdfea82e-1f5b-4f0c-84c4-23dfdfe8c817 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.153852 Nov 20 20:45:56.687484 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 22/38] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:56 2021] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 20 20:45:56.701217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a2e561c-7eec-44db-8f1f-c12300b32758 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:56.702827 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.702827 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:56.722492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2e561c-7eec-44db-8f1f-c12300b32758 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:56.722966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2e561c-7eec-44db-8f1f-c12300b32758 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:56.889323 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a2e561c-7eec-44db-8f1f-c12300b32758 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.196415 Nov 20 20:45:56.890171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 17/39] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:56 2021] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:45:56.902123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be8eb936-7af2-4bd1-bd12-924e2fbbea60 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.903113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be8eb936-7af2-4bd1-bd12-924e2fbbea60 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:45:56.917734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-616e1c8c-8a66-4ac0-bcb8-d118f9167b04 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:56.918617 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.918617 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:56.982641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-616e1c8c-8a66-4ac0-bcb8-d118f9167b04 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.076171 Nov 20 20:45:56.985146 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 18/40] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:56 2021] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:45:56.994943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0a795de-480b-4675-a75b-a9e620659685 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1344384999"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:56.996211 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:56.996211 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:56.997418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-c0a795de-480b-4675-a75b-a9e620659685 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 88dad535-c87b-45b9-bb01-cbd4d40629a8 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:57.041883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be8eb936-7af2-4bd1-bd12-924e2fbbea60 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:57.053129 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be8eb936-7af2-4bd1-bd12-924e2fbbea60 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1220 microversion: 2.1 time: 0.153737 Nov 20 20:45:57.056124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 23/41] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:45:56 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:45:57.059462 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0a795de-480b-4675-a75b-a9e620659685 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.065881 Nov 20 20:45:57.065131 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 19/42] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:56 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:57.069895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-007e995d-358e-4d96-b290-f503292f648e tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-796134457", "name": "tempest-test_aggregate-1657916204"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.121323 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.121323 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:57.123016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-007e995d-358e-4d96-b290-f503292f648e tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid 8c9d384a-2a0a-4133-b323-6848685bfaf5 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:57.201904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-007e995d-358e-4d96-b290-f503292f648e tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.142859 Nov 20 20:45:57.209218 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 24/43] 10.222.0.41 () {60 vars in 1164 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:57.215186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92e5b5db-baa6-47b2-92ff-7539b6f9ff7d tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:57.216169 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.216169 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:57.231677 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92e5b5db-baa6-47b2-92ff-7539b6f9ff7d tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.020607 Nov 20 20:45:57.235501 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 25/44] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:45:57 2021] GET /compute/v2.1/os-aggregates => generated 515 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:57.245202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a643a381-b2b4-4fdb-8e03-687e2a9f9830 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.246733 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.246733 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:57.262429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a643a381-b2b4-4fdb-8e03-687e2a9f9830 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:57.263220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a643a381-b2b4-4fdb-8e03-687e2a9f9830 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:57.666116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a8d99cb-9e31-4c60-84f4-0e6cfbf79edd tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.667691 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.667691 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.668680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a8d99cb-9e31-4c60-84f4-0e6cfbf79edd tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:57.669524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a8d99cb-9e31-4c60-84f4-0e6cfbf79edd tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:57.670519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a8d99cb-9e31-4c60-84f4-0e6cfbf79edd tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.603504 Nov 20 20:45:57.673815 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 20/45] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 607 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:57.690449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0773c158-9e13-4a56-b084-b35b3cc5ec6f tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:57.691283 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.691283 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.732469 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0773c158-9e13-4a56-b084-b35b3cc5ec6f tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.053449 Nov 20 20:45:57.737037 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 21/46] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:57 2021] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:45:57.743569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-826e4413-503a-4e23-aa8e-4bf7916c10b0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1309489111"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.750816 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.750816 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.752334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-826e4413-503a-4e23-aa8e-4bf7916c10b0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 5457645b-4086-4be4-ac23-1b3e2e9ffc87 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:57.786675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-826e4413-503a-4e23-aa8e-4bf7916c10b0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047363 Nov 20 20:45:57.794852 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 22/47] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:45:57.803539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-326410277"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.805587 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.805587 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.824485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:57.830715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:57.841670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:57.842572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:57.858408 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-326410277 could not be found. Nov 20 20:45:57.861753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-326410277 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:57.863923 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df78b81d-f577-49f3-b64f-c9c141300c99 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.065670 Nov 20 20:45:57.864394 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 23/48] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:57.872515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37de4bed-eefa-4622-b63c-34a085e49ba8 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:57.873532 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.873532 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.914238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37de4bed-eefa-4622-b63c-34a085e49ba8 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045491 Nov 20 20:45:57.919234 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 24/49] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:57 2021] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 20 20:45:57.929487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6881e3ac-1387-4bf6-9522-3db48bd1d018 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.931312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6881e3ac-1387-4bf6-9522-3db48bd1d018 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:57.932346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6881e3ac-1387-4bf6-9522-3db48bd1d018 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.007356 Nov 20 20:45:57.933121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 25/50] 10.222.0.41 () {60 vars in 1164 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 20:45:57.943385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bbd8c034-7573-4fa6-bc7d-03567896d3e2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.944976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bbd8c034-7573-4fa6-bc7d-03567896d3e2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:57.946043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bbd8c034-7573-4fa6-bc7d-03567896d3e2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.007387 Nov 20 20:45:57.959892 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 26/51] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:45:57.979596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d05b4e60-6744-4cb9-a42a-6b6488bfecd2 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-192339663"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:57.981622 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:57.981622 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:57.983516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d05b4e60-6744-4cb9-a42a-6b6488bfecd2 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:57.984555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d05b4e60-6744-4cb9-a42a-6b6488bfecd2 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:57.987499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d05b4e60-6744-4cb9-a42a-6b6488bfecd2 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.025604 Nov 20 20:45:57.988434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:58.002275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4dd103f0-ff25-4e3a-87a3-7e89834acb2d tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1819726505"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:58.005953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-4dd103f0-ff25-4e3a-87a3-7e89834acb2d tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 66c6faed-3f36-40d3-8290-db2c0406b828 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:58.045960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4dd103f0-ff25-4e3a-87a3-7e89834acb2d tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049910 Nov 20 20:45:58.049079 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 28/53] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:45:58.059716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44828890-63d8-49f7-a1fe-fc0ff7c05234 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1819726505"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:58.063456 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:58.063456 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:45:58.065634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-44828890-63d8-49f7-a1fe-fc0ff7c05234 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 5415d4d3-6d9d-4e1b-a465-d36b92847047 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:58.100385 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-44828890-63d8-49f7-a1fe-fc0ff7c05234 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1819726505 already exists. Nov 20 20:45:58.101483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44828890-63d8-49f7-a1fe-fc0ff7c05234 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1819726505 already exists. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:58.102515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44828890-63d8-49f7-a1fe-fc0ff7c05234 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.048836 Nov 20 20:45:58.108191 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 29/54] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:58 2021] POST /compute/v2.1/os-aggregates => generated 111 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:45:58.116932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:58.116932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:45:58.131032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:58.131532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:58.132564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:45:58.132844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:45:58.847197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a643a381-b2b4-4fdb-8e03-687e2a9f9830 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.1 time: 1.606614 Nov 20 20:45:58.862541 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 26/55] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:45:57 2021] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:58.878163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eaf41d0-4947-44be-b591-1fe3287bb4d5 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:58.879615 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:58.879615 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:58.929848 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eaf41d0-4947-44be-b591-1fe3287bb4d5 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.056457 Nov 20 20:45:58.937321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 27/56] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:58 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:45:58.943290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a61153e-2e34-4b0f-b767-e0d476a3c64c tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-533364789"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:58.945031 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:58.945031 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:58.946621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-7a61153e-2e34-4b0f-b767-e0d476a3c64c tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 726df9ad-41eb-4b28-a01f-3772890c1345 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:58.992493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a61153e-2e34-4b0f-b767-e0d476a3c64c tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053333 Nov 20 20:45:58.996808 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 28/57] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:58 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:59.007859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f51dc40-0645-4fff-a46e-b0d7f903ebeb tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.009351 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.009351 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.010721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f51dc40-0645-4fff-a46e-b0d7f903ebeb tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:59.011599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f51dc40-0645-4fff-a46e-b0d7f903ebeb tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:59.012576 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f51dc40-0645-4fff-a46e-b0d7f903ebeb tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.008687 Nov 20 20:45:59.018672 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 29/58] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:59 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:59.029716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4887dd3a-25d2-4917-b341-c5e2fb5684df tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.068674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4887dd3a-25d2-4917-b341-c5e2fb5684df tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048143 Nov 20 20:45:59.071116 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 30/59] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:59 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:45:59.084874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-661ce163-1f3c-41af-ade0-0ff910bfd369 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.085983 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.085983 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.134071 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-661ce163-1f3c-41af-ade0-0ff910bfd369 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 20 20:45:59.136045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-661ce163-1f3c-41af-ade0-0ff910bfd369 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:59.138593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-661ce163-1f3c-41af-ade0-0ff910bfd369 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.060185 Nov 20 20:45:59.140655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 31/60] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:45:59 2021] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:45:59.157518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18c254a3-991d-4c0c-abc4-548a325a7b7b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2009762803"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:45:59.159437 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.159437 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.160716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-18c254a3-991d-4c0c-abc4-548a325a7b7b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 9b2ad177-d6f9-4fb3-b6a0-e2577c711ae1 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:45:59.211269 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18c254a3-991d-4c0c-abc4-548a325a7b7b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063030 Nov 20 20:45:59.212433 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 32/61] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:45:59 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:45:59.225825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20950b5f-5d71-4457-9546-5a9f3b8773d4 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.229029 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.229029 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.230819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20950b5f-5d71-4457-9546-5a9f3b8773d4 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:59.231911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20950b5f-5d71-4457-9546-5a9f3b8773d4 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:59.233635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20950b5f-5d71-4457-9546-5a9f3b8773d4 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.013861 Nov 20 20:45:59.234803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 33/62] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:45:59 2021] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:59.254514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06a68d4d-4aed-4800-9e63-6daf08b3ee93 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.255380 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.255380 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.307155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06a68d4d-4aed-4800-9e63-6daf08b3ee93 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.066524 Nov 20 20:45:59.307752 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 34/63] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:59 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:45:59.319187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7abf0d4d-908c-499c-ba88-1d8b459aad94 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.321185 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.321185 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.330791 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7abf0d4d-908c-499c-ba88-1d8b459aad94 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 20 20:45:59.335008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7abf0d4d-908c-499c-ba88-1d8b459aad94 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:59.338291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7abf0d4d-908c-499c-ba88-1d8b459aad94 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023637 Nov 20 20:45:59.339721 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 35/64] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:45:59 2021] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:45:59.349583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50ca6b59-4e86-4097-8323-639ed2dbb0d0 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:45:59.350692 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:45:59.350692 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:45:59.352144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50ca6b59-4e86-4097-8323-639ed2dbb0d0 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:59.354276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50ca6b59-4e86-4097-8323-639ed2dbb0d0 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:45:59.355261 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50ca6b59-4e86-4097-8323-639ed2dbb0d0 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010237 Nov 20 20:45:59.356352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 36/65] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:45:59 2021] GET /compute/v2.1/os-aggregates => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:45:59.955774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:45:59.972080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1012eaa4-ebae-46c0-b38d-fdbb52427034 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1272 microversion: 2.1 time: 1.863027 Nov 20 20:45:59.983641 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 30/66] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:45:58 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1272 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:00.073850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1114460075", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "availability_zone": "tempest-test_az-796134457"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:00.086585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:00.087864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:00.089754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:00.090475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:00.168141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:00.546398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:00.547095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:00.547874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:00.548519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:00.549538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:00.566092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:00.567085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:00.568292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:00.568932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:00.599560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Getting quotas for project df395a6120384dca8ab8bfc43a137ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:00.609702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Getting quotas for user 25669ff1f3d14669bb562da4fe5c2b96 and project df395a6120384dca8ab8bfc43a137ac4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:00.629312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:00.636806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:00.781168 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-77c4be8b-9437-4ae6-949c-685088250fc6 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219541 Nov 20 20:46:00.782235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 37/67] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:45:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:46:00.793113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47e8d23a-e327-4c18-b93a-c4727cc9aa5c tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:00.794740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47e8d23a-e327-4c18-b93a-c4727cc9aa5c tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:00.950233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47e8d23a-e327-4c18-b93a-c4727cc9aa5c tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:00.993339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:00.995100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:00.999558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47e8d23a-e327-4c18-b93a-c4727cc9aa5c tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.210526 Nov 20 20:46:01.000210 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 31/68] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:00 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:01.017925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:01.018818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:01.020562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:01.022700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:01.442837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:01.458022 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b766c06f-8ad9-403c-9614-911800595198 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.471075 Nov 20 20:46:01.463693 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 38/69] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:00 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:02.017223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f93aaca-aa7c-4549-9698-3201fd2554e5 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:02.018819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2f93aaca-aa7c-4549-9698-3201fd2554e5 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:02.130835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f93aaca-aa7c-4549-9698-3201fd2554e5 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:02.137692 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f93aaca-aa7c-4549-9698-3201fd2554e5 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.124238 Nov 20 20:46:02.141947 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 32/70] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:02 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:02.482296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:02.483625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:02.490773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:02.491353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:02.492241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:02.492978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:02.678085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:02.701034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39440921-20f7-49b7-8168-c50e46d72e2b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.222960 Nov 20 20:46:02.701603 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 39/71] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:02 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:03.159008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:03.159641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:03.167493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:03.167866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:03.168659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:03.169086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:03.269025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:03.279774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04b27eaa-e241-41a5-b2e8-8153cd82cdf9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.123969 Nov 20 20:46:03.280874 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 33/72] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:03 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:03.721877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:03.724704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:03.738764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:03.739436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:03.740448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:03.745428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:03.918307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:03.933246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-546bf035-f516-431b-a657-9277eaff0016 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.214511 Nov 20 20:46:03.934346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 40/73] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:03 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:04.297484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:04.298363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:04.304821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:04.306267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:04.307297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:04.307858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:04.413780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:04.422490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9773261-1dc3-4a7d-aa51-72af3212bc39 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.128744 Nov 20 20:46:04.423076 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 41/74] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:04 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:04.517103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Action: 'update', calling method: .version_select at 0x7f3f94163dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:04.519176 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:04.519176 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:05.027765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.028355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.029165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.029813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.037096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2019665174", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:05.094898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:05.114305 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2ebaecd-6230-4637-bf19-b36665f1ce98 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71" status: 200 len: 148 microversion: 2.57 time: 0.859245 Nov 20 20:46:05.115930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 34/75] 10.222.0.41 () {62 vars in 1302 bytes} [Sat Nov 20 20:46:04 2021] PUT /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71 => generated 148 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:05.262550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Action: 'create', calling method: .version_select at 0x7f3f941e3940>, body: {"keypair": {"name": "tempest-keypair-1576695324", "type": "ssh", "user_id": "3e648d491aef40c2a4b380010f613124"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:05.287299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:05.297176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:05.331031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:05.331462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:05.331941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:05.332359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:05.332780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:05.341967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.342462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.343292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.343739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.360158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Getting quotas for project 89da80dbcf5948268735e51c28e4bf40. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:05.363896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Getting quotas for user 9cf38bd3867945fb9726405aad6e61c2 and project 89da80dbcf5948268735e51c28e4bf40. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:05.389244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:05.391472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:05.441978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787611 Nov 20 20:46:05.442793 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 42/76] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:46:05.443892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:05.445011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d5de965-502c-45af-ac66-82afa87751f7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001268 Nov 20 20:46:05.445782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 43/77] 10.222.0.41 () {56 vars in 885 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 20 20:46:05.450672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:05.464395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:05.476323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.476952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.478395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.478842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.606811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:05.612637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:05.628459 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9bc71d52-3049-4ea9-8918-3c4d83551726 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.10 time: 0.509492 Nov 20 20:46:05.629461 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 35/78] 10.222.0.41 () {62 vars in 1199 bytes} [Sat Nov 20 20:46:05 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 511 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:46:05.635071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Calling method '.version_select at 0x7f3f94037dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:05.732387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.733027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.735460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.736195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.751350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:05.760965 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-83a85bc7-29c9-47a9-b5df-d113f44c55dc tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.313961 Nov 20 20:46:05.761572 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 44/79] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:05.771427 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8929a36e-f697-4685-843e-1948179cfd17 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71/detail" status: 200 len: 463 microversion: 2.57 time: 0.140492 Nov 20 20:46:05.778267 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 36/80] 10.222.0.41 () {60 vars in 1303 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71/detail => generated 463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:05.813399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:05.814023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:05.825188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.825647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.826482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:05.826921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:05.949443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:05.966830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f23d5f47-f4fc-477c-8b85-8d9463a54978 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.162271 Nov 20 20:46:05.980428 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 37/81] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:05.984213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aff86330-6ace-4813-9ee2-dbe8d293348d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:05.989847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aff86330-6ace-4813-9ee2-dbe8d293348d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:06.201350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aff86330-6ace-4813-9ee2-dbe8d293348d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:06.210087 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aff86330-6ace-4813-9ee2-dbe8d293348d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1219 microversion: 2.1 time: 0.240239 Nov 20 20:46:06.214751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 38/82] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:06.223964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Action: 'create', calling method: .version_select at 0x7f3f87fed430>, body: {"keypair": {"name": "tempest-keypair-1817279443", "type": "ssh", "user_id": "3e648d491aef40c2a4b380010f613124"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:06.239356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:06.243970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:06.307440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3599661-076b-41ef-9161-1fbd6a162443 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.308481 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:06.308481 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:06.310395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c3599661-076b-41ef-9161-1fbd6a162443 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 20 20:46:06.311194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3599661-076b-41ef-9161-1fbd6a162443 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:06.313372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3599661-076b-41ef-9161-1fbd6a162443 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755 tempest-InstanceUsageAuditLogNegativeTestJSON-1453210755-project-admin] 10.222.0.41 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.535601 Nov 20 20:46:06.319278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 45/83] 10.222.0.41 () {58 vars in 1223 bytes} [Sat Nov 20 20:46:05 2021] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 553 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:46:06.327596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Action: 'update', calling method: .version_select at 0x7f3f877a7e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:06.334373 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:06.334373 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:06.440953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:06.445489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:06.454173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.455029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:06.456236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.457298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:06.463905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-756b861f-02c1-450e-9c01-d25a7a0a054d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.247994 Nov 20 20:46:06.464415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 39/84] 10.222.0.41 () {62 vars in 1199 bytes} [Sat Nov 20 20:46:06 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:46:06.582186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.582940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:06.583908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.584489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:06.654925 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c47ce47c-0166-47e5-bd1b-16f3288bd5d1 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71?user_id=288b939dd3b0443bb33b669a026b95c1" status: 200 len: 148 microversion: 2.57 time: 0.336564 Nov 20 20:46:06.655649 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 46/85] 10.222.0.41 () {62 vars in 1383 bytes} [Sat Nov 20 20:46:06 2021] PUT /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71?user_id=288b939dd3b0443bb33b669a026b95c1 => generated 148 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:06.661962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f4f9aa2-9724-4f21-9f1f-ce738752be21 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Calling method '.version_select at 0x7f3f877a7ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.686461 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f4f9aa2-9724-4f21-9f1f-ce738752be21 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "GET /compute/v2.1/os-keypairs/tempest-keypair-1576695324?user_id=3e648d491aef40c2a4b380010f613124" status: 200 len: 706 microversion: 2.10 time: 0.029468 Nov 20 20:46:06.687871 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 47/86] 10.222.0.41 () {60 vars in 1339 bytes} [Sat Nov 20 20:46:06 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1576695324?user_id=3e648d491aef40c2a4b380010f613124 => generated 706 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:06.694119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc9e4785-7052-4337-8a59-d58cc19e8e37 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] Calling method '.version_select at 0x7f3f877c2dc0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.713034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e6b74b5-320c-45ed-8fcc-c45cc92192e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.714267 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:06.714267 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:06.715597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e6b74b5-320c-45ed-8fcc-c45cc92192e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'afae787fa2614c448ec0b8cbc4961061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382b7fba70dd42a7a165a83f4a15e7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:06.716583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e6b74b5-320c-45ed-8fcc-c45cc92192e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:06.717389 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e6b74b5-320c-45ed-8fcc-c45cc92192e5 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] 10.222.0.41 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.251945 Nov 20 20:46:06.718471 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 40/87] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:46:06 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:06.724066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Action: 'create', calling method: .version_select at 0x7f3f95b43700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-836511947", "type": "ssh"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:06.768027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:06.773284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:06.832578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc9e4785-7052-4337-8a59-d58cc19e8e37 tempest-QuotasAdminTestV257-107443414 tempest-QuotasAdminTestV257-107443414-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71?user_id=288b939dd3b0443bb33b669a026b95c1" status: 200 len: 190 microversion: 2.57 time: 0.143224 Nov 20 20:46:06.834587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 48/88] 10.222.0.41 () {60 vars in 1363 bytes} [Sat Nov 20 20:46:06 2021] GET /compute/v2.1/os-quota-sets/9f533a27496647469bd9f696bf82aa71?user_id=288b939dd3b0443bb33b669a026b95c1 => generated 190 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:06.853724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4490940c-115b-4d77-9513-dc3131177178 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.857005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4490940c-115b-4d77-9513-dc3131177178 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'afae787fa2614c448ec0b8cbc4961061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '382b7fba70dd42a7a165a83f4a15e7b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:06.859036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4490940c-115b-4d77-9513-dc3131177178 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:06.860349 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4490940c-115b-4d77-9513-dc3131177178 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626 tempest-InstanceUsageAuditLogNegativeTestJSON-1989373626-project] 10.222.0.41 "GET /compute/v2.1/os-instance_usage_audit_log/2021-11-20 20:46:06" status: 403 len: 128 microversion: 2.1 time: 0.024567 Nov 20 20:46:06.861512 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 49/89] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 20:46:06 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-11-20%2020%3A46%3A06 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:06.871505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:06.872457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:06.883110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.884234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:06.885708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:06.886509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:07.498066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:07.530172 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-817c3807-10e2-41f3-be79-6d175436c774 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.667336 Nov 20 20:46:07.534598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 50/90] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:06 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:07.555836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:07.557106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:07.568831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:07.569619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:07.572118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:07.572797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:07.720690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:07.725794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Getting quotas for user 2d3f529931cf492f9ee753d372f82f39 and project 016b75738476469abb50a751861462b2. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:07.743677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40dc6cb9-6aef-4d54-85f7-60ccef5ba89d tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.10 time: 1.023142 Nov 20 20:46:07.749604 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 41/91] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 20:46:06 2021] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:46:07.755061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:07.755942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:07.764911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:07.765637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:07.766987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:07.767646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:07.864222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:07.874210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-304b34ff-3bc8-4e94-9931-c49757f4d4da tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.332327 Nov 20 20:46:07.890784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 51/92] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:07 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:07.895545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b64dce3-d3d2-4ba5-afb2-8eb206e1c6d1 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Calling method '.version_select at 0x7f3f87790820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:07.905666 ncdv-master-1 devstack@n-api.service[140942]: WARNING oslo_db.sqlalchemy.utils [None req-6b64dce3-d3d2-4ba5-afb2-8eb206e1c6d1 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:46:07.920020 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b64dce3-d3d2-4ba5-afb2-8eb206e1c6d1 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "GET /compute/v2.1/os-keypairs?user_id=3e648d491aef40c2a4b380010f613124" status: 200 len: 1114 microversion: 2.10 time: 0.027930 Nov 20 20:46:07.932731 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 52/93] 10.222.0.41 () {60 vars in 1258 bytes} [Sat Nov 20 20:46:07 2021] GET /compute/v2.1/os-keypairs?user_id=3e648d491aef40c2a4b380010f613124 => generated 1114 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:46:07.940757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78e0e467-dffc-4873-86b2-e4fbb8c12f2b tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Calling method '.version_select at 0x7f3f877a75e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:07.982679 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78e0e467-dffc-4873-86b2-e4fbb8c12f2b tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-836511947" status: 204 len: 0 microversion: 2.10 time: 0.047861 Nov 20 20:46:07.983713 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 53/94] 10.222.0.41 () {60 vars in 1321 bytes} [Sat Nov 20 20:46:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-836511947 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 20 20:46:07.993196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f8de53e-91e6-4a75-948c-7f343880496e tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Calling method '.version_select at 0x7f3f8776eee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:08.029993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f8de53e-91e6-4a75-948c-7f343880496e tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817279443?user_id=3e648d491aef40c2a4b380010f613124" status: 204 len: 0 microversion: 2.10 time: 0.041615 Nov 20 20:46:08.031128 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 54/95] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 20:46:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817279443?user_id=3e648d491aef40c2a4b380010f613124 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:46:08.041510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b34a1a46-c9bb-468f-bded-d19a7df2ab46 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] Calling method '.version_select at 0x7f3f877a7820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:08.052835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:08.072853 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76283d21-d74c-488a-b8c9-47824881ec29 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1277 microversion: 2.1 time: 0.318757 Nov 20 20:46:08.073269 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b34a1a46-c9bb-468f-bded-d19a7df2ab46 tempest-KeyPairsV210TestJSON-1651199645 tempest-KeyPairsV210TestJSON-1651199645-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576695324?user_id=3e648d491aef40c2a4b380010f613124" status: 204 len: 0 microversion: 2.10 time: 0.036794 Nov 20 20:46:08.081514 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 55/96] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 20:46:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576695324?user_id=3e648d491aef40c2a4b380010f613124 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:46:08.083827 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 42/97] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:07 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1277 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:08.556199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:08.557744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:08.565379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:08.566193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:08.567247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:08.568458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:08.907074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:08.907712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:08.928451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:08.928920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:08.929737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:08.930816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:09.252780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:09.264878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:09.273217 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f83aab9-dea7-46de-9dee-a80134d9a685 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1242 microversion: 2.1 time: 0.378940 Nov 20 20:46:09.278040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 43/98] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:08 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1242 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:09.280586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9982758c-1473-47d4-86c0-8f2671fcf720 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.729732 Nov 20 20:46:09.285642 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 56/99] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:08 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:09.299417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:09.303940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:09.342432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:09.353348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:09.360042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:09.360827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:09.720809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:09.743868 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70ba2ec1-8800-414e-bf7e-f0e4e28e8301 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1277 microversion: 2.1 time: 0.460634 Nov 20 20:46:09.751671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 44/100] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:09 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1277 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:10.294642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:10.295863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:10.304301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:10.304880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.306308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:10.307875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:10.309541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.312796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:10.325338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.326145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:10.328338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.331621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:10.667675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:10.681822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2cdb008-0825-462a-8a97-0e5abdd4c7d4 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1308 microversion: 2.1 time: 0.385504 Nov 20 20:46:10.686889 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 57/101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:10 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1308 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:10.766576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:10.767922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:10.785982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.795495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:10.799785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:10.804368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:11.316703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:11.325243 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-027e1311-2cf4-49aa-9614-f4b1a3e62e35 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.563859 Nov 20 20:46:11.334757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 58/102] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:10 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:11.703971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:11.704987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:11.716800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:11.718990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:11.723766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:11.724444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:11.826490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:11.839917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d296d87c-4f6b-43dc-9c8e-8f1f107a61ac tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1296 microversion: 2.1 time: 0.140299 Nov 20 20:46:11.851817 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 59/103] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:11 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:12.109972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:12.132472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f05a1369-10fe-46b0-8c37-470db81f71d0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 1.832050 Nov 20 20:46:12.146420 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 45/104] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:10 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:12.364012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:12.364765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:12.389437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:12.391552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:12.393581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:12.395266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:12.860192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:12.860823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:12.896448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:12.915104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:12.915990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:12.916615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:13.401933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:13.415087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d23ffce8-c616-4461-838f-36caddcdbfdc tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 1.066646 Nov 20 20:46:13.416602 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 60/105] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:12 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:13.428823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:13.433197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:13.457740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:13.460515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:13.463053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:13.465617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:13.637744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:13.662353 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24feffc2-8ff4-425e-9703-1ad872a4a0db tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1296 microversion: 2.1 time: 0.793037 Nov 20 20:46:13.663051 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 46/106] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:12 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1296 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:14.797238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-264786112", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:14.853165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:14.860557 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdd5279f-3d1a-4ade-9ef8-720b573b5dd2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 1.442511 Nov 20 20:46:14.866626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 61/107] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:13 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:14.876273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:14.879050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:14.892757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:14.907548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:14.916302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:14.917129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.061824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:15.570392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:15.583688 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-840a51ad-7137-4b08-8eff-5b89fffcd8d7 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.715480 Nov 20 20:46:15.585223 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 62/108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:14 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:15.693275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-aea79fc8-8c55-4d87-8790-b858ef2ab76d req-34417f93-78b3-4da4-852b-318446c0bb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b255966-253a-480e-844d-16f700830e9f", "tag": "46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:15.695711 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:15.695711 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:15.732156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aea79fc8-8c55-4d87-8790-b858ef2ab76d req-34417f93-78b3-4da4-852b-318446c0bb26 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:15.733055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aea79fc8-8c55-4d87-8790-b858ef2ab76d req-34417f93-78b3-4da4-852b-318446c0bb26 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.763045 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-aea79fc8-8c55-4d87-8790-b858ef2ab76d req-34417f93-78b3-4da4-852b-318446c0bb26 service nova] Creating event network-changed:46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef for instance 0b255966-253a-480e-844d-16f700830e9f on nch2-master-1 Nov 20 20:46:15.764729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:15.765145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:15.765609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:15.766039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:15.766466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:15.779183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-aea79fc8-8c55-4d87-8790-b858ef2ab76d req-34417f93-78b3-4da4-852b-318446c0bb26 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191657 Nov 20 20:46:15.780422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 63/109] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:15.783840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:15.784284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.785089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:15.785517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.788082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:15.788854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:15.798208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:15.798886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.799994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:15.800575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:15.829918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:15.839991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for user cf07bddf00ea4a7da446130a6308cd27 and project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:15.864482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:15.867255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:15.970650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0df2404-ba20-4f4b-bd9b-ab4ebe4ed4d0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.125770 Nov 20 20:46:15.971301 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 47/110] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:46:16.095094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:16.105643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32a04571-aab9-4c5b-9b59-b9cbdb2b1e3e tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.323130 Nov 20 20:46:16.106274 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 64/111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:15 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:16.264420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-568406cd-231a-4039-8bbb-861623231424 req-0b67e44e-557f-4036-9155-30a78f7b719b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae71d012-3101-45ff-8cfa-86095500e364", "tag": "cdc9972c-0094-48f8-9fca-0182b2a13dd7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:16.266740 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:16.266740 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:16.286665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-568406cd-231a-4039-8bbb-861623231424 req-0b67e44e-557f-4036-9155-30a78f7b719b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:16.287310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-568406cd-231a-4039-8bbb-861623231424 req-0b67e44e-557f-4036-9155-30a78f7b719b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:16.311999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-568406cd-231a-4039-8bbb-861623231424 req-0b67e44e-557f-4036-9155-30a78f7b719b service nova] Creating event network-changed:cdc9972c-0094-48f8-9fca-0182b2a13dd7 for instance ae71d012-3101-45ff-8cfa-86095500e364 on nch1-master-1 Nov 20 20:46:16.324231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d975103-7769-4149-af36-d04143eeda4a tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.347675 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-568406cd-231a-4039-8bbb-861623231424 req-0b67e44e-557f-4036-9155-30a78f7b719b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231667 Nov 20 20:46:16.350109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 65/112] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:16.360340 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d975103-7769-4149-af36-d04143eeda4a tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.378258 Nov 20 20:46:16.362422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.372087 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 48/113] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:15 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:16.372295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:16.375375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cd138ff-77da-4320-a697-5cb40d583e86 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.376019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cd138ff-77da-4320-a697-5cb40d583e86 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:16.406160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:16.406849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:16.409157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:16.411236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:16.744609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:16.753389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40074811-4b2f-4e92-9300-56077d2b1c15 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.401092 Nov 20 20:46:16.754736 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 66/114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:16.760024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49045b4e-2e9d-4bcb-b16c-655cbffe9b5a tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.792712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49045b4e-2e9d-4bcb-b16c-655cbffe9b5a tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.036426 Nov 20 20:46:16.805653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 67/115] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/flavors => generated 2594 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:16.809564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cd138ff-77da-4320-a697-5cb40d583e86 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:16.817126 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cd138ff-77da-4320-a697-5cb40d583e86 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1212 microversion: 2.1 time: 0.451506 Nov 20 20:46:16.817706 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 49/116] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1212 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:16.818151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.818888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:16.829066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:16.829549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:16.830409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:16.830850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:16.843467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2afffc96-5632-4f33-8d91-481b5973718e tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.867270 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2afffc96-5632-4f33-8d91-481b5973718e tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036710 Nov 20 20:46:16.870844 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 50/117] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:16.884340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-13c65e4a-43fe-4141-b5ef-c08e28817c53 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:16.925981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-13c65e4a-43fe-4141-b5ef-c08e28817c53 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043339 Nov 20 20:46:16.929820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 51/118] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:16.962252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99da0c2f-7486-48a3-86d3-2934b942c16e tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.057375 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99da0c2f-7486-48a3-86d3-2934b942c16e tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.119541 Nov 20 20:46:17.074192 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 52/119] 10.222.0.41 () {58 vars in 1164 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.083376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad664939-b53e-427b-98a2-3a1c33dcf2ea tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.100392 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad664939-b53e-427b-98a2-3a1c33dcf2ea tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024829 Nov 20 20:46:17.109939 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 53/120] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.127136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ddb52cc-4aa7-49b9-ba86-1800b82d22ad tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.194383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:17.195211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ddb52cc-4aa7-49b9-ba86-1800b82d22ad tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.083354 Nov 20 20:46:17.204403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 54/121] 10.222.0.41 () {58 vars in 1168 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.204403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.204403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:17.208931 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ce94c01-9d6e-493d-b6ae-13123316f097 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.399873 Nov 20 20:46:17.209602 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 68/122] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:16 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.216774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.216907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:17.217686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.222579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:17.223580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa3848eb-134c-4546-893c-ac091f2fa344 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.259691 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa3848eb-134c-4546-893c-ac091f2fa344 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.047167 Nov 20 20:46:17.270115 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 69/123] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.279011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c81e1b8c-21e4-4992-97fc-75c5dcaac2b7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.295249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c81e1b8c-21e4-4992-97fc-75c5dcaac2b7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023106 Nov 20 20:46:17.297684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 70/124] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.308474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4913c9a-64e3-4121-a552-bbe3a144a6b7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.350923 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4913c9a-64e3-4121-a552-bbe3a144a6b7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.046566 Nov 20 20:46:17.352458 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 71/125] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:17.369922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c0a3ed8-8b5e-45ef-be64-a71f5e186491 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.380228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c0a3ed8-8b5e-45ef-be64-a71f5e186491 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016259 Nov 20 20:46:17.389665 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 72/126] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:17.394764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84ee5d32-45bb-4b65-a76a-9293f622b9d9 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.427919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84ee5d32-45bb-4b65-a76a-9293f622b9d9 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.036722 Nov 20 20:46:17.438232 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 73/127] 10.222.0.41 () {58 vars in 1143 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.443124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6bcac91-00ef-4b5d-931c-059035bc3a45 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.451713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6bcac91-00ef-4b5d-931c-059035bc3a45 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012103 Nov 20 20:46:17.458936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 74/128] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.464798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad6bf5c0-8956-43ca-9991-abfcbc1062eb tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.489993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad6bf5c0-8956-43ca-9991-abfcbc1062eb tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.029718 Nov 20 20:46:17.499509 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 75/129] 10.222.0.41 () {58 vars in 1147 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.504721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4fb2e4a-309a-43e6-af6c-6872a52d5e7c tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.519215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4fb2e4a-309a-43e6-af6c-6872a52d5e7c tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018179 Nov 20 20:46:17.527519 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 76/130] 10.222.0.41 () {58 vars in 1139 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.537143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25ad6df4-1f32-42b7-ba56-01e78f5f37a3 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.549943 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25ad6df4-1f32-42b7-ba56-01e78f5f37a3 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020671 Nov 20 20:46:17.552215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 77/131] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:17.576391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb65b566-68cf-4c80-aa40-4f190320f85f tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.600826 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb65b566-68cf-4c80-aa40-4f190320f85f tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.038059 Nov 20 20:46:17.602591 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 78/132] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.615693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a7832fb8-1c3f-4e93-8ffa-170168e92189 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.661044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a7832fb8-1c3f-4e93-8ffa-170168e92189 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046346 Nov 20 20:46:17.663033 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 79/133] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.682943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4788616c-2931-4cf9-bb4f-e36cbd3bbde7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.697303 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4788616c-2931-4cf9-bb4f-e36cbd3bbde7 tempest-FlavorsV2TestJSON-125902910 tempest-FlavorsV2TestJSON-125902910-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022996 Nov 20 20:46:17.698256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 80/134] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:17.711994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:17.719405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca20752f-7bd1-4e1b-b1ed-55eb5a79593f tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.522223 Nov 20 20:46:17.722584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 55/135] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:17.771012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.771618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:17.781869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.782599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:17.783541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.786716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:17.838158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:17.838777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:17.848986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.852073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:17.853425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:17.854010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.085271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:18.104118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-318de229-8012-49eb-8b97-2af37caf1498 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.336580 Nov 20 20:46:18.114423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 81/136] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:18.118934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:18.128779 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d2e0e8d-fa57-48d5-ae5b-670dccaeb697 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1216 microversion: 2.1 time: 0.294628 Nov 20 20:46:18.130128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 56/137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:17 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1216 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:18.226934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:18.228357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:18.236357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.237067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.239014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.239624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.474993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:18.485567 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b1cb8bf-7819-4a9e-9907-9bdea25907d6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.262811 Nov 20 20:46:18.487444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 82/138] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:18 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:18.731767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-73f3419d-e29e-48e1-8225-18a35df9561a req-19dd2c17-1170-4d61-8629-b82a25a77bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145af1b9-33db-4aeb-a248-55ab57de8146", "tag": "862ee470-d6ef-4357-a9c1-0a08b9523fc7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:18.735869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:18.736499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:18.737108 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:18.737108 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:18.760149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-73f3419d-e29e-48e1-8225-18a35df9561a req-19dd2c17-1170-4d61-8629-b82a25a77bcc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.760769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-73f3419d-e29e-48e1-8225-18a35df9561a req-19dd2c17-1170-4d61-8629-b82a25a77bcc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.769418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.769994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.772882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.774631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.790408 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-73f3419d-e29e-48e1-8225-18a35df9561a req-19dd2c17-1170-4d61-8629-b82a25a77bcc service nova] Creating event network-changed:862ee470-d6ef-4357-a9c1-0a08b9523fc7 for instance 145af1b9-33db-4aeb-a248-55ab57de8146 on nch2-master-1 Nov 20 20:46:18.791239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-73f3419d-e29e-48e1-8225-18a35df9561a req-19dd2c17-1170-4d61-8629-b82a25a77bcc service nova] Acquired lock "compute-rpcapi-router" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:46:18.792620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.793728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.794822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:18.795401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:18.807430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.rpcapi [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 20 20:46:18.809091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] Releasing lock "compute-rpcapi-router" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:46:18.844005 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54ae6519-42f6-4ede-b930-5e5f6ed4511c None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118751 Nov 20 20:46:18.845348 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 57/139] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:19.130245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:19.133073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:19.153743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.159702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.161359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.162615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.478897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:19.487451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1129ac55-10d9-47ae-8a2a-5577f2c69533 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.755827 Nov 20 20:46:19.489101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 83/140] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:18 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:19.494556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:19.495360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:19.510254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.512538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.513556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.514156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.590383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:19.603437 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86a48344-1291-446b-8616-2012e0d5c024 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.484496 Nov 20 20:46:19.604466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 58/141] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:19 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:19.617222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:19.618104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:19.626496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.626953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.627740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:19.628341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:19.633863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:19.643179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-51c30ad2-add3-4702-a228-90bea485932c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1216 microversion: 2.1 time: 0.151531 Nov 20 20:46:19.651885 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 84/142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:19 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:19.903255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:19.916155 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-398f1b3c-f645-403c-814b-5606a4f78de4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.310432 Nov 20 20:46:19.927359 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 59/143] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:19 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:20.022572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d1f5992-d94d-4fd4-8c9a-f70e7a4ffa87 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] Action: 'create', calling method: .version_select at 0x7f3f87764ca0>, body: {"security_group": {"name": "tempest-securitygroup-1360361933", "description": "tempest-description-635426032"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:20.504685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:20.505300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:20.522548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.524447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.525549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.526261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.779489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:20.787895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d08edb2-8ab2-4297-b69c-eaf794644576 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.287019 Nov 20 20:46:20.789880 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d1f5992-d94d-4fd4-8c9a-f70e7a4ffa87 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.033901 Nov 20 20:46:20.791214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 85/144] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:46:19 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:20.795992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:20.797012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:20.806312 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 60/145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:20 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:20.811214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:20.812304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:20.818876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.819547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.820283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.821326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.821595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.822253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.822484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:20.822922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:20.911102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:20.921369 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-334dbad0-7651-4d74-86f6-d1e8b8fcf46a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1272 microversion: 2.1 time: 0.113075 Nov 20 20:46:20.932922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 61/146] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:20 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:20.934240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71d7fe2f-863f-47ad-8606-63116e2ac1cd tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] Action: 'create', calling method: .version_select at 0x7f3f87f869d0>, body: {"security_group": {"name": "tempest-securitygroup-456952953", "description": "tempest-description-625552538"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:21.233333 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71d7fe2f-863f-47ad-8606-63116e2ac1cd tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.304910 Nov 20 20:46:21.234552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 62/147] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:46:20 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:21.246228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:21.246941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:21.262324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:21.263259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:21.266238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:21.266939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:21.454011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:21.462593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cbec7040-5459-4daa-825e-13c7372f8fae tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.669791 Nov 20 20:46:21.466564 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 86/148] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:20 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:21.486942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:21.495586 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ccfe832-3eaf-42ed-b4a7-ea51633bf70c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.253863 Nov 20 20:46:21.496160 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 63/149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:21 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:21.738841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-24a7018a-32e4-4e28-ace0-9151be904335 req-29dfa81f-5b7a-43eb-a21d-307c236d1918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b255966-253a-480e-844d-16f700830e9f", "name": "network-vif-plugged", "status": "completed", "tag": "46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:21.740522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5e63adf-b64c-4f35-93be-3084387e65df tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] Action: 'create', calling method: .version_select at 0x7f3f87659a60>, body: {"security_group": {"name": "tempest-securitygroup-278670982", "description": "tempest-description-1901027518"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:21.740639 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:21.740639 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:21.756463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-24a7018a-32e4-4e28-ace0-9151be904335 req-29dfa81f-5b7a-43eb-a21d-307c236d1918 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:21.756899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-24a7018a-32e4-4e28-ace0-9151be904335 req-29dfa81f-5b7a-43eb-a21d-307c236d1918 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:21.774452 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-24a7018a-32e4-4e28-ace0-9151be904335 req-29dfa81f-5b7a-43eb-a21d-307c236d1918 service nova] Creating event network-vif-plugged:46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef for instance 0b255966-253a-480e-844d-16f700830e9f on nch2-master-1 Nov 20 20:46:21.781500 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-24a7018a-32e4-4e28-ace0-9151be904335 req-29dfa81f-5b7a-43eb-a21d-307c236d1918 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283633 Nov 20 20:46:21.786937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 64/150] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:21.834226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:21.834892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:21.852589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:21.853672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:21.854527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:21.855288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.205164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:22.245881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4bdb10dc-2dce-4d5d-8771-e80d7bba453a tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.431459 Nov 20 20:46:22.246738 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 65/151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:21 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:22.265529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:22.269704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:22.297314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.298188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.299218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.303034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.470687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:22.507216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6cb65f0f-5758-4a45-9766-b84a186e0585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1270 microversion: 2.1 time: 0.252499 Nov 20 20:46:22.519661 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 66/152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:22 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1270 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:22.526556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:22.527414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:22.535969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.536427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.537470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.538443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.541635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5e63adf-b64c-4f35-93be-3084387e65df tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.071858 Nov 20 20:46:22.543054 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 87/153] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:46:21 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:22.550165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:22.551073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:22.558943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.559707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.560795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:22.561433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:22.780844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:22.788664 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6af66425-e7f3-4f3c-8238-46a535681a65 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.244333 Nov 20 20:46:22.792481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 88/154] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:22 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:22.813072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-65aab262-9d82-4a86-b7bc-387a671e5422 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] Action: 'create', calling method: .version_select at 0x7f3f876590d0>, body: {"security_group": {"name": "tempest-securitygroup-27303090", "description": "tempest-description-1300223149"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:22.843723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:22.860874 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4b8bdf3-7081-47d1-a10a-83d82cc1e58d tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1341 microversion: 2.1 time: 0.339049 Nov 20 20:46:22.863044 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 67/155] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:22 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1341 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:23.246110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-65aab262-9d82-4a86-b7bc-387a671e5422 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.443832 Nov 20 20:46:23.246708 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 89/156] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:46:22 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:23.257203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a059ebf-ea3d-4894-935c-e23bb9f0f421 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] Calling method '.version_select at 0x7f3f94049b80>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:23.266752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:23.267562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:23.278838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.279522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:23.280841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.281820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:23.581231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:23.590851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0fda3f73-ad23-4c2c-ad15-05886e7b656b tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.331393 Nov 20 20:46:23.601533 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 90/157] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:23 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:23.829277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:23.830638 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:23.830638 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:23.832237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.832688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:23.834893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.835530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:23.894201 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87efbe28-5a10-4e96-bd78-346d50179b72 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 968 microversion: 2.1 time: 0.290689 Nov 20 20:46:23.903822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 91/158] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:23 2021] GET /compute/v2.1/os-services => generated 968 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:23.909537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:23.910772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:23.919228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.920042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:23.921268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:23.921905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.147516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:24.162768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4227847a-7bc4-47e7-8ee6-c8573998c9d9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.257252 Nov 20 20:46:24.163729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 92/159] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:23 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:24.174346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:24.175205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:24.186034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.188951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.190089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.191256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.553678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:24.564115 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6448e805-1a82-47af-a69c-2c0bdb1ddd68 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.398988 Nov 20 20:46:24.566366 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 93/160] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:24 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:24.571519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:24.572188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:24.596993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.597590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.598505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.599086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.831082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:24.840126 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb83d0fc-bd81-40ec-a7af-504450f21df1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1490 microversion: 2.1 time: 0.272724 Nov 20 20:46:24.846121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 94/161] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:24 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1490 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:24.848464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:24.850132 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:24.850132 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:24.852794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.854025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.856160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.856853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.892975 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b1415d6-3e1d-4b02-8e28-d033396ec318 tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 968 microversion: 2.1 time: 0.048095 Nov 20 20:46:24.894130 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 95/162] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:46:24 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 968 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:24.901922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-fb555d4d-521b-42ce-804d-1158f395b26b req-2f249bcb-e644-4c55-8a43-b5c420fd2d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:24.903739 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:24.903739 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:24.910752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fb555d4d-521b-42ce-804d-1158f395b26b req-2f249bcb-e644-4c55-8a43-b5c420fd2d89 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.911203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fb555d4d-521b-42ce-804d-1158f395b26b req-2f249bcb-e644-4c55-8a43-b5c420fd2d89 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.925131 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-fb555d4d-521b-42ce-804d-1158f395b26b req-2f249bcb-e644-4c55-8a43-b5c420fd2d89 service nova] Creating event network-changed:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch1-master-1 Nov 20 20:46:24.932722 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-fb555d4d-521b-42ce-804d-1158f395b26b req-2f249bcb-e644-4c55-8a43-b5c420fd2d89 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036610 Nov 20 20:46:24.933903 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 96/163] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:24.940179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:24.940968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:24.949561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.950232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:24.951164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:24.951626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.292020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:25.323068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb0c16e8-93b8-4d2a-b858-1b59ec870482 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.387156 Nov 20 20:46:25.330451 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 97/164] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:24 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:25.510327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:25.510860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:25.517100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.517785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.518521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.519013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.618454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] [instance: 0b255966-253a-480e-844d-16f700830e9f] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:46:25.793366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-890a1262-c4fa-4497-a485-8012436968e2 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] 10.222.0.41 "DELETE /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 204 len: 0 microversion: 2.1 time: 0.460225 Nov 20 20:46:25.793863 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 98/165] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:25 2021] DELETE /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:46:25.803838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:25.805182 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:25.805182 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:25.806824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.807266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.808099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.808539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.833348 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f029c101-7180-469c-a5c8-c198d18ae34e tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 968 microversion: 2.1 time: 0.035039 Nov 20 20:46:25.834481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 99/166] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:25 2021] GET /compute/v2.1/os-services => generated 968 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:25.846907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0f98b26b-fd4a-47cd-95a4-284128e6a018 req-3d5452a0-623b-42f7-99e6-0f1cb66a46ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145af1b9-33db-4aeb-a248-55ab57de8146", "name": "network-vif-plugged", "status": "completed", "tag": "862ee470-d6ef-4357-a9c1-0a08b9523fc7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:25.848726 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:25.848726 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:25.856924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0f98b26b-fd4a-47cd-95a4-284128e6a018 req-3d5452a0-623b-42f7-99e6-0f1cb66a46ff service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.857469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0f98b26b-fd4a-47cd-95a4-284128e6a018 req-3d5452a0-623b-42f7-99e6-0f1cb66a46ff service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.870223 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0f98b26b-fd4a-47cd-95a4-284128e6a018 req-3d5452a0-623b-42f7-99e6-0f1cb66a46ff service nova] Creating event network-vif-plugged:862ee470-d6ef-4357-a9c1-0a08b9523fc7 for instance 145af1b9-33db-4aeb-a248-55ab57de8146 on nch2-master-1 Nov 20 20:46:25.875231 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0f98b26b-fd4a-47cd-95a4-284128e6a018 req-3d5452a0-623b-42f7-99e6-0f1cb66a46ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039426 Nov 20 20:46:25.876232 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 100/167] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:25.881407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:25.882225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:25.895634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.896213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:25.897029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:25.897460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.073196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:26.081271 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa6bc7bd-110a-4a9e-93bb-a57d46c17eba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.203624 Nov 20 20:46:26.081952 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 101/168] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:25 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:26.086907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.087702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:26.094151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.094966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.095777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.096373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.315542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:26.344440 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03680d1a-b5cc-4cb9-a78e-54dca1a9a8ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.261322 Nov 20 20:46:26.345196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 102/169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:26.360783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.361374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:26.367683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.368198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.369008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.369448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.470787 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a059ebf-ea3d-4894-935c-e23bb9f0f421 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] 10.222.0.41 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7687 microversion: 2.1 time: 3.217066 Nov 20 20:46:26.472656 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 68/170] 10.222.0.41 () {58 vars in 1190 bytes} [Sat Nov 20 20:46:23 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7687 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:26.478507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.480417 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:26.480417 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:26.482325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.483428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.485201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.485895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.514799 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-577188c7-3c58-4e8d-b00d-0794d449e5ff tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.040762 Nov 20 20:46:26.515781 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 69/171] 10.222.0.41 () {58 vars in 1195 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:46:26.526512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.527498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:26.537293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.538173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.539797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.540689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.704282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:26.712977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f7841c3-0993-4f5f-b2e5-90ee6394bd1d tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1338 microversion: 2.1 time: 0.195922 Nov 20 20:46:26.714842 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 70/172] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:26.719249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0406b27-367c-4536-8bf3-b9c8e0cb31c5 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] Calling method '.version_select at 0x7f3f87f865e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.890987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:26.898888 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ad0a003-a7f4-430e-aaa2-d1f50d53dcaf tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1496 microversion: 2.1 time: 0.541010 Nov 20 20:46:26.899829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 103/173] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1496 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:26.916021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:26.923161 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:26.923161 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:26.925481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.926016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.927032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:26.931903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:26.948033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0406b27-367c-4536-8bf3-b9c8e0cb31c5 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.232054 Nov 20 20:46:26.949138 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 71/174] 10.222.0.41 () {58 vars in 1190 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:26.963926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4baddf46-a911-4f20-891a-5a20e1076fd3 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] Calling method '.version_select at 0x7f3f87f398b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.011240 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3359322d-af59-43d2-868f-52d8bcea172d tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 968 microversion: 2.1 time: 0.106907 Nov 20 20:46:27.017575 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 104/175] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:26 2021] GET /compute/v2.1/os-services => generated 968 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:27.023200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.028208 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:27.028208 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:27.031074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.031600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.032502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.033011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.079828 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0f51e50-6021-46d7-9eb2-d0f10eda271c tempest-ServicesAdminNegativeTestJSON-869522715 tempest-ServicesAdminNegativeTestJSON-869522715-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.059981 Nov 20 20:46:27.082103 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 105/176] 10.222.0.41 () {58 vars in 1197 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:46:27.238407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4baddf46-a911-4f20-891a-5a20e1076fd3 tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/504c2910-57d8-4686-ba92-d4942a21864e" status: 202 len: 0 microversion: 2.1 time: 0.280822 Nov 20 20:46:27.239136 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 72/177] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:46:26 2021] DELETE /compute/v2.1/os-security-groups/504c2910-57d8-4686-ba92-d4942a21864e => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:27.245912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.246564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:27.270945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.270945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.277936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.277936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.347916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad7171f0-8357-4713-94ea-899254bff1af tempest-ServicesAdminNegativeTestJSON-616097938 tempest-ServicesAdminNegativeTestJSON-616097938-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.349268 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:27.349268 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:27.350666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ad7171f0-8357-4713-94ea-899254bff1af tempest-ServicesAdminNegativeTestJSON-616097938 tempest-ServicesAdminNegativeTestJSON-616097938-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '506f0ce7531b4329a4ec5ed8f8490801', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52e94cb6a91d4fd19a9356ffc93ff9e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:27.351342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad7171f0-8357-4713-94ea-899254bff1af tempest-ServicesAdminNegativeTestJSON-616097938 tempest-ServicesAdminNegativeTestJSON-616097938-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:27.353088 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad7171f0-8357-4713-94ea-899254bff1af tempest-ServicesAdminNegativeTestJSON-616097938 tempest-ServicesAdminNegativeTestJSON-616097938-project] 10.222.0.41 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.264820 Nov 20 20:46:27.353943 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 106/178] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/os-services => generated 112 bytes in 266 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:27.375629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9b0e0a9-e531-4b41-8787-cc4ea9b9ba9f tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] Calling method '.version_select at 0x7f3f87641040>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.507760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:27.520933 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3259f7b3-49f6-4a79-a70d-2fee5a75365d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.280811 Nov 20 20:46:27.522530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 73/179] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:27.535509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.536454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:27.575333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.576586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.578220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.578845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.912499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:27.929142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25a448e3-4e2a-4ed1-98fc-a1412f0631ea tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.399212 Nov 20 20:46:27.941888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 74/180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:27.960399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.960577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:27.982594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.983747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.985988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:27.987855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:27.990270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9b0e0a9-e531-4b41-8787-cc4ea9b9ba9f tempest-SecurityGroupsTestAdminJSON-144126347 tempest-SecurityGroupsTestAdminJSON-144126347-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/2fb9e0d0-bd98-4917-a865-dbbff25a9349" status: 202 len: 0 microversion: 2.1 time: 0.621561 Nov 20 20:46:27.991459 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 107/181] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:46:27 2021] DELETE /compute/v2.1/os-security-groups/2fb9e0d0-bd98-4917-a865-dbbff25a9349 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:27.997366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:27.998251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:28.017555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:28.019041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:28.021500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:28.024697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:28.341279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:28.345500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:28.360529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-787a52c4-a93a-457d-b5a3-3b573fe4ea5f tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 200 len: 1496 microversion: 2.1 time: 0.367529 Nov 20 20:46:28.364551 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9046b621-c3e2-46b7-b706-873b3dcfaece tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1487 microversion: 2.1 time: 0.418875 Nov 20 20:46:28.367235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 108/182] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 1496 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:28.371487 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 75/183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:27 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1487 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:28.378520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1fc2858c-7551-4a00-9afe-510b1ae07f69 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] Calling method '.version_select at 0x7f3f8766d700>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:28.387678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:28.388641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:28.397757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:28.399558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:28.400692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:28.401240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.247515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4434c17d-ac8b-4a19-90d3-ba6232fbbd0b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1638 microversion: 2.1 time: 0.858345 Nov 20 20:46:29.250182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 76/184] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:28 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1638 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:29.253873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:29.255145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:29.268104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.268684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.269913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.270115 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1fc2858c-7551-4a00-9afe-510b1ae07f69 tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/7ebe4525-a80c-4073-aae5-e18501e0b269" status: 202 len: 0 microversion: 2.1 time: 0.898888 Nov 20 20:46:29.270693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.275166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 109/185] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:46:28 2021] DELETE /compute/v2.1/os-security-groups/7ebe4525-a80c-4073-aae5-e18501e0b269 => generated 0 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:29.279826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2fdb94e2-1bcd-4b71-bcaf-cb572bf11b76 req-668a4711-c2f3-4389-a589-9e17bbb36f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b255966-253a-480e-844d-16f700830e9f", "name": "network-vif-deleted", "tag": "46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:29.281399 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:29.281399 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:29.297742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2fdb94e2-1bcd-4b71-bcaf-cb572bf11b76 req-668a4711-c2f3-4389-a589-9e17bbb36f81 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.298581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2fdb94e2-1bcd-4b71-bcaf-cb572bf11b76 req-668a4711-c2f3-4389-a589-9e17bbb36f81 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.338340 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2fdb94e2-1bcd-4b71-bcaf-cb572bf11b76 req-668a4711-c2f3-4389-a589-9e17bbb36f81 service nova] Creating event network-vif-deleted:46aeaf97-9ae7-4fc8-85e1-8d82fd6f14ef for instance 0b255966-253a-480e-844d-16f700830e9f on nch2-master-1 Nov 20 20:46:29.355189 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2fdb94e2-1bcd-4b71-bcaf-cb572bf11b76 req-668a4711-c2f3-4389-a589-9e17bbb36f81 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078417 Nov 20 20:46:29.358648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 110/186] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:29.373896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:29.374927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:29.387611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.401249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.403259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.415472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.488134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:29.497878 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-611ea0cc-a0e3-46a9-ac74-36a1ef4258ba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.248079 Nov 20 20:46:29.498642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 77/187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:29 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:29.509663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8792396f-e94c-4873-86c4-0bf1d627ad3c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:29.511704 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:29.511704 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:29.544969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8792396f-e94c-4873-86c4-0bf1d627ad3c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.546519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8792396f-e94c-4873-86c4-0bf1d627ad3c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.775500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:29.784016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e044a8ee-ad9c-43b8-83b6-7dcbd0a31c7b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.423519 Nov 20 20:46:29.785546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 111/188] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:29 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:29.785784 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8792396f-e94c-4873-86c4-0bf1d627ad3c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 0.285641 Nov 20 20:46:29.786587 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 78/189] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:46:29 2021] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:29.792269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ef52257-a613-48db-85e0-b6788ca0388b tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] Calling method '.version_select at 0x7f3f87600d30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:29.813976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c167bd6a-562e-42f2-8efc-8e838925a997 req-201c84af-e8f6-40f4-9e62-d4d4eae85e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae71d012-3101-45ff-8cfa-86095500e364", "name": "network-vif-plugged", "status": "completed", "tag": "cdc9972c-0094-48f8-9fca-0182b2a13dd7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:29.817045 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:29.817045 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:29.841120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c167bd6a-562e-42f2-8efc-8e838925a997 req-201c84af-e8f6-40f4-9e62-d4d4eae85e5a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.841120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c167bd6a-562e-42f2-8efc-8e838925a997 req-201c84af-e8f6-40f4-9e62-d4d4eae85e5a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.864087 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c167bd6a-562e-42f2-8efc-8e838925a997 req-201c84af-e8f6-40f4-9e62-d4d4eae85e5a service nova] Creating event network-vif-plugged:cdc9972c-0094-48f8-9fca-0182b2a13dd7 for instance ae71d012-3101-45ff-8cfa-86095500e364 on nch1-master-1 Nov 20 20:46:29.885821 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c167bd6a-562e-42f2-8efc-8e838925a997 req-201c84af-e8f6-40f4-9e62-d4d4eae85e5a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093402 Nov 20 20:46:29.891310 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 79/190] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:29.903175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:29.904317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:29.914695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.916110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.917431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:29.918348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:29.943814 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. Nov 20 20:46:29.945087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:29.946737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3dc5e60-e6da-4c72-93ac-de7ba19110d8 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 404 len: 111 microversion: 2.1 time: 0.053127 Nov 20 20:46:29.947810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 80/191] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:29 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:29.960345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27756ff8-c6b0-4c0e-aeb5-5e29910a34d1 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:29.962926 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:29.962926 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:30.041238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27756ff8-c6b0-4c0e-aeb5-5e29910a34d1 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.091011 Nov 20 20:46:30.042370 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 81/192] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:29 2021] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:30.180193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ef52257-a613-48db-85e0-b6788ca0388b tempest-SecurityGroupsTestAdminJSON-1695547723 tempest-SecurityGroupsTestAdminJSON-1695547723-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/b65bc633-78de-46b9-8265-4e91111133e1" status: 202 len: 0 microversion: 2.1 time: 0.392461 Nov 20 20:46:30.180977 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 112/193] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:46:29 2021] DELETE /compute/v2.1/os-security-groups/b65bc633-78de-46b9-8265-4e91111133e1 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:30.190599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d9b8d11-53c8-40ed-a6b4-3b337379dabe tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-678239630"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:30.197986 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:30.197986 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:30.202835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-2d9b8d11-53c8-40ed-a6b4-3b337379dabe tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid 6c6a088c-1264-43c7-86b8-55ab286bc5d3 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:30.238284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a575fb7-02f1-4fea-907e-f9b91c922907 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Calling method '.version_select at 0x7f3f87fed700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:30.258713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d9b8d11-53c8-40ed-a6b4-3b337379dabe tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075264 Nov 20 20:46:30.261454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 113/194] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:30 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:30.276138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-188762371", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:30.333114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a575fb7-02f1-4fea-907e-f9b91c922907 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.289422 Nov 20 20:46:30.342164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 82/195] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:46:30 2021] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:46:30.349298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ad07e4c-2e24-4693-bfa0-b8af7429df23 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:30.353120 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:30.353120 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:30.362706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:30.384215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad07e4c-2e24-4693-bfa0-b8af7429df23 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.384819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad07e4c-2e24-4693-bfa0-b8af7429df23 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.533519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ad07e4c-2e24-4693-bfa0-b8af7429df23 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.198312 Nov 20 20:46:30.534847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 83/196] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:46:30 2021] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:30.547156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d37ce357-7426-4b67-985d-8ace5755d823 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Action: 'create', calling method: .version_select at 0x7f3f87f39790>, body: {"pool": "non_exist_pool"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:30.596725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-d37ce357-7426-4b67-985d-8ace5755d823 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] HTTP exception thrown: Floating IP pool not found. Nov 20 20:46:30.597507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d37ce357-7426-4b67-985d-8ace5755d823 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Returning 404 to user: Floating IP pool not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:30.598490 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d37ce357-7426-4b67-985d-8ace5755d823 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.055660 Nov 20 20:46:30.599226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 84/197] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:46:30 2021] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:30.605305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:30.607092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:30.632544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.634175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.635431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.636052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.638497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:30.638922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:30.639388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:30.639790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:30.640363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:30.650378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.650995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.651958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.652614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.683932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Getting quotas for project 5bb3936f93d04a32a65cf0e613991002. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:30.692915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Getting quotas for user 116d6eee94c64ac092e2442f0e2f1ddc and project 5bb3936f93d04a32a65cf0e613991002. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:30.729699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:30.732408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:30.827270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37273773-9daa-4a97-bd9d-41c6d535d7a0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563716 Nov 20 20:46:30.828522 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 114/198] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:46:30.833082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dbf1c96f-bf4d-46d3-8f08-8d6b14711baa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:30.834113 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:30.834113 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:30.843667 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dbf1c96f-bf4d-46d3-8f08-8d6b14711baa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.013878 Nov 20 20:46:30.844810 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 115/199] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:46:30 2021] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:30.849343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e177aaf8-3101-41ba-9623-03884d107dd0 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Calling method '.version_select at 0x7f3f877608b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:30.885420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:30.893020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9732a9fe-7e17-49c2-b183-59914c84d265 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.292630 Nov 20 20:46:30.897065 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 85/200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:30 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:30.910735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:30.911880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:30.925809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.926631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.927346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:30.927800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:30.999598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-e177aaf8-3101-41ba-9623-03884d107dd0 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 706474b7-0f93-472f-9e69-df3bf9d25d4c could not be found", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:46:31.000303 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e177aaf8-3101-41ba-9623-03884d107dd0 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] HTTP exception thrown: Floating IP not found for ID 706474b7-0f93-472f-9e69-df3bf9d25d4c Nov 20 20:46:31.000903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e177aaf8-3101-41ba-9623-03884d107dd0 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] Returning 404 to user: Floating IP not found for ID 706474b7-0f93-472f-9e69-df3bf9d25d4c {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:31.001725 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e177aaf8-3101-41ba-9623-03884d107dd0 tempest-FloatingIPsNegativeTestJSON-636539019 tempest-FloatingIPsNegativeTestJSON-636539019-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/706474b7-0f93-472f-9e69-df3bf9d25d4c" status: 404 len: 111 microversion: 2.1 time: 0.155771 Nov 20 20:46:31.006468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 116/201] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:46:30 2021] DELETE /compute/v2.1/os-floating-ips/706474b7-0f93-472f-9e69-df3bf9d25d4c => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:31.014591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-968b4a25-278d-49c0-95a3-b7e82495df72 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:31.020412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-968b4a25-278d-49c0-95a3-b7e82495df72 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:31.110243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-968b4a25-278d-49c0-95a3-b7e82495df72 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:31.119282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-968b4a25-278d-49c0-95a3-b7e82495df72 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1219 microversion: 2.1 time: 0.115586 Nov 20 20:46:31.120996 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 117/202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:31 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:31.126321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4df4c8a0-a99e-468c-b6f3-e18e6c5ea5aa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:31.128692 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.128692 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:31.137812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4df4c8a0-a99e-468c-b6f3-e18e6c5ea5aa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:31.138650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4df4c8a0-a99e-468c-b6f3-e18e6c5ea5aa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:31.267962 ncdv-master-1 devstack@n-api.service[140942]: WARNING nova.scheduler.client.report [None req-4df4c8a0-a99e-468c-b6f3-e18e6c5ea5aa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] [req-824809f1-679f-4692-a40a-1ea0463c1016] Failed to update aggregates to [] for resource provider with UUID a490f3b4-f2e6-40eb-9b06-915a91dab840. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-824809f1-679f-4692-a40a-1ea0463c1016"}]} Nov 20 20:46:31.412200 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4df4c8a0-a99e-468c-b6f3-e18e6c5ea5aa tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.288844 Nov 20 20:46:31.416859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 118/203] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:46:31 2021] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:31.424830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3068fc5c-4ea0-4386-a7a2-0afafa5b990a tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:31.427123 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.427123 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:31.457753 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3068fc5c-4ea0-4386-a7a2-0afafa5b990a tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.036572 Nov 20 20:46:31.459340 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 119/204] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:31 2021] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 20 20:46:31.471444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdca3fa0-50b4-4a03-beb7-5175de830843 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1118582694"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:31.473271 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.473271 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:31.475120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-cdca3fa0-50b4-4a03-beb7-5175de830843 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid d678dfb9-eceb-490e-bced-1263dc76101e for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:31.527284 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdca3fa0-50b4-4a03-beb7-5175de830843 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061018 Nov 20 20:46:31.532044 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 120/205] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:31 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:31.546539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb2d6280-e953-4e59-9d26-626954c3d5bc tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:31.549087 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.549087 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:31.563236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb2d6280-e953-4e59-9d26-626954c3d5bc tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:31.563866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb2d6280-e953-4e59-9d26-626954c3d5bc tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:31.584259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:31.593260 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dafad33c-0666-426d-bc93-3c8dfbc6d703 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1319 microversion: 2.1 time: 0.694975 Nov 20 20:46:31.607102 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 86/206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:30 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1319 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:31.766773 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb2d6280-e953-4e59-9d26-626954c3d5bc tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.229635 Nov 20 20:46:31.772510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 121/207] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:46:31 2021] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:31.778325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32184192-ed83-4bbe-8c80-52c39bd896c9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:31.779677 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.779677 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:31.806776 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32184192-ed83-4bbe-8c80-52c39bd896c9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.030077 Nov 20 20:46:31.807616 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 87/208] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:46:31 2021] GET /compute/v2.1/os-aggregates => generated 245 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:31.818109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85a9d97e-1f0f-428c-b0ce-26cc11f4b749 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:31.819588 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:31.819588 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:31.836616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a9d97e-1f0f-428c-b0ce-26cc11f4b749 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:31.838281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a9d97e-1f0f-428c-b0ce-26cc11f4b749 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:31.915023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:31.915742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:31.930709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:31.932434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:31.935078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:31.937952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.024749 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85a9d97e-1f0f-428c-b0ce-26cc11f4b749 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.207901 Nov 20 20:46:32.026849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 122/209] 10.222.0.41 () {60 vars in 1190 bytes} [Sat Nov 20 20:46:31 2021] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:32.047376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-258338a5-296e-432c-a4c5-0a43c2076dfd req-f1ce9c25-e3af-41d2-8938-3e4002aeb4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "name": "network-vif-plugged", "status": "completed", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:32.048828 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.048828 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.061666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-258338a5-296e-432c-a4c5-0a43c2076dfd req-f1ce9c25-e3af-41d2-8938-3e4002aeb4a5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.063263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-258338a5-296e-432c-a4c5-0a43c2076dfd req-f1ce9c25-e3af-41d2-8938-3e4002aeb4a5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.087005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-258338a5-296e-432c-a4c5-0a43c2076dfd req-f1ce9c25-e3af-41d2-8938-3e4002aeb4a5 service nova] Creating event network-vif-plugged:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch1-master-1 Nov 20 20:46:32.115660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-258338a5-296e-432c-a4c5-0a43c2076dfd req-f1ce9c25-e3af-41d2-8938-3e4002aeb4a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076761 Nov 20 20:46:32.119239 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 123/210] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:32.139346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33c3a4c2-1473-425c-aa74-2601c0d21a94 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:32.139836 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.139836 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.202334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33c3a4c2-1473-425c-aa74-2601c0d21a94 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.078133 Nov 20 20:46:32.205710 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 124/211] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:32 2021] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:32.217182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:32.220303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:32.236852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.239158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.244066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.244667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.373458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:32.389235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2806860f-048d-4e6d-bedd-8ed1f6af8cec tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1271 microversion: 2.1 time: 0.182142 Nov 20 20:46:32.390152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 125/212] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:32 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:32.402902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df780f4e-4288-4c6d-9233-819d4ff4ac58 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-299600844"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:32.404445 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.404445 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.405886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-df780f4e-4288-4c6d-9233-819d4ff4ac58 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid ada402c2-b764-4231-bbb3-9266cd746e9f for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:32.446876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df780f4e-4288-4c6d-9233-819d4ff4ac58 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.055295 Nov 20 20:46:32.448500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 126/213] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:32 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:32.458928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0afba224-a9ca-4b8e-b396-61dc7f2cfe0c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:32.461523 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.461523 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.481183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0afba224-a9ca-4b8e-b396-61dc7f2cfe0c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.484681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0afba224-a9ca-4b8e-b396-61dc7f2cfe0c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.485464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:32.500882 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac40ca9b-e41c-4bc7-b5a1-0cec4098c489 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.590358 Nov 20 20:46:32.502769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 88/214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:31 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:32.618750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:32.619659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:32.628795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.629414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.630475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.631618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.658573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0afba224-a9ca-4b8e-b396-61dc7f2cfe0c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.203966 Nov 20 20:46:32.659789 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 127/215] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:32 2021] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:32.676427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-387845dd-ac55-4dc4-af24-0ae676576ef3 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:32.681943 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.681943 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.717698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-387845dd-ac55-4dc4-af24-0ae676576ef3 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:32.718457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-387845dd-ac55-4dc4-af24-0ae676576ef3 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:32.893990 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-387845dd-ac55-4dc4-af24-0ae676576ef3 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.227659 Nov 20 20:46:32.903070 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 128/216] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:32 2021] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:46:32.920805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0be3875-49f0-462d-b3cc-8287081ddc97 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:32.921875 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.921875 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.950179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0be3875-49f0-462d-b3cc-8287081ddc97 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044927 Nov 20 20:46:32.951637 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 129/217] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:32 2021] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:32.969532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80c450eb-378c-4076-94a0-766a1d0e848a tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1796444411"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:32.972771 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:32.972771 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:32.975781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-80c450eb-378c-4076-94a0-766a1d0e848a tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid 4ea303db-1267-47b5-92e2-c6edb578268a for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:33.005847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80c450eb-378c-4076-94a0-766a1d0e848a tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.043325 Nov 20 20:46:33.012489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 130/218] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:32 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:33.026690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-beac4834-65a2-438b-b36f-61d660807ed0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1821567985"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:33.030946 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.030946 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.032527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-beac4834-65a2-438b-b36f-61d660807ed0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 5b3344a9-95e1-4a4c-8cc5-9f113b08caab for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:33.071977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-beac4834-65a2-438b-b36f-61d660807ed0 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062532 Nov 20 20:46:33.080027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 131/219] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:33 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:33.094622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-063a84eb-f35a-4038-b1a1-51c8940e32a2 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:33.095593 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.095593 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.149385 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-063a84eb-f35a-4038-b1a1-51c8940e32a2 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.071368 Nov 20 20:46:33.149952 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 132/220] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:33 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:33.156132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce2ee3a8-99b7-4414-9235-93602acfe942 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:33.161735 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.161735 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.187134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce2ee3a8-99b7-4414-9235-93602acfe942 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.188286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce2ee3a8-99b7-4414-9235-93602acfe942 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.303835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:33.318727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fd1f572-f2b0-4349-8202-45554f1d8e0d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1469 microversion: 2.1 time: 0.704837 Nov 20 20:46:33.333819 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 89/221] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:32 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1469 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:33.342632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-184b5b2d-87cb-4b67-8877-17979caa6a17 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:33.358003 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.358003 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:33.370018 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-184b5b2d-87cb-4b67-8877-17979caa6a17 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Nov 20 20:46:33.372241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-184b5b2d-87cb-4b67-8877-17979caa6a17 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:33.374595 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-184b5b2d-87cb-4b67-8877-17979caa6a17 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.038175 Nov 20 20:46:33.375405 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 90/222] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:33 2021] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:33.405159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce2ee3a8-99b7-4414-9235-93602acfe942 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.253286 Nov 20 20:46:33.405780 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 133/223] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:33 2021] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:33.419971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e21821a-ebaf-47f4-aebc-08f6e8aaac84 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:33.420739 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.420739 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.452368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7e21821a-ebaf-47f4-aebc-08f6e8aaac84 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Nov 20 20:46:33.455906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e21821a-ebaf-47f4-aebc-08f6e8aaac84 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:33.458608 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e21821a-ebaf-47f4-aebc-08f6e8aaac84 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.049444 Nov 20 20:46:33.462521 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 134/224] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:33 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:33.478229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:33.479789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:33.498755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.500681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.504218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.506868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.655541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:33.666889 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-def33c43-f7ad-4e2a-a5b8-2b3ceb8d90d9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1277 microversion: 2.1 time: 0.202163 Nov 20 20:46:33.670346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 135/225] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:33 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:33.674841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a3172bd-b362-423c-90b2-6326f03e6409 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:33.676055 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.676055 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.676962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5a3172bd-b362-423c-90b2-6326f03e6409 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '65e644a7656042d98e721d1b4cb2d4a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e558e25f517a4cf7873a4089fac75343', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:33.677598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a3172bd-b362-423c-90b2-6326f03e6409 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:33.678584 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a3172bd-b362-423c-90b2-6326f03e6409 tempest-AggregatesAdminNegativeTestJSON-838249496 tempest-AggregatesAdminNegativeTestJSON-838249496-project] 10.222.0.41 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.007088 Nov 20 20:46:33.682657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 136/226] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:33 2021] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:33.726371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e40d027-35d6-400f-9135-6d31a082f30c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1532269439", "name": "tempest-test_aggregate-1846797195"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:33.739528 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:33.739528 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:33.746499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-2e40d027-35d6-400f-9135-6d31a082f30c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid bcb8740e-9df0-4a09-8753-5ec3eabb44c9 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:33.821606 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e40d027-35d6-400f-9135-6d31a082f30c tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.100400 Nov 20 20:46:33.824400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 137/227] 10.222.0.41 () {60 vars in 1164 bytes} [Sat Nov 20 20:46:33 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:33.840165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:33.844512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:33.861822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.864164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.867139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.868413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.947729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1408737948", "block_migration": true, "disk_over_commit": false}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:33.950858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:33.969281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.972299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:33.973536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:33.974523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:34.245858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:34.254395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7441471b-b9ba-4540-87b6-536c83492f2d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1312 microversion: 2.1 time: 0.428896 Nov 20 20:46:34.264911 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 138/228] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:33 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:34.278507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1498f91-0168-4d8e-ab14-6af4816ecee4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:34.281796 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.281796 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.295374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1498f91-0168-4d8e-ab14-6af4816ecee4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:34.297516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1498f91-0168-4d8e-ab14-6af4816ecee4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:34.489163 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1498f91-0168-4d8e-ab14-6af4816ecee4 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.229303 Nov 20 20:46:34.489926 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 139/229] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:34 2021] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:34.531028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a6fd22f-23d5-4106-8611-b8d799b662f6 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:34.532779 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.532779 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.577702 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a6fd22f-23d5-4106-8611-b8d799b662f6 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.073519 Nov 20 20:46:34.579385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 140/230] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:34 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:34.584886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-420b61ee-b47a-4f0e-8a22-88f57c1b6eb9 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:34.589542 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.589542 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.621690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-420b61ee-b47a-4f0e-8a22-88f57c1b6eb9 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.040882 Nov 20 20:46:34.622683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 141/231] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:34 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:34.630108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c72f2dee-731e-42f0-b6ed-825426688685 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:34.631210 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.631210 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.647463 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c72f2dee-731e-42f0-b6ed-825426688685 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 20 20:46:34.654437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c72f2dee-731e-42f0-b6ed-825426688685 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:34.655586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c72f2dee-731e-42f0-b6ed-825426688685 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.031312 Nov 20 20:46:34.656849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 142/232] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:34 2021] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:34.661441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2fa14ed0-1ad1-46ff-8831-8571e3cb340b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-74154980"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:34.665373 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.665373 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.670776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-2fa14ed0-1ad1-46ff-8831-8571e3cb340b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Generated uuid 84005e78-bb8a-4ed4-8e23-1597f93938a7 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:34.718337 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2fa14ed0-1ad1-46ff-8831-8571e3cb340b tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.060256 Nov 20 20:46:34.719870 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 143/233] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:34 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:34.736718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58cdee8d-85ce-4ddb-bf31-c84bf7c42a33 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:34.739401 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:34.739401 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:34.759782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-58cdee8d-85ce-4ddb-bf31-c84bf7c42a33 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Nov 20 20:46:34.760552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58cdee8d-85ce-4ddb-bf31-c84bf7c42a33 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:34.761873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58cdee8d-85ce-4ddb-bf31-c84bf7c42a33 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.040464 Nov 20 20:46:34.763389 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 144/234] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:34 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:34.772156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:34.772958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:34.788690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:34.790488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:34.791709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:34.793178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.108075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:35.113007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lazy-loading 'flavor' on Instance uuid ae71d012-3101-45ff-8cfa-86095500e364 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:46:35.117430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ba95457-92ee-462b-9f72-98d37e97670a tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 0.352695 Nov 20 20:46:35.118351 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 145/235] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:34 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:35.122833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:35.124278 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:35.124278 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:35.133509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.133963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.151014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.151530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.186791 ncdv-master-1 devstack@n-api.service[140942]: ERROR nova.api.openstack.compute.aggregates [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 20 20:46:35.188229 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Nov 20 20:46:35.188505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:35.191539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95f22c9a-6233-4b07-98f9-18bc741e8fd2 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.072117 Nov 20 20:46:35.195263 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 146/236] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:35 2021] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:46:35.216148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4fea7d1-5840-4e58-ad6d-d4c63d057f67 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1206013856"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:35.224317 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:35.224317 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:35.229933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-b4fea7d1-5840-4e58-ad6d-d4c63d057f67 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid 02151c4b-00b5-4558-b781-8f8dad1ce9b5 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:35.235997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Going to try to live migrate instance to tempest-host-1408737948 {{(pid=140941) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:46:35.257423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] HTTP exception thrown: Compute host tempest-host-1408737948 could not be found. Nov 20 20:46:35.258792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Returning 400 to user: Compute host tempest-host-1408737948 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:35.260038 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-403473a5-b5e0-4df4-b9d3-4f1142bd08fc tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364/action" status: 400 len: 100 microversion: 2.1 time: 1.883187 Nov 20 20:46:35.269756 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 91/237] 10.222.0.41 () {60 vars in 1278 bytes} [Sat Nov 20 20:46:33 2021] POST /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364/action => generated 100 bytes in 1893 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:46:35.285972 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b4fea7d1-5840-4e58-ad6d-d4c63d057f67 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.092741 Nov 20 20:46:35.295156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8649ce13-b73a-407a-8268-26dd28a12165 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:35.296267 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:35.296267 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:35.301125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 147/238] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:35 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:35.313345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:35.314477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:35.325006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.325751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.327454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.330684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.368568 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8649ce13-b73a-407a-8268-26dd28a12165 tempest-AggregatesAdminNegativeTestJSON-1194447159 tempest-AggregatesAdminNegativeTestJSON-1194447159-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.096966 Nov 20 20:46:35.369167 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 92/239] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:35 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:35.380584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:35.381255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:35.410284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.411007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.411967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:35.412564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:35.813886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:35.825080 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-457659f1-44b7-48de-b684-8c45d336632e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1462 microversion: 2.1 time: 0.517803 Nov 20 20:46:35.825684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 148/240] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:35 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1462 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:35.835468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6300a06-858d-4dcd-83bf-f90496dfedf9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:35.836308 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:35.836308 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:35.847182 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6300a06-858d-4dcd-83bf-f90496dfedf9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.019450 Nov 20 20:46:35.854665 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 149/241] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:35 2021] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:35.987026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:35.997127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b70d063c-b34f-47f6-83d6-aa7919755760 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1469 microversion: 2.1 time: 0.626487 Nov 20 20:46:36.017051 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 93/242] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:35 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1469 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:36.036481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5be59b11-8ef0-4e81-aa65-06760247e0dd tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:36.041066 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:36.041066 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:36.093955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5be59b11-8ef0-4e81-aa65-06760247e0dd tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.071863 Nov 20 20:46:36.094988 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 94/243] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:46:36 2021] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:36.106276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1992aaee-c958-44c4-aeb9-33018116ed7f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:36.108408 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:36.108408 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:36.120058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1992aaee-c958-44c4-aeb9-33018116ed7f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.018433 Nov 20 20:46:36.122433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 95/244] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:46:36 2021] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:36.149262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd1902ff-21c6-485d-9c5d-27a1a27651be tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:36.151153 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:36.151153 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:36.198841 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd1902ff-21c6-485d-9c5d-27a1a27651be tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.068002 Nov 20 20:46:36.199437 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 96/245] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:36 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:36.208215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:36.208996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:36.217668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:36.218625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:36.220387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:36.221035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:36.288377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:36.289750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:36.298811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:36.299547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:36.302402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:36.303018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:36.979936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:36.989176 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd01a044-14ae-41aa-98c3-ad63b8b1d433 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1613 microversion: 2.1 time: 1.132120 Nov 20 20:46:37.000749 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 150/246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:35 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1613 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:37.007335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9557200f-ff91-40f1-a484-7757602b325d tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-566103472", "availability_zone": "tempest-test_az-204448467"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:37.009455 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:37.009455 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:37.011120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-9557200f-ff91-40f1-a484-7757602b325d tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid f735d309-d2c1-4f0a-b70e-61c6578a7926 for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:37.017093 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5538cda-f41c-4659-9724-2b56ec501abd tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 0.816527 Nov 20 20:46:37.023741 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 97/247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:36 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:37.037302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-364031059", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:37.072625 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9557200f-ff91-40f1-a484-7757602b325d tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.070205 Nov 20 20:46:37.073828 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 151/248] 10.222.0.41 () {60 vars in 1164 bytes} [Sat Nov 20 20:46:37 2021] POST /compute/v2.1/os-aggregates => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:37.085634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:37.087226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:37.104566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:37.105033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:37.106445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:37.106891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:37.143808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:37.680534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6b1444538c3e4667a01dce32e9b5e7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db732c19328144888d5f96699272f261', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:37.681415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] flavor_id is None. Assuming migration. {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 20 20:46:37.682515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 20:46:37.911456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:37.912357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:37.913071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:37.913659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:37.914342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:37.926932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:37.927750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:37.928764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:37.930102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:37.955157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Getting quotas for project 89da80dbcf5948268735e51c28e4bf40. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:37.962351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Getting quotas for user 9cf38bd3867945fb9726405aad6e61c2 and project 89da80dbcf5948268735e51c28e4bf40. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:38.001122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:38.006440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:38.121985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ba4a130-bec8-47a2-be2b-29ce1106764e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092411 Nov 20 20:46:38.125223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 98/249] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:46:38.136346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c1601aa-9c02-4d80-9904-09f8d0b77802 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-566103472_new", "availability_zone": "tempest-test_az-204448467_new"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:38.283073 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:38.283073 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:38.352012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1601aa-9c02-4d80-9904-09f8d0b77802 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:38.352455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1601aa-9c02-4d80-9904-09f8d0b77802 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:38.462359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c1601aa-9c02-4d80-9904-09f8d0b77802 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 334 microversion: 2.1 time: 0.335608 Nov 20 20:46:38.469005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 99/250] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 20:46:38 2021] PUT /compute/v2.1/os-aggregates/16 => generated 334 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:38.474030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-324ce2fe-2884-438c-a458-582f2fb9a635 req-47f09fc1-52a3-4e24-802a-c2814d5f13af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308b5cdb-b513-47fa-9696-3a05d6c27027", "tag": "2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:38.480570 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:38.480570 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:38.672280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-caca4826-504f-47d7-be38-d710eb3f4448 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448/action" status: 202 len: 0 microversion: 2.1 time: 1.593024 Nov 20 20:46:38.673746 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 152/251] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:46:37 2021] POST /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448/action => generated 0 bytes in 1599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:38.701804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:38.702624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:38.715861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:38.716680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:38.722846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:38.723986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:38.832703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-324ce2fe-2884-438c-a458-582f2fb9a635 req-47f09fc1-52a3-4e24-802a-c2814d5f13af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:38.833522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-324ce2fe-2884-438c-a458-582f2fb9a635 req-47f09fc1-52a3-4e24-802a-c2814d5f13af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:38.856960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-324ce2fe-2884-438c-a458-582f2fb9a635 req-47f09fc1-52a3-4e24-802a-c2814d5f13af service nova] Creating event network-changed:2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c for instance 308b5cdb-b513-47fa-9696-3a05d6c27027 on nch2-master-1 Nov 20 20:46:38.862633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-324ce2fe-2884-438c-a458-582f2fb9a635 req-47f09fc1-52a3-4e24-802a-c2814d5f13af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.392152 Nov 20 20:46:38.864491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 100/252] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:38.882390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0051f71-1965-4f02-8528-f9ae26d83212 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:38.884053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0051f71-1965-4f02-8528-f9ae26d83212 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:39.153285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0051f71-1965-4f02-8528-f9ae26d83212 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:39.162922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0051f71-1965-4f02-8528-f9ae26d83212 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1218 microversion: 2.1 time: 0.296680 Nov 20 20:46:39.165388 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 101/253] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:38 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:39.170663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f8a0cb9-dfe6-4047-a8b8-fcccbab6210b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:39.182278 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:39.182278 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:39.205683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f8a0cb9-dfe6-4047-a8b8-fcccbab6210b tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.038736 Nov 20 20:46:39.215957 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 102/254] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:46:39 2021] GET /compute/v2.1/os-aggregates => generated 337 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:39.234981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:39.243732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:39.281120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:39.281570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:39.294334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:39.305533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:39.653768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:39.661201 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6560a52-60e4-47e2-abf7-2d7ba1d9a4a8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1471 microversion: 2.1 time: 0.442642 Nov 20 20:46:39.661678 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 103/255] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:39 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:39.822713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:39.834695 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2371fed4-3619-450d-8d18-6fa898b017c0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 1.157642 Nov 20 20:46:39.840809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 153/256] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:38 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:39.884975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07f863f2-6651-41f0-a25a-dfd39213d6c7 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:39.887853 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:39.887853 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:39.953281 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07f863f2-6651-41f0-a25a-dfd39213d6c7 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.086615 Nov 20 20:46:39.955561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 154/257] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:39 2021] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:39.971616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d9d40da-33a4-4f29-8a93-d4e44ae726a9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-837279944"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:39.972991 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:39.972991 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:39.974229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-1d9d40da-33a4-4f29-8a93-d4e44ae726a9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Generated uuid eddaa7ae-d673-4658-b7c2-30fbd815b2be for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:40.076975 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d9d40da-33a4-4f29-8a93-d4e44ae726a9 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.115304 Nov 20 20:46:40.086412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 155/258] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 20:46:39 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:40.099126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aee705f4-5d5d-4646-8e45-11a5a09ca5e5 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:40.106430 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:40.106430 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:40.126824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aee705f4-5d5d-4646-8e45-11a5a09ca5e5 tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.039166 Nov 20 20:46:40.134010 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 156/259] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:46:40 2021] GET /compute/v2.1/os-aggregates => generated 230 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:40.144755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c65fbfe1-8305-4533-b575-8b5369d6618f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:40.146734 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:40.146734 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:40.192153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c65fbfe1-8305-4533-b575-8b5369d6618f tempest-AggregatesAdminTestJSON-1339146968 tempest-AggregatesAdminTestJSON-1339146968-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.054353 Nov 20 20:46:40.193974 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 157/260] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:40 2021] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:46:40.204525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:40.207075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:40.208454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-824627049", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "6c75a303-6203-42d9-b558-9a8c1c2891e4"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:40.220038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:40.224021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:40.227413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:40.228333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:40.396958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] validate_networks() for [('6c75a303-6203-42d9-b558-9a8c1c2891e4', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:46:40.542032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:40.565005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f993eb5-c65e-4a94-8864-4897a5b84726 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1288 microversion: 2.1 time: 0.361773 Nov 20 20:46:40.565679 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 158/261] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:40 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1288 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:40.582641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:40.583429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:40.598721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:40.601020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:40.609986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:40.621562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:40.690441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:46:40.971107 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2dbeb315-cb7e-4001-b0fd-cf1b15173aea tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "DELETE /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 204 len: 0 microversion: 2.1 time: 0.400943 Nov 20 20:46:40.973839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 159/262] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:40 2021] DELETE /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:46:40.981609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:40.986819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:41.001631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:41.003659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:41.006350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:41.009392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.103873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:46:42.104862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:46:42.105559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:46:42.106270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:46:42.106842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:46:42.125321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.125768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.126611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.127047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.162562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:42.172473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50d8bbc8-12fb-4a4b-9c8b-1630aafbd56b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1471 microversion: 2.1 time: 1.197242 Nov 20 20:46:42.173051 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 160/263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:40 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1471 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:42.176246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Getting quotas for project eb059314b462499a8d78e0e350d5de4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:46:42.185451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:42.186349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:42.194221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Getting quotas for user 9d9cc64fc72543b4b0abbaba637eeb3e and project eb059314b462499a8d78e0e350d5de4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:46:42.198654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.199112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.199909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.200346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.215936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:46:42.219022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:46:42.310970 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-001c7bab-b523-4866-8343-097cb4e4de02 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.648185 Nov 20 20:46:42.311887 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 104/264] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:46:42.325157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:42.328054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:42.343654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.344343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.345312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:42.345904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:42.936753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:42.947437 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-339b2414-e429-44ab-b364-c074e8663ab9 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1472 microversion: 2.1 time: 0.634312 Nov 20 20:46:42.954620 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 105/265] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:42 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1472 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:42.972191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:42.972832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:43.004104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.004999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.006791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.007411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.239792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:43.257597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3dd31969-ea88-4670-8277-7276b8afd9c1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 1.073548 Nov 20 20:46:43.261386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 161/266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:42 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:43.269094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:43.274971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:43.282302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.283088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.284809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.285439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.423458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:43.439982 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72f4e6d4-4c9a-4ac2-a4f3-3eee03ca9e55 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1269 microversion: 2.1 time: 0.176888 Nov 20 20:46:43.440830 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 162/267] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:43 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:43.534563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:43.543274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28914caa-353f-4c0f-89bf-0d176d750da4 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.586513 Nov 20 20:46:43.556879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 106/268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:42 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:43.570781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:43.571581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:43.579765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.582594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.583529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:43.586621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:43.874511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5139c385-70aa-4e09-a1b6-309664100cfc tempest-AZAdminNegativeTestJSON-812760247 tempest-AZAdminNegativeTestJSON-812760247-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:43.877906 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:43.877906 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:43.883898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5139c385-70aa-4e09-a1b6-309664100cfc tempest-AZAdminNegativeTestJSON-812760247 tempest-AZAdminNegativeTestJSON-812760247-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '333c46204625499f9f2c72b2f43d3347', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0fad5fc1794849b2f1bcd7a055cd04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:43.887461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5139c385-70aa-4e09-a1b6-309664100cfc tempest-AZAdminNegativeTestJSON-812760247 tempest-AZAdminNegativeTestJSON-812760247-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:43.888416 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5139c385-70aa-4e09-a1b6-309664100cfc tempest-AZAdminNegativeTestJSON-812760247 tempest-AZAdminNegativeTestJSON-812760247-project] 10.222.0.41 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.445493 Nov 20 20:46:43.894976 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 163/269] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:46:43 2021] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 453 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:43.973699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:43.974302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:43.992569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:44.000917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:44.002015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:44.002638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:44.436977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:44.445363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-378d405b-eb3b-4314-bd4b-8f4875e214f7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1471 microversion: 2.1 time: 0.886768 Nov 20 20:46:44.446133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 107/270] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:43 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1471 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:44.463524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:44.464372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:44.479879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:44.480325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:44.481121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:44.481555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:44.932810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25669ff1f3d14669bb562da4fe5c2b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df395a6120384dca8ab8bfc43a137ac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:44.944292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:44.952629 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51906c1f-9118-4fe1-b8ff-4fc1c7753aeb tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 0.505463 Nov 20 20:46:44.957097 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 108/271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:44 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:44.966662 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af93f4ba-842e-40f6-a391-aa55ab6888f3 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 200 len: 1472 microversion: 2.1 time: 0.986440 Nov 20 20:46:44.967327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 164/272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:43 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 1472 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:44.986025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:44.986765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:44.990519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:44.994325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:45.014692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.015141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.015953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.016394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.024966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.025421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.030155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.030833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.500782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:45.509784 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6dd90fd4-1539-4985-aff4-211aeda7c44a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1275 microversion: 2.1 time: 0.545738 Nov 20 20:46:45.510413 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 109/273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:44 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1275 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:45.549447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-77b5d45b-80f0-4998-83f7-e6c489dc264d req-b0a33cbb-216c-47fd-a3fd-7dd647cfac63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145af1b9-33db-4aeb-a248-55ab57de8146", "name": "network-vif-deleted", "tag": "862ee470-d6ef-4357-a9c1-0a08b9523fc7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:45.555876 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:45.555876 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:45.577789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-77b5d45b-80f0-4998-83f7-e6c489dc264d req-b0a33cbb-216c-47fd-a3fd-7dd647cfac63 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.578275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-77b5d45b-80f0-4998-83f7-e6c489dc264d req-b0a33cbb-216c-47fd-a3fd-7dd647cfac63 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.605496 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-77b5d45b-80f0-4998-83f7-e6c489dc264d req-b0a33cbb-216c-47fd-a3fd-7dd647cfac63 service nova] Creating event network-vif-deleted:862ee470-d6ef-4357-a9c1-0a08b9523fc7 for instance 145af1b9-33db-4aeb-a248-55ab57de8146 on nch2-master-1 Nov 20 20:46:45.618613 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-77b5d45b-80f0-4998-83f7-e6c489dc264d req-b0a33cbb-216c-47fd-a3fd-7dd647cfac63 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074743 Nov 20 20:46:45.619219 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 110/274] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:45.624293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:45.625264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:45.631775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.632532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.633578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.634281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.913302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:45.924508 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74c579ee-c4d0-43d1-8911-6c6f6dbf5f86 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.949491 Nov 20 20:46:45.925720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 165/275] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:44 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:45.931289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2052eb1c-9eca-4111-8034-5ead8cd3f1a8 req-cb993297-fb55-42f6-959d-912bac2584e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308b5cdb-b513-47fa-9696-3a05d6c27027", "name": "network-vif-plugged", "status": "completed", "tag": "2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:45.933125 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:45.933125 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:45.946248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2052eb1c-9eca-4111-8034-5ead8cd3f1a8 req-cb993297-fb55-42f6-959d-912bac2584e2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:45.947035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2052eb1c-9eca-4111-8034-5ead8cd3f1a8 req-cb993297-fb55-42f6-959d-912bac2584e2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:45.961911 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2052eb1c-9eca-4111-8034-5ead8cd3f1a8 req-cb993297-fb55-42f6-959d-912bac2584e2 service nova] Creating event network-vif-plugged:2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c for instance 308b5cdb-b513-47fa-9696-3a05d6c27027 on nch2-master-1 Nov 20 20:46:45.973555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2052eb1c-9eca-4111-8034-5ead8cd3f1a8 req-cb993297-fb55-42f6-959d-912bac2584e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044802 Nov 20 20:46:45.974840 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 166/276] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:45.983547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:45.984611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:46.016675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.019858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.025385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.029463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.168332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:46.176804 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-855c3b38-90d5-4bae-99a9-21aa23073975 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.556108 Nov 20 20:46:46.177924 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 111/277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:45 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:46.183894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:46.184690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] [instance: 145af1b9-33db-4aeb-a248-55ab57de8146] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:46.192221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.193076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.194236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.195528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.213178 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] HTTP exception thrown: Instance 145af1b9-33db-4aeb-a248-55ab57de8146 could not be found. Nov 20 20:46:46.214118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] Returning 404 to user: Instance 145af1b9-33db-4aeb-a248-55ab57de8146 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:46.215148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e552489a-7a38-4529-8217-4c3dddbe5673 tempest-AggregatesAdminTestJSON-570804011 tempest-AggregatesAdminTestJSON-570804011-project] 10.222.0.41 "GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146" status: 404 len: 111 microversion: 2.1 time: 0.036029 Nov 20 20:46:46.224796 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 112/278] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:46 2021] GET /compute/v2.1/servers/145af1b9-33db-4aeb-a248-55ab57de8146 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:46.354850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:46.363520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82e67d80-50b5-4785-8a44-775d9485cdf9 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 0.387311 Nov 20 20:46:46.367192 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 167/279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:45 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:46.534208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:46.534889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:46.544448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.545079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.546155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.549062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.945476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:46.949415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:46.973173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.974961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:46.977847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:46.979496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.120712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:47.133456 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e888177-7cad-488e-829b-fb17431a89b4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.604330 Nov 20 20:46:47.137053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 113/280] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:46 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:47.196741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:47.198224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:47.207496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:47.209351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.210933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:47.216032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.302935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:47.311061 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62fe4994-69f4-463b-8d28-c5c3cff2861e tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.372788 Nov 20 20:46:47.330176 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 168/281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:46 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:47.385626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:47.386795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:47.405776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:47.406325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.411058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:47.412820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.745845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:47.786949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2296ba99-1635-4788-9d5b-83c0f1b86556 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1319 microversion: 2.1 time: 0.406963 Nov 20 20:46:47.787572 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 169/282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:47 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:47.825815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8b598424-17f4-4ef7-a759-017829a8121e req-b3be05d0-bfaf-42b8-b463-4f33ec2e38b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055480e4-60a2-498c-813d-86502a476e44", "tag": "783944b3-4138-4d0f-b209-7f593cf9e786"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:47.827407 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:47.827407 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:47.851401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8b598424-17f4-4ef7-a759-017829a8121e req-b3be05d0-bfaf-42b8-b463-4f33ec2e38b7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:47.853730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8b598424-17f4-4ef7-a759-017829a8121e req-b3be05d0-bfaf-42b8-b463-4f33ec2e38b7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:47.889045 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8b598424-17f4-4ef7-a759-017829a8121e req-b3be05d0-bfaf-42b8-b463-4f33ec2e38b7 service nova] Creating event network-changed:783944b3-4138-4d0f-b209-7f593cf9e786 for instance 055480e4-60a2-498c-813d-86502a476e44 on nch2-master-1 Nov 20 20:46:47.901674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8b598424-17f4-4ef7-a759-017829a8121e req-b3be05d0-bfaf-42b8-b463-4f33ec2e38b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096273 Nov 20 20:46:47.902326 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 170/283] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:48.155480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:48.156418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:48.168642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.170743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:48.171976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.172755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:48.441097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:48.450919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7197dfa-6b8b-4e8e-8c3f-cd05cfb81b75 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 1.259451 Nov 20 20:46:48.455103 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 114/284] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:47 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:48.473420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:48.477223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:48.493299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.494250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:48.495242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.498919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:48.578707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:48.587195 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ecc7f3a-2226-47df-9199-85a25cb2a4f2 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.436026 Nov 20 20:46:48.587785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 171/285] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:48 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:48.805133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:48.805750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:48.812269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.812719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:48.813727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:48.814350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.077873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:49.087072 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e6ac23d8-a265-4d14-89be-d232640d66e2 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1469 microversion: 2.1 time: 0.286218 Nov 20 20:46:49.089676 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 172/286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:48 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1469 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:46:49.109171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:49.112409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:49.136333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.136788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.137575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.138006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.357813 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5b26d9d-5633-4262-bab0-f627a1ca4395 tempest-DeleteServersAdminTestJSON-8443978 tempest-DeleteServersAdminTestJSON-8443978-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027/action" status: 202 len: 0 microversion: 2.1 time: 0.255596 Nov 20 20:46:49.360947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 173/287] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:46:49 2021] POST /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:46:49.373012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:49.373719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:49.386150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.387871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.390907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.393230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.492111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.492543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.499708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lazy-loading 'fault' on Instance uuid 308b5cdb-b513-47fa-9696-3a05d6c27027 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:46:49.721910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:49.727703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:49.734867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e39575f1-7964-42b8-be1f-b2bbd2dd1bc7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1452 microversion: 2.1 time: 0.370070 Nov 20 20:46:49.737984 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 174/288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:49 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1452 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:49.743361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-976d5a7a-9a9c-4e0c-a227-4219a4588ce0 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 1.285175 Nov 20 20:46:49.753966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:49.754628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:49.756950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 115/289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:48 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:49.766623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.772463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:49.774325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.775364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.775954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.778187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:49.791667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.793417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:49.797597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:49.799539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.174082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:50.184894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b8bd72c-f710-4052-bc2d-27f6049e6d3f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.445768 Nov 20 20:46:50.189598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 175/290] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:49 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:50.196056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:50.197633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:50.214737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.216842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.219687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.222763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.253525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:46:50.376687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5278e6c8-66c7-4aaf-8013-4f59f767edd0 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "DELETE /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 204 len: 0 microversion: 2.1 time: 0.183702 Nov 20 20:46:50.378985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 176/291] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:50 2021] DELETE /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:46:50.400327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:50.402370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:50.413104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.414853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.416077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.417655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.425003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:50.434167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c8fccaf-39dd-4eb8-8368-2cc71758ffec tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.674618 Nov 20 20:46:50.438169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 116/292] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:49 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:50.517942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.519434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.520187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lazy-loading 'fault' on Instance uuid 308b5cdb-b513-47fa-9696-3a05d6c27027 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:46:50.839148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9100ed12-e0f6-44f1-8ed0-7ead4cd6ca28 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-610822396", "id": 549294859, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:50.841698 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:50.841698 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:50.863459 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9100ed12-e0f6-44f1-8ed0-7ead4cd6ca28 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.310394 Nov 20 20:46:50.865318 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 117/293] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:50 2021] POST /compute/v2.1/flavors => generated 426 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:50.872807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1ba303e7-f76d-47ba-bf85-41eee236e8fb req-01769b87-8460-43ce-8cf4-d7f83a29ed6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa97729-64d1-4da2-9d9f-052cf676e7c9", "tag": "3d39c4e8-282d-4632-8433-fb1d3c1a36a7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:50.879495 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:50.879495 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:50.893951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1ba303e7-f76d-47ba-bf85-41eee236e8fb req-01769b87-8460-43ce-8cf4-d7f83a29ed6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.894989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1ba303e7-f76d-47ba-bf85-41eee236e8fb req-01769b87-8460-43ce-8cf4-d7f83a29ed6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.916380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1ba303e7-f76d-47ba-bf85-41eee236e8fb req-01769b87-8460-43ce-8cf4-d7f83a29ed6e service nova] Creating event network-changed:3d39c4e8-282d-4632-8433-fb1d3c1a36a7 for instance 8fa97729-64d1-4da2-9d9f-052cf676e7c9 on nch1-master-1 Nov 20 20:46:50.923933 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1ba303e7-f76d-47ba-bf85-41eee236e8fb req-01769b87-8460-43ce-8cf4-d7f83a29ed6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057113 Nov 20 20:46:50.924836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 118/294] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:50.947659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:50.951347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:50.968790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.972162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:50.979639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:50.980605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.067007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:51.078917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-819cbce5-89f5-4be5-a135-603d9f3b9e5b tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1458 microversion: 2.1 time: 0.693661 Nov 20 20:46:51.080261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 177/295] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:50 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1458 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:51.093237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95c01580-9885-4fa8-b5eb-cbf04f65a63f tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.095160 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:51.095160 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:51.135101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95c01580-9885-4fa8-b5eb-cbf04f65a63f tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/549294859" status: 202 len: 0 microversion: 2.1 time: 0.053500 Nov 20 20:46:51.139285 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 178/296] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:46:51 2021] DELETE /compute/v2.1/flavors/549294859 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:51.144144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50207cd8-c864-456c-8954-bb80d12302b1 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.176586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50207cd8-c864-456c-8954-bb80d12302b1 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035259 Nov 20 20:46:51.190607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 179/297] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:51 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:51.196418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ae312cf-fb83-48f5-aaf1-48ba93402626 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-858679548", "id": 1387161123, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:51.198525 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:51.198525 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:51.229148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ae312cf-fb83-48f5-aaf1-48ba93402626 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.037007 Nov 20 20:46:51.236056 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 180/298] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:51 2021] POST /compute/v2.1/flavors => generated 416 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:51.241170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.242647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:51.251076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.252496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.253868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.254574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.645799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:51.659195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:51.673759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7612e1d8-ad90-4992-84d1-6e2a2b687b53 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.431861 Nov 20 20:46:51.675832 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 181/299] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:51 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:51.676236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b2ac559-f820-4316-943f-bf54f8f69a2d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.746703 Nov 20 20:46:51.677247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 119/300] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:50 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:51.690202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a8e5adb7-1b01-4465-a93b-7f91d90d06cc tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.764087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a8e5adb7-1b01-4465-a93b-7f91d90d06cc tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.084609 Nov 20 20:46:51.766598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 182/301] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:51 2021] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:51.774228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.775065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:51.793238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.794043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.795095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.795738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.917604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Calling method '.version_select at 0x7f3f967c3700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:51.918976 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:51.918976 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:51.920872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.921334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.948771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.949622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.968661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:51.969423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:51.989408 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20865ebd-496b-49d5-89a0-0208f93523bb tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.307486 Nov 20 20:46:51.993186 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 120/302] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:46:51 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:52.000167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43645f6f-12c5-49c1-b2fc-5569b363b835 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.001275 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.001275 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.023643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43645f6f-12c5-49c1-b2fc-5569b363b835 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1387161123" status: 202 len: 0 microversion: 2.1 time: 0.028496 Nov 20 20:46:52.024934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 121/303] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:46:51 2021] DELETE /compute/v2.1/flavors/1387161123 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:52.032081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71c7abb5-2623-46a1-bcc0-dc05102895b7 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-203891257"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.034904 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.034904 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.038273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.aggregate [None req-71c7abb5-2623-46a1-bcc0-dc05102895b7 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Generated uuid d4b6720c-810f-4b22-94f8-8600c7d18ad0 for aggregate {{(pid=140941) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 20:46:52.098865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71c7abb5-2623-46a1-bcc0-dc05102895b7 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.071213 Nov 20 20:46:52.099624 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 122/304] 10.222.0.41 () {62 vars in 1204 bytes} [Sat Nov 20 20:46:52 2021] POST /compute/v2.1/os-aggregates => generated 246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:52.105287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:52.119464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a558fef5-b482-4cac-ace6-cfd4ad22792f tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.130801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1c281d8-e4ca-4f30-b551-2ff7f53b0584 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.360440 Nov 20 20:46:52.142640 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 183/305] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:51 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:52.150189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.151051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:52.159182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:52.160939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:52.162811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:52.164113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:52.185607 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a558fef5-b482-4cac-ace6-cfd4ad22792f tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077744 Nov 20 20:46:52.188736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 123/306] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:52 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:52.193230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33fa7fb2-70bd-4cac-aa6d-7a56a13fb486 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-815971821"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.200385 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.200385 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.241205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:52.244923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:52.247230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lazy-loading 'fault' on Instance uuid 308b5cdb-b513-47fa-9696-3a05d6c27027 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:46:52.256871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33fa7fb2-70bd-4cac-aa6d-7a56a13fb486 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.067045 Nov 20 20:46:52.261819 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 124/307] 10.222.0.41 () {62 vars in 1212 bytes} [Sat Nov 20 20:46:52 2021] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:52.274787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9190af1-2022-42f9-91f5-98e1c46ae1d5 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-294831258", "id": 535095021, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.276416 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.276416 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.318286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9190af1-2022-42f9-91f5-98e1c46ae1d5 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.054154 Nov 20 20:46:52.320011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 125/308] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:52 2021] POST /compute/v2.1/flavors => generated 425 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:52.327017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d93d976e-ed12-4cac-ac76-4b59450fb9ff tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.327985 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.327985 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.337749 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d93d976e-ed12-4cac-ac76-4b59450fb9ff tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.016411 Nov 20 20:46:52.338917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 126/309] 10.222.0.41 () {60 vars in 1192 bytes} [Sat Nov 20 20:46:52 2021] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:52.344331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41dcf844-3ebc-4cbc-afb1-312e382ec6a3 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.345296 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.345296 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.375631 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41dcf844-3ebc-4cbc-afb1-312e382ec6a3 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/535095021" status: 202 len: 0 microversion: 2.1 time: 0.035379 Nov 20 20:46:52.377408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 127/310] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:46:52 2021] DELETE /compute/v2.1/flavors/535095021 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:52.386447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac701eb6-cd33-42bc-b585-cf677a613f0a tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.388838 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.388838 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:52.399742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac701eb6-cd33-42bc-b585-cf677a613f0a tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:52.400617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac701eb6-cd33-42bc-b585-cf677a613f0a tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:52.627710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac701eb6-cd33-42bc-b585-cf677a613f0a tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.247608 Nov 20 20:46:52.628806 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 128/311] 10.222.0.41 () {62 vars in 1234 bytes} [Sat Nov 20 20:46:52 2021] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:52.670025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '116d6eee94c64ac092e2442f0e2f1ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb3936f93d04a32a65cf0e613991002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:52.683568 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-932e37a1-ccf6-4f38-aa84-1e4ca554b5d1 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 200 len: 1458 microversion: 2.1 time: 0.539396 Nov 20 20:46:52.685472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 184/312] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:52 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 1458 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:52.695475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2c06605-508c-43d6-81ac-90d91d6fd809 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.715671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c310b8f3-dba0-4bb1-9b43-7bd0ea0bdf6c tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Action: 'create', calling method: .version_select at 0x7f3f87fc6550>, body: {"pool": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.722886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2c06605-508c-43d6-81ac-90d91d6fd809 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036020 Nov 20 20:46:52.723990 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 185/313] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:52 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:52.743098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-772b9cf6-cd22-4865-8977-ee618d9a391f tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:52.744647 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:52.744647 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:52.753677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-772b9cf6-cd22-4865-8977-ee618d9a391f tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:52.754510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-772b9cf6-cd22-4865-8977-ee618d9a391f tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:52.973947 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-772b9cf6-cd22-4865-8977-ee618d9a391f tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.237277 Nov 20 20:46:52.980093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 186/314] 10.222.0.41 () {62 vars in 1234 bytes} [Sat Nov 20 20:46:52 2021] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:46:52.996259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:52.997276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:53.008521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:53.010139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:53.011192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:53.011797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:53.862640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:53.872032 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-357dea5b-7681-4a86-8e2c-3818601a8711 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.881176 Nov 20 20:46:53.873787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 187/315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:52 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:53.887405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:53.888032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:53.910146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:53.910767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:53.912034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:53.912776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.285643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:54.307525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8d926d2-dde8-40c1-9cdf-a10be458d5b2 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.428360 Nov 20 20:46:54.309964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 188/316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:53 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:54.327775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08469cb9-19b9-4c19-b040-3f039a28fc81 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1870653829", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:54.333263 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:54.333263 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:54.369859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08469cb9-19b9-4c19-b040-3f039a28fc81 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.056980 Nov 20 20:46:54.371139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 189/317] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:54 2021] POST /compute/v2.1/flavors => generated 507 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:54.386665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-362730fa-800b-4aad-8ff6-515b71472b84 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:54.390024 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:54.390024 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:54.425317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-362730fa-800b-4aad-8ff6-515b71472b84 tempest-AggregatesAdminTestV241-2094475835 tempest-AggregatesAdminTestV241-2094475835-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.046780 Nov 20 20:46:54.426750 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 190/318] 10.222.0.41 () {60 vars in 1195 bytes} [Sat Nov 20 20:46:54 2021] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:54.450295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:54.451953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:54.472549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.472957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.475596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.478626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.796745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:54.808181 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5de8d1e5-5327-4987-a011-f51139a1a6a9 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.379460 Nov 20 20:46:54.809155 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 191/319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:54 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:54.814453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e40c28e6-100e-4f2b-9aba-4591308fe828 req-59a5ef99-f5c6-4dfa-a417-40b3a6b40210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308b5cdb-b513-47fa-9696-3a05d6c27027", "name": "network-vif-deleted", "tag": "2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:54.816273 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:54.816273 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:54.825623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e40c28e6-100e-4f2b-9aba-4591308fe828 req-59a5ef99-f5c6-4dfa-a417-40b3a6b40210 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.826463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e40c28e6-100e-4f2b-9aba-4591308fe828 req-59a5ef99-f5c6-4dfa-a417-40b3a6b40210 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.847363 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e40c28e6-100e-4f2b-9aba-4591308fe828 req-59a5ef99-f5c6-4dfa-a417-40b3a6b40210 service nova] Creating event network-vif-deleted:2d49535f-b0ab-4bc3-8a90-462f9bfa2d5c for instance 308b5cdb-b513-47fa-9696-3a05d6c27027 on nch2-master-1 Nov 20 20:46:54.857397 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e40c28e6-100e-4f2b-9aba-4591308fe828 req-59a5ef99-f5c6-4dfa-a417-40b3a6b40210 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046754 Nov 20 20:46:54.858270 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 192/320] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:54.864662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f13d8588-8d7f-4c42-b39b-f4dab5bd2608 req-b6cc870a-8d43-49a6-b1ea-05976eefbb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055480e4-60a2-498c-813d-86502a476e44", "name": "network-vif-plugged", "status": "completed", "tag": "783944b3-4138-4d0f-b209-7f593cf9e786"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:54.868741 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:54.868741 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:54.878278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f13d8588-8d7f-4c42-b39b-f4dab5bd2608 req-b6cc870a-8d43-49a6-b1ea-05976eefbb50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.879011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f13d8588-8d7f-4c42-b39b-f4dab5bd2608 req-b6cc870a-8d43-49a6-b1ea-05976eefbb50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.894542 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f13d8588-8d7f-4c42-b39b-f4dab5bd2608 req-b6cc870a-8d43-49a6-b1ea-05976eefbb50 service nova] Creating event network-vif-plugged:783944b3-4138-4d0f-b209-7f593cf9e786 for instance 055480e4-60a2-498c-813d-86502a476e44 on nch2-master-1 Nov 20 20:46:54.901609 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f13d8588-8d7f-4c42-b39b-f4dab5bd2608 req-b6cc870a-8d43-49a6-b1ea-05976eefbb50 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041271 Nov 20 20:46:54.902570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 193/321] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:54.914425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:54.915511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:54.930544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.931032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.931871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:54.933353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:54.996101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. Nov 20 20:46:54.996710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:54.997542 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e6d78c61-2871-497e-905e-ab03c8efcd0e tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 404 len: 111 microversion: 2.1 time: 0.093734 Nov 20 20:46:55.007558 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 194/322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:54 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:55.013009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-15f67f46-82a0-4a95-925c-47fc1f0caa0e tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.014002 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:55.014002 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:55.037140 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-15f67f46-82a0-4a95-925c-47fc1f0caa0e tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/d71b6834-7495-404b-8021-81041f27cdea" status: 202 len: 0 microversion: 2.1 time: 0.028195 Nov 20 20:46:55.037725 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 195/323] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:55 2021] DELETE /compute/v2.1/flavors/d71b6834-7495-404b-8021-81041f27cdea => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:55.043976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.046106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.052718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.053369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.055586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.056226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.388061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:55.399860 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b2a7372-2867-4d55-b1e8-435897104ecf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.356811 Nov 20 20:46:55.401930 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 196/324] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:55 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:55.424542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.425297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.444552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.445982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.447101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.447740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.479474 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. Nov 20 20:46:55.480374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:55.482217 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0a1f702-b08f-4cc9-bd99-b694b7e669ff tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "DELETE /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 404 len: 111 microversion: 2.1 time: 0.078630 Nov 20 20:46:55.483323 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 197/325] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:55 2021] DELETE /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:55.488038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-277df699-73bc-4a53-a403-255636807b32 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.515005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-277df699-73bc-4a53-a403-255636807b32 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030286 Nov 20 20:46:55.516217 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 198/326] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:55.528446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.534711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.544580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.545051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.545900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.549517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.733520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:55.743392 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d2243e2-6121-4475-a09f-b76437303dae tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1318 microversion: 2.1 time: 0.225745 Nov 20 20:46:55.753720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 199/327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:55 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:55.760040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.760656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 308b5cdb-b513-47fa-9696-3a05d6c27027] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.767990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.769032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.769860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.770330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.786785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. Nov 20 20:46:55.787635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 308b5cdb-b513-47fa-9696-3a05d6c27027 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:55.789317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c702402-27a1-4f38-b04e-1e1edfd940f7 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027" status: 404 len: 111 microversion: 2.1 time: 0.033574 Nov 20 20:46:55.789934 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 200/328] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:55 2021] GET /compute/v2.1/servers/308b5cdb-b513-47fa-9696-3a05d6c27027 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:55.796569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-deff219f-62ba-4952-9a26-24cfa80dd9ec tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1203274191", "id": "0c75e95d-8bb3-4645-9361-fe733099d87f", "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:55.798792 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:55.798792 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:55.823011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-deff219f-62ba-4952-9a26-24cfa80dd9ec tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.031802 Nov 20 20:46:55.824101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 201/329] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:55 2021] POST /compute/v2.1/flavors => generated 507 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:55.830788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.831622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.839690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.840401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.841510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.842191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.860342 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. Nov 20 20:46:55.860945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:55.862207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f767c78d-15cb-4434-b163-389c00727c06 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 404 len: 111 microversion: 2.1 time: 0.036212 Nov 20 20:46:55.863305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 202/330] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:55 2021] DELETE /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:55.871040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:55.872721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:55.879718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.881388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:55.882915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:55.883497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.065423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:56.074801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed5970c3-2aa7-4324-9fa7-2bb2b690fdfa tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.210238 Nov 20 20:46:56.075388 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 203/331] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:55 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:56.090274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e552df6-fd57-4969-be08-d9e24437985e tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.094016 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:56.094016 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:56.139687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e552df6-fd57-4969-be08-d9e24437985e tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/0c75e95d-8bb3-4645-9361-fe733099d87f" status: 202 len: 0 microversion: 2.1 time: 0.061095 Nov 20 20:46:56.141782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 204/332] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:46:56 2021] DELETE /compute/v2.1/flavors/0c75e95d-8bb3-4645-9361-fe733099d87f => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:56.152883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.153503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] [instance: 0b255966-253a-480e-844d-16f700830e9f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:56.162759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.163100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.164404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.164869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.198928 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] HTTP exception thrown: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. Nov 20 20:46:56.208591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] Returning 404 to user: Instance 0b255966-253a-480e-844d-16f700830e9f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:56.209442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a2d3aa1-d504-4026-9ddb-fe0ceba62b23 tempest-DeleteServersAdminTestJSON-1236847635 tempest-DeleteServersAdminTestJSON-1236847635-project] 10.222.0.41 "GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f" status: 404 len: 111 microversion: 2.1 time: 0.066355 Nov 20 20:46:56.210993 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 205/333] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/servers/0b255966-253a-480e-844d-16f700830e9f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:46:56.222507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bbfba11-7841-44c9-85c9-b9e69c90f955 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.279207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bbfba11-7841-44c9-85c9-b9e69c90f955 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067236 Nov 20 20:46:56.282551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 206/334] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:56.303502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99e2c5bb-fcfd-4722-a959-b260c2164894 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-833264092", "id": 743842412, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:56.305943 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:56.305943 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:46:56.338952 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99e2c5bb-fcfd-4722-a959-b260c2164894 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.045434 Nov 20 20:46:56.340230 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 207/335] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:56 2021] POST /compute/v2.1/flavors => generated 410 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:56.355125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86452ec4-088b-493d-a4e0-1f08d1eed9fd tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.372901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86452ec4-088b-493d-a4e0-1f08d1eed9fd tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/743842412" status: 200 len: 410 microversion: 2.1 time: 0.025549 Nov 20 20:46:56.376988 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 208/336] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/flavors/743842412 => generated 410 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:56.834517 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c310b8f3-dba0-4bb1-9b43-7bd0ea0bdf6c tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.203320 Nov 20 20:46:56.836628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 129/337] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:46:52 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:56.843669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.846640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:56.855315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.856000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.857090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.857680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.919604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27c2bc83-68b2-48a0-9c1b-fd2866c70237 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.942520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27c2bc83-68b2-48a0-9c1b-fd2866c70237 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.562206 Nov 20 20:46:56.953842 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 209/338] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:56.958971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:56.959771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:56.966841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.967293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:56.968082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:56.968678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:57.176887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:57.188780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b32b2d1-a4cd-425b-90c8-60329fa06891 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1468 microversion: 2.1 time: 0.233313 Nov 20 20:46:57.189563 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 210/339] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1468 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:57.205932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72337d92-985d-469e-9e57-29e553895db6 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Action: 'create', calling method: .version_select at 0x7f3f87334670>, body: {"pool": null} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:57.268242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:57.279570 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f2af899-8612-46a5-9d0f-8ca6f395e21c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.441366 Nov 20 20:46:57.280306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 130/340] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:56 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:57.289378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8aaa6141-8341-4a75-ad23-1dc2b84262e1 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:57.291839 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:57.291839 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:57.326676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8aaa6141-8341-4a75-ad23-1dc2b84262e1 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/743842412" status: 202 len: 0 microversion: 2.1 time: 0.042861 Nov 20 20:46:57.329637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 131/341] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:46:57 2021] DELETE /compute/v2.1/flavors/743842412 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:57.340585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:57.342741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:57.389483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:57.389483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:57.389483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:57.392275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.083899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:58.097849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e294e34-6d31-462d-b821-c20e6df19324 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.765067 Nov 20 20:46:58.098490 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 132/342] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:57 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:58.127990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:58.130170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:58.146131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.146590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.150459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.151491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.237733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lazy-loading 'flavor' on Instance uuid 055480e4-60a2-498c-813d-86502a476e44 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:46:58.349161 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6841fe83-f046-47fb-842e-245f579e0500 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44/action" status: 202 len: 0 microversion: 2.1 time: 0.231465 Nov 20 20:46:58.354280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 133/343] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:46:58 2021] POST /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:46:58.360157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27e3b113-706e-4728-a6f1-bc4b99ae0f58 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:58.402635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27e3b113-706e-4728-a6f1-bc4b99ae0f58 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050201 Nov 20 20:46:58.405320 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 134/344] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:46:58 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:58.430749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:58.431790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:58.465392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.465934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.466864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.467469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.795417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:58.802817 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85881926-4eb9-4721-80c7-57e917f9e9c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.396314 Nov 20 20:46:58.803404 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 135/345] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:58 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:58.820404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:58.821136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:58.853006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.855040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:58.856298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:58.859077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:59.311068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:59.325400 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-574f5d7c-0aab-4995-a843-b0a930bf1cb6 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1476 microversion: 2.1 time: 0.509419 Nov 20 20:46:59.334872 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 136/346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:58 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1476 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:59.337012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d65ead79-593f-4931-a731-037deac5de47 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-123641750", "id": 1992064863, "os-flavor-access:is_public": "False"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:59.340591 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:59.340591 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:59.376022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d65ead79-593f-4931-a731-037deac5de47 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.048434 Nov 20 20:46:59.376916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 137/347] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:59 2021] POST /compute/v2.1/flavors => generated 429 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:59.384131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-faba4aae-6cf8-468b-8f69-52fc9f4ae06e req-e2ffa8a0-3199-4d3f-9a51-6d7687324695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa97729-64d1-4da2-9d9f-052cf676e7c9", "name": "network-vif-plugged", "status": "completed", "tag": "3d39c4e8-282d-4632-8433-fb1d3c1a36a7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:59.385916 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:46:59.385916 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:46:59.393945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-faba4aae-6cf8-468b-8f69-52fc9f4ae06e req-e2ffa8a0-3199-4d3f-9a51-6d7687324695 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:59.394688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-faba4aae-6cf8-468b-8f69-52fc9f4ae06e req-e2ffa8a0-3199-4d3f-9a51-6d7687324695 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:59.415690 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-faba4aae-6cf8-468b-8f69-52fc9f4ae06e req-e2ffa8a0-3199-4d3f-9a51-6d7687324695 service nova] Creating event network-vif-plugged:3d39c4e8-282d-4632-8433-fb1d3c1a36a7 for instance 8fa97729-64d1-4da2-9d9f-052cf676e7c9 on nch1-master-1 Nov 20 20:46:59.427043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-faba4aae-6cf8-468b-8f69-52fc9f4ae06e req-e2ffa8a0-3199-4d3f-9a51-6d7687324695 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048398 Nov 20 20:46:59.428306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 138/348] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:46:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:59.437378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:59.438311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:59.446481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:59.447321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:59.448322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:59.449033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:59.874981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72337d92-985d-469e-9e57-29e553895db6 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.673770 Nov 20 20:46:59.876842 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 211/349] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:46:57 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:46:59.881481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0095277-854a-4061-ac5a-12980e1c820a tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "1992064863"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:46:59.895090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:46:59.900553 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f0095277-854a-4061-ac5a-12980e1c820a tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] HTTP exception thrown: Flavor 1992064863 could not be found. Nov 20 20:46:59.901351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0095277-854a-4061-ac5a-12980e1c820a tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] Returning 400 to user: Flavor 1992064863 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:46:59.902356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0095277-854a-4061-ac5a-12980e1c820a tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.024453 Nov 20 20:46:59.903403 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 212/350] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:46:59 2021] POST /compute/v2.1/servers => generated 81 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:46:59.917336 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c8458b0-82f0-42ee-8d4c-ab623cee8941 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1317 microversion: 2.1 time: 0.483248 Nov 20 20:46:59.927754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 139/351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:59 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:46:59.927754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:46:59.927754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:46:59.933423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:59.933864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:46:59.934716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:46:59.935144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:00.092318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:00.100074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d383f62-3c9d-432e-9100-fedfdedf144a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.179110 Nov 20 20:47:00.101283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 140/352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:46:59 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:00.106361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-018712ed-f32e-4d21-857a-a0d59b816159 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Action: 'create', calling method: .version_select at 0x7f3f95b43ee0>, body: {"pool": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:00.216120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f3ab23b-f136-4561-b077-a3f41ecafd76 tempest-FloatingIPDetailsNegativeTestJSON-1597393032 tempest-FloatingIPDetailsNegativeTestJSON-1597393032-project] Calling method '.version_select at 0x7f3f87319e50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:00.272809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-6f3ab23b-f136-4561-b077-a3f41ecafd76 tempest-FloatingIPDetailsNegativeTestJSON-1597393032 tempest-FloatingIPDetailsNegativeTestJSON-1597393032-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3834c0a9-52b1-4f3a-9d89-9656bb58b8d3 could not be found", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:47:00.274387 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-6f3ab23b-f136-4561-b077-a3f41ecafd76 tempest-FloatingIPDetailsNegativeTestJSON-1597393032 tempest-FloatingIPDetailsNegativeTestJSON-1597393032-project] HTTP exception thrown: Floating IP not found for ID 3834c0a9-52b1-4f3a-9d89-9656bb58b8d3 Nov 20 20:47:00.276230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f3ab23b-f136-4561-b077-a3f41ecafd76 tempest-FloatingIPDetailsNegativeTestJSON-1597393032 tempest-FloatingIPDetailsNegativeTestJSON-1597393032-project] Returning 404 to user: Floating IP not found for ID 3834c0a9-52b1-4f3a-9d89-9656bb58b8d3 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:00.277823 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f3ab23b-f136-4561-b077-a3f41ecafd76 tempest-FloatingIPDetailsNegativeTestJSON-1597393032 tempest-FloatingIPDetailsNegativeTestJSON-1597393032-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips/3834c0a9-52b1-4f3a-9d89-9656bb58b8d3" status: 404 len: 111 microversion: 2.1 time: 0.372972 Nov 20 20:47:00.278607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 213/353] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:46:59 2021] GET /compute/v2.1/os-floating-ips/3834c0a9-52b1-4f3a-9d89-9656bb58b8d3 => generated 111 bytes in 375 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:00.286751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6cae3801-bb6e-435b-9398-e0b7dfab4131 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:00.287765 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:00.287765 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:00.320927 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6cae3801-bb6e-435b-9398-e0b7dfab4131 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1992064863" status: 202 len: 0 microversion: 2.1 time: 0.040761 Nov 20 20:47:00.321975 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 214/354] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:47:00 2021] DELETE /compute/v2.1/flavors/1992064863 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:00.331429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b2f739ce-b0cc-4561-9c6c-da35a47d0c77 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:00.360400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b2f739ce-b0cc-4561-9c6c-da35a47d0c77 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033665 Nov 20 20:47:00.362105 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 215/355] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:00 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:00.367981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:00.369187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:00.377722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:00.378998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:00.379808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:00.380577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:00.729944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:00.737291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e03b96c-7332-4ff6-9e1d-182d3ca42819 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1459 microversion: 2.1 time: 0.373639 Nov 20 20:47:00.742533 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 216/356] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:00 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1459 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:00.749598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0781e73c-ede9-4348-b992-eb1b65951dc6 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1442580152", "id": 1766167980, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:00.751363 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:00.751363 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:00.771628 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0781e73c-ede9-4348-b992-eb1b65951dc6 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.027716 Nov 20 20:47:00.773439 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 217/357] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:00 2021] POST /compute/v2.1/flavors => generated 415 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:00.780024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:00.780821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:00.787110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:00.787901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:00.789061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:00.789757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:01.733956 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54e52cbe-3912-4577-a6e3-a6af23b3260a tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1610 microversion: 2.1 time: 0.958807 Nov 20 20:47:01.738173 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 218/358] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:00 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1610 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:01.745749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e7141761-837b-4f71-9b59-01a5d3c68a29 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1522080543", "id": 116648656, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:01.753385 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:01.753385 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:01.783344 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e7141761-837b-4f71-9b59-01a5d3c68a29 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.044043 Nov 20 20:47:01.784455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 219/359] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:01 2021] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:01.793363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:01.794371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:01.803190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:01.804558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:01.805546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:01.812764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:02.242757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-018712ed-f32e-4d21-857a-a0d59b816159 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.140009 Nov 20 20:47:02.250879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 141/360] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:47:00 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:02.259356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:02.272969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:02.273992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:02.276322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-698fe346-2e60-45f7-9874-d2ff7acfaff3 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1507 microversion: 2.1 time: 0.490442 Nov 20 20:47:02.279811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 220/361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:01 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1507 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:02.285177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:02.285897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:02.286981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:02.287700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:02.294698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:02.297547 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:02.297547 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:02.299531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:02.300237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:02.306243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:02.306973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:02.362535 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c94d8a1-aea8-4027-8137-1308fdedff06 tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081209 Nov 20 20:47:02.367220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 221/362] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:47:02 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:02.390942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa4f9834-fba3-43c0-85f4-5fc10ac10ee8 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:02.425498 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa4f9834-fba3-43c0-85f4-5fc10ac10ee8 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 418 microversion: 2.1 time: 0.055658 Nov 20 20:47:02.430467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 222/363] 10.222.0.41 () {58 vars in 1168 bytes} [Sat Nov 20 20:47:02 2021] GET /compute/v2.1/flavors/detail?is_public=f => generated 418 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:02.439265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dee59672-18db-4435-91af-e6df7cc4c70b tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Action: 'create', calling method: .version_select at 0x7f3f8733be50>, body: {"pool": null} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:02.534767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:02.558671 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa567aeb-d8a4-47d7-a4a6-2e50ce3d2b0d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.306395 Nov 20 20:47:02.568730 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 142/364] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:02 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:03.005867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0298ec4-be40-4c56-8155-5e850772227a tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1383307044", "id": 662102304, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:03.037283 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:03.037283 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:03.121329 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0298ec4-be40-4c56-8155-5e850772227a tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.549888 Nov 20 20:47:03.121972 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 143/365] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:47:02 2021] POST /compute/v2.1/flavors => generated 446 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:03.132309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:03.135513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:03.156253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:03.157536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:03.167140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:03.170320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:03.217699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Lazy-loading 'flavor' on Instance uuid 055480e4-60a2-498c-813d-86502a476e44 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:03.233399 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 055480e4-60a2-498c-813d-86502a476e44 while it is in vm_state suspended Nov 20 20:47:03.234277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 055480e4-60a2-498c-813d-86502a476e44 while it is in vm_state suspended {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:03.235521 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfc027cf-0f91-4d2d-96ff-0d87d5c1d6ba tempest-LiveMigrationNegativeTest-1921044942 tempest-LiveMigrationNegativeTest-1921044942-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44/action" status: 409 len: 155 microversion: 2.1 time: 0.112191 Nov 20 20:47:03.238515 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 144/366] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:47:03 2021] POST /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44/action => generated 155 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:47:03.244953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03697d1c-f9bb-4175-944d-922c62213fca tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:03.291423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03697d1c-f9bb-4175-944d-922c62213fca tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 418 microversion: 2.1 time: 0.045481 Nov 20 20:47:03.292276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 145/367] 10.222.0.41 () {58 vars in 1176 bytes} [Sat Nov 20 20:47:03 2021] GET /compute/v2.1/flavors/detail?is_public=false => generated 418 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:03.818476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5866934a-ddf8-4f4a-b86b-687951a69f7b tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:03.829012 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5866934a-ddf8-4f4a-b86b-687951a69f7b tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] 10.222.0.41 "GET /compute/v2.1/flavors/662102304" status: 200 len: 446 microversion: 2.55 time: 0.532637 Nov 20 20:47:03.834799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 146/368] 10.222.0.41 () {60 vars in 1195 bytes} [Sat Nov 20 20:47:03 2021] GET /compute/v2.1/flavors/662102304 => generated 446 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:03.845616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:03.846489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:03.855475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:03.856937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:03.858016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:03.858847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:03.901046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:47:04.170881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d97ca2d0-b2df-4ff0-a735-0c19cac92b4b tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "DELETE /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 204 len: 0 microversion: 2.1 time: 0.332620 Nov 20 20:47:04.175178 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 147/369] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:47:03 2021] DELETE /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:04.176726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-39176544-76f3-49f4-bebd-645abbc35e98 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:04.189252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-39176544-76f3-49f4-bebd-645abbc35e98 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 418 microversion: 2.1 time: 0.015765 Nov 20 20:47:04.190041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 148/370] 10.222.0.41 () {58 vars in 1170 bytes} [Sat Nov 20 20:47:04 2021] GET /compute/v2.1/flavors/detail?is_public=no => generated 418 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:04.219686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:04.222086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:04.235672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.236493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:04.237775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.240062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:04.539856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:04.551632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0cad601-f06a-4efb-8a3f-00713cedb076 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.354159 Nov 20 20:47:04.552251 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 149/371] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:04 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:04.557603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76fcf4db-0b22-42f5-b959-e0aeff0e48da tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] Action: 'update', calling method: .version_select at 0x7f3f9608a790>, body: {"flavor": {"description": "new"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:04.567756 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:04.567756 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:04.599038 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76fcf4db-0b22-42f5-b959-e0aeff0e48da tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] 10.222.0.41 "PUT /compute/v2.1/flavors/662102304" status: 200 len: 447 microversion: 2.55 time: 0.045695 Nov 20 20:47:04.599986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 150/372] 10.222.0.41 () {62 vars in 1215 bytes} [Sat Nov 20 20:47:04 2021] PUT /compute/v2.1/flavors/662102304 => generated 447 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:04.605401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:04.606012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:04.611954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.612784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:04.613491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.613595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:04.848292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:04.861186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd0639ca-fe78-485a-b6f1-4126d8c67c99 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1465 microversion: 2.1 time: 0.259412 Nov 20 20:47:04.862291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 151/373] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:04 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:04.867915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7cd99c3d-0509-4183-a4f5-a3f2030c6ee8 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:04.885028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7cd99c3d-0509-4183-a4f5-a3f2030c6ee8 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 418 microversion: 2.1 time: 0.021676 Nov 20 20:47:04.893352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 152/374] 10.222.0.41 () {58 vars in 1168 bytes} [Sat Nov 20 20:47:04 2021] GET /compute/v2.1/flavors/detail?is_public=0 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:04.901376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78f257d6-df0c-48f8-9161-47c8bf8f19dd"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:04.903379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:04.910309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.910997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:04.912386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:04.913887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:05.353805 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56c12f00-14d6-45b8-b89e-46a2717a588a tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "POST /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458233 Nov 20 20:47:05.354829 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 153/375] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:47:04 2021] POST /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:05.368742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea48f2bc-6d57-49ce-b00f-febbc477c57f tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.416895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea48f2bc-6d57-49ce-b00f-febbc477c57f tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 6144 microversion: 2.55 time: 0.056536 Nov 20 20:47:05.417612 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 154/376] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail => generated 6144 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:05.440014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c244c4d0-acde-433e-ad1c-b7cf063ef128 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.464735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c244c4d0-acde-433e-ad1c-b7cf063ef128 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5807 microversion: 2.1 time: 0.035352 Nov 20 20:47:05.465499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 155/377] 10.222.0.41 () {58 vars in 1168 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail?is_public=t => generated 5807 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:05.471127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17a4e4df-1bac-4b6a-895e-748bbd3e188e tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.490245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17a4e4df-1bac-4b6a-895e-748bbd3e188e tempest-FlavorsV255TestJSON-961444823 tempest-FlavorsV255TestJSON-961444823-project] 10.222.0.41 "GET /compute/v2.1/flavors" status: 200 len: 3405 microversion: 2.55 time: 0.023254 Nov 20 20:47:05.500181 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 156/378] 10.222.0.41 () {60 vars in 1165 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors => generated 3405 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:05.505888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4e4dae5-b482-4693-8a9c-7daa8da5563b tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.549627 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4e4dae5-b482-4693-8a9c-7daa8da5563b tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5807 microversion: 2.1 time: 0.057187 Nov 20 20:47:05.559988 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 157/379] 10.222.0.41 () {58 vars in 1174 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail?is_public=true => generated 5807 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:05.564302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74ca8a35-d5ca-47da-bac5-b9fc20946c1c tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.565195 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:05.565195 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:05.592456 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74ca8a35-d5ca-47da-bac5-b9fc20946c1c tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/662102304" status: 202 len: 0 microversion: 2.55 time: 0.036756 Nov 20 20:47:05.594107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 158/380] 10.222.0.41 () {60 vars in 1198 bytes} [Sat Nov 20 20:47:05 2021] DELETE /compute/v2.1/flavors/662102304 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:05.601233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34c30531-2d14-47bc-bbe7-110679ca5995 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.621236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34c30531-2d14-47bc-bbe7-110679ca5995 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.025669 Nov 20 20:47:05.622246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 159/381] 10.222.0.41 () {58 vars in 1172 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:05.627009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.627721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:05.634845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:05.635916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:05.636724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:05.637155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:05.681969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dee59672-18db-4435-91af-e6df7cc4c70b tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.251020 Nov 20 20:47:05.683197 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 223/382] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:47:02 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:05.688259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1095086-d306-47d2-9e2b-fea2db8985a0 tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.728991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1095086-d306-47d2-9e2b-fea2db8985a0 tempest-FlavorsV255TestJSON-1244329711 tempest-FlavorsV255TestJSON-1244329711-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5707 microversion: 2.55 time: 0.044477 Nov 20 20:47:05.730275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 224/383] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail => generated 5707 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:05.738399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74641ac4-6856-4932-aafa-b6dcffabd76c tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:05.792040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74641ac4-6856-4932-aafa-b6dcffabd76c tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.060457 Nov 20 20:47:05.793229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 225/384] 10.222.0.41 () {58 vars in 1168 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:05.808897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ec1f94c-2391-4ee8-9213-ae7218c2a8a1 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f872de280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.174764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:06.191210 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9553af2c-3574-4868-8617-95cdb8db70e6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.567803 Nov 20 20:47:06.193428 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 160/385] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:06.201275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-208393e6-0a88-464b-84aa-44bade6887b3 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.202036 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:06.202036 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:06.276125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-208393e6-0a88-464b-84aa-44bade6887b3 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/116648656" status: 202 len: 0 microversion: 2.1 time: 0.081573 Nov 20 20:47:06.277244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 161/386] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:47:06 2021] DELETE /compute/v2.1/flavors/116648656 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:06.286516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.287379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:06.306004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:06.308760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:06.309760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:06.312510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:06.696014 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ec1f94c-2391-4ee8-9213-ae7218c2a8a1 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips/b889b597-62d4-484b-b3c6-bc8f3aaa4b55" status: 200 len: 141 microversion: 2.1 time: 0.899651 Nov 20 20:47:06.698175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 226/387] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:47:05 2021] GET /compute/v2.1/os-floating-ips/b889b597-62d4-484b-b3c6-bc8f3aaa4b55 => generated 141 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:06.710484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dff786f5-498c-415a-85ea-915098f0f49a tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.747489 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dff786f5-498c-415a-85ea-915098f0f49a tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047796 Nov 20 20:47:06.748825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 227/388] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:06 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:06.753581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4836ca55-e099-4b0a-8967-8674cadb117e tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f8733b940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.943900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:06.952227 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58568635-6583-43e4-b8b0-51bcb6f7c610 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 200 len: 1465 microversion: 2.1 time: 0.674031 Nov 20 20:47:06.952812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 162/389] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:06 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 1465 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:06.968964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e488dbf6-e41c-4257-aefc-8312b796f4de tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:06.969741 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:06.969741 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:07.005647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e488dbf6-e41c-4257-aefc-8312b796f4de tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1766167980" status: 202 len: 0 microversion: 2.1 time: 0.051752 Nov 20 20:47:07.009671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 163/390] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:47:06 2021] DELETE /compute/v2.1/flavors/1766167980 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:07.014414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1335b8b7-74d7-4cf4-95e9-19b0ef7e31e5 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:07.075450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1335b8b7-74d7-4cf4-95e9-19b0ef7e31e5 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064557 Nov 20 20:47:07.095631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 164/391] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:07 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:07.100417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91852c3e-999e-4526-8fef-b350f5e6cb86 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1844215792", "id": 778042200, "os-flavor-access:is_public": "False"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:07.109981 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:07.109981 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:07.142365 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91852c3e-999e-4526-8fef-b350f5e6cb86 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.045214 Nov 20 20:47:07.144162 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 165/392] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:07 2021] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:07.157082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f587239-ce2d-4c7a-82ba-6b00c02ef0ca tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:07.182563 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f587239-ce2d-4c7a-82ba-6b00c02ef0ca tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029438 Nov 20 20:47:07.183799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 166/393] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:07 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:07.198332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8aa69c05-406c-4689-abb9-bbfdd094aca9 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:07.228287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8aa69c05-406c-4689-abb9-bbfdd094aca9 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034604 Nov 20 20:47:07.229648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 167/394] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:07 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:07.237456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:07.238914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:07.247526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:07.248446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:07.249700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:07.250315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.107434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:08.116288 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2ae756f-a2f7-4665-96cb-c442baa023c8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1476 microversion: 2.1 time: 0.885236 Nov 20 20:47:08.119866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 168/395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:07 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1476 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:08.126795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32dcfac6-a10b-48d6-b483-48c36f8b6d39 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:08.127724 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:08.127724 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:08.176010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32dcfac6-a10b-48d6-b483-48c36f8b6d39 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/778042200" status: 202 len: 0 microversion: 2.1 time: 0.054238 Nov 20 20:47:08.177208 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 169/396] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:47:08 2021] DELETE /compute/v2.1/flavors/778042200 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:08.198312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2f6c6ff5-f2d5-4c39-b22b-2e615c4718fc req-90eec432-ea1a-4f6f-b7f4-c1a0574be756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055480e4-60a2-498c-813d-86502a476e44", "name": "network-vif-deleted", "tag": "783944b3-4138-4d0f-b209-7f593cf9e786"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:08.206731 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:08.206731 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:08.227567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f6c6ff5-f2d5-4c39-b22b-2e615c4718fc req-90eec432-ea1a-4f6f-b7f4-c1a0574be756 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.229587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f6c6ff5-f2d5-4c39-b22b-2e615c4718fc req-90eec432-ea1a-4f6f-b7f4-c1a0574be756 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.246905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2f6c6ff5-f2d5-4c39-b22b-2e615c4718fc req-90eec432-ea1a-4f6f-b7f4-c1a0574be756 service nova] Creating event network-vif-deleted:783944b3-4138-4d0f-b209-7f593cf9e786 for instance 055480e4-60a2-498c-813d-86502a476e44 on nch2-master-1 Nov 20 20:47:08.252120 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2f6c6ff5-f2d5-4c39-b22b-2e615c4718fc req-90eec432-ea1a-4f6f-b7f4-c1a0574be756 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073760 Nov 20 20:47:08.253125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 170/397] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:08.260766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:08.261672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: 055480e4-60a2-498c-813d-86502a476e44] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:08.269789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.270424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.271414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.271998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.297242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] HTTP exception thrown: Instance 055480e4-60a2-498c-813d-86502a476e44 could not be found. Nov 20 20:47:08.298186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Returning 404 to user: Instance 055480e4-60a2-498c-813d-86502a476e44 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:08.299027 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa78fb0d-6ed0-4012-931c-5f6e2bb7be90 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44" status: 404 len: 111 microversion: 2.1 time: 0.044320 Nov 20 20:47:08.300379 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 171/398] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:08 2021] GET /compute/v2.1/servers/055480e4-60a2-498c-813d-86502a476e44 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:08.307691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04534db1-72f0-4585-9a67-06be5e202b7b tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:08.346196 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04534db1-72f0-4585-9a67-06be5e202b7b tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044298 Nov 20 20:47:08.347171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 172/399] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:08 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:08.353853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:08.354523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:08.366662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.371214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.372568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.373006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.423792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:47:08.561975 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-becb4424-10be-452f-9236-10d66bca3836 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 204 len: 0 microversion: 2.1 time: 0.212782 Nov 20 20:47:08.565170 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 173/400] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:47:08 2021] DELETE /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:08.572866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfe3cf2a-e967-43c4-9686-c9ecd5f9de13 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-150034626", "id": 1687815103, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:08.574577 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:08.574577 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:08.598817 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfe3cf2a-e967-43c4-9686-c9ecd5f9de13 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.030959 Nov 20 20:47:08.599486 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 174/401] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:08 2021] POST /compute/v2.1/flavors => generated 413 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:08.625863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:08.635062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:08.657088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.657734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:08.658827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:08.659411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:09.442599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4836ca55-e099-4b0a-8967-8674cadb117e tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/b889b597-62d4-484b-b3c6-bc8f3aaa4b55" status: 202 len: 0 microversion: 2.1 time: 2.692088 Nov 20 20:47:09.450818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 228/402] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:47:06 2021] DELETE /compute/v2.1/os-floating-ips/b889b597-62d4-484b-b3c6-bc8f3aaa4b55 => generated 0 bytes in 2700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:09.458672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2b3f8be1-0941-458e-abdc-6a8c6f398775 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:09.491605 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2b3f8be1-0941-458e-abdc-6a8c6f398775 tempest-FlavorsAdminTestJSON-1419061280 tempest-FlavorsAdminTestJSON-1419061280-project] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.037709 Nov 20 20:47:09.526217 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 229/403] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:09 2021] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:09.537746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:09.539062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:09.545965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:09.547095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:09.547906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:09.548345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:09.637501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:09.645778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9b5ccda-6794-4e5e-ab9d-70f241bd790d tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1475 microversion: 2.1 time: 1.045188 Nov 20 20:47:09.658147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 175/404] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:08 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1475 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:09.663248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86bce2bd-0141-45d3-be14-46a7f638c8a9 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f87bd0d30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:09.758349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:09.766571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6f0f568-c28f-4e3e-9f29-313f393c535e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1475 microversion: 2.1 time: 0.238806 Nov 20 20:47:09.767310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 230/405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:09 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1475 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:09.772447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0656c1f9-2087-419a-9782-ce4bf5042b23 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:09.773531 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:09.773531 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:09.793271 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0656c1f9-2087-419a-9782-ce4bf5042b23 tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1687815103" status: 202 len: 0 microversion: 2.1 time: 0.024690 Nov 20 20:47:09.793961 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 231/406] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:47:09 2021] DELETE /compute/v2.1/flavors/1687815103 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:09.801678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e890ad5-19cc-4fda-9ec1-52b6b4ddcbab tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:09.825811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e890ad5-19cc-4fda-9ec1-52b6b4ddcbab tempest-FlavorsAdminTestJSON-838221525 tempest-FlavorsAdminTestJSON-838221525-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027593 Nov 20 20:47:09.837822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 232/407] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:09 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:47:10.128743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86bce2bd-0141-45d3-be14-46a7f638c8a9 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.469098 Nov 20 20:47:10.129466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 176/408] 10.222.0.41 () {58 vars in 1163 bytes} [Sat Nov 20 20:47:09 2021] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:47:10.139580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cf73d89-cdca-468f-8075-472761d935dd tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f8733bf70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:10.480173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "name": "network-vif-unplugged", "status": "completed", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:10.481860 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:10.481860 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:10.500000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:10.500840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:10.527623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cf73d89-cdca-468f-8075-472761d935dd tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.391568 Nov 20 20:47:10.536108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 233/409] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:47:10 2021] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:10.544302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3277e6d7-5454-48b8-ad03-a818ab81b8d9 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f87334b80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:10.546945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] Creating event network-vif-unplugged:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch2-master-1 Nov 20 20:47:10.560168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] Instance 409a187f-c361-49ef-a9a0-2762cda33448 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:47:10.581704 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e98974f7-6f43-4a16-9436-4c125b021af7 req-f790f492-787e-4af8-9952-1df7197a60f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106251 Nov 20 20:47:10.585025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 177/410] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:10.664571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:10.666183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:10.675845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:10.678870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:10.681594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:10.682071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:11.351828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf38bd3867945fb9726405aad6e61c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89da80dbcf5948268735e51c28e4bf40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:11.360862 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a9215db-0b50-4ceb-8bb7-5545e377fb8c tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 200 len: 1475 microversion: 2.1 time: 0.700959 Nov 20 20:47:11.368581 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 178/411] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:10 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 1475 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:11.384401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:11.385414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:11.395129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:11.398864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:11.400582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:11.401323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:12.260564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3277e6d7-5454-48b8-ad03-a818ab81b8d9 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/b1867e14-039f-4de2-930e-6d10775a41a2" status: 202 len: 0 microversion: 2.1 time: 1.722977 Nov 20 20:47:12.263019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 234/412] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:47:10 2021] DELETE /compute/v2.1/os-floating-ips/b1867e14-039f-4de2-930e-6d10775a41a2 => generated 0 bytes in 1726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:47:12.356018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:12.397656 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a03d4a4-f318-4e90-be44-3747bf085bab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1475 microversion: 2.1 time: 1.013999 Nov 20 20:47:12.401208 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 179/413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:11 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1475 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:12.915857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d6560d55-d3c8-43a2-844f-3ca6bbdcc90a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:12.919305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:12.938444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:12.946171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:12.950561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:12.951800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:13.052105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-644b4d76-7eb3-4903-a00b-bfcab4a742d1 tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Calling method '.version_select at 0x7f3f87c39a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:13.054324 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:13.054324 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:13.056302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-644b4d76-7eb3-4903-a00b-bfcab4a742d1 tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '7498799f67a54045aafa0aada12fe100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cf3ae9fe5c4f5a900cd6d3c86cd6f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:13.057196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-644b4d76-7eb3-4903-a00b-bfcab4a742d1 tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:13.058335 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-644b4d76-7eb3-4903-a00b-bfcab4a742d1 tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.654760 Nov 20 20:47:13.068349 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 180/414] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:47:12 2021] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:13.075822 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:13.075822 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:13.091624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96ede0e5-c100-4af1-9330-8041d11b0b81 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f87bd09d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:13.612430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] HTTP exception thrown: Volume d6560d55-d3c8-43a2-844f-3ca6bbdcc90a could not be found. Nov 20 20:47:13.619587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Returning 400 to user: Volume d6560d55-d3c8-43a2-844f-3ca6bbdcc90a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:13.633444 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fc381f73-de92-4920-84b0-cb252ee9967a tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] 10.222.0.41 "PUT /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/78f257d6-df0c-48f8-9161-47c8bf8f19dd" status: 400 len: 107 microversion: 2.1 time: 1.369144 Nov 20 20:47:13.642833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 235/415] 10.222.0.41 () {60 vars in 1432 bytes} [Sat Nov 20 20:47:12 2021] PUT /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/78f257d6-df0c-48f8-9161-47c8bf8f19dd => generated 107 bytes in 1379 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:47:13.653833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:13.657707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] [instance: ae71d012-3101-45ff-8cfa-86095500e364] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:13.688250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:13.688700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:13.695700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:13.696097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:13.734122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] HTTP exception thrown: Instance ae71d012-3101-45ff-8cfa-86095500e364 could not be found. Nov 20 20:47:13.735054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] Returning 404 to user: Instance ae71d012-3101-45ff-8cfa-86095500e364 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:13.736166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9e61cf4-c829-4fac-8434-d79ea6f60ab5 tempest-LiveMigrationNegativeTest-1224343807 tempest-LiveMigrationNegativeTest-1224343807-project] 10.222.0.41 "GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364" status: 404 len: 111 microversion: 2.1 time: 0.092073 Nov 20 20:47:13.740280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 236/416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:13 2021] GET /compute/v2.1/servers/ae71d012-3101-45ff-8cfa-86095500e364 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:13.770345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:13.777716 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:13.777716 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:13.813495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:13.813936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:13.862776 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] Creating event network-changed:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch2-master-1 Nov 20 20:47:13.902758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] Instance 409a187f-c361-49ef-a9a0-2762cda33448 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:47:13.934457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-59a69d97-1075-4c81-a7c8-88388cb2b743 req-012ca6f1-8f53-4d66-ac17-825f2eb3aa5e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190852 Nov 20 20:47:13.935471 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 237/417] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:13.961708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb966eb9-a4ed-4cfa-8b7b-dc41a87929cb tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Calling method '.version_select at 0x7f3f87371820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:13.962981 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:13.962981 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:13.965971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb966eb9-a4ed-4cfa-8b7b-dc41a87929cb tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '7498799f67a54045aafa0aada12fe100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cf3ae9fe5c4f5a900cd6d3c86cd6f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:13.968941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb966eb9-a4ed-4cfa-8b7b-dc41a87929cb tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:13.972457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb966eb9-a4ed-4cfa-8b7b-dc41a87929cb tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034049 Nov 20 20:47:13.978859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 238/418] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:13 2021] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:13.991365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:13.993357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:14.008099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:14.010855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:14.011895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:14.014698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:14.679783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:14.703457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5effb5c-3e95-4f8e-927b-6924ce7a2480 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1475 microversion: 2.1 time: 0.721066 Nov 20 20:47:14.714670 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 239/419] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:13 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1475 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:14.720930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:14.721920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:14.733791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:14.734693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:14.737434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:14.738170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:14.976173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lazy-loading 'services' on Instance uuid 8fa97729-64d1-4da2-9d9f-052cf676e7c9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:15.135782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8e5d11f-5f73-479c-b3a5-115b44fdb3a1 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/78f257d6-df0c-48f8-9161-47c8bf8f19dd" status: 202 len: 0 microversion: 2.1 time: 0.418883 Nov 20 20:47:15.143106 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 240/420] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 20:47:14 2021] DELETE /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/78f257d6-df0c-48f8-9161-47c8bf8f19dd => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:15.154325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11440b0c-a867-47eb-8de7-acd07bd1311c tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Calling method '.version_select at 0x7f3f87206550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:15.156591 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:15.156591 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:15.158494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-11440b0c-a867-47eb-8de7-acd07bd1311c tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '7498799f67a54045aafa0aada12fe100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cf3ae9fe5c4f5a900cd6d3c86cd6f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:15.159334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11440b0c-a867-47eb-8de7-acd07bd1311c tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:15.160357 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11440b0c-a867-47eb-8de7-acd07bd1311c tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.014625 Nov 20 20:47:15.166137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 241/421] 10.222.0.41 () {58 vars in 1178 bytes} [Sat Nov 20 20:47:15 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:15.172628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:15.174651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:15.199657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.203657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.205536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.206576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.285656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0cc74b4a-1925-4778-bf88-2161315d4513 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117093 Nov 20 20:47:15.294383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 242/422] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:47:15 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:15.859915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Calling method '.version_select at 0x7f3f87216a60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:15.860682 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:15.860682 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:15.862841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.863352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.915876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.919275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.950588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.951423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.964993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d13e14c-712a-4a5c-8efb-556a6352cf9d tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.668632 Nov 20 20:47:15.968811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 243/423] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:15 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:15.978308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:15.978920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:15.994585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.995038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:15.997864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:15.999444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.406718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:16.421700 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f983251-832b-47f7-abcf-df2cdca59983 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1473 microversion: 2.1 time: 0.451987 Nov 20 20:47:16.424988 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 244/424] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:15 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:16.467445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae68564f-3677-4e99-b3ae-a1593cdf912d tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Calling method '.version_select at 0x7f3f87259f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.468718 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:16.468718 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:16.473457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ae68564f-3677-4e99-b3ae-a1593cdf912d tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '7498799f67a54045aafa0aada12fe100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cf3ae9fe5c4f5a900cd6d3c86cd6f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:16.476638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae68564f-3677-4e99-b3ae-a1593cdf912d tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:16.482895 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ae68564f-3677-4e99-b3ae-a1593cdf912d tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.056631 Nov 20 20:47:16.487249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 245/425] 10.222.0.41 () {58 vars in 1172 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:16.507722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-47e57938-35fa-4d48-a2cb-59681a57b892 req-fd2af1a5-b977-42df-b273-cdbbb5bf24c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae71d012-3101-45ff-8cfa-86095500e364", "name": "network-vif-deleted", "tag": "cdc9972c-0094-48f8-9fca-0182b2a13dd7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:16.512523 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:16.512523 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:16.539478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-47e57938-35fa-4d48-a2cb-59681a57b892 req-fd2af1a5-b977-42df-b273-cdbbb5bf24c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.541059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-47e57938-35fa-4d48-a2cb-59681a57b892 req-fd2af1a5-b977-42df-b273-cdbbb5bf24c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.572333 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-47e57938-35fa-4d48-a2cb-59681a57b892 req-fd2af1a5-b977-42df-b273-cdbbb5bf24c8 service nova] Creating event network-vif-deleted:cdc9972c-0094-48f8-9fca-0182b2a13dd7 for instance ae71d012-3101-45ff-8cfa-86095500e364 on nch1-master-1 Nov 20 20:47:16.589375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-47e57938-35fa-4d48-a2cb-59681a57b892 req-fd2af1a5-b977-42df-b273-cdbbb5bf24c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099317 Nov 20 20:47:16.591350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 246/426] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:16.607903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.609764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:16.626891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.630610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.634481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.635161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.708374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b0b28cd5-5e3d-4ee2-8cd9-10326d34c961 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114518 Nov 20 20:47:16.709175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 247/427] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:47:16.725001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1764462e-b646-471d-a317-be1cf1b86ebe tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Calling method '.version_select at 0x7f3f87206670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.726600 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:16.726600 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:16.727847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1764462e-b646-471d-a317-be1cf1b86ebe tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] HTTP exception thrown: Hypervisor with ID '2326bf79-032d-43fa-888e-1f065bb3b9c4' could not be found. Nov 20 20:47:16.733158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1764462e-b646-471d-a317-be1cf1b86ebe tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Returning 404 to user: Hypervisor with ID '2326bf79-032d-43fa-888e-1f065bb3b9c4' could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:16.734088 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1764462e-b646-471d-a317-be1cf1b86ebe tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/2326bf79-032d-43fa-888e-1f065bb3b9c4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.023757 Nov 20 20:47:16.738634 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 248/428] 10.222.0.41 () {58 vars in 1277 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/os-hypervisors/2326bf79-032d-43fa-888e-1f065bb3b9c4/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:16.752871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Calling method '.version_select at 0x7f3f871fd820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.753812 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:16.753812 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:16.764656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.766771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.805790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.806302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.854094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:16.857036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:16.880000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-454aff63-d067-413d-90e6-fe29edaa92f5 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.138737 Nov 20 20:47:16.890647 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 249/429] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:16.915413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8339c1e-6066-4acb-9d10-45622ebee8bf tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Calling method '.version_select at 0x7f3f872163a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.921135 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:16.921135 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:16.927682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c8339c1e-6066-4acb-9d10-45622ebee8bf tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '7498799f67a54045aafa0aada12fe100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cf3ae9fe5c4f5a900cd6d3c86cd6f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:16.930637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8339c1e-6066-4acb-9d10-45622ebee8bf tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:16.932841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8339c1e-6066-4acb-9d10-45622ebee8bf tempest-HypervisorAdminNegativeTestJSON-693618423 tempest-HypervisorAdminNegativeTestJSON-693618423-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.039612 Nov 20 20:47:16.943272 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 250/430] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:16.955321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-467aedd7-38ca-4c9c-8a54-afb3fddc3602 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Calling method '.version_select at 0x7f3f871fd310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:16.971817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-467aedd7-38ca-4c9c-8a54-afb3fddc3602 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] HTTP exception thrown: Hypervisor with ID 'a0ec7c8b-9f51-4105-a4e2-6781c943cc8f' could not be found. Nov 20 20:47:16.976764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-467aedd7-38ca-4c9c-8a54-afb3fddc3602 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] Returning 404 to user: Hypervisor with ID 'a0ec7c8b-9f51-4105-a4e2-6781c943cc8f' could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:16.979086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-467aedd7-38ca-4c9c-8a54-afb3fddc3602 tempest-HypervisorAdminNegativeTestJSON-895008311 tempest-HypervisorAdminNegativeTestJSON-895008311-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/a0ec7c8b-9f51-4105-a4e2-6781c943cc8f" status: 404 len: 123 microversion: 2.1 time: 0.033303 Nov 20 20:47:16.985815 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 251/431] 10.222.0.41 () {58 vars in 1256 bytes} [Sat Nov 20 20:47:16 2021] GET /compute/v2.1/os-hypervisors/a0ec7c8b-9f51-4105-a4e2-6781c943cc8f => generated 123 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:17.260132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96ede0e5-c100-4af1-9330-8041d11b0b81 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/5e500668-d56e-415c-84b5-4326c8fa1e58" status: 202 len: 0 microversion: 2.1 time: 4.189999 Nov 20 20:47:17.270403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 181/432] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:47:13 2021] DELETE /compute/v2.1/os-floating-ips/5e500668-d56e-415c-84b5-4326c8fa1e58 => generated 0 bytes in 4201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:17.274286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c95d1bc9-e75b-4df0-bc88-bf5dce1c27a4 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] Calling method '.version_select at 0x7f3f872765e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:17.341304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b42c0c88-3b77-44ad-8c44-d258788d8fbe tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87bd0ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:17.418697 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b42c0c88-3b77-44ad-8c44-d258788d8fbe tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7" status: 200 len: 662 microversion: 2.1 time: 0.082373 Nov 20 20:47:17.419497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 182/433] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:17 2021] GET /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7 => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:17.436548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5580170a-5911-42cb-a493-734ee98dc28d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87b9d550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:17.540609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5580170a-5911-42cb-a493-734ee98dc28d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7" status: 200 len: 662 microversion: 2.1 time: 0.113549 Nov 20 20:47:17.548500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 183/434] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:17 2021] GET /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:17.553310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:17.554260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:17.571730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:17.574026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:17.577862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:17.578261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:17.980294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:17.993615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7737e4cf-7828-41c7-8670-4fc8b54ed4f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1470 microversion: 2.1 time: 0.443722 Nov 20 20:47:17.995853 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 184/435] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:17 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1470 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:18.019754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:18.020757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:18.034556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.035977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.037122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.039473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.140363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aadd8dd2-ebb1-422c-9606-5b7e21ed549d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448/action" status: 204 len: 0 microversion: 2.1 time: 0.134308 Nov 20 20:47:18.141896 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 185/436] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:47:18 2021] POST /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448/action => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:47:18.153945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:18.155005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:18.164293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.165071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.166387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.167183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.463224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:18.471707 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfd9d0f0-6ee5-4671-85d2-c6cd444019ff tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1470 microversion: 2.1 time: 0.324956 Nov 20 20:47:18.472289 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 186/437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:18 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1470 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:18.883968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6ddf0992-3ec0-4aad-b514-6aba5d937841"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:18.885114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:18.903516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.904281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.906531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:18.908065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:18.923004 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c95d1bc9-e75b-4df0-bc88-bf5dce1c27a4 tempest-FloatingIPDetailsTestJSON-1658860328 tempest-FloatingIPDetailsTestJSON-1658860328-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/e754c517-4091-469e-8dbc-36733f7992f2" status: 202 len: 0 microversion: 2.1 time: 1.656432 Nov 20 20:47:18.924835 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 252/438] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:47:17 2021] DELETE /compute/v2.1/os-floating-ips/e754c517-4091-469e-8dbc-36733f7992f2 => generated 0 bytes in 1659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:18.943721 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:18.943721 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:18.984132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] HTTP exception thrown: Volume bae07052-f2c2-4f80-9f6d-46eedc554250 could not be found. Nov 20 20:47:18.985052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] Returning 404 to user: Volume bae07052-f2c2-4f80-9f6d-46eedc554250 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:18.986322 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e13b6240-48db-49db-a297-e45af6841feb tempest-VolumesAdminNegativeTest-1674966139 tempest-VolumesAdminNegativeTest-1674966139-project-admin] 10.222.0.41 "PUT /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/bae07052-f2c2-4f80-9f6d-46eedc554250" status: 404 len: 109 microversion: 2.1 time: 0.109450 Nov 20 20:47:18.987805 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 187/439] 10.222.0.41 () {60 vars in 1432 bytes} [Sat Nov 20 20:47:18 2021] PUT /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9/os-volume_attachments/bae07052-f2c2-4f80-9f6d-46eedc554250 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:19.488575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:19.489192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:19.498143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:19.500479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:19.501356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:19.501793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:19.823616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:19.849873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f675fca-f859-4ab6-8cc3-affe0ae4a575 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1470 microversion: 2.1 time: 0.363587 Nov 20 20:47:19.851647 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 253/440] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:19 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:20.205156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c5667e9b-1fd6-4d8e-867d-1637439f9bfc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87216dc0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:20.304469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c5667e9b-1fd6-4d8e-867d-1637439f9bfc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2" status: 200 len: 662 microversion: 2.1 time: 0.112990 Nov 20 20:47:20.305347 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 254/441] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:20 2021] GET /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2 => generated 662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:20.329095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed893d21-9557-477f-bff8-76170aac5fe1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871fd9d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:20.409479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed893d21-9557-477f-bff8-76170aac5fe1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2" status: 200 len: 662 microversion: 2.1 time: 0.092011 Nov 20 20:47:20.414062 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 255/442] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:20 2021] GET /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2 => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:20.874253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:20.878030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:20.901297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:20.902851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:20.913450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:20.913898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:20.952682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b659d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:20.954132 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:20.954132 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:20.960811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:20.961423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:20.968187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:20.968882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.062268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eee317b4-ce4d-4364-ae66-9830a79885be tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 1.017914 Nov 20 20:47:21.063774 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 188/443] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:47:20 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.079929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b41a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.082469 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.082469 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:21.089111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.091548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.095121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.096696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.192875 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4acfdc9-4280-4af8-b301-599cb7243af0 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.120090 Nov 20 20:47:21.195780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 189/444] 10.222.0.41 () {58 vars in 1138 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.206304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b805e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.207856 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.207856 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:21.215151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.218480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.221055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.225663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.278821 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-296e3270-2ab4-4235-816d-256c30edcdac tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.076819 Nov 20 20:47:21.285070 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 190/445] 10.222.0.41 () {58 vars in 1144 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:47:21.299698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b41940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.301647 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.301647 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:21.304881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.305802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.307270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.308076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.344878 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dc01c50-924f-45f7-96c6-0377d54ce3cc tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.052092 Nov 20 20:47:21.346415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 191/446] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.358944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b80670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.360689 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.360689 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:21.362717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.363456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.366963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.367647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.409126 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ee10e48-0890-417c-a6d3-724838cfc147 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.055476 Nov 20 20:47:21.410561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 192/447] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.424705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87b41430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.426434 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.426434 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:21.430516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.431070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.432039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.432726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.432834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:21.443684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff8df5c7-902f-44c6-88b7-4d7dc4fc0934 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1470 microversion: 2.1 time: 0.576077 Nov 20 20:47:21.450327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 256/448] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:20 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1470 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:21.488271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c79f843-f2c8-45f7-873d-94127da1107f tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.069393 Nov 20 20:47:21.489242 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 193/449] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.499721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87216820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.500696 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.500696 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:21.525483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.526351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.559619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.561843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.641268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.641899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:21.663027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.664219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.665260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.665983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.687961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f156810-3b51-4b97-97fe-fc8f4a2e9411 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.192529 Nov 20 20:47:21.696975 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 257/450] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:21.702004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Calling method '.version_select at 0x7f3f87216e50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.706181 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:21.706181 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:21.720988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.723081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.738412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:47:21.754119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.755660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.792069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-730481cf-325e-4e73-8fb1-d99e99d395d2 tempest-HostsAdminTestJSON-1698145970 tempest-HostsAdminTestJSON-1698145970-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.093599 Nov 20 20:47:21.794247 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 258/451] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:21.902910 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93044bc0-82fc-458f-970c-30144a928588 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 204 len: 0 microversion: 2.1 time: 0.268799 Nov 20 20:47:21.903674 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 194/452] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:47:21 2021] DELETE /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:21.920447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:21.921204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:21.934438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.934892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:21.935702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:21.936135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:22.285104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfdfd0f8-9b9d-4e18-8ddf-13d6564d2807 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Calling method '.version_select at 0x7f3f871e78b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:22.444512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:22.453731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49aa9f53-4df3-49f3-a313-95afe93f3551 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1513 microversion: 2.1 time: 0.545031 Nov 20 20:47:22.460354 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 195/453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1513 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:22.468329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d0bcd7da-6314-43df-984b-174c9222ce65 req-838ad435-6be0-4072-a1d9-8fa15ddeca12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "name": "network-vif-plugged", "status": "completed", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:22.473008 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:22.473008 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:22.496601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d0bcd7da-6314-43df-984b-174c9222ce65 req-838ad435-6be0-4072-a1d9-8fa15ddeca12 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:22.500827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d0bcd7da-6314-43df-984b-174c9222ce65 req-838ad435-6be0-4072-a1d9-8fa15ddeca12 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:22.551547 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d0bcd7da-6314-43df-984b-174c9222ce65 req-838ad435-6be0-4072-a1d9-8fa15ddeca12 service nova] Creating event network-vif-plugged:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch2-master-1 Nov 20 20:47:22.572699 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d0bcd7da-6314-43df-984b-174c9222ce65 req-838ad435-6be0-4072-a1d9-8fa15ddeca12 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110650 Nov 20 20:47:22.573784 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 196/454] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:22.592293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:22.593151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:22.626323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:22.629593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:22.635614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:22.637426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:22.984037 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfdfd0f8-9b9d-4e18-8ddf-13d6564d2807 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 371 microversion: 2.1 time: 1.081070 Nov 20 20:47:22.984973 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 259/455] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:47:21 2021] GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 371 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:22.998166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f871721f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:23.007392 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:23.007392 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:23.113931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:23.114488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:23.115318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:23.118710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:23.182456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:23.197704 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f53e75d-ab7c-4296-9d26-1b317a3c24b6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1462 microversion: 2.1 time: 0.613395 Nov 20 20:47:23.198929 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 197/456] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:22 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1462 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:23.215691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d56f200e-b4ab-4d8f-8721-344f1d54b9ec tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87c39820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:23.244796 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13f78d22-11d0-4cc9-a2f6-bda197bcb537 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 328 microversion: 2.1 time: 0.249333 Nov 20 20:47:23.245482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 260/457] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:22 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:23.262547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:23.263315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:23.275540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:23.276877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:23.278907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:23.279899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:23.324348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d56f200e-b4ab-4d8f-8721-344f1d54b9ec tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7" status: 200 len: 661 microversion: 2.1 time: 0.123706 Nov 20 20:47:23.330925 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 198/458] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:23 2021] GET /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7 => generated 661 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:23.348410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffa80e3e-cacc-4813-8d30-c8e5747637e0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87bad670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:23.422757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffa80e3e-cacc-4813-8d30-c8e5747637e0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7" status: 200 len: 661 microversion: 2.1 time: 0.085340 Nov 20 20:47:23.437136 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 199/459] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:23 2021] GET /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:23.692497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-747398187", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:23.775106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:24.106163 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89ebba24-eada-4c6d-9cdd-4972feba6b71 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1613 microversion: 2.1 time: 0.858545 Nov 20 20:47:24.106776 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 261/460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:23 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1613 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:24.106776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:24.106776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:24.126353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:24.126900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:24.128691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:24.129855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:24.541233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:24.541655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:24.542162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:24.542592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:24.542741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:24.543139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:24.564595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d53630e-878b-4da8-a868-982850f8e0c7 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1513 microversion: 2.1 time: 0.456188 Nov 20 20:47:24.565766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:24.565998 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 262/461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:24 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:24.566668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:24.567628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:24.568207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:24.572013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-703935838", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:24.603252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:24.608098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for user 948c0d21026644f3816730cbd512501f and project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:24.621640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.utils [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] cores quota exceeded for 02ccf1d03fcd4cf595fe2da58caf887c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140941) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 20 20:47:24.622711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 20 20:47:24.623671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:24.626183 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4d90605-4241-4397-93ad-6188cf295dfe tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.187290 Nov 20 20:47:24.626986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 200/462] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:23 2021] POST /compute/v2.1/servers => generated 111 bytes in 1189 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:24.636460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26911682-df69-435e-8582-e925eb1f8add tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '.version_select at 0x7f3f87bd0a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:24.639945 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:24.639945 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:24.641565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26911682-df69-435e-8582-e925eb1f8add tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:24.643883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26911682-df69-435e-8582-e925eb1f8add tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:24.659468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:24.668534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26911682-df69-435e-8582-e925eb1f8add tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.040082 Nov 20 20:47:24.669240 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 201/463] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:47:24 2021] GET /compute/v2.1/os-migrations => generated 409 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:24.688010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87bd0af0>, body: {"quota_set": {"cores": 20}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:24.690265 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:24.690265 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:25.061303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:25.061774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:25.062302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:25.062951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:25.063509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:25.082920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.082920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:25.085871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.086363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:25.133081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Getting quotas for project d3d075cbe0444578ada04c262fdd9164. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:25.140574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Getting quotas for user 8f544fa27eb24a2ebf3f3a931528e373 and project d3d075cbe0444578ada04c262fdd9164. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:25.159492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:25.162561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:25.251125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef892c6e-5f03-4249-bbf9-f02021daf416 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683773 Nov 20 20:47:25.252286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 263/464] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:25.270120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.271086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:25.272296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.272913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:25.282475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-213842985", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:25.373777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:25.469022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19183989-cfdb-49f1-84f4-0e4ebe159f33 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 329 microversion: 2.1 time: 0.785518 Nov 20 20:47:25.476040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 202/465] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:24 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 329 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:25.476040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1127195029", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:25.553200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:25.963381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:25.963810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:25.964280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:25.964942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:25.965602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:25.980875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.981360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:25.985642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:25.987400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.062942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:26.084126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for user cf07bddf00ea4a7da446130a6308cd27 and project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:26.102710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:26.108292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:26.203546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32aca487-71d6-4182-942f-d27ab66ebf37 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949600 Nov 20 20:47:26.209152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 264/466] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:26.214226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1fb4f5b-b05b-40bd-b905-9fd3f5e75165 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Calling method '.version_select at 0x7f3f8711d160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:26.697270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1fb4f5b-b05b-40bd-b905-9fd3f5e75165 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 371 microversion: 2.1 time: 0.486566 Nov 20 20:47:26.698231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 265/467] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:47:26 2021] GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 371 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:26.703213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:26.704294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:26.712949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:26.713898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.715253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:26.715936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.777927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:26.778442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.780635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lazy-loading 'fault' on Instance uuid 8fa97729-64d1-4da2-9d9f-052cf676e7c9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:26.850335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:26.851540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:26.852421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:26.853043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:26.853677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:26.880850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:26.884202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.887873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:26.890091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:26.969263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9cc64fc72543b4b0abbaba637eeb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb059314b462499a8d78e0e350d5de4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:26.977076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Getting quotas for project d3d075cbe0444578ada04c262fdd9164. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:26.977653 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73378447-f71b-43d4-bd52-0404cf3a0807 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 200 len: 1307 microversion: 2.1 time: 0.277918 Nov 20 20:47:26.982566 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 266/468] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:26 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:26.987658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a6af3faa-dbfd-4ecd-81c9-72b23fa00358 req-eac21052-3608-4789-8472-eda55c956344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa97729-64d1-4da2-9d9f-052cf676e7c9", "name": "network-vif-deleted", "tag": "3d39c4e8-282d-4632-8433-fb1d3c1a36a7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:26.991698 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:26.991698 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:27.003064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Getting quotas for user 8f544fa27eb24a2ebf3f3a931528e373 and project d3d075cbe0444578ada04c262fdd9164. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:27.016642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a6af3faa-dbfd-4ecd-81c9-72b23fa00358 req-eac21052-3608-4789-8472-eda55c956344 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:27.017378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a6af3faa-dbfd-4ecd-81c9-72b23fa00358 req-eac21052-3608-4789-8472-eda55c956344 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:27.032380 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a6af3faa-dbfd-4ecd-81c9-72b23fa00358 req-eac21052-3608-4789-8472-eda55c956344 service nova] Creating event network-vif-deleted:3d39c4e8-282d-4632-8433-fb1d3c1a36a7 for instance 8fa97729-64d1-4da2-9d9f-052cf676e7c9 on nch1-master-1 Nov 20 20:47:27.035010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:27.042856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:27.054603 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a6af3faa-dbfd-4ecd-81c9-72b23fa00358 req-eac21052-3608-4789-8472-eda55c956344 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069553 Nov 20 20:47:27.057503 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 267/469] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:27.063152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb8c0ba7-f9f4-4659-979b-94950c125c7c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:27.064376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb8c0ba7-f9f4-4659-979b-94950c125c7c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:27.176419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f705258-15bd-49dc-844e-451c0965b86a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705459 Nov 20 20:47:27.183764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 203/470] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:27.196704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87bd08b0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:27.200486 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:27.200486 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:27.329640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb8c0ba7-f9f4-4659-979b-94950c125c7c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:27.342087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb8c0ba7-f9f4-4659-979b-94950c125c7c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1212 microversion: 2.1 time: 0.282744 Nov 20 20:47:27.345025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 268/471] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:27 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1212 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:27.353648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fdcf9fdb-aa82-4603-b0ba-5484a084bba2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:27.355027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fdcf9fdb-aa82-4603-b0ba-5484a084bba2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:27.355605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:27.356060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:27.360984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:27.362832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:27.487960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43a23d00-d608-4e45-91c1-ff8fed1c1132 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 328 microversion: 2.1 time: 0.302626 Nov 20 20:47:27.492764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 204/472] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:27 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 328 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:27.552737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fdcf9fdb-aa82-4603-b0ba-5484a084bba2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:27.561318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fdcf9fdb-aa82-4603-b0ba-5484a084bba2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1218 microversion: 2.1 time: 0.214803 Nov 20 20:47:27.570278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 269/473] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:27 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:27.778568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-519652882", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:27.858175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:27.998587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:27.999380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] [instance: 8fa97729-64d1-4da2-9d9f-052cf676e7c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:28.009921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.018837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.019979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.024018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.061778 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] HTTP exception thrown: Instance 8fa97729-64d1-4da2-9d9f-052cf676e7c9 could not be found. Nov 20 20:47:28.062415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] Returning 404 to user: Instance 8fa97729-64d1-4da2-9d9f-052cf676e7c9 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:28.063242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-612d1738-e2e9-4948-bbf4-9c1938bde8c4 tempest-VolumesAdminNegativeTest-1918384537 tempest-VolumesAdminNegativeTest-1918384537-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9" status: 404 len: 111 microversion: 2.1 time: 0.068334 Nov 20 20:47:28.067100 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 270/474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:27 2021] GET /compute/v2.1/servers/8fa97729-64d1-4da2-9d9f-052cf676e7c9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:28.363363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:28.363964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:28.377536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.377988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.378808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.379259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.550355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:28.560274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-485ec05b-16ec-4289-904d-65f7b3eda862 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1270 microversion: 2.1 time: 0.200349 Nov 20 20:47:28.565389 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 271/475] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:28 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:28.591452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:28.592329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:28.603804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.604553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.605572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:28.606230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:28.792013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:28.801631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60d8ec1b-a911-49d4-a0a9-d5c815d5a2fa tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1214 microversion: 2.1 time: 0.211501 Nov 20 20:47:28.815394 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 272/476] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:28 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:28.993001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:28.993547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:28.993872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:28.994582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:28.995165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:29.012066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.014814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.016002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.018695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.066664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:29.085064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for user 948c0d21026644f3816730cbd512501f and project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:29.105188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.utils [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] instances quota exceeded for 02ccf1d03fcd4cf595fe2da58caf887c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140941) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 20 20:47:29.105986 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 20 20:47:29.106787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:29.107903 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d314f08-5966-4858-9b15-763bf156782a tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.333637 Nov 20 20:47:29.108982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 205/477] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:27 2021] POST /compute/v2.1/servers => generated 119 bytes in 1336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:29.119607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f871e70d0>, body: {"quota_set": {"instances": 10}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:29.121842 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:29.121842 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:29.580726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:29.581416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:29.591315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.592201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.597506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.598644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.752802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.753835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.754862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.766665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.937410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:29.950318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c0b7db5-4a01-4fe0-8cd3-5f3fcc598c4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1270 microversion: 2.1 time: 0.372215 Nov 20 20:47:29.950822 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 206/478] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:29 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1270 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:29.951590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b169057-3621-4887-bd45-864f19fed1d6 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 329 microversion: 2.1 time: 0.837178 Nov 20 20:47:29.952407 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 273/479] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:29 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 329 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:29.975430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a363f07-f15c-47cd-803f-a06e04463fe0 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Calling method '.version_select at 0x7f3f87216820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:29.979871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:29.980515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:29.993767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:29.995214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:29.999388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:30.002947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:30.214409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:30.224143 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f823722-43e0-4f09-bd70-50a2abea58a4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1276 microversion: 2.1 time: 0.272320 Nov 20 20:47:30.226976 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 207/480] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:29 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:30.575046 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a363f07-f15c-47cd-803f-a06e04463fe0 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 371 microversion: 2.1 time: 0.613965 Nov 20 20:47:30.576152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 274/481] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:47:29 2021] GET /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 371 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:30.586421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87b41e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:30.589924 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:30.589924 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:30.876680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:30.877466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:30.878631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:30.879222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:30.919884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Calling method '.version_select at 0x7f3f871e7ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:30.922841 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:30.922841 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:30.927909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:30.932733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:30.936069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:30.936878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:30.975628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8379b15-33d0-42db-a365-70e9fbf8fd14 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 325 microversion: 2.1 time: 0.393507 Nov 20 20:47:30.976990 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 208/482] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:30 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:30.993398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:30.994917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:31.013824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:31.016294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:31.017559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:31.018621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:31.028383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11cb866e-a63b-46e5-b1c1-126a421a1e5d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.404237 Nov 20 20:47:31.032182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 275/483] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:47:30 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:31.255257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9634c9f7-4629-43d8-a72e-02f7de3813f9 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Calling method '.version_select at 0x7f3f873719d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:31.257352 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:31.257352 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:31.259276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9634c9f7-4629-43d8-a72e-02f7de3813f9 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:31.260078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9634c9f7-4629-43d8-a72e-02f7de3813f9 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:31.260892 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9634c9f7-4629-43d8-a72e-02f7de3813f9 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.220669 Nov 20 20:47:31.282478 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 276/484] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:47:31 2021] GET /compute/v2.1/os-hosts => generated 109 bytes in 242 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:31.295869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-357442201", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:31.408142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:31.695166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:31.714309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01c13818-4095-4836-a941-ba54e641aeba tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.735918 Nov 20 20:47:31.715235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 209/485] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:30 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:31.720200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:31.720980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:31.733219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:31.738042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:31.739029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:31.739482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:31.902627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:31.925110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66118d17-4908-4688-9f1a-ece451e9ba68 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1276 microversion: 2.1 time: 0.208522 Nov 20 20:47:31.925899 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 210/486] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:31 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:31.933199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9be499e9-56c5-467d-95a1-01783057ce88 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Calling method '.version_select at 0x7f3f87b65280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:31.936142 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:31.936142 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:31.939745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9be499e9-56c5-467d-95a1-01783057ce88 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:31.940706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9be499e9-56c5-467d-95a1-01783057ce88 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:31.941827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9be499e9-56c5-467d-95a1-01783057ce88 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014596 Nov 20 20:47:31.942609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 211/487] 10.222.0.41 () {58 vars in 1190 bytes} [Sat Nov 20 20:47:31 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:31.962193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69efef71-76b0-46f6-870e-d73e92cc0319 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Calling method '.version_select at 0x7f3f87b41a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:31.989317 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-69efef71-76b0-46f6-870e-d73e92cc0319 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 20 20:47:31.989788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69efef71-76b0-46f6-870e-d73e92cc0319 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:31.991309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69efef71-76b0-46f6-870e-d73e92cc0319 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.042380 Nov 20 20:47:31.992352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 212/488] 10.222.0.41 () {58 vars in 1211 bytes} [Sat Nov 20 20:47:31 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:47:32.007902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8e7bb11-ccd0-4246-813a-39571f3f7543 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Calling method '.version_select at 0x7f3f941e3a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.010335 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:32.010335 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:32.015577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f8e7bb11-ccd0-4246-813a-39571f3f7543 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:32.016744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8e7bb11-ccd0-4246-813a-39571f3f7543 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.017098 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8e7bb11-ccd0-4246-813a-39571f3f7543 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.019685 Nov 20 20:47:32.017820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 213/489] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:47:31 2021] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:32.033974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d298433-0638-4569-9a1d-2cfc61aeaf4d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Calling method '.version_select at 0x7f3f87b65160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.059966 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-8d298433-0638-4569-9a1d-2cfc61aeaf4d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 20 20:47:32.060882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d298433-0638-4569-9a1d-2cfc61aeaf4d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.061868 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d298433-0638-4569-9a1d-2cfc61aeaf4d tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.031768 Nov 20 20:47:32.062702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 214/490] 10.222.0.41 () {58 vars in 1190 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:47:32.074593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8796d437-131e-4c28-ba04-4cb92dc1c53e tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Calling method '.version_select at 0x7f3f87c39310>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.075631 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:shutdown failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:32.075631 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:32.077365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8796d437-131e-4c28-ba04-4cb92dc1c53e tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:32.079518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8796d437-131e-4c28-ba04-4cb92dc1c53e tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.080931 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8796d437-131e-4c28-ba04-4cb92dc1c53e tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012391 Nov 20 20:47:32.091184 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 215/491] 10.222.0.41 () {58 vars in 1196 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:47:32.105696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07f07fe9-f1c5-4516-abe4-5e6c53b77f07 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Calling method '.version_select at 0x7f3f87b41160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.154106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-07f07fe9-f1c5-4516-abe4-5e6c53b77f07 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 20 20:47:32.155110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07f07fe9-f1c5-4516-abe4-5e6c53b77f07 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.156115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07f07fe9-f1c5-4516-abe4-5e6c53b77f07 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.059201 Nov 20 20:47:32.157128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 216/492] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:47:32.166831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba96bc10-1053-461a-b98c-597e0df979fd tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Calling method '.version_select at 0x7f3f87b65280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.169198 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:start failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:32.169198 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:32.170749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ba96bc10-1053-461a-b98c-597e0df979fd tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:32.171791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba96bc10-1053-461a-b98c-597e0df979fd tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.172792 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba96bc10-1053-461a-b98c-597e0df979fd tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010810 Nov 20 20:47:32.175500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 217/493] 10.222.0.41 () {58 vars in 1193 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:47:32.184304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6cb4a0c2-bcb5-4948-8357-45867acb1acf tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Calling method '.version_select at 0x7f3f87b19700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.201835 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6cb4a0c2-bcb5-4948-8357-45867acb1acf tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 20 20:47:32.202704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6cb4a0c2-bcb5-4948-8357-45867acb1acf tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.203722 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6cb4a0c2-bcb5-4948-8357-45867acb1acf tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.023423 Nov 20 20:47:32.210955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 218/494] 10.222.0.41 () {58 vars in 1214 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:47:32.218659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ff69d0f-dbc1-45bd-b079-c8830bb1fe0e tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87b41700>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:32.220657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ff69d0f-dbc1-45bd-b079-c8830bb1fe0e tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.221663 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ff69d0f-dbc1-45bd-b079-c8830bb1fe0e tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.009415 Nov 20 20:47:32.222460 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 219/495] 10.222.0.41 () {60 vars in 1189 bytes} [Sat Nov 20 20:47:32 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:47:32.249124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec7997b5-aa29-42e0-9c39-783facee7f65 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87c39af0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:32.250360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec7997b5-aa29-42e0-9c39-783facee7f65 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.251330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec7997b5-aa29-42e0-9c39-783facee7f65 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.018010 Nov 20 20:47:32.252064 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 220/496] 10.222.0.41 () {60 vars in 1189 bytes} [Sat Nov 20 20:47:32 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:47:32.267739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5877f2bb-2dd8-4eb1-858a-879198cc2c73 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Action: 'update', calling method: .version_select at 0x7f3f87c39af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:32.269194 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hosts:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:32.269194 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:32.275847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5877f2bb-2dd8-4eb1-858a-879198cc2c73 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '4b3de5ed4a1649ca9743bbeaba52d3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf21a13fe9da4631baea316fc4b6986c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:32.276525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5877f2bb-2dd8-4eb1-858a-879198cc2c73 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.277358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5877f2bb-2dd8-4eb1-858a-879198cc2c73 tempest-HostsAdminNegativeTestJSON-896119647 tempest-HostsAdminNegativeTestJSON-896119647-project] 10.222.0.41 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.018024 Nov 20 20:47:32.277912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 221/497] 10.222.0.41 () {60 vars in 1189 bytes} [Sat Nov 20 20:47:32 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:47:32.300836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1916e886-edd8-47ab-a8c1-4a800a66ef22 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87b41a60>, body: {"status": null, "maintenance_mode": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:32.302750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1916e886-edd8-47ab-a8c1-4a800a66ef22 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.304733 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1916e886-edd8-47ab-a8c1-4a800a66ef22 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010012 Nov 20 20:47:32.306222 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 222/498] 10.222.0.41 () {60 vars in 1189 bytes} [Sat Nov 20 20:47:32 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:47:32.322008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6811df08-30c6-41b4-b1c3-af95181fa563 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87be0160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:32.325308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.hosts [None req-6811df08-30c6-41b4-b1c3-af95181fa563 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Enabling host nonexistent_hostname. Nov 20 20:47:32.335421 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6811df08-30c6-41b4-b1c3-af95181fa563 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 20 20:47:32.336737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6811df08-30c6-41b4-b1c3-af95181fa563 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:32.338386 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6811df08-30c6-41b4-b1c3-af95181fa563 tempest-HostsAdminNegativeTestJSON-1648122813 tempest-HostsAdminNegativeTestJSON-1648122813-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025087 Nov 20 20:47:32.344928 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 223/499] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:47:32 2021] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:47:32.733184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:32.733819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:32.739873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:32.740330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:32.741427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:32.741856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:32.950961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:32.951642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:32.952127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:32.952974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:32.953455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:32.967015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:32.967554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:32.969183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:32.969773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:32.998516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:33.005672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Getting quotas for user 948c0d21026644f3816730cbd512501f and project 02ccf1d03fcd4cf595fe2da58caf887c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:33.029014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:33.040037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.utils [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] ram quota exceeded for 02ccf1d03fcd4cf595fe2da58caf887c, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140942) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Nov 20 20:47:33.040645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eaede0a8-fe06-45eb-9ffd-6a0b993974f6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.311353 Nov 20 20:47:33.042063 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 20 20:47:33.042331 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 224/500] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:32 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:47:33.043389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:33.045547 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97c54bc1-6bbf-482f-ad37-97ec55f6f62b tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.761396 Nov 20 20:47:33.049781 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 277/501] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:31 2021] POST /compute/v2.1/servers => generated 110 bytes in 1766 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:33.057413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:33.060117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:33.064711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87172c10>, body: {"quota_set": {"ram": 51200}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:33.082288 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:33.082288 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:33.094588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:33.096539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:33.097398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:33.098395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:33.229329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:33.241663 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-253a3e47-8eb6-41b7-924d-0096fcc866ae tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1276 microversion: 2.1 time: 0.192648 Nov 20 20:47:33.242347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 225/502] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:33 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:33.398650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:33.401189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:33.402544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:33.403968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:33.581508 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79d6ebec-f74e-49a7-80b3-ab6512f93185 tempest-QuotasAdminNegativeTest-795355262 tempest-QuotasAdminNegativeTest-795355262-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 200 len: 329 microversion: 2.1 time: 0.530325 Nov 20 20:47:33.582119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 278/503] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:33 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 329 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:33.595343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d12b508c-1e0f-44a5-960e-840fe56b970d tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Action: 'update', calling method: .version_select at 0x7f3f87bad8b0>, body: {"quota_set": {"ram": 0}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:33.596913 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:33.596913 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:33.598533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d12b508c-1e0f-44a5-960e-840fe56b970d tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '948c0d21026644f3816730cbd512501f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02ccf1d03fcd4cf595fe2da58caf887c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:33.599432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d12b508c-1e0f-44a5-960e-840fe56b970d tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:33.602735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d12b508c-1e0f-44a5-960e-840fe56b970d tempest-QuotasAdminNegativeTest-527369020 tempest-QuotasAdminNegativeTest-527369020-project] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c" status: 403 len: 116 microversion: 2.1 time: 0.010328 Nov 20 20:47:33.613144 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 226/504] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:47:33 2021] PUT /compute/v2.1/os-quota-sets/02ccf1d03fcd4cf595fe2da58caf887c => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:47:34.060170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:34.061006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:34.070986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:34.073894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:34.077166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:34.077873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:34.258921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:34.259529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:34.281806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:34.283821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:34.289238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:34.290214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:34.873446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:34.890170 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-383f11ab-594e-4e94-b376-3f80f6c3ec95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.833519 Nov 20 20:47:34.898911 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 279/505] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:34 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:35.188442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:35.201686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d5b9a71-d558-49a0-8376-f52f4dab68dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.946831 Nov 20 20:47:35.217825 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 227/506] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:34 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:47:35.355282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f094ebce-41a1-4eea-86c6-f777ed9c5c03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:35.378651 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f094ebce-41a1-4eea-86c6-f777ed9c5c03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.475712 Nov 20 20:47:35.381213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 280/507] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:47:34 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:36.050615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5578017-a362-4bde-9801-968ef11f4aad tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1547249761", "id": 347300198, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:36.054382 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:36.054382 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:36.101714 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5578017-a362-4bde-9801-968ef11f4aad tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.713749 Nov 20 20:47:36.102318 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 228/508] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:35 2021] POST /compute/v2.1/flavors => generated 422 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:36.116753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:36.117553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:36.137450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:36.138063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:36.138899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:36.139336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:36.326499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-574196150", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "1f07f823-03fd-485f-ad70-6286912e8408"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:36.452957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] validate_networks() for [('1f07f823-03fd-485f-ad70-6286912e8408', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:37.230720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:37.261510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ed1533b-182f-47e6-a618-44c7d390d30f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 1.155311 Nov 20 20:47:37.268400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 229/509] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:36 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:37.293067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-65f0fcb7-2ce1-43d0-8eb7-734632e22811 req-768dc1f8-3fb3-4aa1-b9d7-bd30214b9504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:37.301165 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:37.301165 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:37.335954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-65f0fcb7-2ce1-43d0-8eb7-734632e22811 req-768dc1f8-3fb3-4aa1-b9d7-bd30214b9504 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:37.336661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-65f0fcb7-2ce1-43d0-8eb7-734632e22811 req-768dc1f8-3fb3-4aa1-b9d7-bd30214b9504 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:37.350757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-65f0fcb7-2ce1-43d0-8eb7-734632e22811 req-768dc1f8-3fb3-4aa1-b9d7-bd30214b9504 service nova] Creating event network-changed:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:47:37.366575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-65f0fcb7-2ce1-43d0-8eb7-734632e22811 req-768dc1f8-3fb3-4aa1-b9d7-bd30214b9504 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095777 Nov 20 20:47:37.370588 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 230/510] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:37.379168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f0e448d-12ca-49e7-87ba-544121e9dc65 tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:37.391358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f0e448d-12ca-49e7-87ba-544121e9dc65 tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019263 Nov 20 20:47:37.392489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 231/511] 10.222.0.41 () {58 vars in 1181 bytes} [Sat Nov 20 20:47:37 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:47:37.401384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:37.402947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:37.411298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:37.411720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:37.413099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:37.413869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:37.830633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:37.831113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:37.831637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:37.832114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:37.832595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:37.848788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:37.857230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:37.858315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:37.859633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:37.904928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:37.917675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for user e417004a75cd4291a2ef4a9d233c9f28 and project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:37.951305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:37.954061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:38.051012 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-891f9ab6-0735-452e-9fdd-2b9b912b43aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.451075 Nov 20 20:47:38.058332 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 281/512] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:47:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 20:47:38.063451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-dae62026-6bad-4298-9cc9-e674ee594a1f req-0f6fda32-33ad-4308-9b47-e27d25426570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d01ba62e-c3aa-436b-933b-c4a6533f5f03", "tag": "5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:38.069472 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:38.069472 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:38.080775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:38.085425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dae62026-6bad-4298-9cc9-e674ee594a1f req-0f6fda32-33ad-4308-9b47-e27d25426570 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:38.086095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dae62026-6bad-4298-9cc9-e674ee594a1f req-0f6fda32-33ad-4308-9b47-e27d25426570 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:38.090407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e8033a5-5038-4ef2-bfad-2262c6091680 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.696711 Nov 20 20:47:38.094769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 232/513] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:37 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:38.116657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ac9ea75-14c9-4280-9b0b-02a28f5ffd1d tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-507551363", "id": 1475795247, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:38.118416 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:38.118416 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:38.120591 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-dae62026-6bad-4298-9cc9-e674ee594a1f req-0f6fda32-33ad-4308-9b47-e27d25426570 service nova] Creating event network-changed:5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd for instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 on nch1-master-1 Nov 20 20:47:38.136649 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-dae62026-6bad-4298-9cc9-e674ee594a1f req-0f6fda32-33ad-4308-9b47-e27d25426570 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076563 Nov 20 20:47:38.138936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 282/514] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:38.156960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ac9ea75-14c9-4280-9b0b-02a28f5ffd1d tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.059823 Nov 20 20:47:38.163983 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 233/515] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:38 2021] POST /compute/v2.1/flavors => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:38.168426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:38.169039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:38.353533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:38.363885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:38.368382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:38.371733 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eee72c4a-5239-402f-9e41-6ebe5d6c7a7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1261 microversion: 2.25 time: 0.205004 Nov 20 20:47:38.386939 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 234/516] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:38 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:38.403174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba8eb3e9-5e81-406c-8f3a-b6fb2b0afa5c tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:38.414328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba8eb3e9-5e81-406c-8f3a-b6fb2b0afa5c tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025964 Nov 20 20:47:38.419251 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 235/517] 10.222.0.41 () {58 vars in 1181 bytes} [Sat Nov 20 20:47:38 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:47:38.431024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:38.431653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:38.441753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:38.443985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:38.445819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:38.446527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:38.717116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f8711d670>, body: {"keypair": {"name": "tempest-keypair-1707290375"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:38.763285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:38.772200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:39.152508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:39.171624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:39.203471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80c5bf8a-0059-476b-96f1-4aba5dd909fa tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 1.063138 Nov 20 20:47:39.205692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 283/518] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:38 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1066 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:39.217168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'create', calling method: .version_select at 0x7f3f8711d8b0>, body: {"keypair": {"name": "tempest-keypair-885863100"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:39.230976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:39.247772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4abc23c-6f2e-4bff-afd6-192a1aa69ac5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.827295 Nov 20 20:47:39.250185 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 236/519] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:38 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:39.258033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:39.272879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:39.295775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:39.296478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:39.301820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:39.304051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:39.304770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:39.327412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for user 6ca8ada3b9574675821f2b1a25d6c7e2 and project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:39.744684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:39.752134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for user 6ca8ada3b9574675821f2b1a25d6c7e2 and project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:39.782027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3dc12942-3704-4ab8-a1f6-549051cf029b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.575127 Nov 20 20:47:39.783373 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 284/520] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:47:39 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:39.789757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c401b54-c312-449d-95b2-ccaf8b6c54b5 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f870e70d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:39.797803 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c401b54-c312-449d-95b2-ccaf8b6c54b5 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs/tempest-keypair-1707290375" status: 200 len: 706 microversion: 2.2 time: 0.013235 Nov 20 20:47:39.798491 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 285/521] 10.222.0.41 () {60 vars in 1257 bytes} [Sat Nov 20 20:47:39 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1707290375 => generated 706 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:39.804961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:39.805596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:39.813953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:39.814539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:39.817268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:39.818440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:39.846434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:39.857757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-391e8a82-9ce1-4d92-80ec-a13284bfb1a6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.605510 Nov 20 20:47:39.859893 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 237/522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:39 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:39.867994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7fe22785-3983-4eb9-b064-b39e1e5f8b92 req-6792b258-b1e1-45c9-a92f-b3e31d4eaa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5", "tag": "d96f4ca5-742f-4e26-8329-f408e9d46a05"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:39.884252 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:39.884252 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:39.893849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7fe22785-3983-4eb9-b064-b39e1e5f8b92 req-6792b258-b1e1-45c9-a92f-b3e31d4eaa02 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:39.894319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7fe22785-3983-4eb9-b064-b39e1e5f8b92 req-6792b258-b1e1-45c9-a92f-b3e31d4eaa02 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:39.919035 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7fe22785-3983-4eb9-b064-b39e1e5f8b92 req-6792b258-b1e1-45c9-a92f-b3e31d4eaa02 service nova] Creating event network-changed:d96f4ca5-742f-4e26-8329-f408e9d46a05 for instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 on nch1-master-1 Nov 20 20:47:39.926111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7fe22785-3983-4eb9-b064-b39e1e5f8b92 req-6792b258-b1e1-45c9-a92f-b3e31d4eaa02 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064762 Nov 20 20:47:39.928247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 238/523] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:39.938674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3faa89dd-b164-4922-9d0a-05b538cfa09f tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87c39700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:39.953906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:39.979577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:39.985296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3faa89dd-b164-4922-9d0a-05b538cfa09f tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707290375" status: 204 len: 0 microversion: 2.2 time: 0.055187 Nov 20 20:47:39.987502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:39.992541 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 239/524] 10.222.0.41 () {60 vars in 1260 bytes} [Sat Nov 20 20:47:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707290375 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:39.994191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4d0f140-8a50-40de-b76f-483a5103d0dc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1321 microversion: 2.25 time: 0.194270 Nov 20 20:47:40.012938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87b33f70>, body: {"keypair": {"name": "tempest-keypair-910658867"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:40.013535 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 286/525] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:39 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:40.055881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:40.061643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:40.267066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:40.267716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:40.277133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:40.277588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:40.282871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:40.283600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:40.410358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:40.419078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:40.460274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb8c356a-a51d-4b2b-b797-1d0b1352d086 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.451032 Nov 20 20:47:40.467118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 240/526] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:40 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 458 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:40.478452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ef689c1-2c95-4011-bcd7-82e10b53959e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87c39670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:40.519362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ef689c1-2c95-4011-bcd7-82e10b53959e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910658867" status: 204 len: 0 microversion: 2.2 time: 0.050265 Nov 20 20:47:40.520767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 241/527] 10.222.0.41 () {60 vars in 1257 bytes} [Sat Nov 20 20:47:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910658867 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:40.534181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfe073fe-0bec-4305-a9d7-e91a8c8fddd2 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87bad9d0>, body: {"keypair": {"name": "tempest-keypair-1234577090", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:40.560714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-dfe073fe-0bec-4305-a9d7-e91a8c8fddd2 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:40.569015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-dfe073fe-0bec-4305-a9d7-e91a8c8fddd2 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:40.606989 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfe073fe-0bec-4305-a9d7-e91a8c8fddd2 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.079780 Nov 20 20:47:40.610094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 242/528] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 20:47:40 2021] POST /compute/v2.1/os-keypairs => generated 589 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 20 20:47:40.623276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a5f4906-3dfd-4b46-80f0-08fc07ef200e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87b419d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:40.668981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a5f4906-3dfd-4b46-80f0-08fc07ef200e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234577090" status: 204 len: 0 microversion: 2.2 time: 0.052132 Nov 20 20:47:40.670249 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 243/529] 10.222.0.41 () {60 vars in 1260 bytes} [Sat Nov 20 20:47:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234577090 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:40.691225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87b19280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1654212907"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:40.715425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:40.720143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:40.720302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:40.728648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a63c912-7275-42e0-8e7e-d83ed58eceea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.465210 Nov 20 20:47:40.738033 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 287/530] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:40 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:47:40.876501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:40.877792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:40.887251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:40.887708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:40.888554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:40.888993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:40.962694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:40.974464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:41.018710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca7fe49a-06de-4dae-9d18-7a8b3b13e942 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.342753 Nov 20 20:47:41.022207 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 244/531] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:40 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 347 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:41.035551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:41.042043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:41.060056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.060940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.062628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.064046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.312092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:41.320552 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0c52b1d-f79d-4560-afb1-9fd725d95fdd tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.447611 Nov 20 20:47:41.326796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 288/532] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:40 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:41.341595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87259af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1997521695"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:41.365033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:41.377572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:41.381477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:41.394184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:41.400392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:41.404840 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e08341b-0ae2-485e-b14c-f4ef3daae2a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1319 microversion: 2.25 time: 0.378319 Nov 20 20:47:41.406073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 245/533] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:41 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:41.858529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Calling method '.version_select at 0x7f3f87b805e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:41.867569 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:41.867569 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:41.873054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.875550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.885728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:41.896133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:41.921292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.921292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.937158 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a935b05c-d8fe-4bf5-9c4f-ce3a2c4f95a3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.607477 Nov 20 20:47:41.937769 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 289/534] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:41 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 609 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:41.941090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.941374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.951628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:41.952245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:41.962915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fdb37f99-af54-407b-bafd-3f1c09ff9bf6 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.555509 Nov 20 20:47:41.963898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.964300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.965155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:41.965542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:41.970820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 246/535] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 20:47:41 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:42.202322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f560d0c-2bcf-4d48-ae4b-8ae3086ba5cb tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:42.223061 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f560d0c-2bcf-4d48-ae4b-8ae3086ba5cb tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.250270 Nov 20 20:47:42.223651 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 247/536] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:47:41 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:42.228974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87b41ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-55434943"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:42.264496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:42.279187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:42.341012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:42.351713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-181aaf1f-3144-4ff5-bf82-c42d4418820a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.402634 Nov 20 20:47:42.352306 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 290/537] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:41 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:42.371111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Calling method '.version_select at 0x7f3f8711d310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:42.374973 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:42.374973 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:42.380011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:42.380918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:42.420052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:42.420899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:42.440250 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-763b9985-ff95-4e9a-a71b-935cf346faa4 tempest-HypervisorAdminV228Test-1820422406 tempest-HypervisorAdminV228Test-1820422406-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.083121 Nov 20 20:47:42.441845 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 291/538] 10.222.0.41 () {60 vars in 1192 bytes} [Sat Nov 20 20:47:42 2021] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:42.536270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:42.544504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:42.571193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86ff84ba-dca7-4802-85c3-fa404403ae13 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.2 time: 0.346451 Nov 20 20:47:42.573917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 248/539] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:42 2021] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 349 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:42.582627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:42.584297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:42.598523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:42.600551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:42.601983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:42.610943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:42.680745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-811708868", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:42.755244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:42.975562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:42.992183 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30e1f0a0-a933-4ea6-9b27-118cb06463b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.415661 Nov 20 20:47:42.993140 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 249/540] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:42 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:43.008294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:43.009775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:43.024883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.030903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.033508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.035430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.245946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:43.246894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:43.248073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:43.248795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:43.249240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:43.261448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.262173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.263145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.263762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.288532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:43.295635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for user 634f122b90184fd794dd55b6b09fd98d and project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:43.310310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:43.313370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:43.420097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d072dc2a-19ca-4e4a-b6ff-97bf2ffbecc4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976874 Nov 20 20:47:43.423161 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 292/541] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:43.433161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef0bd738-8f67-45de-b6fb-705ec2cfa90e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f870e7670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:43.446300 ncdv-master-1 devstack@n-api.service[140942]: WARNING oslo_db.sqlalchemy.utils [None req-ef0bd738-8f67-45de-b6fb-705ec2cfa90e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:47:43.485507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef0bd738-8f67-45de-b6fb-705ec2cfa90e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.057915 Nov 20 20:47:43.487508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 293/542] 10.222.0.41 () {60 vars in 1176 bytes} [Sat Nov 20 20:47:43 2021] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:43.503486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee1e9288-5077-4a8c-8289-3e265e95f347 tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-101213003", "imageRef": "333d26bf-496d-493b-ab9c-cddc76039d7d", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:43.525658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:43.546199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:43.549580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:43.554815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54ee6458-e6d1-469b-b4c9-49f4a8ce8c02 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 0.560443 Nov 20 20:47:43.555408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 250/543] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:42 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:43.559872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:43.560470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:43.577498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.578204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.579180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:43.581577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:43.588728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-ee1e9288-5077-4a8c-8289-3e265e95f347 tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:43.863374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:43.872058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d09d32cd-a3b9-4df5-bf06-21c72a911d26 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.315507 Nov 20 20:47:43.872650 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 251/544] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:43 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:43.885625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-842230147", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "1475795247", "adminPass": "***", "networks": [{"uuid": "b732d073-2758-47f6-b640-8b10bd32a71a"}], "security_groups": [{"name": "tempest-securitygroup--2054261647"}], "key_name": "tempest-keypair-885863100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:44.125541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] validate_networks() for [('b732d073-2758-47f6-b640-8b10bd32a71a', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:44.344905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ee1e9288-5077-4a8c-8289-3e265e95f347 tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 20 20:47:44.345515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee1e9288-5077-4a8c-8289-3e265e95f347 tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:47:44.346374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee1e9288-5077-4a8c-8289-3e265e95f347 tempest-FlavorsV2NegativeTest-1554346156 tempest-FlavorsV2NegativeTest-1554346156-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.856095 Nov 20 20:47:44.352017 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 294/545] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:43 2021] POST /compute/v2.1/servers => generated 93 bytes in 862 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:47:44.357522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fedbff73-e9c5-4b42-b335-d326d16337ac tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f871130d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:44.388876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fedbff73-e9c5-4b42-b335-d326d16337ac tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-55434943" status: 204 len: 0 microversion: 2.2 time: 0.035529 Nov 20 20:47:44.389483 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 295/546] 10.222.0.41 () {60 vars in 1314 bytes} [Sat Nov 20 20:47:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-55434943 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:44.396740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1293511691", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:44.469249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:44.747744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:44.748306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:44.748922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:44.749409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:44.749889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:44.767494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:44.769233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:44.772211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:44.777444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:44.826364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:44.833624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for user 634f122b90184fd794dd55b6b09fd98d and project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:44.873161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:44.875535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:44.982757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:44.983532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:44.984201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:44.984855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:44.985509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:44.996449 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea6c617b-eb9d-4f32-bd5e-65c5971071f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602320 Nov 20 20:47:44.999118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 296/547] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:45.012042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.012395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.013231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.013674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.014275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7a532bb8-6a9f-474d-80d9-3d6632dc94d4 req-187fe6f0-2672-42a0-b229-018a338d3cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-plugged", "status": "completed", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:45.016368 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:45.016368 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:45.032794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7a532bb8-6a9f-474d-80d9-3d6632dc94d4 req-187fe6f0-2672-42a0-b229-018a338d3cf1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.033299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7a532bb8-6a9f-474d-80d9-3d6632dc94d4 req-187fe6f0-2672-42a0-b229-018a338d3cf1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.051799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:45.061297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for user 6ca8ada3b9574675821f2b1a25d6c7e2 and project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:45.080841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7a532bb8-6a9f-474d-80d9-3d6632dc94d4 req-187fe6f0-2672-42a0-b229-018a338d3cf1 service nova] Creating event network-vif-plugged:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:47:45.089427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:45.094465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7a532bb8-6a9f-474d-80d9-3d6632dc94d4 req-187fe6f0-2672-42a0-b229-018a338d3cf1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086722 Nov 20 20:47:45.094465 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 297/548] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:45.096395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:45.098202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-813f39d4-5609-4559-ba9a-1747dccb30e1 req-7c9e538f-8e93-47fc-a7f0-c99100f5b71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564e731b-fef8-42db-8af6-3500bc8c6798", "tag": "189ed4ef-80e9-4e25-b461-a33679104e74"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:45.101198 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:45.101198 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:45.110191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-813f39d4-5609-4559-ba9a-1747dccb30e1 req-7c9e538f-8e93-47fc-a7f0-c99100f5b71a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.110987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-813f39d4-5609-4559-ba9a-1747dccb30e1 req-7c9e538f-8e93-47fc-a7f0-c99100f5b71a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.127989 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-813f39d4-5609-4559-ba9a-1747dccb30e1 req-7c9e538f-8e93-47fc-a7f0-c99100f5b71a service nova] Creating event network-changed:189ed4ef-80e9-4e25-b461-a33679104e74 for instance 564e731b-fef8-42db-8af6-3500bc8c6798 on nch2-master-1 Nov 20 20:47:45.136471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-813f39d4-5609-4559-ba9a-1747dccb30e1 req-7c9e538f-8e93-47fc-a7f0-c99100f5b71a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042031 Nov 20 20:47:45.137421 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 298/549] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:45.143919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:45.144625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:45.154193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.155002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.156501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.157154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.239591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69a6b570-8053-4986-b96f-daa351a4a205 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.361581 Nov 20 20:47:45.240981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 252/550] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:45.267985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d984cee1-bd3e-4e92-ba54-8a0046e57731 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87b338b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:45.304464 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d984cee1-bd3e-4e92-ba54-8a0046e57731 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1997521695" status: 204 len: 0 microversion: 2.2 time: 0.061036 Nov 20 20:47:45.309416 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 253/551] 10.222.0.41 () {60 vars in 1320 bytes} [Sat Nov 20 20:47:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1997521695 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:45.318725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:45.325538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:45.346083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.350822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.351729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.352170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.473650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:45.489525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9cb6188c-d7bf-425c-9c93-181ad9e2df95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.350749 Nov 20 20:47:45.492549 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 299/552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:45 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:45.502847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:45.504705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:45.521107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.522663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:45.536667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:45.537312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.020853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.037823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.040005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.041332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbff93ec-4f6f-4f14-8def-7aae016653ab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 0.730529 Nov 20 20:47:46.042672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 254/553] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:45 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:46.074033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.075475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:46.093808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.094825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.098252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.101065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.122094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.138448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af2c2458-76cf-49f0-ae38-b507a15b4ed8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.643292 Nov 20 20:47:46.139096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 300/554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:45 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:46.152624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.153597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:46.169529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.170308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.171263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.171877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.268944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.279976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:46.288017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b09fc368-a558-4fa5-bc6d-ae274fe245f3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1267 microversion: 2.1 time: 0.147134 Nov 20 20:47:46.288482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 301/555] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:46 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:46.296790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62a0faf8-6908-463e-94ae-c51406b91c22 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f871130d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.299337 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e2a73a1-5234-4511-bf0e-ad4c32147393 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1210 microversion: 2.1 time: 0.251281 Nov 20 20:47:46.303900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 255/556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:46 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1210 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:46.331099 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62a0faf8-6908-463e-94ae-c51406b91c22 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1654212907" status: 204 len: 0 microversion: 2.2 time: 0.041522 Nov 20 20:47:46.333621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 302/557] 10.222.0.41 () {60 vars in 1320 bytes} [Sat Nov 20 20:47:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1654212907 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:46.342018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f87b19ee0>, body: {"keypair": {"name": "tempest-keypair-1928114489"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:46.377096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:46.384077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:46.509672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.511499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:46.524523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.524974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.527357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:46.527802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:46.819206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:46.827470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:46.895469 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da4afa16-0fdc-4d2f-bfb8-33587771403e tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.557508 Nov 20 20:47:46.897389 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 256/558] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:46 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 560 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:46.928388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-92f8ec7c-2221-4cb0-be7b-b278fe5fc2a0 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87ac4700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.954318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-92f8ec7c-2221-4cb0-be7b-b278fe5fc2a0 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs/tempest-keypair-1928114489" status: 200 len: 707 microversion: 2.2 time: 0.043633 Nov 20 20:47:46.960375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 257/559] 10.222.0.41 () {60 vars in 1257 bytes} [Sat Nov 20 20:47:46 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1928114489 => generated 707 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:46.968439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6c01ec9-6f51-468e-b62a-fd803494dc77 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87b33a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:46.976318 ncdv-master-1 devstack@n-api.service[140941]: WARNING oslo_db.sqlalchemy.utils [None req-f6c01ec9-6f51-468e-b62a-fd803494dc77 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:47:46.997019 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f6c01ec9-6f51-468e-b62a-fd803494dc77 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.034869 Nov 20 20:47:46.998160 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 258/560] 10.222.0.41 () {60 vars in 1176 bytes} [Sat Nov 20 20:47:46 2021] GET /compute/v2.1/os-keypairs => generated 564 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:47:47.008148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b75410b-1255-4a67-85af-5e1a9b0557b3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87b9d670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:47.051041 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b75410b-1255-4a67-85af-5e1a9b0557b3 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928114489" status: 204 len: 0 microversion: 2.2 time: 0.046529 Nov 20 20:47:47.053861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 259/561] 10.222.0.41 () {60 vars in 1260 bytes} [Sat Nov 20 20:47:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928114489 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:47:47.062630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:47.067812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:47.077115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.077570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.078398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.078838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.204494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:47.219616 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b56e36c-e0c4-483f-819b-0278d95cf29c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.714635 Nov 20 20:47:47.223884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 303/562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:46 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:47.232913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Action: 'create', calling method: .version_select at 0x7f3f8711de50>, body: {"keypair": {"name": "tempest-keypair-1584357957", "type": "x509"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:47.252128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:47.263799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:47.289511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.processutils [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4de02gv9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4de02gv9/temp.key -subj /CN=a17cd7c160384b419117a1e55eccc2f5 -extensions v3_req_client {{(pid=140942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 20 20:47:47.638239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.processutils [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4de02gv9/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4de02gv9/temp.key -subj /CN=a17cd7c160384b419117a1e55eccc2f5 -extensions v3_req_client" returned: 0 in 0.349s {{(pid=140942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 20 20:47:47.639744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.processutils [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4de02gv9/temp.key -password pass: {{(pid=140942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 20 20:47:47.678343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:47.689090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.processutils [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4de02gv9/temp.key -password pass:" returned: 0 in 0.049s {{(pid=140942) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 20 20:47:47.691357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:47.694848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:47.696528 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d8d308d-a670-4831-8f3e-abe619e17fb2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 0.640284 Nov 20 20:47:47.698020 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 260/563] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:47 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:47.712669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:47.714417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:47.725141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.725976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.727229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.728182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.754864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:47.761685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Getting quotas for user a17cd7c160384b419117a1e55eccc2f5 and project 90dd8a1a4a6f43f1b7a3c3dd3371ba8d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:47.783762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d8a520d-b0d2-406b-a866-a7d3d15ea7a4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.557585 Nov 20 20:47:47.794965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 304/564] 10.222.0.41 () {62 vars in 1197 bytes} [Sat Nov 20 20:47:47 2021] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 569 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:47.809334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5", "name": "network-vif-plugged", "status": "completed", "tag": "d96f4ca5-742f-4e26-8329-f408e9d46a05"}, {"server_uuid": "d01ba62e-c3aa-436b-933b-c4a6533f5f03", "name": "network-vif-plugged", "status": "completed", "tag": "5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:47.812347 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:47.812347 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:47.824501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.824919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.842920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] Creating event network-vif-plugged:d96f4ca5-742f-4e26-8329-f408e9d46a05 for instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 on nch1-master-1 Nov 20 20:47:47.843988 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] Creating event network-vif-plugged:5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd for instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 on nch1-master-1 Nov 20 20:47:47.852551 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5fc2b317-5e13-4a0e-9cdd-5e39f0074d9b req-0f50bc77-490a-4cf7-ae59-377fab8a3e1a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053148 Nov 20 20:47:47.854213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 305/565] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:47.875800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:47.876917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:47.896577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.899440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:47.901000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:47.901548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.112577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:48.134297 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0eaa1711-64e1-419e-89c6-2516269d605a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1321 microversion: 2.1 time: 0.275278 Nov 20 20:47:48.135139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 306/566] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:47 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:48.147306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.148364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:48.158528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.164471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.166711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.173307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.266539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:48.279542 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c9d3d3d-7b18-4c0d-910b-c748312442ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1312 microversion: 2.1 time: 0.580153 Nov 20 20:47:48.280172 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 261/567] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:47 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1312 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:48.285128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9afd5846-e496-4653-9e08-d7d7ab438ae4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f87bd0f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.309113 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9afd5846-e496-4653-9e08-d7d7ab438ae4 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs/tempest-keypair-1584357957" status: 200 len: 1534 microversion: 2.2 time: 0.027936 Nov 20 20:47:48.309952 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 262/568] 10.222.0.41 () {60 vars in 1257 bytes} [Sat Nov 20 20:47:48 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1584357957 => generated 1534 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:48.324372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.325710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:48.332798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.333479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.334989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.335580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.347171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:48.361185 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e56e9850-6b8e-4f4a-817f-b091a3a9d1bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1272 microversion: 2.1 time: 0.224942 Nov 20 20:47:48.362742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 307/569] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:48 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:48.387501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6be99d20-6d94-4bf7-bf5d-b924e276ad1b tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f871e78b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.392753 ncdv-master-1 devstack@n-api.service[140942]: WARNING oslo_db.sqlalchemy.utils [None req-6be99d20-6d94-4bf7-bf5d-b924e276ad1b tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:47:48.406989 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6be99d20-6d94-4bf7-bf5d-b924e276ad1b tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.043041 Nov 20 20:47:48.407946 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 308/570] 10.222.0.41 () {60 vars in 1176 bytes} [Sat Nov 20 20:47:48 2021] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:48.420873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-357ff3bc-0c19-4aee-9cec-e6f5240e8431 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] Calling method '.version_select at 0x7f3f871139d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.448701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-357ff3bc-0c19-4aee-9cec-e6f5240e8431 tempest-KeyPairsV22TestJSON-1587849452 tempest-KeyPairsV22TestJSON-1587849452-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584357957" status: 204 len: 0 microversion: 2.2 time: 0.029676 Nov 20 20:47:48.449689 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 309/571] 10.222.0.41 () {60 vars in 1260 bytes} [Sat Nov 20 20:47:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584357957 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:47:48.641052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3e75d867-be36-4dab-b6a8-53b89bb4ff2b req-98f6682a-ef75-4e4f-ab37-0fb7dd917a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6acf73a5-9605-4b53-83dc-09af84fee3fe", "tag": "1f1cf981-26ff-4024-b94c-8e78ef84d154"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:48.644876 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:48.644876 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:48.673502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3e75d867-be36-4dab-b6a8-53b89bb4ff2b req-98f6682a-ef75-4e4f-ab37-0fb7dd917a85 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.674274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3e75d867-be36-4dab-b6a8-53b89bb4ff2b req-98f6682a-ef75-4e4f-ab37-0fb7dd917a85 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.712618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3e75d867-be36-4dab-b6a8-53b89bb4ff2b req-98f6682a-ef75-4e4f-ab37-0fb7dd917a85 service nova] Creating event network-changed:1f1cf981-26ff-4024-b94c-8e78ef84d154 for instance 6acf73a5-9605-4b53-83dc-09af84fee3fe on nch1-master-1 Nov 20 20:47:48.727270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3e75d867-be36-4dab-b6a8-53b89bb4ff2b req-98f6682a-ef75-4e4f-ab37-0fb7dd917a85 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089252 Nov 20 20:47:48.730400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 310/572] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:48.741343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:48.743220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:48.744268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:48.756682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.759765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.760247 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43f8025b-8078-43e4-acd4-9d4cee4f3c29 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1318 microversion: 2.1 time: 0.442750 Nov 20 20:47:48.762295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:48.765204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:48.779735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 263/573] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:48 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:49.153919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:49.155130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:49.163767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.171048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.172117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.174218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.331148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:49.339688 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81aba4cd-5423-45f2-acea-3eaaabfeb0e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1321 microversion: 2.1 time: 0.191874 Nov 20 20:47:49.340283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 264/574] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:49 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:49.348972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:49.349938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:49.367257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.370502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.375266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.379402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.711180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:49.723177 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-de598cfe-6a86-4e04-9ecc-93a9724063ca tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1462 microversion: 2.1 time: 0.377507 Nov 20 20:47:49.737699 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 265/575] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:49 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1462 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:49.746086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:49.750149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:49.761160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.761871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.763073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.764293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.791450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:49.801372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:49.807224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:49.808599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b014b0b6-8c4a-4023-8384-d017982bac8b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 1.076251 Nov 20 20:47:49.822923 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 311/576] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:48 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:49.838474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:49.839539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:49.850235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.858461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:49.860345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:49.860795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.075227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:50.084063 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc4b0392-59d3-4882-8ba9-48c2284c624c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.342777 Nov 20 20:47:50.084662 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 266/577] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:49 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:50.089313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:50.089853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:50.096078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.096526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.097316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.097744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.244333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:50.253031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Old instance type m1.heat2, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 20:47:50.272352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:50.272775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:50.273511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:50.273912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:50.274352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:50.400878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:50.413407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45399026-bde6-483f-9eb9-6581a10cdec8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1468 microversion: 2.1 time: 0.327451 Nov 20 20:47:50.414111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 267/578] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:50 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1468 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:50.421312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-eefdb12e-89fa-4439-b650-4d6e0060f9f1 req-f0363e40-db49-4898-bf91-a71e351712ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8954e-6602-42a8-ba75-16bd4aa8ecf3", "tag": "4d485831-9d58-4e82-8916-5e43c48e5118"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:50.423733 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:50.423733 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:50.453065 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-847db987-d141-4ca1-b759-d24e167db65b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5/action" status: 202 len: 0 microversion: 2.1 time: 0.628911 Nov 20 20:47:50.457348 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 312/579] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:47:49 2021] POST /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:47:50.461337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eefdb12e-89fa-4439-b650-4d6e0060f9f1 req-f0363e40-db49-4898-bf91-a71e351712ff service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.463797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eefdb12e-89fa-4439-b650-4d6e0060f9f1 req-f0363e40-db49-4898-bf91-a71e351712ff service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.466147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:50.466977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:50.478651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.479117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.480009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.480743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.483028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-eefdb12e-89fa-4439-b650-4d6e0060f9f1 req-f0363e40-db49-4898-bf91-a71e351712ff service nova] Creating event network-changed:4d485831-9d58-4e82-8916-5e43c48e5118 for instance 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 on nch2-master-1 Nov 20 20:47:50.495753 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-eefdb12e-89fa-4439-b650-4d6e0060f9f1 req-f0363e40-db49-4898-bf91-a71e351712ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080134 Nov 20 20:47:50.497862 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 268/580] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:50.502852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:50.518643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:50.526630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.527089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.528956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.531902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.919689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:50.929004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e94fd93f-3da9-48fa-962d-18c283435c07 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1466 microversion: 2.1 time: 0.429903 Nov 20 20:47:50.941007 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 269/581] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:50 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1466 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:50.954215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:50.955104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:50.966182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.966869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:50.975833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:50.976522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.064319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:51.082389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f2dd21e-e9ac-464a-a297-09b2e1745aa4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.621208 Nov 20 20:47:51.084220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 313/582] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:50 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:51.098085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:51.102386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:51.111852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.116167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.117145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.117700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.574218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:51.589285 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90e54402-fd40-487a-8745-44512a10e50b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1471 microversion: 2.1 time: 0.646724 Nov 20 20:47:51.589882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 270/583] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:50 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1471 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:51.606886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-443107198"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:51.623467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:51.631458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.631716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.634042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.637660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.688913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:51.704688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:51.710504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:51.716358 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b77943b-c07d-443e-86a3-39b4be40af7e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 0.627459 Nov 20 20:47:51.718297 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 314/584] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:51 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:51.733796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:51.736737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:51.753828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.754873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:51.757836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:51.758462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:52.295416 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-efb06968-11d4-4d3b-90b9-21bec19268b7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "POST /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26/action" status: 202 len: 0 microversion: 2.1 time: 0.691906 Nov 20 20:47:52.298032 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 271/585] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:47:51 2021] POST /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:47:52.312004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7a6f92d0-52b3-4e30-a522-55425f143323 req-a896c23d-f5b7-44d4-a885-276bcc788acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564e731b-fef8-42db-8af6-3500bc8c6798", "name": "network-vif-plugged", "status": "completed", "tag": "189ed4ef-80e9-4e25-b461-a33679104e74"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:52.315692 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:52.315692 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:52.332562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7a6f92d0-52b3-4e30-a522-55425f143323 req-a896c23d-f5b7-44d4-a885-276bcc788acf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:52.334344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7a6f92d0-52b3-4e30-a522-55425f143323 req-a896c23d-f5b7-44d4-a885-276bcc788acf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:52.362984 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7a6f92d0-52b3-4e30-a522-55425f143323 req-a896c23d-f5b7-44d4-a885-276bcc788acf service nova] Creating event network-vif-plugged:189ed4ef-80e9-4e25-b461-a33679104e74 for instance 564e731b-fef8-42db-8af6-3500bc8c6798 on nch2-master-1 Nov 20 20:47:52.388002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7a6f92d0-52b3-4e30-a522-55425f143323 req-a896c23d-f5b7-44d4-a885-276bcc788acf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085860 Nov 20 20:47:52.389780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 272/586] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:52.407753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:52.408589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:52.420919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:52.423864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:52.425469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:52.428336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:52.464534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:52.472467 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a5a4bd6-252d-4c37-b152-5aa008b93111 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.751751 Nov 20 20:47:52.499090 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 315/587] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:51 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:52.519040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adc2f29a-aaab-4320-a3e8-f9bd00e1da5b tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871fd310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:52.598601 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-adc2f29a-aaab-4320-a3e8-f9bd00e1da5b tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.098339 Nov 20 20:47:52.600221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 316/588] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:52 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:52.618499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:52.619310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:52.625390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:52.626027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:52.637077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:52.637077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.204145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.212687 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-691da89c-d243-4ff3-b325-792a96707a7a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.821444 Nov 20 20:47:53.221632 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 273/589] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:52 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:53.237801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:53.238490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:53.258384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:53.259031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.260168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:53.260740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.340516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.352929 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-96fccaec-c2fc-4e5a-b339-c487a56dd2b0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1471 microversion: 2.1 time: 0.749391 Nov 20 20:47:53.354095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 317/590] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:52 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1471 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:53.359949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4923e2f2-7377-4cea-9e71-a2eceebff792 req-93b95aad-4023-4794-8e6b-4fe0fa0f55b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c757299-9a55-42d6-a189-d689f2c8f7ef", "tag": "49830bee-e4b8-4568-83a8-d29f300b9690"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:53.370570 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:53.370570 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:47:53.380264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4923e2f2-7377-4cea-9e71-a2eceebff792 req-93b95aad-4023-4794-8e6b-4fe0fa0f55b7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:53.381290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4923e2f2-7377-4cea-9e71-a2eceebff792 req-93b95aad-4023-4794-8e6b-4fe0fa0f55b7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.394624 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4923e2f2-7377-4cea-9e71-a2eceebff792 req-93b95aad-4023-4794-8e6b-4fe0fa0f55b7 service nova] Creating event network-changed:49830bee-e4b8-4568-83a8-d29f300b9690 for instance 2c757299-9a55-42d6-a189-d689f2c8f7ef on nch2-master-1 Nov 20 20:47:53.401180 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4923e2f2-7377-4cea-9e71-a2eceebff792 req-93b95aad-4023-4794-8e6b-4fe0fa0f55b7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045150 Nov 20 20:47:53.402593 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 318/591] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:47:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:53.484321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.496925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.499014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.500827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b078aff1-c266-4e77-bde0-4b0207f1138f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1361 microversion: 2.25 time: 0.278026 Nov 20 20:47:53.502313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 274/592] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:53 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:53.508339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:53.508952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:53.522982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:53.524137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.525033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:53.525706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:53.670534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:53.674433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-411260285", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "e089fcf3-9dcc-485e-b53f-bb119c8c3467"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:53.680088 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27b6b375-ad76-4c3b-8e06-12aad529a7e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.175782 Nov 20 20:47:53.680813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 275/593] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:53 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:53.685495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a18cefbf-0271-4efd-b6aa-6cda9681ccda tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87b41310>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:53.733332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a18cefbf-0271-4efd-b6aa-6cda9681ccda tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.051272 Nov 20 20:47:53.738096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 276/594] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:53 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:53.738233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] validate_networks() for [('e089fcf3-9dcc-485e-b53f-bb119c8c3467', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:54.230292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:54.231304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:54.238504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:54.239088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:54.240569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:54.241146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:54.413291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:54.421371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5937877-4751-478f-9b89-6ff367f0af54 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.195164 Nov 20 20:47:54.421975 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 277/595] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:54 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:54.426689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:54.428093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:54.434472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:54.434921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:54.435755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:54.436362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:54.601659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:54.609566 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76fa292b-4fc5-4399-8770-42fd7ae40dbf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1471 microversion: 2.1 time: 0.186593 Nov 20 20:47:54.610561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 278/596] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:54 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:54.675335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1240757587", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "554d0697-db40-4745-a60d-da36ede89e92"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:54.726865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] validate_networks() for [('554d0697-db40-4745-a60d-da36ede89e92', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:47:55.251379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:55.254183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:55.257229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:55.258041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:55.259374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:55.279996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:47:55.281016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:47:55.281638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:47:55.282279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:47:55.282833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:47:55.291232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.293800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.296975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.299797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.308790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.309231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.310035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.310501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.346444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:55.353364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for user dbb46ce41ca44f57aeef1d6b2191b4cb and project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:55.366209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:47:55.377574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for user b9094951b1a24a48a1db5b87e80f6234 and project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:47:55.382879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:55.385212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:55.398679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:47:55.402349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:47:55.485240 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e76302b-c5ed-4136-aef4-ba5e778a667a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872161 Nov 20 20:47:55.488082 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 279/597] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:55.498658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:55.501751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:55.514500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.517671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.518886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.519765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.610148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e71e744c-0652-436d-aa8b-3d9307776a68 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202918 Nov 20 20:47:55.611034 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 319/598] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:47:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:47:55.657772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:55.664423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:55.688425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.692067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.695685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.698683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.854323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:55.862267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:55.865428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:55.866737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7634bca5-d656-495e-b8d5-e351f77367d0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1556 microversion: 2.25 time: 0.377551 Nov 20 20:47:55.874732 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 280/599] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:55 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1556 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:55.885535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cd60069-65c7-4e24-826d-d5a21d70fa40 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87c39af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:55.954967 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cd60069-65c7-4e24-826d-d5a21d70fa40 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.078969 Nov 20 20:47:55.955625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 281/600] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:55 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:55.968900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:55.970251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:55.979272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:55.980308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:55.999199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:56.000186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:56.076325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:56.097249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c50b6501-3654-4bd7-8011-db144e05f9c7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.475664 Nov 20 20:47:56.098043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 320/601] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:55 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:56.141131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ef50129-5c3f-4d9e-9bde-6ae72a0b2c3f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:56.147292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ef50129-5c3f-4d9e-9bde-6ae72a0b2c3f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:56.313511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ef50129-5c3f-4d9e-9bde-6ae72a0b2c3f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:56.321327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ef50129-5c3f-4d9e-9bde-6ae72a0b2c3f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1211 microversion: 2.1 time: 0.194623 Nov 20 20:47:56.324419 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 321/602] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:56 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1211 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:56.338690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69e44786-4488-4634-bdcc-c1581a38410d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:56.339655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69e44786-4488-4634-bdcc-c1581a38410d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:56.348372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:56.357916 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49228f8a-3bdd-4188-9424-8a0ad0f18135 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.392942 Nov 20 20:47:56.358770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 282/603] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:55 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:56.363288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:56.365316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:56.371705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:56.372331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:56.374552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:56.375603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:56.450387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-69e44786-4488-4634-bdcc-c1581a38410d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:56.459664 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69e44786-4488-4634-bdcc-c1581a38410d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1224 microversion: 2.1 time: 0.132458 Nov 20 20:47:56.460467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 322/604] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:56 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:56.620944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-057f4abe-4b09-423b-8815-7fa50c564c37 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f86f7fb80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1133834701", "description": "tempest-description-1234835390"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:56.659578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:56.668214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f4d40b8-ce6e-4f30-89be-4a3cca0793c1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.308183 Nov 20 20:47:56.674595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 283/605] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:56 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:56.904617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:56.905914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:56.915972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:56.917643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:56.919624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:56.921369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:56.943631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-057f4abe-4b09-423b-8815-7fa50c564c37 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.481817 Nov 20 20:47:56.945456 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 323/606] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:47:56 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:56.957229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45cda93e-456d-48db-912f-9cf018925d91 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f86f7f430>, body: {"security_group_rule": {"parent_group_id": "0fcf19d0-1437-48d8-bc8f-5498493aa410", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:57.170110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 564e731b-fef8-42db-8af6-3500bc8c6798 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:57.238447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fe5cb62-2507-483c-b1b4-901dae60f7f4 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 2048 microversion: 2.25 time: 0.562292 Nov 20 20:47:57.239163 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 284/607] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:56 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 2048 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:57.246131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2777432a-a5f2-4122-be1b-8c5573fda2dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87b33790>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:57.316925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2777432a-a5f2-4122-be1b-8c5573fda2dc tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.075076 Nov 20 20:47:57.318519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 285/608] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:57 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:57.323351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:57.324135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:57.331150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.331905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.332860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.335716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.502413 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45cda93e-456d-48db-912f-9cf018925d91 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.548920 Nov 20 20:47:57.516509 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 324/609] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:47:56 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:57.519983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:57.520628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:57.543814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.547757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.553374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.554253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.585117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:57.598016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b25851d-d2e6-4539-8b0e-e8a30077b778 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.275652 Nov 20 20:47:57.602823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 286/610] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:57 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:57.612194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:57.613271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:57.634413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.637074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.637922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.638398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.818581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:57.836304 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b258a6d-5d9a-4439-85aa-760a82b76adf tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1269 microversion: 2.1 time: 0.232163 Nov 20 20:47:57.838916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 287/611] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:57 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1269 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:57.850526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:57.851987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:57.860698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.861154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:57.861956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:57.862492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.047232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 564e731b-fef8-42db-8af6-3500bc8c6798 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:58.128132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:58.136252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95d677a1-157c-472e-a617-9c1b4d3a11c2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.294820 Nov 20 20:47:58.136631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 288/612] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:57 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:58.160938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:58.161639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:58.197300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-958bfb63-54ab-4ecf-83ab-2ac3c323da61 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 2048 microversion: 2.25 time: 0.692205 Nov 20 20:47:58.197686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.198318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.199273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.199613 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 325/613] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:47:57 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 2048 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:47:58.201526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.204760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86e1e16e-21c3-488a-9167-1dc38f6b0add tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f86f7f3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1155608301", "description": "tempest-description-653566575"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:58.341930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:58.355843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-791501b6-6d85-4c25-a7b8-b6e769df38ff tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1282 microversion: 2.1 time: 0.212071 Nov 20 20:47:58.359315 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 289/614] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:58 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:58.371568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:58.374254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:58.389791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.390639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.393135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.393772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.702667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:58.711076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-deb9670c-a626-4de6-83d6-e672bee6fc4c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.349035 Nov 20 20:47:58.711656 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 290/615] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:58 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:58.720982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:58.724407 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86e1e16e-21c3-488a-9167-1dc38f6b0add tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.523461 Nov 20 20:47:58.729547 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:47:58.729547 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:47:58.731655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.732293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.733312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.733920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.734914 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 326/616] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:47:58 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:58.739987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1969e03d-6402-4528-9292-00be4e217d33 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f870ef430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:58.806376 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb00e7fc-aa6c-4ea1-a94e-facd8669b0f0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.093567 Nov 20 20:47:58.808158 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 291/617] 10.222.0.41 () {60 vars in 1216 bytes} [Sat Nov 20 20:47:58 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:47:58.837259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1969e03d-6402-4528-9292-00be4e217d33 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.101006 Nov 20 20:47:58.840933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 327/618] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:47:58 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:58.850799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:58.851629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:58.857747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.858637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73e622dc-3da6-4d73-a13c-6571f732d4a7 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f86fe13a0>, body: {"security_group_rule": {"parent_group_id": "9b2c5737-1267-460e-8252-07642b02e59a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:58.859212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:58.860119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:58.862857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.203228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:59.214770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81305bc4-81b3-4af2-a219-36eaf26e6a62 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.405400 Nov 20 20:47:59.215540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 292/619] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:58 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:59.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:47:59.228264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:59.241922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.242848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.243968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.244638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.271515 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73e622dc-3da6-4d73-a13c-6571f732d4a7 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.417879 Nov 20 20:47:59.272655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 328/620] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:47:58 2021] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:47:59.282332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:59.283200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:59.294934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.295715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.297993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.298637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.308860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'flavor' on Instance uuid 564e731b-fef8-42db-8af6-3500bc8c6798 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:47:59.348360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Going to try to live migrate instance to nch1-master-1 {{(pid=140941) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:47:59.675757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:47:59.684583 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25653c41-d60c-4ba1-9228-7215e6c6f03a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.410487 Nov 20 20:47:59.687620 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 329/621] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:59 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:47:59.700716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:47:59.701586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:47:59.715134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.715826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:47:59.716807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:47:59.717406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:00.110567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:00.119571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ece46b92-6500-4ad6-9bd8-846dbac8d71f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.430734 Nov 20 20:48:00.133390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 330/622] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:47:59 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:00.139804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94373eb1-2568-4d38-9ff7-eca851cd57f9 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f871720d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-889797281", "description": "tempest-description-1152122394"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:00.694247 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94373eb1-2568-4d38-9ff7-eca851cd57f9 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.558882 Nov 20 20:48:00.695729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 331/623] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:48:00 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:00.699827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:00.700728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:00.723836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:00.725037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:00.726183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:00.726856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.047021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:01.061553 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e122eb87-c54b-4c8d-939c-3e7b5c9be689 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.364875 Nov 20 20:48:01.077811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 332/624] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:00 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:01.087840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ab997859-acc9-4564-ae7c-9e63fe258e45 req-74598c21-d84a-4b3d-b2e0-8fff1890f22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acf73a5-9605-4b53-83dc-09af84fee3fe", "name": "network-vif-plugged", "status": "completed", "tag": "1f1cf981-26ff-4024-b94c-8e78ef84d154"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:01.091659 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:01.091659 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:01.111807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ab997859-acc9-4564-ae7c-9e63fe258e45 req-74598c21-d84a-4b3d-b2e0-8fff1890f22c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.113181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ab997859-acc9-4564-ae7c-9e63fe258e45 req-74598c21-d84a-4b3d-b2e0-8fff1890f22c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.134204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ab997859-acc9-4564-ae7c-9e63fe258e45 req-74598c21-d84a-4b3d-b2e0-8fff1890f22c service nova] Creating event network-vif-plugged:1f1cf981-26ff-4024-b94c-8e78ef84d154 for instance 6acf73a5-9605-4b53-83dc-09af84fee3fe on nch1-master-1 Nov 20 20:48:01.150226 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ab997859-acc9-4564-ae7c-9e63fe258e45 req-74598c21-d84a-4b3d-b2e0-8fff1890f22c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065003 Nov 20 20:48:01.151887 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 333/625] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:01.160075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:01.166088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:01.175839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.176579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.178246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.178913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.455270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:01.463799 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef8e2251-f0b9-4148-84eb-73a72d8b3fda tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.310230 Nov 20 20:48:01.464578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 334/626] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:01 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:01.478829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c59ae5c-b5f9-49ba-90d0-4112a2e113d3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871e7310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:01.541193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c59ae5c-b5f9-49ba-90d0-4112a2e113d3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.075273 Nov 20 20:48:01.542072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 335/627] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:01 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:01.546789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:01.547816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:01.555026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.555868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.556916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.557717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.712502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:01.720171 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b860c048-2f2f-4a12-bfdd-7bae4f2ee028 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.176663 Nov 20 20:48:01.720810 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 336/628] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:01 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:01.726704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-fbf7670d-c690-4ef9-b3c4-9b17a15b0792 req-5d9b1814-9f37-4479-aa6c-68f52aa4f967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40", "tag": "6b6045ba-274e-4026-bce3-97b2ebae1812"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:01.728618 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:01.728618 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:01.735753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fbf7670d-c690-4ef9-b3c4-9b17a15b0792 req-5d9b1814-9f37-4479-aa6c-68f52aa4f967 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.736267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fbf7670d-c690-4ef9-b3c4-9b17a15b0792 req-5d9b1814-9f37-4479-aa6c-68f52aa4f967 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.748335 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-fbf7670d-c690-4ef9-b3c4-9b17a15b0792 req-5d9b1814-9f37-4479-aa6c-68f52aa4f967 service nova] Creating event network-changed:6b6045ba-274e-4026-bce3-97b2ebae1812 for instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 on nch1-master-1 Nov 20 20:48:01.755042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-fbf7670d-c690-4ef9-b3c4-9b17a15b0792 req-5d9b1814-9f37-4479-aa6c-68f52aa4f967 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032650 Nov 20 20:48:01.756668 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 337/629] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:01.761900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-44ed5020-7fba-4dc3-a033-aa99567af608 req-a9f9181d-6f80-4540-976a-8de6b3e02a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f26975-add1-4d8b-aee6-67a5d77835e4", "tag": "4584c376-5c69-4cf4-91b1-13f4afc7c28d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:01.763895 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:01.763895 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:01.772389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-44ed5020-7fba-4dc3-a033-aa99567af608 req-a9f9181d-6f80-4540-976a-8de6b3e02a2d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.772843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-44ed5020-7fba-4dc3-a033-aa99567af608 req-a9f9181d-6f80-4540-976a-8de6b3e02a2d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.785622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-44ed5020-7fba-4dc3-a033-aa99567af608 req-a9f9181d-6f80-4540-976a-8de6b3e02a2d service nova] Creating event network-changed:4584c376-5c69-4cf4-91b1-13f4afc7c28d for instance 60f26975-add1-4d8b-aee6-67a5d77835e4 on nch1-master-1 Nov 20 20:48:01.791615 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-44ed5020-7fba-4dc3-a033-aa99567af608 req-a9f9181d-6f80-4540-976a-8de6b3e02a2d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033625 Nov 20 20:48:01.792826 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 338/630] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:01.797899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:01.798850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:01.808725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.809421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.810975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:01.811721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:01.882420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ca8c78c-8a91-4116-a753-45b06868bde8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798/action" status: 202 len: 0 microversion: 2.25 time: 2.665495 Nov 20 20:48:01.888673 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 293/631] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:47:59 2021] POST /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798/action => generated 0 bytes in 2670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:01.892633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fda5c1d9-310e-4b4c-9d00-c1cf94e98505 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87a6c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2019475391", "description": "tempest-description-1448232521"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:02.146121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:02.165496 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a66df356-454d-4b5f-bdb4-c34878efe2f5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.370838 Nov 20 20:48:02.167261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 339/632] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:01 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:02.186634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:02.188299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:02.198929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.198929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.199287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.200260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.328888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fda5c1d9-310e-4b4c-9d00-c1cf94e98505 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.441263 Nov 20 20:48:02.329488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 294/633] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:48:01 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:02.334881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:02.335708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:02.347845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.348524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.350621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.354276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.639862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:02.658628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:02.665170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:02.666807 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-008fbfd8-9069-4519-b491-c937d82cf274 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.336099 Nov 20 20:48:02.667736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 295/634] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:02 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:02.672292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:02.673102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:02.680970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.682591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.684318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:02.685039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:02.879666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:02.891811 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06bc391f-9634-4fcf-8a4e-49f439251b78 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.222832 Nov 20 20:48:02.892769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 296/635] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:02 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:02.904512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a708eaa9-177f-4562-9d32-5d72994465f2 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87a6c4c0>, body: {"security_group_rule": {"parent_group_id": "5ea0cedc-301c-417f-99d2-c0d3a5fbe0a8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "8312e254-01a8-4e4b-979d-bcf3f19a8a4c"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:03.095343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:03.105475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12457132-b16a-4c1d-8303-dd8c013d16ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.936989 Nov 20 20:48:03.109258 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 340/636] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:02 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:03.119860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:03.120766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:03.135473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.135843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.136726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.137216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.272002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a708eaa9-177f-4562-9d32-5d72994465f2 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.374378 Nov 20 20:48:03.272847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 297/637] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:48:02 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:03.284069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7cded656-c9f6-44a1-b0ea-1eff62546dd3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a6c670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:03.335860 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7cded656-c9f6-44a1-b0ea-1eff62546dd3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.061800 Nov 20 20:48:03.336683 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 298/638] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:03 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:03.341593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:03.342545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:03.350532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.351185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.352160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.352751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.527247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:03.533529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:03.543248 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da74c588-2acc-41d3-bd40-7e4544ac7738 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.432544 Nov 20 20:48:03.544362 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 341/639] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:03 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:03.545899 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11e13563-a67f-4d6b-921d-63175a7fad40 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.207579 Nov 20 20:48:03.546660 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 299/640] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:03 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:03.550960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:03.551715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:03.559447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8954e-6602-42a8-ba75-16bd4aa8ecf3", "name": "network-vif-plugged", "status": "completed", "tag": "4d485831-9d58-4e82-8916-5e43c48e5118"}, {"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-plugged", "status": "completed", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}, {"server_uuid": "2c757299-9a55-42d6-a189-d689f2c8f7ef", "name": "network-vif-plugged", "status": "completed", "tag": "49830bee-e4b8-4568-83a8-d29f300b9690"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:03.559677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.560027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.560824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.561268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.562207 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:03.562207 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:03.571118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.571799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.587442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Creating event network-vif-plugged:4d485831-9d58-4e82-8916-5e43c48e5118 for instance 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 on nch2-master-1 Nov 20 20:48:03.588230 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Creating event network-vif-plugged:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:48:03.588914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] Creating event network-vif-plugged:49830bee-e4b8-4568-83a8-d29f300b9690 for instance 2c757299-9a55-42d6-a189-d689f2c8f7ef on nch2-master-1 Nov 20 20:48:03.597974 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d5a21294-a2b4-42c1-a980-3293162761ba req-4e7a4418-6c94-4347-b86f-5f8d9442d78f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051923 Nov 20 20:48:03.604084 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 342/641] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:03.609619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44d7621b-c0c2-4be5-964f-d64683ff26ff tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f871e7d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-302915415", "description": "tempest-description-1823075952"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:03.789816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:03.806637 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eca6f155-2f3f-49cd-ad46-d2c21eade2ac tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.256031 Nov 20 20:48:03.807846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 300/642] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:03 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:03.820213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:03.822981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:03.832540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.834257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:03.836146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:03.836866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.046487 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44d7621b-c0c2-4be5-964f-d64683ff26ff tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.440870 Nov 20 20:48:04.054363 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 343/643] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:48:03 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:04.063066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:04.064139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:04.072170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.072883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.074792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.075899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.298254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:04.307989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:04.309702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:04.310985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-106ba18e-5ceb-4217-aed4-5907d6a91c80 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.502007 Nov 20 20:48:04.311627 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 301/644] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:03 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:04.322673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9def0974-4205-43f2-adae-bd3367e931cd tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87b363a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1054622566", "description": "tempest-description-682893154"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:04.342217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:04.356411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34078e78-d68e-44db-9f6e-4eeb4a50c88d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.300484 Nov 20 20:48:04.357345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 344/645] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:04 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:04.362896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:04.363679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:04.372553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.373256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.374294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.374889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.544567 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9def0974-4205-43f2-adae-bd3367e931cd tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.228316 Nov 20 20:48:04.545342 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 302/646] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:48:04 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:04.565637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-133cbee5-3af7-4d8b-8bac-d1d978b3ec95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87b331f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:04.625928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-133cbee5-3af7-4d8b-8bac-d1d978b3ec95 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.071821 Nov 20 20:48:04.626815 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 303/647] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:04 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:04.634875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93e0f0a8-cc48-46e4-8425-31dfabc9733e tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87b333a0>, body: {"security_group_rule": {"parent_group_id": "28d60a0b-323a-4806-a4bd-518f6aadc8b8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "31c36607-66cf-4da0-b414-d0d7fe059673"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:04.705086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:04.712623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17c9bf58-388f-48fe-a2f6-be71db9d0226 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1389 microversion: 2.1 time: 0.354081 Nov 20 20:48:04.722570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 345/648] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:04 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1389 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:04.722570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:04.722570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:04.737392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.737750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.738582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:04.739015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:04.992320 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93e0f0a8-cc48-46e4-8425-31dfabc9733e tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.364009 Nov 20 20:48:04.994345 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 304/649] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:48:04 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:04.998975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:04.999771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:05.034821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.038112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.039135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.041750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.238401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.261524 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2bd1bc4d-c9a2-44f2-a2ae-687b6c7eb8da tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.547249 Nov 20 20:48:05.273561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 346/650] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:04 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:05.289550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1a7642c2-1e02-474f-a8a7-1c78f5606a30 req-0a9e30fc-dd08-4983-bc6d-0a9c3c6e6899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564e731b-fef8-42db-8af6-3500bc8c6798", "name": "network-vif-unplugged", "status": "completed", "tag": "189ed4ef-80e9-4e25-b461-a33679104e74"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:05.296066 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:05.296066 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:05.313215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a7642c2-1e02-474f-a8a7-1c78f5606a30 req-0a9e30fc-dd08-4983-bc6d-0a9c3c6e6899 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.315143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a7642c2-1e02-474f-a8a7-1c78f5606a30 req-0a9e30fc-dd08-4983-bc6d-0a9c3c6e6899 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.340316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.348521 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1a7642c2-1e02-474f-a8a7-1c78f5606a30 req-0a9e30fc-dd08-4983-bc6d-0a9c3c6e6899 service nova] Creating event network-vif-unplugged:189ed4ef-80e9-4e25-b461-a33679104e74 for instance 564e731b-fef8-42db-8af6-3500bc8c6798 on nch2-master-1 Nov 20 20:48:05.352635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10bd8c2d-4ac2-490c-a885-54264848e25d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1314 microversion: 2.1 time: 0.356993 Nov 20 20:48:05.364426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1a7642c2-1e02-474f-a8a7-1c78f5606a30 req-0a9e30fc-dd08-4983-bc6d-0a9c3c6e6899 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086161 Nov 20 20:48:05.365676 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 347/651] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:05.367470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 305/652] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:04 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:05.373059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da8f596b-d319-4103-b1db-768bf29b8ee1 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a8e550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:05.377338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:05.385329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:05.392074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.392762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.393770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.394388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.634033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.645025 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8ae3974-9c5f-430b-bf35-c95102052ba0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.277888 Nov 20 20:48:05.648992 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 348/653] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:05 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:05.655646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:05.661357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:05.673355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.679035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.680225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.680822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.787184 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da8f596b-d319-4103-b1db-768bf29b8ee1 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/31c36607-66cf-4da0-b414-d0d7fe059673" status: 202 len: 0 microversion: 2.1 time: 0.417621 Nov 20 20:48:05.788276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 306/654] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:05 2021] DELETE /compute/v2.1/os-security-groups/31c36607-66cf-4da0-b414-d0d7fe059673 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:05.793104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:05.793958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:05.803423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.804143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.805266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:05.818853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:05.921693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.936047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.937659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:05.938882 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-612d1d09-02cb-481d-90a9-1a9b136fabfd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.288750 Nov 20 20:48:05.949463 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 349/655] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:05 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:05.949463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-645364cd-33d9-481e-a600-4e9054485d4a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86fe18b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:05.999966 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-645364cd-33d9-481e-a600-4e9054485d4a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.059438 Nov 20 20:48:06.007935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 350/656] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:05 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:06.012821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.013476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:06.019571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.020044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.021381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.022148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.030594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:06.039488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7081dc2b-c054-4bcd-a41a-045f8456aee6 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.249998 Nov 20 20:48:06.040833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 307/657] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:05 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:06.047383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cbfecfd-77cf-4c58-ac37-3bcfed68bf56 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87ac4310>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.115544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cbfecfd-77cf-4c58-ac37-3bcfed68bf56 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/28d60a0b-323a-4806-a4bd-518f6aadc8b8" status: 200 len: 247 microversion: 2.1 time: 0.071695 Nov 20 20:48:06.130352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 308/658] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/os-security-groups/28d60a0b-323a-4806-a4bd-518f6aadc8b8 => generated 247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:06.136652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16a4843f-054b-48d1-97bf-44d2575b2993 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87b33a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-558793015", "description": "tempest-description-825184471"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:06.208506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:06.222673 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff635038-7250-4c6f-8482-4f3a50961656 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1589 microversion: 2.1 time: 0.212229 Nov 20 20:48:06.238439 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 351/659] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1589 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:06.250340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.251189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:06.260664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.261123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.262501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.262954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.340488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16a4843f-054b-48d1-97bf-44d2575b2993 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.208641 Nov 20 20:48:06.354469 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 309/660] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:48:06 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:06.354469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.362489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:06.369520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.371975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.372864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.373313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.386422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6bd834f-0e0b-4214-9aa6-12717abd87cf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146402 Nov 20 20:48:06.394317 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 352/661] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:06.399626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ffc0843-24cf-484e-9940-ada285fb83a8 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f86f9f9d0>, body: {"security_group_rule": {"parent_group_id": "dcb4492b-9f67-4e5a-8021-42debabca608", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:06.684319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:06.691813 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ce3ef35-0e99-4cac-8368-319e699aa573 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.342677 Nov 20 20:48:06.693524 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 310/662] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:06.698219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.698897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:06.708135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.709259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.710247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.710877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.883457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:06.892812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-912e80b9-4cdd-4433-adc8-1b9bff5e7ab5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1464 microversion: 2.1 time: 0.197910 Nov 20 20:48:06.894411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 311/663] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1464 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:06.899368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:06.900152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:06.907750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.908424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:06.909403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:06.909983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.091246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.100652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94561994-5c39-4ef8-b331-15c39ca82432 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.205004 Nov 20 20:48:07.101237 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 312/664] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:06 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:07.117772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:07.118419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:07.125084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.126030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.126433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.126879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.247817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ffc0843-24cf-484e-9940-ada285fb83a8 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.852064 Nov 20 20:48:07.254190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 353/665] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:48:06 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:07.259494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:07.260295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:07.268660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.269560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.272458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.273506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.297367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.306109 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7aacba00-0854-40d7-8911-97dbfc1638ce tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1462 microversion: 2.1 time: 0.192347 Nov 20 20:48:07.318179 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 313/666] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:07 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1462 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:07.318179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d670c19-9102-4557-b3c2-5c4ac6178154 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a6c670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:07.365921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d670c19-9102-4557-b3c2-5c4ac6178154 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.055970 Nov 20 20:48:07.371770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 314/667] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:07 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:07.372055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:07.372477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:07.379230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.379681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.380839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:07.381466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:07.577625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.588476 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-349afb6b-5321-4f2a-a6c5-ce55951d04c9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.220309 Nov 20 20:48:07.599326 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 315/668] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:07 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:07.603263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7fc9756-3710-4879-8793-7ec863dfef4a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Action: 'create', calling method: .version_select at 0x7f3f87bd0d30>, body: {"security_group_rule": {"parent_group_id": "dcb4492b-9f67-4e5a-8021-42debabca608", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:07.836935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7fc9756-3710-4879-8793-7ec863dfef4a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.238547 Nov 20 20:48:07.846271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 316/669] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:48:07 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:07.851586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1067234182", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6acf73a5-9605-4b53-83dc-09af84fee3fe"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:07.910984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:07.945160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.957651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.963500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:07.966327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff8ac3b8-fcb7-4293-8cf0-9fa76898b082 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.709753 Nov 20 20:48:07.969144 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 354/670] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:07 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:07.981136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:07.982510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:08.003091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.003800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.006697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.009686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.188690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:08.189115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:08.189735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:08.190177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:08.190587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:08.200329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.200782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.201603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.202168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.221163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:08.225606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Getting quotas for user 634f122b90184fd794dd55b6b09fd98d and project c1a432e5f0bc49dc942d406268442ed3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:08.237549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:08.240340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:08.266835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:08.281184 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45269e23-4b2b-4f45-832a-b2c0c1549c9d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.308338 Nov 20 20:48:08.291744 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 355/671] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:07 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:08.291744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a0297bde-c8cb-4ff9-afd2-2b8e0575b89e req-c33cb06d-10c0-42fa-829d-c7d7d936c2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564e731b-fef8-42db-8af6-3500bc8c6798", "tag": "189ed4ef-80e9-4e25-b461-a33679104e74"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:08.291744 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:08.291744 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:08.300741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0297bde-c8cb-4ff9-afd2-2b8e0575b89e req-c33cb06d-10c0-42fa-829d-c7d7d936c2b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.301193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0297bde-c8cb-4ff9-afd2-2b8e0575b89e req-c33cb06d-10c0-42fa-829d-c7d7d936c2b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.303676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d04d6c4-596b-47c0-9968-756777d3464a tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456079 Nov 20 20:48:08.304887 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 317/672] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:48:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:48:08.309654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6445780d-a740-47fd-9435-5c67fb1d60ab tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a03940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.324368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a0297bde-c8cb-4ff9-afd2-2b8e0575b89e req-c33cb06d-10c0-42fa-829d-c7d7d936c2b3 service nova] Creating event network-changed:189ed4ef-80e9-4e25-b461-a33679104e74 for instance 564e731b-fef8-42db-8af6-3500bc8c6798 on nch2-master-1 Nov 20 20:48:08.339400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a0297bde-c8cb-4ff9-afd2-2b8e0575b89e req-c33cb06d-10c0-42fa-829d-c7d7d936c2b3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052174 Nov 20 20:48:08.340579 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 356/673] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:08.352921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.353879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:08.367227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.367692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.369082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.369714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.413002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6445780d-a740-47fd-9435-5c67fb1d60ab tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/dcb4492b-9f67-4e5a-8021-42debabca608" status: 200 len: 663 microversion: 2.1 time: 0.106720 Nov 20 20:48:08.413595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 318/674] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:48:08 2021] GET /compute/v2.1/os-security-groups/dcb4492b-9f67-4e5a-8021-42debabca608 => generated 663 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:08.419775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ceaca08-5ca0-4c62-8d07-399d09a361f1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.420387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ceaca08-5ca0-4c62-8d07-399d09a361f1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:08.503691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ceaca08-5ca0-4c62-8d07-399d09a361f1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:08.539296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ceaca08-5ca0-4c62-8d07-399d09a361f1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1214 microversion: 2.1 time: 0.113504 Nov 20 20:48:08.539900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 319/675] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:08 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:08.545451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e5c92e1-d600-405c-973f-74c759dd43a2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a03040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.608760 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e5c92e1-d600-405c-973f-74c759dd43a2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.067919 Nov 20 20:48:08.615101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 320/676] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:08 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:08.619613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89452868-ac33-4a29-b3f7-8347c251ee9e tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a6cf70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.853419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89452868-ac33-4a29-b3f7-8347c251ee9e tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-group-rules/b3b15397-7c44-4fd2-90e4-9f2b0a8601bf" status: 202 len: 0 microversion: 2.1 time: 0.237166 Nov 20 20:48:08.854009 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 321/677] 10.222.0.41 () {58 vars in 1286 bytes} [Sat Nov 20 20:48:08 2021] DELETE /compute/v2.1/os-security-group-rules/b3b15397-7c44-4fd2-90e4-9f2b0a8601bf => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:08.859077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:08.859695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:08.873638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.874116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.874933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:08.875370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:08.992782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.013573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1a8d53eb-fc54-49b6-abc2-0d55e9ce4411 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.667767 Nov 20 20:48:09.015520 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 357/678] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:08 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:09.023917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-66d39038-995f-4a9b-bc03-c37e6c3ee97d tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f870a5f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.174931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.184722 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9580fa84-dab7-40bd-827e-9563e0baaa0c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.329640 Nov 20 20:48:09.194948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 322/679] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:08 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:09.194948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:09.194948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:09.198329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.198781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.199731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.200171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.279562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a7785ee-fd97-4ff8-aeaf-ab2ad1ad8c2a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.092032 Nov 20 20:48:09.280226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 323/680] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:09 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:09.287520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.287998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:09.312676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.313129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.313936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.314400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.517353 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-66d39038-995f-4a9b-bc03-c37e6c3ee97d tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/dcb4492b-9f67-4e5a-8021-42debabca608" status: 202 len: 0 microversion: 2.1 time: 0.499568 Nov 20 20:48:09.523296 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 358/681] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:09 2021] DELETE /compute/v2.1/os-security-groups/dcb4492b-9f67-4e5a-8021-42debabca608 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:09.528468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.529427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:09.546708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.547729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.549046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.549774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.594696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.604481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.616248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.623599 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6bb05524-cdf4-4870-9182-38e3f08caa49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.340806 Nov 20 20:48:09.635191 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 324/682] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:09 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:09.635191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a6c430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.668995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31c36607-66cf-4da0-b414-d0d7fe059673 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:48:09.669626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Neutron security group 31c36607-66cf-4da0-b414-d0d7fe059673 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] HTTP exception thrown: Security group 31c36607-66cf-4da0-b414-d0d7fe059673 does not exist Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-2bd7157e-9955-4103-a999-ff214099d40b'] Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Returning 404 to user: Security group 31c36607-66cf-4da0-b414-d0d7fe059673 does not exist Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-2bd7157e-9955-4103-a999-ff214099d40b'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f3b51ce-a925-447c-9d6b-ee4172993a7a tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/31c36607-66cf-4da0-b414-d0d7fe059673" status: 404 len: 194 microversion: 2.1 time: 0.046865 Nov 20 20:48:09.673223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 325/683] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:09 2021] DELETE /compute/v2.1/os-security-groups/31c36607-66cf-4da0-b414-d0d7fe059673 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:48:09.682944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.683556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:09.696573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.697026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.697827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:09.698301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:09.792694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.804706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb331805-b797-4861-abf4-f02a048a9689 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1266 microversion: 2.1 time: 0.123522 Nov 20 20:48:09.812118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:09.821991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e96fe6c3-a3f1-4bd5-9efc-2df8a3a25743 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.297225 Nov 20 20:48:09.822809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 326/684] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:09 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:09.833195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7bc791a6-0a69-4261-a03a-c00d64dfc285 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87c39f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.835090 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 359/685] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:09 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:09.839972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f52e4e4-a616-4f04-8f9a-f80daa2e1b07 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f871e75e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:09.918363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7bc791a6-0a69-4261-a03a-c00d64dfc285 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.093131 Nov 20 20:48:09.919589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 327/686] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:09 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:10.025813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-dd708da0-993b-416e-9a87-04b7b353ea40 req-68f284cf-aed2-4ae5-b70b-38b63050e295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f26975-add1-4d8b-aee6-67a5d77835e4", "name": "network-vif-plugged", "status": "completed", "tag": "4584c376-5c69-4cf4-91b1-13f4afc7c28d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:10.030534 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:10.030534 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:10.045528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dd708da0-993b-416e-9a87-04b7b353ea40 req-68f284cf-aed2-4ae5-b70b-38b63050e295 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.047006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dd708da0-993b-416e-9a87-04b7b353ea40 req-68f284cf-aed2-4ae5-b70b-38b63050e295 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.076903 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-dd708da0-993b-416e-9a87-04b7b353ea40 req-68f284cf-aed2-4ae5-b70b-38b63050e295 service nova] Creating event network-vif-plugged:4584c376-5c69-4cf4-91b1-13f4afc7c28d for instance 60f26975-add1-4d8b-aee6-67a5d77835e4 on nch1-master-1 Nov 20 20:48:10.093999 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-dd708da0-993b-416e-9a87-04b7b353ea40 req-68f284cf-aed2-4ae5-b70b-38b63050e295 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072914 Nov 20 20:48:10.095672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 328/687] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:10.103650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:10.104846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:10.136437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.139989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.145161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.146656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.343962 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f52e4e4-a616-4f04-8f9a-f80daa2e1b07 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/28d60a0b-323a-4806-a4bd-518f6aadc8b8" status: 202 len: 0 microversion: 2.1 time: 0.507467 Nov 20 20:48:10.344747 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 360/688] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:09 2021] DELETE /compute/v2.1/os-security-groups/28d60a0b-323a-4806-a4bd-518f6aadc8b8 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:10.351367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:10.352030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:10.379750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.380757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.381575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.382013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.460593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:10.470746 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dcd5beb1-262d-4cb5-9ba2-73ed04278ccd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.372634 Nov 20 20:48:10.479111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 329/689] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:10 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:10.485116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:10.488122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:10.494186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.494789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.495872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.496419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.562591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ace3b3e4-1e8e-4eef-a2c4-8a3759a41ca2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.070991 Nov 20 20:48:10.563580 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 330/690] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:10 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:10.581922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-682f3b88-b6d6-46d4-bc68-424965930877 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a6c0d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:10.910615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-682f3b88-b6d6-46d4-bc68-424965930877 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/8312e254-01a8-4e4b-979d-bcf3f19a8a4c" status: 202 len: 0 microversion: 2.1 time: 0.340240 Nov 20 20:48:10.912127 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 331/691] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:10 2021] DELETE /compute/v2.1/os-security-groups/8312e254-01a8-4e4b-979d-bcf3f19a8a4c => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:10.921224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:10.928946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ac2ad394-cd5f-4e8a-873d-f8578342d7a1 req-767f20c9-7be1-4ff9-bbc8-dec6409d00c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c757299-9a55-42d6-a189-d689f2c8f7ef", "tag": "49830bee-e4b8-4568-83a8-d29f300b9690"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:10.931591 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:10.931591 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:10.937808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a8fe017-0d37-4764-a613-ebca644e4206 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.587878 Nov 20 20:48:10.948786 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 361/692] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:10 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:10.964512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:10.969464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:10.972134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ac2ad394-cd5f-4e8a-873d-f8578342d7a1 req-767f20c9-7be1-4ff9-bbc8-dec6409d00c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.972873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ac2ad394-cd5f-4e8a-873d-f8578342d7a1 req-767f20c9-7be1-4ff9-bbc8-dec6409d00c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.982178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.982646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.985915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:10.988167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:10.991455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ac2ad394-cd5f-4e8a-873d-f8578342d7a1 req-767f20c9-7be1-4ff9-bbc8-dec6409d00c1 service nova] Creating event network-changed:49830bee-e4b8-4568-83a8-d29f300b9690 for instance 2c757299-9a55-42d6-a189-d689f2c8f7ef on nch2-master-1 Nov 20 20:48:10.997070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ac2ad394-cd5f-4e8a-873d-f8578342d7a1 req-767f20c9-7be1-4ff9-bbc8-dec6409d00c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083091 Nov 20 20:48:10.998597 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 332/693] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:11.004926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:11.005961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:11.013896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.014755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.015773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.016425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.093691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:11.108229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58d5d778-ced6-468f-8846-8ea2628cb0c0 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1272 microversion: 2.1 time: 0.107851 Nov 20 20:48:11.119959 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 333/694] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:10 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:11.136180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:11.137097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:11.148700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.149508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.150354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.153972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.329315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:11.343088 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8bd999ac-31b0-42be-8a49-57f637787220 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.221593 Nov 20 20:48:11.354901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 334/695] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:11 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:11.369589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f4db007-5ecf-4836-82d2-dc922fb738bd tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a14f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:11.419018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:11.446538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:11.448513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:11.449974 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-23254b4b-ce49-42cc-a24d-d7bd20ba8e3a tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.500108 Nov 20 20:48:11.452684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 362/696] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:10 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:11.466438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d3eef74-33a1-4a06-94c9-b647e1e5ac49 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87276790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:11.537280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d3eef74-33a1-4a06-94c9-b647e1e5ac49 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1454 microversion: 2.1 time: 0.081990 Nov 20 20:48:11.540129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 363/697] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:11 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:11.558878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:11.559806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:11.575239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.576048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.577105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.577761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.723132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f4db007-5ecf-4836-82d2-dc922fb738bd tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/5ea0cedc-301c-417f-99d2-c0d3a5fbe0a8" status: 202 len: 0 microversion: 2.1 time: 0.366609 Nov 20 20:48:11.724475 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 335/698] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:11 2021] DELETE /compute/v2.1/os-security-groups/5ea0cedc-301c-417f-99d2-c0d3a5fbe0a8 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:11.732215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:11.733157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:11.748504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.749024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.749889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:11.750411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:11.824047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04a98cc5-cad5-4c6c-8c6e-5f05631c4918 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.095634 Nov 20 20:48:11.825789 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 336/699] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:11 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:11.836803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca39d2b0-b1e4-44f2-8ea6-3cb9a2230b36 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f87a03ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.139122 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca39d2b0-b1e4-44f2-8ea6-3cb9a2230b36 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/9b2c5737-1267-460e-8252-07642b02e59a" status: 202 len: 0 microversion: 2.1 time: 0.311371 Nov 20 20:48:12.140893 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 337/700] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:11 2021] DELETE /compute/v2.1/os-security-groups/9b2c5737-1267-460e-8252-07642b02e59a => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:12.151726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.152649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:12.171009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.171460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.172281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.172913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.300327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:12.308314 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02c54344-2d16-4b2c-a56a-11637ab1d000 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.765942 Nov 20 20:48:12.309552 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 364/701] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:11 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:12.322026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bbd0a76e-3ac5-404b-94d6-41e5ee15bb96 req-773d37bb-7bbb-442f-829d-6dd00ab82a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40", "name": "network-vif-plugged", "status": "completed", "tag": "6b6045ba-274e-4026-bce3-97b2ebae1812"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:12.330622 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:12.330622 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:12.338535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bbd0a76e-3ac5-404b-94d6-41e5ee15bb96 req-773d37bb-7bbb-442f-829d-6dd00ab82a50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.339362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bbd0a76e-3ac5-404b-94d6-41e5ee15bb96 req-773d37bb-7bbb-442f-829d-6dd00ab82a50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.344412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:12.354417 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bbd0a76e-3ac5-404b-94d6-41e5ee15bb96 req-773d37bb-7bbb-442f-829d-6dd00ab82a50 service nova] Creating event network-vif-plugged:6b6045ba-274e-4026-bce3-97b2ebae1812 for instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 on nch1-master-1 Nov 20 20:48:12.358255 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6aad82e-c97e-49ee-aacc-e5499d6f1794 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.214119 Nov 20 20:48:12.359115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 338/702] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:12.359756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bbd0a76e-3ac5-404b-94d6-41e5ee15bb96 req-773d37bb-7bbb-442f-829d-6dd00ab82a50 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048396 Nov 20 20:48:12.360350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 365/703] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:12.369511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e74c1b4-ff4f-4250-9c10-8457e8c07b27 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] Calling method '.version_select at 0x7f3f871e7040>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.371792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.372439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:12.378666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.379115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.380568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.381107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.577073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:12.587946 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed1e422e-b3e0-4618-ac6f-ea7401cc3e37 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.219528 Nov 20 20:48:12.588995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 339/704] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:12.594322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.595044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:12.602088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.603219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.605302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.605841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.801323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:12.815216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-346fe4bc-3121-4e3c-b242-34734f6bad60 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.224783 Nov 20 20:48:12.816909 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 340/705] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:12.824164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.825050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:12.831909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.832750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.833810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.834339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.854378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e74c1b4-ff4f-4250-9c10-8457e8c07b27 tempest-SecurityGroupRulesTestJSON-309733550 tempest-SecurityGroupRulesTestJSON-309733550-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/0fcf19d0-1437-48d8-bc8f-5498493aa410" status: 202 len: 0 microversion: 2.1 time: 0.492487 Nov 20 20:48:12.855378 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 366/706] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:48:12 2021] DELETE /compute/v2.1/os-security-groups/0fcf19d0-1437-48d8-bc8f-5498493aa410 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:12.863633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-553fd665-014c-4eb5-ab85-3857a1663041 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f872764c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:12.929694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-553fd665-014c-4eb5-ab85-3857a1663041 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1463 microversion: 2.1 time: 0.069490 Nov 20 20:48:12.930481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 367/707] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1463 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:12.935271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:12.936614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:12.943850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.944393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.945259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:12.945860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:12.987064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b9524a1-ed2e-4d99-9eb4-11e0df3017dd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.055028 Nov 20 20:48:12.987696 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 368/708] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:12 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:12.993619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53e46cb1-7f69-4e53-93bf-8265a3cc8bca tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f872765e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.043823 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53e46cb1-7f69-4e53-93bf-8265a3cc8bca tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 200 len: 1463 microversion: 2.1 time: 0.054559 Nov 20 20:48:13.044392 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 369/709] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:13.055880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.056799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.062657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.063091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.063862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.064293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.085660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.093887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.095549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.096710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f94e67a-617f-49fd-aa8b-519a88c0aeb6 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.278766 Nov 20 20:48:13.097278 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 341/710] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:12 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:13.205516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.214573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb0901b4-aa44-4658-825b-c2d9c616ab7f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1466 microversion: 2.1 time: 0.162772 Nov 20 20:48:13.215458 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 370/711] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1466 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:13.231990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1141411459"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:13.233202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.240166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.240830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.241750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.242434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.327995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.329419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.339690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.340817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.341813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.342707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.547619 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-078ef4e5-d5a9-4091-9a6e-dd84bcdfe45f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "POST /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03/action" status: 202 len: 0 microversion: 2.1 time: 0.319491 Nov 20 20:48:13.552948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 342/712] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:13 2021] POST /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:48:13.557995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.558772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.565263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.565691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.566591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.566936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.598940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.607802 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2bfda439-99e6-41fe-9727-dbdedb270842 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.285702 Nov 20 20:48:13.608385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 371/713] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:13.626127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4036ed34-9c4d-4149-aa51-78e051284a61 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f1aca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.687933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4036ed34-9c4d-4149-aa51-78e051284a61 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.065784 Nov 20 20:48:13.688845 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 372/714] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:13.693596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.694490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.701052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.701503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.702338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.702778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.798103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:13.825208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f6b44bd2-dd92-4339-91f0-e6df4d553740 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.270041 Nov 20 20:48:13.826630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 343/715] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:13.840007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:13.844238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:13.868414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.868885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:13.869889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:13.870519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.116740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.134917 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45aac976-23d4-4d6a-9554-322f6047da95 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.304601 Nov 20 20:48:14.146488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 344/716] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:14.152522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:14.153918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:14.160857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.162416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.163422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.163862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.183095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.190678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4c90dcb-11f5-4674-8ae1-395f2bc6a015 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.500674 Nov 20 20:48:14.197782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 373/717] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:13 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:14.202468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:14.204518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:14.211486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.212161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.213434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.214085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.223194 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02638ee0-1013-496f-899d-38c4a475dfdb tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.074926 Nov 20 20:48:14.228134 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 345/718] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:14 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:14.547704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.557102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.558876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.560034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42b87bb4-5ec7-4a41-b864-228c6a5a83c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.361218 Nov 20 20:48:14.560604 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 374/719] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:14 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:14.625945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:14.626745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:14.635644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.636335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.637488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.637980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.700562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b932e3c-f821-448f-8e21-37fcb6b72075 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f872599d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:14.772571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b932e3c-f821-448f-8e21-37fcb6b72075 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.073607 Nov 20 20:48:14.773441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 375/720] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:14 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:14.844019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:14.845036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:14.859597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.860053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.860861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:14.861297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:14.916726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:14.924140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81692716-34c9-4476-9fe9-ec1c7b9746d6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.302994 Nov 20 20:48:14.929709 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 346/721] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:14 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:15.112044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-dbc8508c-8774-4bf1-9992-b04891a564ae req-e4c4b439-45b2-4776-9892-8611b2c0ccf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52b80c7-eace-4956-a4bb-9903bc93a9b5", "tag": "d8a96fcd-0d70-42d9-969c-d580c3b6eb61"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:15.113793 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:15.113793 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:15.128915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dbc8508c-8774-4bf1-9992-b04891a564ae req-e4c4b439-45b2-4776-9892-8611b2c0ccf4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.129366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dbc8508c-8774-4bf1-9992-b04891a564ae req-e4c4b439-45b2-4776-9892-8611b2c0ccf4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.141155 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-dbc8508c-8774-4bf1-9992-b04891a564ae req-e4c4b439-45b2-4776-9892-8611b2c0ccf4 service nova] Creating event network-changed:d8a96fcd-0d70-42d9-969c-d580c3b6eb61 for instance a52b80c7-eace-4956-a4bb-9903bc93a9b5 on nch1-master-1 Nov 20 20:48:15.146478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-dbc8508c-8774-4bf1-9992-b04891a564ae req-e4c4b439-45b2-4776-9892-8611b2c0ccf4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037846 Nov 20 20:48:15.147767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 347/722] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:15.153182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:15.154176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:15.163800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.164784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.165840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.166541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.268958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.281442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-983c42de-6019-4d11-a730-7883f8e50ae1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1324 microversion: 2.1 time: 0.440883 Nov 20 20:48:15.284985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 376/723] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:14 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:15.292358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:15.293313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:15.303344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.305148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.307788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.308551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.458008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.465872 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d6e9af7-4d63-4bdf-a469-adf12ac96b62 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.316562 Nov 20 20:48:15.466506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 348/724] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:15 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:15.471230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:15.472147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:15.479176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.479856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.480990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.481590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.530164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a5f4fbf6-b8f3-4d53-962d-891f7b895d5a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.062112 Nov 20 20:48:15.531637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 349/725] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:15 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:15.579494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:15.580279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:15.587573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.588027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.588983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.589431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.697717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.707015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e376177-42f8-4a4b-bc5d-ee8b759d9fe4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.420748 Nov 20 20:48:15.707769 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 377/726] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:15 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:15.740033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.748777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.750360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:15.751526 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffdf8a26-6022-4386-8784-e3678db3298d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1566 microversion: 2.25 time: 0.176190 Nov 20 20:48:15.752244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 350/727] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:15 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:48:15.785653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-acf5ff79-1c9d-464a-aa9b-7901a58f16d0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f872594c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:15.846286 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-acf5ff79-1c9d-464a-aa9b-7901a58f16d0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.063027 Nov 20 20:48:15.853662 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 378/728] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:15 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:15.943357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:15.944110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:15.953829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.954497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:15.955432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:15.955977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.280990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:16.288923 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f661de91-e10e-440c-a502-27dfd457afef tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1311 microversion: 2.1 time: 0.349924 Nov 20 20:48:16.289489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 351/729] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:15 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1311 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:16.307305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:16.308256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:16.314978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.315989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.316989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.318269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.482951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:16.484267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:16.502252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.502964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.504015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.504638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.535267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:16.546374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a535af61-d914-448d-8e56-6420e711960c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.243133 Nov 20 20:48:16.546966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 379/730] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:16 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:16.552962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:16.555272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:16.564844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.565639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.566796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.571579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.617364 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8eb861fa-f264-4aa6-9963-53bdea90e19f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.067361 Nov 20 20:48:16.619214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 380/731] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:16 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:16.707272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:16.727096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20c790e9-8d41-4fde-b82a-c6b563c53a97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.247663 Nov 20 20:48:16.727691 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 352/732] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:16 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:16.744321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:16.744922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:16.779424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.779875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.780683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.781122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.791999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1310008871", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "f82a7818-62f9-41df-8e59-1f9bb434e3d7"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:16.852370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] validate_networks() for [('f82a7818-62f9-41df-8e59-1f9bb434e3d7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:16.938115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:16.946268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4ae2317-c8b6-4542-8abb-0249538c4a65 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.205527 Nov 20 20:48:16.946831 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 353/733] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:16 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:16.951274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:16.951878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:16.959071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.959523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:16.960320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:16.960760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.102101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.109524 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-959ba82b-a787-4416-8f72-88eae34d7e1f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.161712 Nov 20 20:48:17.110138 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 354/734] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:16 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:17.123820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.124425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.131435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.131882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.132722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.133101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.267270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:17.267686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:17.268155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:17.268557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:17.268960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:17.278348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.279207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.280065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.280443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.284454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.295494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.297467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.299673 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b1df2cf-4c83-4e72-b0eb-ee949d1204d9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1556 microversion: 2.25 time: 0.179369 Nov 20 20:48:17.300070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:17.300759 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 355/735] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1556 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:17.307035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70e13d83-af42-4317-ac8e-efe038c03e00 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a149d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.317453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for user 49baaf06032347a1bcf476aa84043eeb and project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:17.329310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:17.331980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:17.354773 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70e13d83-af42-4317-ac8e-efe038c03e00 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.052512 Nov 20 20:48:17.355431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 356/736] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:17.360031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db52d8e3-47e0-4e68-adff-2ca326c0f54c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2041359249", "metadata": {"": ""}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:17.361550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db52d8e3-47e0-4e68-adff-2ca326c0f54c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:17.362516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db52d8e3-47e0-4e68-adff-2ca326c0f54c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action" status: 400 len: 170 microversion: 2.1 time: 0.006076 Nov 20 20:48:17.363400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 357/737] 10.222.0.41 () {60 vars in 1278 bytes} [Sat Nov 20 20:48:17 2021] POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action => generated 170 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:48:17.368481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.369166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.375873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.376414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.377286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.377797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.394022 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32cdb889-9686-4dd0-9dae-50b927eb8c53 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773171 Nov 20 20:48:17.395482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 381/738] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:48:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:48:17.405024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-23822a26-56e5-4b68-b34f-68d6e407d768 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '.version_select at 0x7f3f86f2ec10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.407738 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:17.407738 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:17.409508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23822a26-56e5-4b68-b34f-68d6e407d768 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.410796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23822a26-56e5-4b68-b34f-68d6e407d768 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.428984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-23822a26-56e5-4b68-b34f-68d6e407d768 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 1281 microversion: 2.25 time: 0.032010 Nov 20 20:48:17.437162 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 382/739] 10.222.0.41 () {60 vars in 1183 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/os-migrations => generated 1281 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:17.437162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.437162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.445330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.446148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.447566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.448005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.584842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.593620 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8a1d633-b0de-442b-a54e-5d8584fcf4b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1493 microversion: 2.1 time: 0.229142 Nov 20 20:48:17.594639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 358/740] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1493 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:17.599965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cb15297-f848-4f1a-ae61-4fe84b3c674d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.601696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cb15297-f848-4f1a-ae61-4fe84b3c674d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.648163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.660259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be5a971f-865c-4450-9fab-0687d2ce718f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.228304 Nov 20 20:48:17.660857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 383/741] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:17.675648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5cb15297-f848-4f1a-ae61-4fe84b3c674d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:17.679952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.680719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.683271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cb15297-f848-4f1a-ae61-4fe84b3c674d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1218 microversion: 2.1 time: 0.087540 Nov 20 20:48:17.684249 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 359/742] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:17.696273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.696731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.698643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.699099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.699231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-507d2d34-41f3-4499-813e-ed0e877f55ab req-28e7f5d1-a12c-4260-abf1-2abfcbbfcd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-unplugged", "status": "completed", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:17.700723 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:17.700723 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:17.709976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-507d2d34-41f3-4499-813e-ed0e877f55ab req-28e7f5d1-a12c-4260-abf1-2abfcbbfcd13 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.710863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-507d2d34-41f3-4499-813e-ed0e877f55ab req-28e7f5d1-a12c-4260-abf1-2abfcbbfcd13 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.724744 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-507d2d34-41f3-4499-813e-ed0e877f55ab req-28e7f5d1-a12c-4260-abf1-2abfcbbfcd13 service nova] Creating event network-vif-unplugged:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:48:17.729770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-507d2d34-41f3-4499-813e-ed0e877f55ab req-28e7f5d1-a12c-4260-abf1-2abfcbbfcd13 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033993 Nov 20 20:48:17.730421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 360/743] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:17.862197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 564e731b-fef8-42db-8af6-3500bc8c6798 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:17.876697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.878003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.884194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2622e90c-5acc-433a-b686-54ecdb511ebf tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 2048 microversion: 2.25 time: 0.221050 Nov 20 20:48:17.897566 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 384/744] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 2048 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:17.898672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.898672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.898672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.898672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.898930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:17.898930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.898930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.898930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.899223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.899223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.966770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ee5dfc2-1cb1-4ef5-a3a3-5a6a5bd63069 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.080310 Nov 20 20:48:17.967454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 385/745] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:17 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:17.980451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:17.981146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:17.991337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.991790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:17.992584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:17.993021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.077241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c54c5cc7-5bb2-4087-a2c2-bb6101e19858 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1644 microversion: 2.1 time: 0.344917 Nov 20 20:48:18.078932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 361/746] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1644 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.086145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.086757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:18.093738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.094600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.095355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.095784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.168972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:18.180961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52ec5053-fc75-47e5-b864-bbff17f22648 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.209597 Nov 20 20:48:18.190641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 386/747] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:17 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.198175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-485282009", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "1f07f823-03fd-485f-ad70-6286912e8408"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:18.264582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] validate_networks() for [('1f07f823-03fd-485f-ad70-6286912e8408', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:18.275467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:18.283848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b328b540-0a06-4d51-928f-b6e1d5ca60b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.203711 Nov 20 20:48:18.294082 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 362/748] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.294082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.294082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:18.299729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.300177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.300966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.301397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.439933 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-060178a0-6905-4438-b29c-ad53f29438c0 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1644 microversion: 2.1 time: 0.153844 Nov 20 20:48:18.440506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 363/749] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1644 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.446399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.447189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:18.456496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.457176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.458244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.458833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.613371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:18.626884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-beab035e-30bc-4c89-9a4e-dd10c08ca76b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.185077 Nov 20 20:48:18.637974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 364/750] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.644658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fdefb3e-3011-4ab1-ac42-16050d6c667a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1006881258", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:18.646721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fdefb3e-3011-4ab1-ac42-16050d6c667a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:18.648186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fdefb3e-3011-4ab1-ac42-16050d6c667a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action" status: 400 len: 938 microversion: 2.1 time: 0.008447 Nov 20 20:48:18.649255 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 365/751] 10.222.0.41 () {60 vars in 1278 bytes} [Sat Nov 20 20:48:18 2021] POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:48:18.653802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e4db7ea-e5a5-4226-9c1e-dbd82f4297e0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a3faf0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.752036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e4db7ea-e5a5-4226-9c1e-dbd82f4297e0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.097142 Nov 20 20:48:18.753024 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 366/752] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:18.762520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.766988 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:18.766988 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:18.769189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.769807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.770687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.771119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.827715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58d259cf-7d1f-4e61-9014-5c8178d05efa tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.072860 Nov 20 20:48:18.829576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:18.830325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:18.831009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:18.831732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:18.832410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:18.838232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 367/753] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:18.843527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:18.844727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:18.848043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.850892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.851971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.852513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.853064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.853963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.855127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:18.855855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:18.894221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:18.903696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for user e417004a75cd4291a2ef4a9d233c9f28 and project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:18.921509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:18.924216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:18.991121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0619c131-96d5-453f-a034-8d518ddb2700 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.799135 Nov 20 20:48:18.992072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 387/754] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:48:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 20:48:19.003612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:19.004442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.057873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.058659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.060762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.062271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.132183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.141563 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4da1b4b-ec7c-4828-87a1-edec381ff970 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.300835 Nov 20 20:48:19.142505 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 368/755] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:19.148106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:19.149598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.158198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.159116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.160218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.161006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.189759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lazy-loading 'flavor' on Instance uuid 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:19.203112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Going to try to live migrate instance to nch2-master-1 {{(pid=140941) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:48:19.220174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.239323 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e44c5a5f-4497-461e-b74e-aed3dd9cb251 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1276 microversion: 2.1 time: 0.233287 Nov 20 20:48:19.243608 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 388/756] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:18 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:19.264720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:19.266287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.292360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.292822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.293623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.298186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.383274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-658b0567-8a06-47aa-b979-8ac3b7589b45 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 14 microversion: 2.1 time: 0.137946 Nov 20 20:48:19.385055 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 389/757] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:19 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:19.398622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:19.399527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.498760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.511269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.512742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.513886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab79b60d-b2d5-44c9-a106-5d9bee967516 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1261 microversion: 2.25 time: 0.127071 Nov 20 20:48:19.515469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 390/758] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:19 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:19.525832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:19.531146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.548452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.548910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.549709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.553316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.863769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:19.873774 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-792902e6-14ef-4a32-87ef-65deff5db3d0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.357834 Nov 20 20:48:19.874390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 391/759] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:19 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:19.882147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:19.886233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:19.898345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.900774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:19.903511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:19.905822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:20.317831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:20.330031 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59360b87-6305-42c3-a0cc-037a0ba449e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.451695 Nov 20 20:48:20.331283 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 392/760] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:19 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:20.336584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:20.336584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:20.361246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:20.361833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:20.370735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:20.371199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:20.966026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:20.974004 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99bb1d75-94ea-4797-b1fc-338a74e6c7a3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.641160 Nov 20 20:48:20.986913 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 393/761] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:20 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:20.992255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb0ca012-6c7d-46f4-833f-036d5658047e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f36790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:21.063395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb0ca012-6c7d-46f4-833f-036d5658047e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.075058 Nov 20 20:48:21.069592 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 394/762] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:20 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:21.069592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c68c8354-e801-41f5-a488-589721431106 req-5b802ea4-1670-4ac3-95d6-efd2d55d2aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01ba62e-c3aa-436b-933b-c4a6533f5f03", "name": "network-vif-plugged", "status": "completed", "tag": "5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:21.080324 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:21.080324 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:21.095438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c68c8354-e801-41f5-a488-589721431106 req-5b802ea4-1670-4ac3-95d6-efd2d55d2aa3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.096006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c68c8354-e801-41f5-a488-589721431106 req-5b802ea4-1670-4ac3-95d6-efd2d55d2aa3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.116286 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c68c8354-e801-41f5-a488-589721431106 req-5b802ea4-1670-4ac3-95d6-efd2d55d2aa3 service nova] Creating event network-vif-plugged:5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd for instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 on nch1-master-1 Nov 20 20:48:21.121870 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c68c8354-e801-41f5-a488-589721431106 req-5b802ea4-1670-4ac3-95d6-efd2d55d2aa3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056696 Nov 20 20:48:21.123571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 395/763] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:21.129653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37dcf034-3424-4580-b532-67a820c6c0ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:21.131514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37dcf034-3424-4580-b532-67a820c6c0ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:21.132694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37dcf034-3424-4580-b532-67a820c6c0ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action" status: 400 len: 619 microversion: 2.1 time: 0.007781 Nov 20 20:48:21.133664 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 396/764] 10.222.0.41 () {60 vars in 1278 bytes} [Sat Nov 20 20:48:21 2021] POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:48:21.138616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:21.139700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:21.147685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.148544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.149490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.150069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.456343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:21.472612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc741aa5-7388-438a-918d-58ddf93cd667 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.336984 Nov 20 20:48:21.474028 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 397/765] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:21 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:21.480060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:21.481659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:21.493171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.493919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.495267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.495733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.537156 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa5db672-6d9d-49ba-a0ad-da921cbdb06f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40/action" status: 202 len: 0 microversion: 2.1 time: 2.393169 Nov 20 20:48:21.541118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 369/766] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:19 2021] POST /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40/action => generated 0 bytes in 2395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:21.548594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:21.549344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:21.601380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.602022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.616077 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f58244a-02f9-467e-8ef5-9422645a9dd9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 8208 microversion: 2.1 time: 0.132632 Nov 20 20:48:21.616801 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 398/767] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:21 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 8208 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:21.617468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.618314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.626641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:21.638643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:21.662475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.668053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.670687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.672547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.782400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:21.806500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:21.809603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:21.810935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28591cc9-8ece-4720-b807-8a1fd4a8a549 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1319 microversion: 2.25 time: 0.271677 Nov 20 20:48:21.812235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 370/768] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:21 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:21.818727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:21.819532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:21.829492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.830284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:21.832374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:21.833183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.040950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:22.052154 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5a2f857-c30a-4828-899d-ad883ea9dda1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.427549 Nov 20 20:48:22.056158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 399/769] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:21 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:22.061532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:22.066764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:22.085030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.085991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.087038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.087585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.167131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:22.179279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d3eaafe-bf3b-4669-b9d4-2540033ba2d8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.364788 Nov 20 20:48:22.180115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 371/770] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:21 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:22.185247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-782b01ab-2480-4eb2-aebc-f2a5028669be req-bccb1f0b-7260-4545-b874-e14f86bbae79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60d2233-750a-4b19-b2b7-a577b8091aee", "tag": "3c47ade7-005b-489c-858d-16364f1b0424"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:22.191209 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:22.191209 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:22.200615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-782b01ab-2480-4eb2-aebc-f2a5028669be req-bccb1f0b-7260-4545-b874-e14f86bbae79 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.201237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-782b01ab-2480-4eb2-aebc-f2a5028669be req-bccb1f0b-7260-4545-b874-e14f86bbae79 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.228056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-782b01ab-2480-4eb2-aebc-f2a5028669be req-bccb1f0b-7260-4545-b874-e14f86bbae79 service nova] Creating event network-changed:3c47ade7-005b-489c-858d-16364f1b0424 for instance c60d2233-750a-4b19-b2b7-a577b8091aee on nch2-master-1 Nov 20 20:48:22.232911 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-782b01ab-2480-4eb2-aebc-f2a5028669be req-bccb1f0b-7260-4545-b874-e14f86bbae79 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050894 Nov 20 20:48:22.233722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 372/771] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:22.238868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:22.251084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:22.258305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.258989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.272315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.273408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.536176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:22.547507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7df98ea6-b78d-452a-92f7-859e017f70f1 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.489949 Nov 20 20:48:22.557631 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 400/772] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:22 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:22.596787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:22.598673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:22.609949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.610731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.611719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.612315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.801038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:22.819344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d855035-0033-4d97-8adc-de2675d8ce06 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.584073 Nov 20 20:48:22.819952 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 373/773] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:22 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:22.831967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79668687-6689-4b13-9730-a372024b9674 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879ee9d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:22.893383 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79668687-6689-4b13-9730-a372024b9674 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.072141 Nov 20 20:48:22.898859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 374/774] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:22 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:22.903464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:22.904256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:22.915652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.916394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:22.917372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:22.918606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.009348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.017367 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a739319-6e8e-477b-be23-fbcfadbf2a9e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.465132 Nov 20 20:48:23.017947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 401/775] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:22 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:23.037974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:23.039148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:23.050477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.051203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.052572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.053043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.153211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c7144ea-deaf-4056-aa08-1e5fe81547f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 16360 microversion: 2.1 time: 0.133981 Nov 20 20:48:23.157593 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 402/776] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:23 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 16360 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:23.165566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:23.166474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:23.175190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.175759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.177739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.179710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.389417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.405631 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afd17e28-1592-4a39-857c-8ea60552a73f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.505025 Nov 20 20:48:23.417572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 375/777] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:22 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:23.432697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-980803170"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:23.444406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:23.475963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.476831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.478255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.478916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.643134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.662992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.664805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.669996 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-10b64a3c-cb52-44b3-b083-8918663c4573 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.510949 Nov 20 20:48:23.677798 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 403/778] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:23 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:23.682669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:23.691110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:23.704983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.714655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.717797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.720290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.920311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:23.929684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d5eeb02-0fa7-42af-89dc-cc00fa048fcc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.250468 Nov 20 20:48:23.930303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 404/779] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:23 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:23.946006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-766ef6bf-281f-4f89-b6ad-3faed7fca7e5 req-c1d1aa21-02f4-4d9b-aeeb-06772976fb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52b80c7-eace-4956-a4bb-9903bc93a9b5", "name": "network-vif-plugged", "status": "completed", "tag": "d8a96fcd-0d70-42d9-969c-d580c3b6eb61"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:23.947926 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:23.947926 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:23.967735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-766ef6bf-281f-4f89-b6ad-3faed7fca7e5 req-c1d1aa21-02f4-4d9b-aeeb-06772976fb9d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:23.968203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-766ef6bf-281f-4f89-b6ad-3faed7fca7e5 req-c1d1aa21-02f4-4d9b-aeeb-06772976fb9d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:23.993472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-389fd59c-011a-43dc-a185-12de1dc379b1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action" status: 202 len: 0 microversion: 2.1 time: 0.574189 Nov 20 20:48:24.002094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 376/780] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:23 2021] POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:48:24.005708 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-766ef6bf-281f-4f89-b6ad-3faed7fca7e5 req-c1d1aa21-02f4-4d9b-aeeb-06772976fb9d service nova] Creating event network-vif-plugged:d8a96fcd-0d70-42d9-969c-d580c3b6eb61 for instance a52b80c7-eace-4956-a4bb-9903bc93a9b5 on nch1-master-1 Nov 20 20:48:24.012404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.013942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.020928 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-766ef6bf-281f-4f89-b6ad-3faed7fca7e5 req-c1d1aa21-02f4-4d9b-aeeb-06772976fb9d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088670 Nov 20 20:48:24.023261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 405/781] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:24.031012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.035487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.036940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.037799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.038281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.039221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.063768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.073618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.074856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.076467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.385324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:24.393276 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f68b2fe6-572e-4c2d-b331-11f975b86901 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.367333 Nov 20 20:48:24.394069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 406/782] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:24.406900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3287688-5cac-4391-a97a-6f7d8201f976 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87257c10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.455843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:24.462808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3287688-5cac-4391-a97a-6f7d8201f976 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.067833 Nov 20 20:48:24.468655 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa37adda-dfa0-48e4-947f-b973fde2e750 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.467280 Nov 20 20:48:24.468814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 407/783] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:24.469228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 377/784] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:24.482550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:24.482797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-509663164"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:24.483199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.483785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.491713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.492217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.493032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.493476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.494040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.495304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.496140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.496581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.552710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9c3c3d0-3730-477c-8120-c3d10632be8f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 16360 microversion: 2.1 time: 0.081477 Nov 20 20:48:24.553556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 378/785] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:24 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 16360 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:24.555598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Cannot 'createImage' instance 60f26975-add1-4d8b-aee6-67a5d77835e4 while it is in task_state image_snapshot Nov 20 20:48:24.556375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 409 to user: Cannot 'createImage' instance 60f26975-add1-4d8b-aee6-67a5d77835e4 while it is in task_state image_snapshot {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:24.557542 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-adade3a2-c493-4a80-ad1c-6bf3f4ef839e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action" status: 409 len: 159 microversion: 2.1 time: 0.078585 Nov 20 20:48:24.558581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d5aad347-32b5-4593-8997-e7bc0e5a2a9c req-5d5aaa33-ca87-4b93-bf70-0f420ef6c0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40", "name": "network-vif-unplugged", "status": "completed", "tag": "6b6045ba-274e-4026-bce3-97b2ebae1812"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:24.558777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 408/786] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:24 2021] POST /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4/action => generated 159 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:48:24.560235 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:24.560235 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:24.565139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.565749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.569724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d5aad347-32b5-4593-8997-e7bc0e5a2a9c req-5d5aaa33-ca87-4b93-bf70-0f420ef6c0a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.570789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d5aad347-32b5-4593-8997-e7bc0e5a2a9c req-5d5aaa33-ca87-4b93-bf70-0f420ef6c0a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.573280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.573920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.574758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.576068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.585605 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d5aad347-32b5-4593-8997-e7bc0e5a2a9c req-5d5aaa33-ca87-4b93-bf70-0f420ef6c0a0 service nova] Creating event network-vif-unplugged:6b6045ba-274e-4026-bce3-97b2ebae1812 for instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 on nch1-master-1 Nov 20 20:48:24.591027 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d5aad347-32b5-4593-8997-e7bc0e5a2a9c req-5d5aaa33-ca87-4b93-bf70-0f420ef6c0a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036383 Nov 20 20:48:24.592741 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 379/787] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:24.597624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4dab15d4-59fe-4068-b540-76c080262b4e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f87b800d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.795276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:24.805210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ebe263b-df88-42f8-9a52-5cd65e6db4ed tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.245050 Nov 20 20:48:24.806855 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 409/788] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:24.814393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.815458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.824820 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4dab15d4-59fe-4068-b540-76c080262b4e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/images/54d1667e-debf-4a14-97a3-8481b2731b12" status: 204 len: 0 microversion: 2.1 time: 0.230704 Nov 20 20:48:24.825707 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 380/789] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:24 2021] DELETE /compute/v2.1/images/54d1667e-debf-4a14-97a3-8481b2731b12 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:24.837463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:24.838229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:24.843058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.845520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.846414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.846863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.851245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.852040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:24.853408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:24.854209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.062512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.074315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.077810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.078983 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c88ba41-f3fb-4f3d-ace2-bcff9e4bd6de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.270864 Nov 20 20:48:25.080318 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 410/790] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:25.085674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:25.086554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:25.092955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.093430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.094263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.094963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.171910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.186229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-046e906d-2cff-4eca-af3f-1a921abc2429 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1533 microversion: 2.1 time: 0.356133 Nov 20 20:48:25.189631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 381/791] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:24 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1533 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:25.304564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.313875 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13a55a1b-7a3d-43b0-adf2-9fcff418592d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.232515 Nov 20 20:48:25.314927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 411/792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:25 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:25.411366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:25.412028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:25.421625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.432255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.433345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.433951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.480397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d1af36b2-8ec5-49cf-b7a5-b10e90bcce86 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f7f310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:25.538756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d1af36b2-8ec5-49cf-b7a5-b10e90bcce86 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.066523 Nov 20 20:48:25.539513 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 412/793] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:25 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:25.545588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:25.546485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:25.555399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.556120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.559603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.560256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.675837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.685033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5686436a-c713-45fb-9b9d-975c508b7252 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1314 microversion: 2.1 time: 0.278162 Nov 20 20:48:25.686402 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 382/794] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:25 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:25.691066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:25.692195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:25.698747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.698953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.699970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.700907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.748662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:25.761176 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-290ea372-1520-4dbc-bdf4-8681ba4f5693 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.220415 Nov 20 20:48:25.762096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 413/795] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:25 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:25.764119 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7cb121a2-0139-44eb-aa5b-34a8184eeb7e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 16360 microversion: 2.1 time: 0.076532 Nov 20 20:48:25.767788 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 383/796] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:25 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 16360 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:25.824326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:25.824326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:25.829874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.830355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.831163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:25.831602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:25.990743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.000806 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee9c3e58-44f0-46a6-a65c-fecfc419c952 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.181841 Nov 20 20:48:26.010861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 414/797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:25 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:26.099223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.100101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.107223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.107901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.108862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.109295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.207456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.209161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.218818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.219274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.220236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.220680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.275428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.288929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.290468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.291587 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c577d91b-6752-41ac-98b5-215cc7deb546 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.197572 Nov 20 20:48:26.307039 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 384/798] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:26.331510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.332578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.349595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.351629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.352594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.355196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.445631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.454578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5079aed-d631-4d12-b03f-dfbb74124e7f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1539 microversion: 2.1 time: 0.250669 Nov 20 20:48:26.455608 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 415/799] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:26.527076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:26.536959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-791df4d6-0b8b-478a-814f-42e25acc97f1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.209708 Nov 20 20:48:26.547544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 385/800] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:26.554875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccc8ee39-87cd-4e0f-9bbf-a64f489e9b57 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f0c5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.605287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccc8ee39-87cd-4e0f-9bbf-a64f489e9b57 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.055623 Nov 20 20:48:26.612765 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 416/801] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:26.618294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f6126a-4e65-40c1-a727-0559f7cf71ba", "tag": "9247b2b9-3787-408f-9910-0d7f430ac7e3"}, {"name": "network-changed", "server_uuid": "7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40", "tag": "6b6045ba-274e-4026-bce3-97b2ebae1812"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:26.620194 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:26.620194 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:26.628560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.629472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.643522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] Creating event network-changed:9247b2b9-3787-408f-9910-0d7f430ac7e3 for instance 06f6126a-4e65-40c1-a727-0559f7cf71ba on nch2-master-1 Nov 20 20:48:26.644123 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] Creating event network-changed:6b6045ba-274e-4026-bce3-97b2ebae1812 for instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 on nch1-master-1 Nov 20 20:48:26.654371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3cd8ddd8-2cf7-4289-be7f-a7ad9f2fdfe9 req-a4fe4efa-c96b-4779-ac98-7cf5f9964b09 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041363 Nov 20 20:48:26.660098 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 386/802] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:26 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:26.703685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.704584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.713561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.714755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.716084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.716680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.778795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:26.780020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.794873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.795423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.796296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.796810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.847181 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02133f81-f99b-41bc-9f3b-ce27555cab56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 16360 microversion: 2.1 time: 0.072266 Nov 20 20:48:26.854011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 387/803] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:26 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 16360 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:26.859473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:26.860384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:26.867399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.868092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:26.869068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:26.869657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.010718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.030147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3464ee9-5ce2-40f3-8ce5-40b6daa09c84 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1464 microversion: 2.1 time: 0.326372 Nov 20 20:48:27.043235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 417/804] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:27.061704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.062499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:27.086000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.086000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.087637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.088060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.131557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.140022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c41a988-7a0d-45d8-bc29-d6cf19d15597 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.284454 Nov 20 20:48:27.153831 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 388/805] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:26 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:27.330789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.337231 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:27.337231 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:27.339236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'deleted': False, 'project_id': '9b99679aacb54db2a3edebace7ce5620'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:27.347902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.349548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.350666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.351405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.543229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-704bbfaf-1d0f-4e4c-8f81-599e90d924a1 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.387719 Nov 20 20:48:27.544134 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 389/806] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/detail => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:27.564322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.564941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:27.572692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.573139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.573931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.574385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.586761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.595885 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb37f2e1-1ce0-44bf-9782-65193b206103 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.549255 Nov 20 20:48:27.601422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 418/807] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:27.613145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.615011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:27.623683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.624312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.625498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.627871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.852168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.863237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.866624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.867793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82dc382d-f495-4bca-bed3-f26cd019a28d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.322703 Nov 20 20:48:27.880884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 390/808] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:27.886098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.886245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:27.893053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.893516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.894348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.894861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.912982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:27.925087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e8a665f-a615-45e9-bcbd-d79a4c4beaa4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1539 microversion: 2.1 time: 0.320758 Nov 20 20:48:27.928382 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 419/809] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1539 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:27.937849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:27.946934 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:27.946934 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:27.952491 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:27.952491 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:27.954953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'deleted': False} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:27.969693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.970418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:27.971476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:27.972420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.125410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:28.134728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:48:28.135770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4857e303-3e72-4174-a206-2f393889b75e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1476 microversion: 2.1 time: 0.253711 Nov 20 20:48:28.147909 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 391/810] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:28.153313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6dd7be03-84aa-4d4e-87c1-cc3279e907b2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879eec10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:28.212102 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6dd7be03-84aa-4d4e-87c1-cc3279e907b2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.063044 Nov 20 20:48:28.213341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 392/811] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:28 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:28.219222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:28.220473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:28.228086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.229406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.230785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.231389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.297313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.297853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.731587 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad7ccce4-3242-4fb1-8c69-47e6ae34f3b3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21029 microversion: 2.1 time: 0.801901 Nov 20 20:48:28.734818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 420/812] 10.222.0.41 () {58 vars in 1170 bytes} [Sat Nov 20 20:48:27 2021] GET /compute/v2.1/servers/detail?all_tenants= => generated 21029 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:28.762345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:28.762995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:28.779180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.779616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.780413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.780834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.873656 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-918d67d5-073e-4269-8bb5-4c957ba79213 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.658894 Nov 20 20:48:28.876217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 393/813] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:28 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:28.883176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-56b5b5a0-582f-454e-a082-b816f017945f req-36db76ee-ca39-44c8-927a-43b9db076b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60d2233-750a-4b19-b2b7-a577b8091aee", "name": "network-vif-plugged", "status": "completed", "tag": "3c47ade7-005b-489c-858d-16364f1b0424"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:28.885086 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:28.885086 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:28.894397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-56b5b5a0-582f-454e-a082-b816f017945f req-36db76ee-ca39-44c8-927a-43b9db076b10 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.895329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-56b5b5a0-582f-454e-a082-b816f017945f req-36db76ee-ca39-44c8-927a-43b9db076b10 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.912190 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-56b5b5a0-582f-454e-a082-b816f017945f req-36db76ee-ca39-44c8-927a-43b9db076b10 service nova] Creating event network-vif-plugged:3c47ade7-005b-489c-858d-16364f1b0424 for instance c60d2233-750a-4b19-b2b7-a577b8091aee on nch2-master-1 Nov 20 20:48:28.918729 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-56b5b5a0-582f-454e-a082-b816f017945f req-36db76ee-ca39-44c8-927a-43b9db076b10 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040095 Nov 20 20:48:28.918729 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 394/814] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:28.927801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:28.928032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:28.938416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.938416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:28.938732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:28.939051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.077375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.092313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68437d0d-6080-4b48-8be2-58359803368f tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.357649 Nov 20 20:48:29.092921 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 421/815] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:28 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:29.112212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.124935 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:29.124935 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:29.127578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'deleted': False, 'project_id': '9b99679aacb54db2a3edebace7ce5620'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:29.148461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.149273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.151611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.152850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.511193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.528665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e01b12f-98e1-405f-9d9f-aebf1615ab40 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.607960 Nov 20 20:48:29.531123 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 395/816] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:28 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:29.537336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.554322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:29.573338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.573780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.579727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.580194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.606452 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa9c0a5c-5342-456c-811c-3da987710c2b tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail?tenant_id=c1a432e5f0bc49dc942d406268442ed3" status: 200 len: 15 microversion: 2.1 time: 0.505963 Nov 20 20:48:29.607491 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 422/817] 10.222.0.41 () {58 vars in 1230 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/servers/detail?tenant_id=c1a432e5f0bc49dc942d406268442ed3 => generated 15 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:29.612097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.612786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:29.619995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.620579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.621945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.622508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.767874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.779826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.782004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.784667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7bc19a4-441b-4e1f-8536-ab3cd331c6cc tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.251242 Nov 20 20:48:29.786159 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 396/818] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:29.794870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.795705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:29.804108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.804981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.806012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.806742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.862799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:29.872726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8dafefaf-17ac-4e44-ad47-2b0c53bbd13a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1521 microversion: 2.1 time: 0.264060 Nov 20 20:48:29.873410 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 423/819] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:29.877529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3f5dc82-6f86-49b3-8e05-3ba329441a5e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f0c160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.958942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3f5dc82-6f86-49b3-8e05-3ba329441a5e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.084404 Nov 20 20:48:29.964539 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 424/820] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:29.965324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:29.967924 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:29.967924 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:29.975548 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:29.975548 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:29.976976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'tenant_id': 'c1a432e5f0bc49dc942d406268442ed3', 'deleted': False} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:29.982416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.983069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.984834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:29.987171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:29.995506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.012924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3282edc9-c52e-4a1c-ac3e-b5362974dfd1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1475 microversion: 2.1 time: 0.224746 Nov 20 20:48:30.014158 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 397/821] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1475 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:30.019304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:30.020704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.028379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.029401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.030520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.031154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.036379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:48:30.097273 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4645e8c-cb57-44b0-8098-0df9cb46691d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.081308 Nov 20 20:48:30.102288 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 398/822] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:30 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:30.109394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.110214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.117952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.118667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.119473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.120008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.149788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:48:30.156207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.156902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.275226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad98133e-1ef7-4173-8574-0b1c26ba7c10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 204 len: 0 microversion: 2.1 time: 0.169065 Nov 20 20:48:30.276919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 399/823] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:48:30 2021] DELETE /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:30.291113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.292255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.299759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.300437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.302285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.302723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.365943 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f438b0a1-f880-44bc-832e-a0da2656d2f3 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c1a432e5f0bc49dc942d406268442ed3" status: 200 len: 4826 microversion: 2.1 time: 0.405366 Nov 20 20:48:30.367212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 425/824] 10.222.0.41 () {58 vars in 1256 bytes} [Sat Nov 20 20:48:29 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c1a432e5f0bc49dc942d406268442ed3 => generated 4826 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:30.372630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.373500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.381925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.382766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.384078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.384846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.509563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.526111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca1e99f1-5733-4a6b-befd-02050fdb255a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.247603 Nov 20 20:48:30.536459 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 400/825] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:30.541550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.544476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.548095 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:30.548095 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:30.549630 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:30.549630 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:30.550410 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ab90fe7-eeea-4c97-a799-2a4b772c4062 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1527 microversion: 2.1 time: 0.181937 Nov 20 20:48:30.550986 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 426/826] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:30.551109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'tenant_id': '9b99679aacb54db2a3edebace7ce5620', 'deleted': False} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:30.556576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.556747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.557272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.557798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.558527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.559187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.563982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.564464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.565382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.565827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.589268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ef6b4d5b-9c88-4537-a174-ed9d32269be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9b99679aacb54db2a3edebace7ce5620" status: 200 len: 15 microversion: 2.1 time: 0.051266 Nov 20 20:48:30.590674 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 401/827] 10.222.0.41 () {58 vars in 1256 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=9b99679aacb54db2a3edebace7ce5620 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:30.608038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce664a6f-5f88-4dfe-a512-a4ef52f0a62d tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.612362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce664a6f-5f88-4dfe-a512-a4ef52f0a62d tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008004 Nov 20 20:48:30.613446 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 402/828] 10.222.0.41 () {58 vars in 1188 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:30.631886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:30.632982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.639695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.640147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.640962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.641385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.729489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.737538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e52819e-ba93-4cbd-9ad2-b8ebf003ba12 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1318 microversion: 2.1 time: 0.184656 Nov 20 20:48:30.742405 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 427/829] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:30.769085 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4c5880d-3f28-4f0f-baf2-c470b2cda979 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.141553 Nov 20 20:48:30.770884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 403/830] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:30 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:48:30.778942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.782417 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:30.782417 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:30.783593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.784432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:30.791747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.792261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.793088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.793662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.804136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:30.804749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:30.810940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.811390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.812178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:30.812608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:30.892508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:48:30.993976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:30.994752 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-865d8b5a-f558-4f0d-bb0e-8c43cb9944d5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.219270 Nov 20 20:48:30.995861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 428/831] 10.222.0.41 () {58 vars in 1149 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers?status=error => generated 338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:31.001825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8fedbb7b-c4b0-4d43-b308-c94f5b8e8d5d req-f4f0538a-aa1e-4e95-aaf2-7937456c3340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f26975-add1-4d8b-aee6-67a5d77835e4", "name": "network-vif-plugged", "status": "completed", "tag": "4584c376-5c69-4cf4-91b1-13f4afc7c28d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:31.003614 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:31.003614 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:31.012454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8fedbb7b-c4b0-4d43-b308-c94f5b8e8d5d req-f4f0538a-aa1e-4e95-aaf2-7937456c3340 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.012894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8fedbb7b-c4b0-4d43-b308-c94f5b8e8d5d req-f4f0538a-aa1e-4e95-aaf2-7937456c3340 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.017233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:31.018734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:31.031424 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86596a5f-0f2d-49ec-a196-bd24f76ecc40 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.230155 Nov 20 20:48:31.037508 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 404/832] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:30 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:48:31.042305 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8fedbb7b-c4b0-4d43-b308-c94f5b8e8d5d req-f4f0538a-aa1e-4e95-aaf2-7937456c3340 service nova] Creating event network-vif-plugged:4584c376-5c69-4cf4-91b1-13f4afc7c28d for instance 60f26975-add1-4d8b-aee6-67a5d77835e4 on nch1-master-1 Nov 20 20:48:31.044787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06b3f569-c69d-4f20-ab2f-061a6658ad57 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87930a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.050793 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8fedbb7b-c4b0-4d43-b308-c94f5b8e8d5d req-f4f0538a-aa1e-4e95-aaf2-7937456c3340 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053478 Nov 20 20:48:31.051929 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 429/833] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:31.057339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:31.058500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.065253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.065688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.066509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.067484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.110447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06b3f569-c69d-4f20-ab2f-061a6658ad57 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.071227 Nov 20 20:48:31.111360 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 405/834] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.117133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.118148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.127870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.128331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.130811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.131328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.167687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-600fd811-8704-4dbc-9668-75b74f9a7c8a tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.114424 Nov 20 20:48:31.169178 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 430/835] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:31 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:31.178148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:31.179602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.185971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.186777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.187871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.188468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.238332 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da63d05b-8458-4eba-9221-4dbde7b9603e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.067602 Nov 20 20:48:31.240406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 431/836] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:31 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:31.245621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.246390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.256681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.257654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.258978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.259979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.324206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:31.333433 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-145940c0-1659-4b10-8a6d-61a29f9b5c40 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1473 microversion: 2.1 time: 0.220344 Nov 20 20:48:31.334005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 406/837] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1473 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.426777 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca2cff12-ab8e-4127-9dea-c0639874d833 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1613 microversion: 2.1 time: 0.184296 Nov 20 20:48:31.428169 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 432/838] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1613 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.448348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.449113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.456783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.457236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.458395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.462087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.545274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.546363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.562600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.563684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.566182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.569310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.703417 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c15642e5-4bf0-4815-b733-65fce1483a71 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1613 microversion: 2.1 time: 0.256414 Nov 20 20:48:31.720336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 407/839] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1613 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.728704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.729347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.748548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.749104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.750102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.750750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.768540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:31.774310 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a0c836a-0e93-4ff5-8a87-64a38a715e8c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.232813 Nov 20 20:48:31.774310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 433/840] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.787373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.790973 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:31.790973 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:31.792629 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:31.792629 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:31.794317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:31.802591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.803147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.804064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.804596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.919319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:31.928272 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6af5eb24-3438-4d76-ae28-a435f122e686 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1527 microversion: 2.1 time: 0.206715 Nov 20 20:48:31.937932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 408/841] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1527 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:31.937932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:31.937932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:31.941330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.941822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.943881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:31.944333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:31.974624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:48:32.042099 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df92df72-55d4-47a0-8457-3f137bf22ecb tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2312 microversion: 2.1 time: 0.267047 Nov 20 20:48:32.043265 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 434/842] 10.222.0.41 () {58 vars in 1189 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:32.053845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.054486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.060491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.060945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.061747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.062239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.133351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.140977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71bd472d-8d03-4ca3-a1f0-64fb60425681 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1506 microversion: 2.1 time: 0.210680 Nov 20 20:48:32.141544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 409/843] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:31 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:32.146856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.150104 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:32.150104 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:32.151448 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:32.151448 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:32.152563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:48:32.157911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.158399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.159219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.159656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.217800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.228606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.230456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.231756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75b6cd61-b806-4b7f-9aaa-12ebfe8951aa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.181585 Nov 20 20:48:32.243053 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 435/844] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:32.245258 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1535a39d-6466-4338-98dc-c957bf9ada85 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.102530 Nov 20 20:48:32.245909 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 410/845] 10.222.0.41 () {58 vars in 1195 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:32.252533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.253211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.255689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5bca785c-dfb7-414d-b6f2-0bbf33a3ead7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f9f940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.260690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.261145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.262022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.262567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.310778 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5bca785c-dfb7-414d-b6f2-0bbf33a3ead7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1455 microversion: 2.1 time: 0.066467 Nov 20 20:48:32.316476 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 436/846] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:32.316476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:32.317899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.326019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.326616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.327512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.328048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.374487 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f683a09-9f71-49d4-ba84-bdb42f2b22b6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.061706 Nov 20 20:48:32.380386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 437/847] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:32 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:32.397864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:32.398953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.406211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.406920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.407720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.408164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.432787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.444321 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c564f2d-9294-4945-8991-8c13b435e280 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1506 microversion: 2.1 time: 0.193721 Nov 20 20:48:32.454190 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 411/848] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:32.463473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.465058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.471056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.471665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.472468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.472891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.531200 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4cd526e8-2802-43ff-9c8d-faa4a72726d8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.149016 Nov 20 20:48:32.532558 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 438/849] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:32 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:32.539067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:32.540725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.547755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.548214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.549013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.549456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.646694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.648961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:32.649489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:32.650466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:32.650683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:32.651253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:32.655319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb25baab-a024-4205-9b75-c5934e82ced0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1473 microversion: 2.1 time: 0.200028 Nov 20 20:48:32.655922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 412/850] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:32.660196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:32.661703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.667514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.668014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.668730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.669159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.720843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.727707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.728182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.729379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.729846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.757468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:32.757899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:32.758396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:32.758805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:32.759213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:32.760215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2d8fabb-d4f1-46ba-8b88-5cfc5e8616ca tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "POST /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee/action" status: 202 len: 1108 microversion: 2.1 time: 0.226398 Nov 20 20:48:32.761202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 439/851] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:32 2021] POST /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee/action => generated 1108 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 20 20:48:32.775680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.776590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.782626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.784500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.784500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.784500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.831073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.839245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.839835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.841163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.841787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.873941 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9cd1605-dc8b-46fb-b40f-11f17e5e2cf1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 1066 microversion: 2.1 time: 0.216847 Nov 20 20:48:32.875495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 413/852] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:32 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 1066 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 20 20:48:32.880275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.881101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:32.890632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.891089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.891958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:32.892391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:32.968909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:32.983991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-48795d75-da57-411a-a179-5fcf4966306a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.211882 Nov 20 20:48:32.985430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 440/853] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:32.995526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:32.996170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.002395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.002849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.003666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.004101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.078422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.087111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af05f284-3495-4378-9512-6846db715d38 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.210579 Nov 20 20:48:33.097228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 414/854] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:33.104938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.105985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.113029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.114436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.115417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.116022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.217181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.225847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-528fe070-d82f-476a-9d05-b6f50ef66fab tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.239206 Nov 20 20:48:33.231659 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 441/855] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:32 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:33.246431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9d00047c-045a-42c9-8f45-1f0f1f082256 req-5d0e2780-eaef-47a8-8798-72e0918c126e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f6126a-4e65-40c1-a727-0559f7cf71ba", "name": "network-vif-plugged", "status": "completed", "tag": "9247b2b9-3787-408f-9910-0d7f430ac7e3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:33.248729 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:33.248729 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:33.262973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9d00047c-045a-42c9-8f45-1f0f1f082256 req-5d0e2780-eaef-47a8-8798-72e0918c126e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.266985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9d00047c-045a-42c9-8f45-1f0f1f082256 req-5d0e2780-eaef-47a8-8798-72e0918c126e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.304203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.304930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9d00047c-045a-42c9-8f45-1f0f1f082256 req-5d0e2780-eaef-47a8-8798-72e0918c126e service nova] Creating event network-vif-plugged:9247b2b9-3787-408f-9910-0d7f430ac7e3 for instance 06f6126a-4e65-40c1-a727-0559f7cf71ba on nch2-master-1 Nov 20 20:48:33.312238 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9d00047c-045a-42c9-8f45-1f0f1f082256 req-5d0e2780-eaef-47a8-8798-72e0918c126e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079056 Nov 20 20:48:33.314315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 442/856] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:33.316054 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75dfb72c-45ab-4ae2-af82-4cdf40689688 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1527 microversion: 2.1 time: 0.214660 Nov 20 20:48:33.317753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 415/857] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:33.325077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c8f27d1-b153-4afc-9365-9addb1012b39 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87b36d30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.327583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.333134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.348489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.349137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.350184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.350961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.402347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c8f27d1-b153-4afc-9365-9addb1012b39 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1464 microversion: 2.1 time: 0.081786 Nov 20 20:48:33.403338 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 416/858] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:33.410693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:33.412285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.419864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.420772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.422090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.422745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.477147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e859840-2ce3-41a2-8ca6-878af46cc98f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.071522 Nov 20 20:48:33.479073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 417/859] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:33 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:33.493150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6420054b-a3b6-4836-93d4-ab903c281b5c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879dc4c0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.561137 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6420054b-a3b6-4836-93d4-ab903c281b5c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 200 len: 1464 microversion: 2.1 time: 0.080427 Nov 20 20:48:33.562142 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 418/860] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 1464 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:33.575890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.576930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.584541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.585257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.586352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.586985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.644274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.654886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.656994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.658343 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-851eb906-de7c-4b45-9117-c931723b7bd1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.342545 Nov 20 20:48:33.658922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 443/861] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:33.677146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:33.678034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.684239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.684694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.685496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.685937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.872842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.881766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dfec1c8-7309-4e3f-a7ca-8d02cdba47ce tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1468 microversion: 2.1 time: 0.311471 Nov 20 20:48:33.889107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 419/862] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:33.899349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1695957739"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:33.900431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.907349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.908150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.908587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.909049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.931407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:33.939124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49cfc5de-931f-47ea-a358-174438ed03e1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1470 microversion: 2.1 time: 0.266196 Nov 20 20:48:33.952290 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 444/863] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:33 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:33.960249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:33.960926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:33.969207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.969660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:33.970624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:33.971705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.099833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1e4c1e9-0926-453e-b659-9020455b3a7f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5/action" status: 204 len: 0 microversion: 2.1 time: 0.145885 Nov 20 20:48:34.101178 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 445/864] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:33 2021] POST /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5/action => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:34.114044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.117282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.135515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.136331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.137322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.140126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.360300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7ac539a-12ba-4761-b9bd-d7d328ec8ed0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "POST /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26/action" status: 202 len: 0 microversion: 2.1 time: 0.465020 Nov 20 20:48:34.362181 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 420/865] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:33 2021] POST /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:48:34.369989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.371039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.379500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.380599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.381617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.382271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.425912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:34.441821 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06d7b99c-4ba8-45ff-8add-d314bd30ea3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.334436 Nov 20 20:48:34.442925 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 446/866] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.451057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.454143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.466614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.467713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.469671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.470354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.554201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:34.561987 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b363da5-0a6d-473b-b84b-f1de506ebcc9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.198270 Nov 20 20:48:34.562611 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 421/867] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.567290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d8e239c7-4252-4944-8882-f4b43b28c47f req-9b3e7ce1-9494-4b3f-9bd0-166823a86d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f26975-add1-4d8b-aee6-67a5d77835e4", "name": "network-vif-deleted", "tag": "4584c376-5c69-4cf4-91b1-13f4afc7c28d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:34.569080 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:34.569080 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:34.576890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d8e239c7-4252-4944-8882-f4b43b28c47f req-9b3e7ce1-9494-4b3f-9bd0-166823a86d23 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.577329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d8e239c7-4252-4944-8882-f4b43b28c47f req-9b3e7ce1-9494-4b3f-9bd0-166823a86d23 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.589180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d8e239c7-4252-4944-8882-f4b43b28c47f req-9b3e7ce1-9494-4b3f-9bd0-166823a86d23 service nova] Creating event network-vif-deleted:4584c376-5c69-4cf4-91b1-13f4afc7c28d for instance 60f26975-add1-4d8b-aee6-67a5d77835e4 on nch1-master-1 Nov 20 20:48:34.594150 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d8e239c7-4252-4944-8882-f4b43b28c47f req-9b3e7ce1-9494-4b3f-9bd0-166823a86d23 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030375 Nov 20 20:48:34.594764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 422/868] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:34.600112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.600805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.607169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.607618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.608418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.608852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.750883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:34.760539 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75f648c3-bbb7-4b6c-8d57-9f5b09a538d1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.164578 Nov 20 20:48:34.761374 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 423/869] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.765446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.766087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.773073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.773509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.774317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.774946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.812423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.813226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.813789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lazy-loading 'fault' on Instance uuid 60f26975-add1-4d8b-aee6-67a5d77835e4 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:34.861216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:34.869964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a148e840-0d25-414e-b048-665dc044dd27 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 200 len: 1314 microversion: 2.1 time: 0.107693 Nov 20 20:48:34.874119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 424/870] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 1314 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.875870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-264e8d3b-362f-4846-bf28-420a27ed02b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879eea60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.900437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:34.912331 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9252db3-98e4-4526-8de6-14e82c93d8f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1470 microversion: 2.1 time: 0.464669 Nov 20 20:48:34.912908 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 447/871] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1470 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.917428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:34.918461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.924494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-264e8d3b-362f-4846-bf28-420a27ed02b6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.052492 Nov 20 20:48:34.924658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.925004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.925343 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 425/872] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:34.926687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.926939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.933130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:34.933732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:34.944112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.944991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:34.945952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:34.946669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.091356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.100192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.101711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.102956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-abddc5a6-749c-4d86-a07d-300d737870fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.176637 Nov 20 20:48:35.103736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 426/873] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:34 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:35.347018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f26975-add1-4d8b-aee6-67a5d77835e4", "name": "network-vif-unplugged", "status": "completed", "tag": "4584c376-5c69-4cf4-91b1-13f4afc7c28d"}, {"server_uuid": "f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5", "name": "network-vif-plugged", "status": "completed", "tag": "d96f4ca5-742f-4e26-8329-f408e9d46a05"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:35.349717 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:35.349717 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:35.363531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.364966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.379617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Creating event network-vif-unplugged:4584c376-5c69-4cf4-91b1-13f4afc7c28d for instance 60f26975-add1-4d8b-aee6-67a5d77835e4 on nch1-master-1 Nov 20 20:48:35.380214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Creating event network-vif-plugged:d96f4ca5-742f-4e26-8329-f408e9d46a05 for instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 on nch1-master-1 Nov 20 20:48:35.386329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] Instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:48:35.394395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-681fad48-e11a-44eb-a599-4f93350a4dd1 req-c4f46a8b-2b5f-46fd-a75d-2d397523c0d4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050895 Nov 20 20:48:35.394977 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 427/874] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:35 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:35.461970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:35.462892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:35.470080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.470797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.471662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.472271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.610827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.618438 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0c0a5efe-9e03-4e5b-b178-9fd7f8c1eb62 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.161592 Nov 20 20:48:35.619073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 428/875] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:35 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:35.623245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:35.623848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:35.629665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.630152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.630938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.631385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.762946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.770839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-15ed8adb-01db-4018-aa01-1d78eb41d651 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.150070 Nov 20 20:48:35.771622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 429/876] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:35 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:35.780331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:35.781453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:35.791221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.791711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.792545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.793073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.932065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:35.939339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d714b043-d230-4643-98de-d10140e12cef tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.165540 Nov 20 20:48:35.939941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 430/877] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:35 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:35.944160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:35.944750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:35.950244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.950687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.951452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.951879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.965827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. Nov 20 20:48:35.966445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:48:35.967240 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-807deda4-0cb8-47ee-b135-73689be2df6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 404 len: 111 microversion: 2.1 time: 0.026426 Nov 20 20:48:35.967760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 431/878] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:35 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:48:35.971962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:35.972460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:35.978823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.979208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:35.979968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:35.980397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.122016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:36.130694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33f3fda0-df89-4e45-a087-42ae82060ae5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1470 microversion: 2.1 time: 0.162002 Nov 20 20:48:36.131340 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 432/879] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:35 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:36.135686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b2dae5fa-1885-4ee9-abd1-fee6f45d7628 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878e4160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:36.180305 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b2dae5fa-1885-4ee9-abd1-fee6f45d7628 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.047898 Nov 20 20:48:36.181026 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 433/880] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:36 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:36.185576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'create', calling method: .version_select at 0x7f3f878daf70>, body: {"keypair": {"name": "tempest-keypair-610147417"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:36.200465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for project 1929d2944a034783a75db63f07c146a6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:36.204450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for user b9094951b1a24a48a1db5b87e80f6234 and project 1929d2944a034783a75db63f07c146a6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:36.241610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fcbae046-71ae-4c98-b0a1-440397a9117d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 1.327331 Nov 20 20:48:36.243033 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 448/881] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:34 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:36.249814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:36.250671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:36.262446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.262919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.265236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.265675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.372642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for project 1929d2944a034783a75db63f07c146a6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:36.377121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for user b9094951b1a24a48a1db5b87e80f6234 and project 1929d2944a034783a75db63f07c146a6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:36.392226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d26dd3d9-397d-43ff-886d-1eef32d245fe tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.209939 Nov 20 20:48:36.393201 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 434/882] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:48:36 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:36.423712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:36.432132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:36.433619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:36.434738 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c1140dd-3178-4554-974a-ded3e80124f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.190439 Nov 20 20:48:36.435493 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 449/883] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:36 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:36.637224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:36.637915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:36.645156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.645617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.646530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.647044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.799161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:36.800202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:36.808233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.808683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.809664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.810125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.858993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:36.870462 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f517e1bf-81f5-4655-8a4d-d43723fea959 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.237727 Nov 20 20:48:36.871236 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 435/884] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:36 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:36.955437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:36.956160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:36.962365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.962892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:36.963742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:36.964291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.011946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.019996 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b91d7046-a856-4d56-b33c-2fe3f10eabff tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1503 microversion: 2.1 time: 0.225550 Nov 20 20:48:37.021766 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 450/885] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:36 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:37.149269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.150165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:37.165003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.166832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.168172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.168924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.194029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.203003 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ba8fa32-af04-43ac-9bd0-c8ed824da6ac tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.251233 Nov 20 20:48:37.203936 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 436/886] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:36 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:37.208284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58ce70bd-3ae2-4b27-9860-67b093714ad5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878b99d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.256207 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58ce70bd-3ae2-4b27-9860-67b093714ad5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.051109 Nov 20 20:48:37.256791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 437/887] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:37.261590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:37.262597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:37.268915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.269383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.270397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.270836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.314216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73ffe83c-949b-4ecd-b32d-a51ae14c6f0f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.055946 Nov 20 20:48:37.314882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 438/888] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:37 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:37.404529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.413101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b733295-7205-4a4f-aa9c-9b590803ae93 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1462 microversion: 2.1 time: 0.268511 Nov 20 20:48:37.413775 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 451/889] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1462 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:37.417964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-81cad721-73c0-497a-a53a-5c6a7d71ac9c req-e2f403bc-56d6-4c4d-a848-68325f25e16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01ba62e-c3aa-436b-933b-c4a6533f5f03", "name": "network-vif-unplugged", "status": "completed", "tag": "5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:37.420009 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:37.420009 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:37.436817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.437476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:37.439517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-81cad721-73c0-497a-a53a-5c6a7d71ac9c req-e2f403bc-56d6-4c4d-a848-68325f25e16b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.439963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-81cad721-73c0-497a-a53a-5c6a7d71ac9c req-e2f403bc-56d6-4c4d-a848-68325f25e16b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.445333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.445781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.446639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.447073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.453891 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-81cad721-73c0-497a-a53a-5c6a7d71ac9c req-e2f403bc-56d6-4c4d-a848-68325f25e16b service nova] Creating event network-vif-unplugged:5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd for instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 on nch1-master-1 Nov 20 20:48:37.459185 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-81cad721-73c0-497a-a53a-5c6a7d71ac9c req-e2f403bc-56d6-4c4d-a848-68325f25e16b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046741 Nov 20 20:48:37.459974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 439/890] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:37.465835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.466609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:37.475133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.475860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.476680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.477081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.693101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.701301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b46c7f0-23eb-4238-b4c8-44894547dd8b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1462 microversion: 2.1 time: 0.273522 Nov 20 20:48:37.716564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.720501 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 452/891] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1462 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:37.726730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.732514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:37.733902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79d154c0-f9d2-40ba-a986-4146ce104231 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '.version_select at 0x7f3f86fe1ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.736272 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a9544dc-d429-43cc-9370-1c3c04dfaa31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1361 microversion: 2.25 time: 0.274899 Nov 20 20:48:37.736762 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:37.736762 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:37.740019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d154c0-f9d2-40ba-a986-4146ce104231 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.740946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d154c0-f9d2-40ba-a986-4146ce104231 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.741414 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 440/892] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:37.756834 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79d154c0-f9d2-40ba-a986-4146ce104231 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.028622 Nov 20 20:48:37.758653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 453/893] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/os-migrations => generated 1568 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:37.778482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99493aad-f466-41d4-95ce-16fbd679bedc tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.788076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99493aad-f466-41d4-95ce-16fbd679bedc tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013184 Nov 20 20:48:37.788993 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 441/894] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:37.799386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ac8d7c7-3e66-452e-bfc6-6dbb70009532 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2061992946", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:37.801551 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:37.801551 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:37.820448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ac8d7c7-3e66-452e-bfc6-6dbb70009532 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.024617 Nov 20 20:48:37.821703 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 454/895] 10.222.0.41 () {60 vars in 1145 bytes} [Sat Nov 20 20:48:37 2021] POST /compute/v2.1/flavors => generated 499 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:37.833349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c984e47-6d10-4610-aab0-57ae93f3bb4b tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.842064 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c984e47-6d10-4610-aab0-57ae93f3bb4b tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012819 Nov 20 20:48:37.842633 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 442/896] 10.222.0.41 () {58 vars in 1181 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:48:37.887628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:37.888514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:37.896276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.896892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.898630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:37.899505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:37.960441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1607615489", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "6c542808-031e-40df-b94d-0bdce9c6fb3a"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:38.016515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:38.096120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:38.104965 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-698916d9-2a41-4891-8429-2ea31e47a299 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.220988 Nov 20 20:48:38.114858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 455/897] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:37 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.119569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.120263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:38.126224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.126759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.127625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.128138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.255876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:38.256520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:38.257208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:38.257803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:38.258419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:38.270903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.271685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.273049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.273216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.283777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:38.293665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:38.295014 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2084dd5f-184e-4169-94ee-ed64661740db tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1493 microversion: 2.1 time: 0.178813 Nov 20 20:48:38.303085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for user cf07bddf00ea4a7da446130a6308cd27 and project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:38.305193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 456/898] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1493 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.311880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-824757582", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e089fcf3-9dcc-485e-b53f-bb119c8c3467"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:38.316229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:38.319875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:38.371960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10e72b5d-83f4-4ca7-b0e1-308589d81c71 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.415981 Nov 20 20:48:38.372847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 443/899] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:48:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:48:38.378015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] validate_networks() for [('e089fcf3-9dcc-485e-b53f-bb119c8c3467', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:38.379523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.380609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:38.387288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.387742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.388539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.388980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.589133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:38.597690 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d5193eb-bdf9-445b-a090-8371a0a0b5f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.222524 Nov 20 20:48:38.600081 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 444/900] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.604808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61a1b6a8-6bd0-4e8d-be80-7ddc34613b87 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87859f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.654015 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61a1b6a8-6bd0-4e8d-be80-7ddc34613b87 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.052705 Nov 20 20:48:38.654999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 445/901] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.659605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f32343e-54bb-4a9c-af17-31ee0df65d0e tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '.version_select at 0x7f3f8785f940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.661801 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:38.661801 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:38.664379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f32343e-54bb-4a9c-af17-31ee0df65d0e tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.664832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f32343e-54bb-4a9c-af17-31ee0df65d0e tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.684049 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f32343e-54bb-4a9c-af17-31ee0df65d0e tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 1568 microversion: 2.1 time: 0.028020 Nov 20 20:48:38.684775 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 446/902] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/os-migrations => generated 1568 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.689010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:38.689978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:38.697626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.698143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.698936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.699363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.745891 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4912e8ef-87e8-4feb-bd3e-53820b65116b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.059807 Nov 20 20:48:38.750093 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 447/903] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:38 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:38.752947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-393bd3c3-ef10-4cbe-827f-352f25dacb55 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.753639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-393bd3c3-ef10-4cbe-827f-352f25dacb55 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:38.813496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-393bd3c3-ef10-4cbe-827f-352f25dacb55 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:38.825145 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-393bd3c3-ef10-4cbe-827f-352f25dacb55 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1279 microversion: 2.1 time: 0.075959 Nov 20 20:48:38.826032 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 448/904] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1279 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:38.831515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:38.832937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:38.843001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.844711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.845682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.846256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.885256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:38.885743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:38.886152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:38.886627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:38.887073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:38.899883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.900325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.901335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:38.901974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:38.919613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:38.925400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for user b9094951b1a24a48a1db5b87e80f6234 and project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:38.940843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:38.944319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:38.995308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-136dcb28-c8cb-4db3-a17b-c34d560c79a9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.688597 Nov 20 20:48:38.996345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 457/905] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:48:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:48:39.001099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.001858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.008887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.009492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.015468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.016177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.033544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afbf60e0-a6e0-4f49-b80b-2d92a543d282 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1644 microversion: 2.1 time: 0.206661 Nov 20 20:48:39.045926 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 449/906] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1644 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:39.062926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd0a1225-c89c-400c-aa32-3c77a2edf21e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.063550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd0a1225-c89c-400c-aa32-3c77a2edf21e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.117374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd0a1225-c89c-400c-aa32-3c77a2edf21e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:39.124252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd0a1225-c89c-400c-aa32-3c77a2edf21e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1224 microversion: 2.1 time: 0.068745 Nov 20 20:48:39.125630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 450/907] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:39.129916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.130684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.136891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.137331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.138138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.138574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.186730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:39.197149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:39.198676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:39.199835 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20b1b533-4c78-4f04-994f-483207fc5e3c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1556 microversion: 2.25 time: 0.202418 Nov 20 20:48:39.203586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 458/908] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:38 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:39.225718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.227580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.239942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.240403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.241196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.241636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.327226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:39.337793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ae6e9c9-96d8-4c55-acf4-55feb353b461 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.211081 Nov 20 20:48:39.338799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 451/909] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:39.349638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1569863663", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "554d0697-db40-4745-a60d-da36ede89e92"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:39.404256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:39.409801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] validate_networks() for [('554d0697-db40-4745-a60d-da36ede89e92', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:39.423114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa7a86b2-52d1-41c7-b041-d6f36e09a6a3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 2048 microversion: 2.25 time: 0.203169 Nov 20 20:48:39.438099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 459/910] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 2048 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:39.444352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.445346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.451661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.452389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.453386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.454236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.637198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:39.662402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69fd1049-1435-4670-9394-6cbde4418db1 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 2048 microversion: 2.25 time: 0.222698 Nov 20 20:48:39.663425 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 460/911] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 2048 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:39.684296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:39.686110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:39.696580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.697377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.699038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.699851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.885161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:39.885607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:39.886123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:39.886492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:39.886903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:39.898386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.898739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.899562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:39.900007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:39.918750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:39.923302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for user dbb46ce41ca44f57aeef1d6b2191b4cb and project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:39.935321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:39.937654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:39.983713 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a74e3ec7-0f20-419e-926a-03b74abcf912 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643747 Nov 20 20:48:39.984748 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 452/912] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:48:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:48:39.990351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-523a0ddc-eafa-40d7-bb2e-586401f8d167 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87815160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.003238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:40.012077 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec338156-311a-4b5c-8667-2490b366fbae tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.333524 Nov 20 20:48:40.013943 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 461/913] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:40.022736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.036540 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:40.036540 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:40.039431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.039985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.041175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.041968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.070662 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43e0de08-b2a0-4abd-8134-4e8308a89bf2 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.055586 Nov 20 20:48:40.071573 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 462/914] 10.222.0.41 () {60 vars in 1216 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:40.076436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:40.077354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.081140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-523a0ddc-eafa-40d7-bb2e-586401f8d167 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.095334 Nov 20 20:48:40.081882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 453/915] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:39 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:40.085216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.085668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.086499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.086935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.087364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.088376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.095803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.096414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.099556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.100816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.145289 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55672119-5682-4993-9a96-42155c84e645 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.071827 Nov 20 20:48:40.146695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 463/916] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:40 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:40.153104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53e9dd82-34c7-4c1e-aba9-45f800b2a403 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.153712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53e9dd82-34c7-4c1e-aba9-45f800b2a403 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.192033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:40.200818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7036e026-5eff-40fa-bbb3-3d8175a3a719 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1337 microversion: 2.1 time: 0.117202 Nov 20 20:48:40.210995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 454/917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1337 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:40.216900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:40.217443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.225581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.226030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.226860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.227290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.228058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-53e9dd82-34c7-4c1e-aba9-45f800b2a403 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:40.241612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53e9dd82-34c7-4c1e-aba9-45f800b2a403 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1211 microversion: 2.1 time: 0.093111 Nov 20 20:48:40.242938 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 464/918] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:40.247573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.248180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.255746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.255977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.256734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.257180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.335238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f65b737-06b9-4b39-b7a6-66cdf7a83e8b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba/action" status: 202 len: 0 microversion: 2.25 time: 0.122179 Nov 20 20:48:40.336292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 455/919] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:48:40 2021] POST /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:40.347374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.348641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.357089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.358104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.359102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.359634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.416720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:40.429054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc0e591d-cbd0-4586-89d7-b5cf91637109 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1276 microversion: 2.1 time: 0.183588 Nov 20 20:48:40.431607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 465/920] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:40.447959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:40.449838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:40.461267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.467684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.468439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:40.469057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:40.659942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:40.710881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f7e6f60-fdfe-465e-a12e-6446eaf10328 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 2053 microversion: 2.25 time: 0.368400 Nov 20 20:48:40.711924 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 456/921] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 2053 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:40.746006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:40.754596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-edb2b1cc-105b-4a56-af0b-0c8560ab970b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.319888 Nov 20 20:48:40.755540 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 466/922] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:40 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:41.032893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:41.034454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:41.046904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.048284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.053355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.054414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.095905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e081377a-a724-48ae-b533-807cbd340c4a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871158b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:41.224874 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e081377a-a724-48ae-b533-807cbd340c4a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.133007 Nov 20 20:48:41.227812 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 467/923] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:41 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:41.277672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:41.291179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:41.309554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.313499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.318685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.319706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.399416 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-322de3e5-b98e-49d1-a848-e44ba07d426d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.170146 Nov 20 20:48:41.400488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 468/924] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:41 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:41.410144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:41.411758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:41.435177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.435866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.436897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.437354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.774852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:41.784881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0712e49-54cb-4a44-9d8f-500dc04275cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.382878 Nov 20 20:48:41.788018 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 469/925] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:41 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:41.796232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:41.799282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:41.814594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.820399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.821541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.822357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:41.964643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:41.972386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-500ed7f0-ec59-4863-9529-92e5ab0b41c7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1281 microversion: 2.1 time: 0.182648 Nov 20 20:48:41.979189 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 470/926] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:41 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:41.984243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:41.986227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:41.997300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:41.998569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:41.999186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.000672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.001238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.015904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0003db25-e6fc-4d4d-a343-0ab637c155f3 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.989783 Nov 20 20:48:42.024851 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 457/927] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:41 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:42.039419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:42.042886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:42.062973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.063424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.064229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.064669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.313898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:42.325820 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac4dd230-1f72-42e5-8ce5-82be52d4f210 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.345014 Nov 20 20:48:42.326771 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 471/928] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:41 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:42.343298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:42.344433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:42.354451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.357938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.358963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.359567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.669643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:42.682269 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7050ebcb-f7b6-410f-95d5-d9dd5bd06c3a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.354002 Nov 20 20:48:42.684506 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 472/929] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:42 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:42.696548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-43785fa5-854f-4029-a6be-9f7585ddc3a5 req-45898181-4846-4106-9ab6-e91c76cac601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-plugged", "status": "completed", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:42.700113 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:42.700113 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:42.723890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-43785fa5-854f-4029-a6be-9f7585ddc3a5 req-45898181-4846-4106-9ab6-e91c76cac601 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.724755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-43785fa5-854f-4029-a6be-9f7585ddc3a5 req-45898181-4846-4106-9ab6-e91c76cac601 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.748360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-43785fa5-854f-4029-a6be-9f7585ddc3a5 req-45898181-4846-4106-9ab6-e91c76cac601 service nova] Creating event network-vif-plugged:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:48:42.767841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-43785fa5-854f-4029-a6be-9f7585ddc3a5 req-45898181-4846-4106-9ab6-e91c76cac601 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081090 Nov 20 20:48:42.768773 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 473/930] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:42.784350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd05ac16-fbdc-4232-a8d2-40adca9f18ff tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f872063a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:42.891209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd05ac16-fbdc-4232-a8d2-40adca9f18ff tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.119503 Nov 20 20:48:42.894386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 474/931] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:42 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:42.908657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:42.913091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:42.924961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.925303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.933235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:42.933895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:42.998097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13bdc116-e970-445f-a3e6-135df762131c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.100831 Nov 20 20:48:43.009260 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 475/932] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:42 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:43.015637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cf41554c-ff22-4b2c-9cf9-d6fd9c1ff360 req-cb880788-bb62-4d16-85bd-d7f95ca4c995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:43.017394 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:43.017394 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:43.027932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf41554c-ff22-4b2c-9cf9-d6fd9c1ff360 req-cb880788-bb62-4d16-85bd-d7f95ca4c995 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.028621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf41554c-ff22-4b2c-9cf9-d6fd9c1ff360 req-cb880788-bb62-4d16-85bd-d7f95ca4c995 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.042299 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cf41554c-ff22-4b2c-9cf9-d6fd9c1ff360 req-cb880788-bb62-4d16-85bd-d7f95ca4c995 service nova] Creating event network-changed:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:48:43.047935 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cf41554c-ff22-4b2c-9cf9-d6fd9c1ff360 req-cb880788-bb62-4d16-85bd-d7f95ca4c995 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036748 Nov 20 20:48:43.049066 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 476/933] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:43.055990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:43.056854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:43.064803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.065619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.066584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.067026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.108934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:43.158859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49fdcbb1-a909-43c6-9075-821efb4b8722 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 2033 microversion: 2.25 time: 1.132708 Nov 20 20:48:43.159810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 458/934] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:42 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 2033 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:43.168106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:43.168721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:43.185615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.192600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.193881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.194502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.349228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:43.361829 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7948ca75-8138-4075-9501-38c412873891 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1269 microversion: 2.1 time: 0.200450 Nov 20 20:48:43.363230 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 459/935] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:43 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:43.369994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:43.370967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:43.381075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.382331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.384439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.391547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.507603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:43.524548 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c8b9985-83f0-4f74-b88e-53ecd4681644 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.473668 Nov 20 20:48:43.527500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 477/936] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:43 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:43.537143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:43.540490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:43.556362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.557176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.558210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.558800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.690392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'flavor' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:43.773119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Going to try to live migrate instance to nch1-master-1 {{(pid=140942) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:48:43.825361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:43.842213 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-575ac036-61f1-4097-b70d-7476b7a27027 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1470 microversion: 2.1 time: 0.477666 Nov 20 20:48:43.842816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 460/937] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:43 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1470 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:43.847236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:43.848977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:43.864864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.865629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:43.866607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:43.867673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:44.479583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:44.495967 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-602ce1f5-c1fa-4940-a7ef-44bad63d7a76 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.651604 Nov 20 20:48:44.499383 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 461/938] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:43 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:44.506684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:44.508065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:44.540381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:44.541686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:44.544926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:44.548247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:45.336528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:45.351658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-020b7e7a-6431-4c6e-b473-3827e3141753 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.848834 Nov 20 20:48:45.354043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 462/939] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:44 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:45.367226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b76b279-c054-4ef1-827b-076c70902a0d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87815c10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:45.453093 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b76b279-c054-4ef1-827b-076c70902a0d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.092116 Nov 20 20:48:45.453907 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 463/940] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:45 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:45.458679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:45.460270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:45.467611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:45.468435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:45.469470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:45.470164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:45.516018 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67c0db4a-96af-443d-af20-0583e2516489 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 24534 microversion: 2.1 time: 0.060730 Nov 20 20:48:45.517886 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 464/941] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:45 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 24534 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:45.524338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:45.525344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:45.533357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:45.534330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:45.539564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:45.540028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.326423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:46.326423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-715eefae-03e6-4121-be92-f3ddfd10e443 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.792861 Nov 20 20:48:46.326423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 465/942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:45 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:46.326423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:46.327145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:46.330327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.330866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.331763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.332805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.662227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:46.674863 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52736325-3295-410b-9428-330d7ec67f92 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.358938 Nov 20 20:48:46.675796 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 466/943] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:46 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:46.680043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:46.694232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:46.702924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11d29114-8ded-4fb9-9a5f-7c5411c12e33 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba/action" status: 202 len: 0 microversion: 2.25 time: 3.169923 Nov 20 20:48:46.704587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 478/944] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:48:43 2021] POST /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba/action => generated 0 bytes in 3173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:48:46.710351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d1fa016e-f265-4056-8766-3f99c70d62b3 req-a014c05e-8d08-4f0c-8a0a-366811474b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ca2999-8a94-4c5f-bc08-7ba55ff79ba4", "tag": "1469ba97-d687-4daa-b763-d4b8c0589efb"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:46.712170 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:46.712170 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:46.713044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.713770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.718676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.719297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.728093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d1fa016e-f265-4056-8766-3f99c70d62b3 req-a014c05e-8d08-4f0c-8a0a-366811474b05 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.728525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d1fa016e-f265-4056-8766-3f99c70d62b3 req-a014c05e-8d08-4f0c-8a0a-366811474b05 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.742379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d1fa016e-f265-4056-8766-3f99c70d62b3 req-a014c05e-8d08-4f0c-8a0a-366811474b05 service nova] Creating event network-changed:1469ba97-d687-4daa-b763-d4b8c0589efb for instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 on nch1-master-1 Nov 20 20:48:46.748594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d1fa016e-f265-4056-8766-3f99c70d62b3 req-a014c05e-8d08-4f0c-8a0a-366811474b05 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042536 Nov 20 20:48:46.749438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 479/945] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:46.767956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:46.769018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:46.788168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.789000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:46.790203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:46.792080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.020629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.040060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e08a8217-e9c6-46b0-af75-6394e96d3402 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.363141 Nov 20 20:48:47.040778 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 467/946] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:46 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:47.045401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:47.046326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:47.063003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.063815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.065330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.066433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.133116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.143069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-516e0bd4-7149-46e6-b11d-102582c1ea29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.391913 Nov 20 20:48:47.145912 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 480/947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:46 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:47.156453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba418d4d-bc4e-413f-b019-3312628fc135 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87172040>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:47.249961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba418d4d-bc4e-413f-b019-3312628fc135 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.098368 Nov 20 20:48:47.251307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 481/948] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:47 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:47.260627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:47.263219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:47.282438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.287438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.288521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.289142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.377364 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c033df4a-c7f8-4105-b4c2-fb376a02c432 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.124364 Nov 20 20:48:47.382231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 482/949] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:47 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:47.385562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:47.386309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:47.404435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.405543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.408586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.409088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.585781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.595613 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f425dc2-d464-45f5-8260-b62ac6857bc8 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.553275 Nov 20 20:48:47.607992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 468/950] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:47 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:47.612973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:47.614240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:47.621507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.622186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.623227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.623728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.717418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.726450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.731087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.737655 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85401c4f-8f9b-418e-a001-f5c707e7bde4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.357524 Nov 20 20:48:47.739442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 483/951] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:47 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:47.743967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:47.747421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:47.756252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.756921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.757878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:47.758483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:47.960533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:47.970714 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21d5b9cd-8081-4d72-b74f-7261495fe4fe tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.229516 Nov 20 20:48:47.973820 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 484/952] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:47 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.004670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:48.012608 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0fa47e3-9cf5-4889-aa29-d17a9193c67a tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.403097 Nov 20 20:48:48.022793 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 469/953] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:47 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.057946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.059517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:48.074444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.078966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.080148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.080697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.166025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.166025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:48.182907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.183367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.184220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.186392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.342173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:48.351227 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ad7d678-82dd-4da1-a7ba-b40c8e191a61 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.297220 Nov 20 20:48:48.362394 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 485/954] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.375940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-116aa68f-be55-4135-90f7-253e01f004d4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f9f5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.422862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:48.433165 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77433be9-d2ff-4f96-aab5-f7252dab5db0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.273984 Nov 20 20:48:48.438657 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 470/955] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.444784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:48.446625 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-116aa68f-be55-4135-90f7-253e01f004d4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.081941 Nov 20 20:48:48.448176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:48.455970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.456781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.457065 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 486/956] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.458336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.459644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.526043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acaa4bc1-c6ce-488f-a452-c7792e046efc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.085531 Nov 20 20:48:48.527313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 471/957] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:48 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:48.619238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.620045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ca6c65ff-eae4-490a-a177-425832763398 req-df4f67c1-14b0-4645-971a-87703295b4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f6126a-4e65-40c1-a727-0559f7cf71ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9247b2b9-3787-408f-9910-0d7f430ac7e3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:48.622727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:48.623068 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:48.623068 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:48.638392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.639213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.641240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ca6c65ff-eae4-490a-a177-425832763398 req-df4f67c1-14b0-4645-971a-87703295b4c2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.642708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.643247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.646247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ca6c65ff-eae4-490a-a177-425832763398 req-df4f67c1-14b0-4645-971a-87703295b4c2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.671853 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ca6c65ff-eae4-490a-a177-425832763398 req-df4f67c1-14b0-4645-971a-87703295b4c2 service nova] Creating event network-vif-unplugged:9247b2b9-3787-408f-9910-0d7f430ac7e3 for instance 06f6126a-4e65-40c1-a727-0559f7cf71ba on nch2-master-1 Nov 20 20:48:48.683040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ca6c65ff-eae4-490a-a177-425832763398 req-df4f67c1-14b0-4645-971a-87703295b4c2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075674 Nov 20 20:48:48.687438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 487/958] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:48.759183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.759996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:48.772642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.773110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.773927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.774423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.853371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:48.862103 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1adb015-a14b-44f5-a360-7ca81524d91c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.250659 Nov 20 20:48:48.866978 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 472/959] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:48.877463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4ffb90db-8a7b-4699-a71b-3bdffa559a59 req-c5c86258-2e21-4972-b7f6-3d6345ff8489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67bb1ce-5e3e-497f-af2f-54d0c33e27e2", "tag": "1ebb075b-0271-4950-a74a-182cc4a744f5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:48.881241 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:48.881241 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:48.889342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4ffb90db-8a7b-4699-a71b-3bdffa559a59 req-c5c86258-2e21-4972-b7f6-3d6345ff8489 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:48.890756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4ffb90db-8a7b-4699-a71b-3bdffa559a59 req-c5c86258-2e21-4972-b7f6-3d6345ff8489 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:48.908359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4ffb90db-8a7b-4699-a71b-3bdffa559a59 req-c5c86258-2e21-4972-b7f6-3d6345ff8489 service nova] Creating event network-changed:1ebb075b-0271-4950-a74a-182cc4a744f5 for instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 on nch2-master-1 Nov 20 20:48:48.919293 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4ffb90db-8a7b-4699-a71b-3bdffa559a59 req-c5c86258-2e21-4972-b7f6-3d6345ff8489 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045289 Nov 20 20:48:48.921201 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 473/960] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:48.996898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:48.999086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.013018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.013648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.015025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.017468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.095276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.110843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.112682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.114160 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30d8609e-bc04-425d-8c87-d306426e297c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.361105 Nov 20 20:48:49.127862 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 488/961] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:48:49.136890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:49.137923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.146952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.148005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.149179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.149929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.266780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.277344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dcadf3a3-98aa-4f85-90f2-6f0dbfb1a7ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.287552 Nov 20 20:48:49.280943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 474/962] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:48 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:49.343387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.356865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42c9b915-81bb-4dee-a3b4-e520a9ae9cfa tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.226220 Nov 20 20:48:49.357477 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 489/963] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:49 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:49.372059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:49.372929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.383572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.387306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.390659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.391121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.451824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:49.452437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.464419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.464877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.465890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.466366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.688637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.696381 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47beb936-1c88-4169-a0f8-16a63d09003c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.329572 Nov 20 20:48:49.706688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 475/964] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:49 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:49.715087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c11a2d5-c33f-421d-89fe-0f69be8e830b tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879a6dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:49.735787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:49.748523 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12cfa902-7cd0-463e-82ad-78070b39af87 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.299731 Nov 20 20:48:49.749954 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 490/965] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:49 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:49.757260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:49.758519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.766509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.767648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.768601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.769192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.819701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c11a2d5-c33f-421d-89fe-0f69be8e830b tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.117311 Nov 20 20:48:49.820697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 476/966] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:49 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:49.831276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5b71f2de-f10e-47cb-ac29-cd763c8ab7d8 req-2f409c21-bef1-4fa0-97b6-dce788e13dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-plugged", "status": "completed", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:49.833592 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:49.833592 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:49.858026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5b71f2de-f10e-47cb-ac29-cd763c8ab7d8 req-2f409c21-bef1-4fa0-97b6-dce788e13dcf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.858507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5b71f2de-f10e-47cb-ac29-cd763c8ab7d8 req-2f409c21-bef1-4fa0-97b6-dce788e13dcf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.859101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37df20a3-efd4-4940-966d-68876552b74f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.106765 Nov 20 20:48:49.862100 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 491/967] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:49 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:49.881294 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5b71f2de-f10e-47cb-ac29-cd763c8ab7d8 req-2f409c21-bef1-4fa0-97b6-dce788e13dcf service nova] Creating event network-vif-plugged:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:48:49.885786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:49.886659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:49.888065 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5b71f2de-f10e-47cb-ac29-cd763c8ab7d8 req-2f409c21-bef1-4fa0-97b6-dce788e13dcf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066230 Nov 20 20:48:49.889032 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 477/968] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:49.896547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.904268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:49.905174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:49.905641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.139677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:50.141041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:50.149849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.150704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.151823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.152864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.188461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.198473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c7ff2fa-498c-44c3-9ac1-1e484add8b5e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.317099 Nov 20 20:48:50.199257 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 492/969] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:49 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:50.295355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:50.296304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:50.303883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.304430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.305567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.306336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.359732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.373362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.374961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.376162 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4939f35-f413-42fe-99b0-e6984b14684d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.245703 Nov 20 20:48:50.377070 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 478/970] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:50 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:50.381569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:50.382195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:50.388532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.388975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.389812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.390279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.488669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.507101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c5025ba-202b-4379-b1c7-48a2105e21c7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.215837 Nov 20 20:48:50.508355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 493/971] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:50 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:50.566069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:50.575601 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe8427cd-50a3-4a90-9d9e-a948ea2db7cd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.197385 Nov 20 20:48:50.576196 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 479/972] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:50 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:50.747012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:50.747646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:50.755680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.756052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.757076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.757265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.758767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-75d7e215-70aa-4f80-abfb-ff17d7eb5dfa req-1ea4752e-d7fb-47e2-912f-ba8d0895c58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f6126a-4e65-40c1-a727-0559f7cf71ba", "tag": "9247b2b9-3787-408f-9910-0d7f430ac7e3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:50.760850 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:50.760850 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:50.774363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-75d7e215-70aa-4f80-abfb-ff17d7eb5dfa req-1ea4752e-d7fb-47e2-912f-ba8d0895c58b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.776168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-75d7e215-70aa-4f80-abfb-ff17d7eb5dfa req-1ea4752e-d7fb-47e2-912f-ba8d0895c58b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.819363 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-75d7e215-70aa-4f80-abfb-ff17d7eb5dfa req-1ea4752e-d7fb-47e2-912f-ba8d0895c58b service nova] Creating event network-changed:9247b2b9-3787-408f-9910-0d7f430ac7e3 for instance 06f6126a-4e65-40c1-a727-0559f7cf71ba on nch2-master-1 Nov 20 20:48:50.895280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-75d7e215-70aa-4f80-abfb-ff17d7eb5dfa req-1ea4752e-d7fb-47e2-912f-ba8d0895c58b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144593 Nov 20 20:48:50.896338 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 494/973] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:50.903771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:50.904478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:50.913702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.914960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:50.916475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:50.917218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.070092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.082401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75934ef0-d29a-4c40-82d8-2741eb3d31dd tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.339000 Nov 20 20:48:51.082997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 480/974] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:50 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:51.093232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c008fdaa-d2f6-4fa2-9660-f844e871c6e3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878da820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:51.196288 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c008fdaa-d2f6-4fa2-9660-f844e871c6e3 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.106691 Nov 20 20:48:51.197002 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 481/975] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:51 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:51.201318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:51.208938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:51.215748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.216217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.217034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.217471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.240966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.250731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34a36540-15fe-4c73-a704-e8c46ec71b29 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.352149 Nov 20 20:48:51.263320 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 495/976] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:50 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:51.264896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:51.265699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:51.273299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.273771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.275576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.276046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.290492 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61eea66b-fa17-4dae-a9ea-4aed9612462b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.091002 Nov 20 20:48:51.295869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 482/977] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:51 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:51.397180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:51.398944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:51.422220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.425509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.427230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.428520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.491047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.503027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67694e33-7774-4ea5-a789-fd2f881fe778 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.245922 Nov 20 20:48:51.505148 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 496/978] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:51 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:51.530006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:51.530895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:51.541037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.541983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.543049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.543710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.751916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.763901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-159ea8f3-faec-47b4-b9d7-7c79fac461ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1379 microversion: 2.1 time: 0.241354 Nov 20 20:48:51.765479 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 497/979] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:51 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1379 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:51.771798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:51.772914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:51.781744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.782979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.783955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:51.784555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:51.862465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.881187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.883521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:51.885535 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24d093fc-a733-4a99-8a84-70d06e8d1eb9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.494132 Nov 20 20:48:51.898270 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 483/980] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:51 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:48:52.057949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:52.066995 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a5f0541-f94f-4e61-be28-e08de0949c69 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.299565 Nov 20 20:48:52.076599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 498/981] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:51 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.100573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.101187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.107826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.108552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.109537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.110165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.214406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-115c91ae-6a7e-46fe-b2b8-0f7020b7ebd7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f870efc10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.281083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-115c91ae-6a7e-46fe-b2b8-0f7020b7ebd7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.074591 Nov 20 20:48:52.282092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 499/982] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.290117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.291429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.297841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:52.301727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.303405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.304282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.304999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.311193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1b2deb0-5da6-4378-bba1-2dbad4922ec1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.213668 Nov 20 20:48:52.311820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 484/983] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.318069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:52.319044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.325426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.325894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.329881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.331246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.384009 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8d43683-50cd-46fb-af9a-51b6eee89f37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.070123 Nov 20 20:48:52.395442 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 485/984] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:52 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:52.474089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:52.491843 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc7ee1c7-dfe1-475f-b131-e509718ddc54 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.208111 Nov 20 20:48:52.493008 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 500/985] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.530456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.531157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.539280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.539734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.540575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.541191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.687542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:52.695662 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da077835-d2c8-4a37-9251-5a7a682a1de6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.169960 Nov 20 20:48:52.696258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 486/986] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.782434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.782983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.790034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.790641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.791536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.792071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.905165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.905911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.913365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.913967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.915029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.915688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.943755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:52.951796 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cd70c70b-6e8a-4fad-bed2-8ca3c9318fd8 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1529 microversion: 2.1 time: 0.173046 Nov 20 20:48:52.956071 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 501/987] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1529 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:52.971549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:52.972252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:52.982117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.982649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:52.983512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:52.984020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.082842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.091601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.093404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.095196 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aca9defd-1ba1-442e-aad2-cc140fc15a72 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.193714 Nov 20 20:48:53.107394 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 487/988] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:48:53.112231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.113528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.121258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.121974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.122985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.123576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.171064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.182473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79b011df-edc4-442a-a7fc-ec82e3c93b89 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1529 microversion: 2.1 time: 0.214366 Nov 20 20:48:53.183322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 502/989] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:52 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1529 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.198324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d38f38a-230e-40e5-8d4b-49e043a24b86 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.199491 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:53.199491 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:53.219864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d38f38a-230e-40e5-8d4b-49e043a24b86 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/6c542808-031e-40df-b94d-0bdce9c6fb3a" status: 202 len: 0 microversion: 2.1 time: 0.024961 Nov 20 20:48:53.220505 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 503/990] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:48:53 2021] DELETE /compute/v2.1/flavors/6c542808-031e-40df-b94d-0bdce9c6fb3a => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:48:53.229003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b819fdc6-d4f0-4d56-afed-c1c76959376d tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.250235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b819fdc6-d4f0-4d56-afed-c1c76959376d tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.024799 Nov 20 20:48:53.251362 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 504/991] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.270630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:53.272909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.291468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.292287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.293279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.293807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.318544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.330846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.332657 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8690270-e75e-4a56-9173-69c8759e7d33 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.223175 Nov 20 20:48:53.342590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Old instance type tempest-test_resize_flavor_-2061992946, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 20:48:53.343343 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 488/992] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.345898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:53.346458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:53.347037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:53.348306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:53.348798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ebeb1352-d054-487c-bcb9-6528cd2ee01c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878198b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.348927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:53.402842 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ebeb1352-d054-487c-bcb9-6528cd2ee01c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.058216 Nov 20 20:48:53.404193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 489/993] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.409342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.410082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.417041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.417460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.418495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.418930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.465570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25f64932-0a4f-4701-af0e-4d21ecb4ea3a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964/action" status: 202 len: 0 microversion: 2.1 time: 0.202118 Nov 20 20:48:53.469509 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 505/994] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:53 2021] POST /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:48:53.478084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:53.481288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.493569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.496755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.497669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.498517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.579176 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c82045be-9d86-462c-bad6-5dee957fb45d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.108212 Nov 20 20:48:53.584275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 506/995] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:53 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:53.592981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.593785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.604006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.604506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.605301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.605735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.657147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.666043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-589b660c-33a2-4ca8-b1f4-37bf21da7957 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.260623 Nov 20 20:48:53.668813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 490/996] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.679772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2a6e0804-3c26-4c54-a5cb-f5620d6b97bb req-63853a8c-24db-4863-9219-b5c79aa5ab35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acf73a5-9605-4b53-83dc-09af84fee3fe", "name": "network-vif-plugged", "status": "completed", "tag": "1f1cf981-26ff-4024-b94c-8e78ef84d154"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:53.684349 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:53.684349 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:53.704116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2a6e0804-3c26-4c54-a5cb-f5620d6b97bb req-63853a8c-24db-4863-9219-b5c79aa5ab35 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.704827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2a6e0804-3c26-4c54-a5cb-f5620d6b97bb req-63853a8c-24db-4863-9219-b5c79aa5ab35 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.740815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2a6e0804-3c26-4c54-a5cb-f5620d6b97bb req-63853a8c-24db-4863-9219-b5c79aa5ab35 service nova] Creating event network-vif-plugged:1f1cf981-26ff-4024-b94c-8e78ef84d154 for instance 6acf73a5-9605-4b53-83dc-09af84fee3fe on nch1-master-1 Nov 20 20:48:53.755842 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2a6e0804-3c26-4c54-a5cb-f5620d6b97bb req-63853a8c-24db-4863-9219-b5c79aa5ab35 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084360 Nov 20 20:48:53.759807 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 491/997] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:53.773540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.774590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.787909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.789936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.792509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.794464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.915122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:53.922266 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6116d57-e84b-49b8-9b6f-e899ac160866 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1538 microversion: 2.1 time: 0.336685 Nov 20 20:48:53.922846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 507/998] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1538 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:53.947188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:53.948449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:53.979329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.979705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:53.980503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:53.990172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.028581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.039683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ed8266b-30b5-4a14-b38e-6a057caf3cbb tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.277642 Nov 20 20:48:54.050118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 492/999] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:54.116753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:54.117466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:54.131233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.131929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.132836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.133411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.290776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.299767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdd74808-a349-4f83-9338-34caff0cfc0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.363842 Nov 20 20:48:54.310161 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 508/1000] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:53 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:54.349511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:54.350155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:54.363620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.364069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.364871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.365322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.582841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.594001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c6d425a-2fdb-489a-a47d-511f66740f8b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.248626 Nov 20 20:48:54.594624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 509/1001] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:54 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:54.605654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.607834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3544fda-e3d4-40bd-8b19-8c078276692e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f873718b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:54.615103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.621265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.629419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6405e93f-e07b-4fb3-b4d8-0ce0b0bc26a9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.512032 Nov 20 20:48:54.632759 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 493/1002] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:54 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:54.655616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:54.656848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:54.665199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.665771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.666878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.667478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.705392 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3544fda-e3d4-40bd-8b19-8c078276692e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.109693 Nov 20 20:48:54.706093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 510/1003] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:54 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:54.711398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:54.712009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:54.720786 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eecd1ffb-cfba-4bfd-a43e-4c1780a48689 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.074307 Nov 20 20:48:54.727000 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 494/1004] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:54 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:54.727512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.728214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.729171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.729634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.933909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:54.945732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:54.947069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:54.948268 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5855ca5b-2278-4904-a5ab-d7f6ae07fb68 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1476 microversion: 2.1 time: 0.240156 Nov 20 20:48:54.948879 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 511/1005] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:54 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1476 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:54.966120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.966904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:54.968094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:54.968581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.079703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:55.081277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:55.114903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.115548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.116379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.116824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.252431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:55.266628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90ee3c7c-886e-4fb4-8539-3a18096e2d45 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1538 microversion: 2.1 time: 0.328791 Nov 20 20:48:55.267588 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 495/1006] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:54 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1538 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:55.320755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:55.321425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:55.331248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.333574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.336122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.336655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.390416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:55.399276 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b608f460-b87e-494b-b2d7-8288a7d3c392 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.327893 Nov 20 20:48:55.400471 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 512/1007] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:55 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:55.611788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:55.615127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:55.622661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.624689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.625526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.625973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.642772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:55.653766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d257ec4c-c06c-4a1b-b66e-9faf06c3feb9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.339401 Nov 20 20:48:55.666130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 496/1008] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:55 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:55.669562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:55.670237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:55.703935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.704395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.705217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:55.705656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:55.962981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:55.970793 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52040cfa-72b6-4db2-91e1-ddfe0d5f3b23 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.362677 Nov 20 20:48:55.971373 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 513/1009] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:55 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:55.983147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0997d0f8-b7c5-4285-ab68-c2e3156698f4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87600b80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.055032 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0997d0f8-b7c5-4285-ab68-c2e3156698f4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1455 microversion: 2.1 time: 0.078812 Nov 20 20:48:56.055876 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 514/1010] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:55 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.067926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:56.070540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.086136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.086762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.087579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.090883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.128068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.138281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.141298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.142954 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06ac5601-62ec-43ab-9049-7069a4c0f8fb tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.485917 Nov 20 20:48:56.158173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 497/1011] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:55 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:56.158371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e5c31a4a-96aa-47be-a8b1-a78d74149215 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.100936 Nov 20 20:48:56.159377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 515/1012] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:56 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:56.164559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-441a331d-5441-4a8f-bb13-5f145a42ed91 req-17d2f7b1-c1da-4dfc-9c3c-7fad9e6bd6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca2999-8a94-4c5f-bc08-7ba55ff79ba4", "name": "network-vif-plugged", "status": "completed", "tag": "1469ba97-d687-4daa-b763-d4b8c0589efb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:56.166003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.166730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.167159 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:56.167159 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:56.175013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.175500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.176454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.176893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.179168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-441a331d-5441-4a8f-bb13-5f145a42ed91 req-17d2f7b1-c1da-4dfc-9c3c-7fad9e6bd6ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.179879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-441a331d-5441-4a8f-bb13-5f145a42ed91 req-17d2f7b1-c1da-4dfc-9c3c-7fad9e6bd6ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.195127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-441a331d-5441-4a8f-bb13-5f145a42ed91 req-17d2f7b1-c1da-4dfc-9c3c-7fad9e6bd6ea service nova] Creating event network-vif-plugged:1469ba97-d687-4daa-b763-d4b8c0589efb for instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 on nch1-master-1 Nov 20 20:48:56.201298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-441a331d-5441-4a8f-bb13-5f145a42ed91 req-17d2f7b1-c1da-4dfc-9c3c-7fad9e6bd6ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041429 Nov 20 20:48:56.202663 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 498/1013] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:56.287084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.288209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.297131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.304626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.306087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.306087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.598469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.609441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7bbbb931-ea80-457a-bfd2-d1ad8cbe4c8f tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1462 microversion: 2.1 time: 0.447902 Nov 20 20:48:56.621706 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 516/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1462 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.626994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.629505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.636088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.637059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.637931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.638405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.725988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.734813 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26b805da-9757-4e85-bc23-9982f32470c2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1538 microversion: 2.1 time: 0.453689 Nov 20 20:48:56.739029 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 499/1015] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1538 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.743461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.744244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.750444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.750891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.751709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.752145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.801232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.809077 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80b47c8a-adac-451a-80bb-3553d1e5b62d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.186208 Nov 20 20:48:56.809784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 517/1016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.814350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.814960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.821476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.821923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.822780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.823215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.937246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.945287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-702a5319-d313-4c4d-88eb-48b18a13b8bb tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1462 microversion: 2.1 time: 0.205086 Nov 20 20:48:56.946119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 500/1017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1462 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.956485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:56.961967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:56.963386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.964315 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-083b66f6-52c3-4d27-8265-e714ee1c16b5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.153485 Nov 20 20:48:56.964888 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 518/1018] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:56.969776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.970261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.971131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.971489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.988969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:56.989584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:56.995602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.996068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:56.996920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:56.997499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.053240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:57.053653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:57.054168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:57.054566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:57.054967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:57.127995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.135162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.135618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.136428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.136871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.153489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.167125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72fc2443-989b-42a1-a57e-836732f18850 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.182432 Nov 20 20:48:57.171361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5976f518-c34e-4569-9701-8ac23d89df93 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 1066 microversion: 2.1 time: 0.213684 Nov 20 20:48:57.172060 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 501/1019] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:56 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 1066 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 20 20:48:57.177239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d36af95-96a0-4a7d-9485-3ab1eafe27d5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879eeca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.178466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 519/1020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:56 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.183337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.184308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.190563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.191419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.192401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.192842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.231981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d36af95-96a0-4a7d-9485-3ab1eafe27d5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1464 microversion: 2.1 time: 0.058774 Nov 20 20:48:57.232577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 502/1021] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1464 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.237173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:57.239148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.245373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.245828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.246644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.247080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.290391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56a68964-7110-4155-b444-94864885c9e8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.055816 Nov 20 20:48:57.294425 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 503/1022] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:57 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:57.297604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.298335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.306536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.307021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.307862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.308369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.352575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.364015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.366122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.367332 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-183555d1-9442-46e1-bde7-159faedc1461 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1566 microversion: 2.25 time: 0.187850 Nov 20 20:48:57.367903 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 520/1023] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:57.375190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb12b5bb-fc87-4007-b2aa-7f564222ac0a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f8733b0d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.428671 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb12b5bb-fc87-4007-b2aa-7f564222ac0a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 200 len: 1464 microversion: 2.1 time: 0.059728 Nov 20 20:48:57.435636 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 521/1024] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 1464 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.440926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.443197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.450557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.451018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.451828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.452290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.507773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.517142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-92c8d7ce-1efd-4477-a539-c0eca2da96d6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.224046 Nov 20 20:48:57.518421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 504/1025] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.616542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.625555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-699f8772-ac93-4400-9c95-046291b3daf2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1466 microversion: 2.1 time: 0.188438 Nov 20 20:48:57.626343 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 522/1026] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1466 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.643838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dc40b208-9a23-4bc1-808b-b941a3018fbf tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878075e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.748855 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dc40b208-9a23-4bc1-808b-b941a3018fbf tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?changes-since=2021-11-20T20%3A47%3A20Z" status: 200 len: 2375 microversion: 2.1 time: 0.108687 Nov 20 20:48:57.749541 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 505/1027] 10.222.0.41 () {58 vars in 1198 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/images?changes-since=2021-11-20T20%3A47%3A20Z => generated 2375 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.755305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.756075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.761611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0757c25-50d2-474f-a400-fff100c2bce7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87807ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.762155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.762600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.763378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.763804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.834186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0757c25-50d2-474f-a400-fff100c2bce7 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1416743347" status: 200 len: 485 microversion: 2.1 time: 0.075983 Nov 20 20:48:57.834768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 506/1028] 10.222.0.41 () {58 vars in 1230 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1416743347 => generated 485 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:57.839081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:57.840060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:57.845628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.846125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.846929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:57.848021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:57.904906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:57.913094 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76bfe762-f6c9-4813-bd98-287be0af4a23 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.161393 Nov 20 20:48:57.913761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 523/1029] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:57.918770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-366e1ec0-79d5-4d02-9ddb-446246e17278 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f876dea60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.004091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.019553 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f4c7060-a077-4770-b9a5-5172cfef1d8c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1324 microversion: 2.1 time: 0.183496 Nov 20 20:48:58.020336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 507/1030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1324 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.025450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.026401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.027760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-366e1ec0-79d5-4d02-9ddb-446246e17278 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?server=7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 957 microversion: 2.1 time: 0.112599 Nov 20 20:48:58.033181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.035991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.037031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.037681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.042241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 524/1031] 10.222.0.41 () {58 vars in 1208 bytes} [Sat Nov 20 20:48:57 2021] GET /compute/v2.1/images?server=7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 957 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:58.054043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a9f5cf7-330a-4db4-9419-ce586c5ef3e1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871fde50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.110467 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a9f5cf7-330a-4db4-9419-ce586c5ef3e1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fv2.1%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 485 microversion: 2.1 time: 0.066731 Nov 20 20:48:58.111042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 525/1032] 10.222.0.41 () {58 vars in 1316 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fv2.1%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 485 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:58.121570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-51ddd039-a832-43e4-8ec2-8b518f70a93e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f871fda60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.177680 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-51ddd039-a832-43e4-8ec2-8b518f70a93e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 485 microversion: 2.1 time: 0.059553 Nov 20 20:48:58.179637 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 526/1033] 10.222.0.41 () {58 vars in 1302 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 485 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:58.183869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.184469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.187092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.191881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.192338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.193131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.193562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.195249 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-037b8ac5-7ab3-4d79-a3b8-e6162cd76029 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.173728 Nov 20 20:48:58.195843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 508/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.200336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a173d79-579a-4443-87a0-93aeda98c5f6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f878da4c0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.309779 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a173d79-579a-4443-87a0-93aeda98c5f6 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.112574 Nov 20 20:48:58.310407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 509/1035] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.315070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-63a35d8c-a3ce-46c8-948e-9454f5993c0c req-12068685-7a5c-4014-b56e-daa35d2caae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67bb1ce-5e3e-497f-af2f-54d0c33e27e2", "name": "network-vif-plugged", "status": "completed", "tag": "1ebb075b-0271-4950-a74a-182cc4a744f5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:58.319129 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:58.319129 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:48:58.326909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63a35d8c-a3ce-46c8-948e-9454f5993c0c req-12068685-7a5c-4014-b56e-daa35d2caae1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.327351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63a35d8c-a3ce-46c8-948e-9454f5993c0c req-12068685-7a5c-4014-b56e-daa35d2caae1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.334978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.339412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-63a35d8c-a3ce-46c8-948e-9454f5993c0c req-12068685-7a5c-4014-b56e-daa35d2caae1 service nova] Creating event network-vif-plugged:1ebb075b-0271-4950-a74a-182cc4a744f5 for instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 on nch2-master-1 Nov 20 20:48:58.342081 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd5a6923-467a-4030-a183-06fd4d9e047b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.161493 Nov 20 20:48:58.342643 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 527/1036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.344980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-63a35d8c-a3ce-46c8-948e-9454f5993c0c req-12068685-7a5c-4014-b56e-daa35d2caae1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033431 Nov 20 20:48:58.345683 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 510/1037] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:48:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:58.346970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:58.348656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.351548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-599729a5-991c-4368-b119-c6b6d021e5e4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87807a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.354577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.355019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.355887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.356334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.399452 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea170226-9622-4624-a130-9754e0bde37a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.055595 Nov 20 20:48:58.400478 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 528/1038] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:58 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:58.406038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.406971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.414252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.414708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.415629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.416074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.427158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-599729a5-991c-4368-b119-c6b6d021e5e4 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.080344 Nov 20 20:48:58.427733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 511/1039] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.440491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3e8ea8a-433d-4d94-bb3e-7eb52657e982 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f879a9dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.549686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3e8ea8a-433d-4d94-bb3e-7eb52657e982 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.113755 Nov 20 20:48:58.550300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 512/1040] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:48:58.558735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.558735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.563516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.563964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.564741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.565175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.578417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.586453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.588006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.589134 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6196fde0-8fbf-485d-8dc5-28f0cc38e421 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1541 microversion: 2.25 time: 0.187506 Nov 20 20:48:58.589695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 529/1041] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1541 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:58.601881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf378e48-99ee-4e44-bf10-977afc4b7f1e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87384b80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.673671 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf378e48-99ee-4e44-bf10-977afc4b7f1e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?changes-since=2021-11-20T20%3A47%3A15Z" status: 200 len: 6334 microversion: 2.1 time: 0.082906 Nov 20 20:48:58.674304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 530/1042] 10.222.0.41 () {58 vars in 1219 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images/detail?changes-since=2021-11-20T20%3A47%3A15Z => generated 6334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.679658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8955ef9a-1bd2-49da-afe7-2518074341f3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '.version_select at 0x7f3f873714c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.680941 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:48:58.680941 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:48:58.682426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8955ef9a-1bd2-49da-afe7-2518074341f3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.682877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8955ef9a-1bd2-49da-afe7-2518074341f3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.694292 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8955ef9a-1bd2-49da-afe7-2518074341f3 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 2542 microversion: 2.25 time: 0.018950 Nov 20 20:48:58.694892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 531/1043] 10.222.0.41 () {60 vars in 1183 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/os-migrations => generated 2542 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:58.699209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eef7a14b-bdea-43ab-a3a3-fc8a62bcd0b2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87206c10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.712066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:58.719419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-838b391d-fa76-4b6e-a46c-029b68bfdde7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.167332 Nov 20 20:48:58.719980 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 513/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.725370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.726013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.732093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.732198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.732971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.733396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.744195 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eef7a14b-bdea-43ab-a3a3-fc8a62bcd0b2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1416743347" status: 200 len: 665 microversion: 2.1 time: 0.048165 Nov 20 20:48:58.744768 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 532/1045] 10.222.0.41 () {58 vars in 1251 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1416743347 => generated 665 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:58.756898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2b7c9dfe-6d3a-4911-9f77-03ca11569f1e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f873f24c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.812072 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2b7c9dfe-6d3a-4911-9f77-03ca11569f1e tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fv2.1%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1467 microversion: 2.1 time: 0.058546 Nov 20 20:48:58.812648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 533/1046] 10.222.0.41 () {58 vars in 1337 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fv2.1%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1467 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:58.824821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fcb0e0fc-d83a-4623-9e0d-c0f9ff5e4dd2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f873f2670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.867948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:48:58.874239 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fcb0e0fc-d83a-4623-9e0d-c0f9ff5e4dd2 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1467 microversion: 2.1 time: 0.052770 Nov 20 20:48:58.874812 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 534/1047] 10.222.0.41 () {58 vars in 1323 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.41%2Fcompute%2Fservers%2Fd01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1467 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:58.880880 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cea49f4-cab7-4eb1-b933-adc2c38ec53f tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 2033 microversion: 2.25 time: 0.159931 Nov 20 20:48:58.881583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 514/1048] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 2033 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:58.887786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3e37f0d-f76b-46e2-9591-23ead21b45b5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f8776e3a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.930413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:58.931223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:58.940679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.941509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.942352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:58.942797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:58.970557 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3e37f0d-f76b-46e2-9591-23ead21b45b5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.086035 Nov 20 20:48:58.971349 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 535/1049] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:58.976065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-821955250", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "1f07f823-03fd-485f-ad70-6286912e8408"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:59.027415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] validate_networks() for [('1f07f823-03fd-485f-ad70-6286912e8408', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:48:59.085858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.093555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47f95402-4e5a-4bb4-b6c0-a418e0cda8e5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.166694 Nov 20 20:48:59.094218 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 515/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:58 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:48:59.099435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e260e32a-b38d-412d-8e2b-9606f4615386 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87819ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.165318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e260e32a-b38d-412d-8e2b-9606f4615386 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.069675 Nov 20 20:48:59.165891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 516/1051] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.170283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.170883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.177234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.177676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.178498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.178929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.313243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.321420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b1da2ce5-1d76-4c0b-9496-3e6f8e08811d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1521 microversion: 2.1 time: 0.154483 Nov 20 20:48:59.321992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 517/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.326272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e1d5c2e-e136-44df-86d8-143db765f8a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87817700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.375297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e1d5c2e-e136-44df-86d8-143db765f8a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059" status: 200 len: 784 microversion: 2.1 time: 0.052198 Nov 20 20:48:59.375946 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 518/1053] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059 => generated 784 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:48:59.381366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.381621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.388355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.388802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.389675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.390018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.410374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:48:59.410877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:48:59.411282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:48:59.411690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:48:59.412099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:48:59.420828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.421277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.422121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.422562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.439542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:48:59.444016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for user e417004a75cd4291a2ef4a9d233c9f28 and project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:48:59.455120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:48:59.458068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:48:59.502558 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-989ba62f-a31f-4e95-b087-19a31ef06481 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.530346 Nov 20 20:48:59.503625 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 536/1054] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:48:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 20:48:59.507583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.508459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.515354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.515671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.516450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.516887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.541890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.549432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ced73753-d07d-4cd4-a53f-bf047c9a9590 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.172383 Nov 20 20:48:59.550120 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 519/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.555027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.555701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.561734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.562382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.563207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.563646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.666188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.673545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b4d146af-ded2-492c-9f01-9107ae4bbbbc tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1521 microversion: 2.1 time: 0.169318 Nov 20 20:48:59.674330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 537/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.679366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52a89505-3942-48d0-877b-c097d548e1d0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86ee71f0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.719519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.727600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e088ff71-0293-4b76-90ef-d1af0b0983c9 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1311 microversion: 2.1 time: 0.175930 Nov 20 20:48:59.728308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 520/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1311 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.731053 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52a89505-3942-48d0-877b-c097d548e1d0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.055832 Nov 20 20:48:59.731620 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 538/1058] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:48:59.733045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:59.734008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.741453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.741883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.742691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.743119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.744714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.745318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.789261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42ebb084-5eac-4b63-8598-81e365072ea7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.059847 Nov 20 20:48:59.789922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 521/1059] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:59 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:48:59.795260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-729017359"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:48:59.796509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.804483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.804937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.805792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.806285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.821857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.829062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.830779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:48:59.832160 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6587b5f4-3b48-40e1-ab34-5d1a625e41d2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1261 microversion: 2.25 time: 0.091123 Nov 20 20:48:59.832948 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 539/1060] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1261 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:48:59.837465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:48:59.838169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:48:59.845051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.845752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.846802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:48:59.847459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:48:59.993973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:00.002291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55b26279-a678-493d-99b8-ae7c4cf39e22 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.167882 Nov 20 20:49:00.005527 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 540/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:48:59 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:00.013158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e62a82c0-0136-4dc6-91ce-e64c38dceadb tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87360820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.147926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0a0e902-1c19-4ce7-8389-3bb3cf72dda2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4/action" status: 202 len: 0 microversion: 2.1 time: 0.356107 Nov 20 20:49:00.151215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 522/1062] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:48:59 2021] POST /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:49:00.157371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.158097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:00.164788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.165322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.166487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.166938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.324946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:00.333659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a2f4258-5e91-419f-8f41-d130c6a17499 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.180552 Nov 20 20:49:00.334268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 523/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:00.338770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eae4a4e3-8acc-4a90-a842-8636631a6f6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f878e4a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.456463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eae4a4e3-8acc-4a90-a842-8636631a6f6a tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e" status: 204 len: 0 microversion: 2.1 time: 0.121092 Nov 20 20:49:00.457800 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 524/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] DELETE /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:00.465452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb8f0958-1529-46f6-8fd5-640dfcdecd39 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f878e4040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.478156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e62a82c0-0136-4dc6-91ce-e64c38dceadb tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3" status: 204 len: 0 microversion: 2.1 time: 0.470379 Nov 20 20:49:00.478726 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 541/1065] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] DELETE /compute/v2.1/images/236b43fd-3a12-43cf-ab6e-4963232447f3 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:00.486145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67125128-2cc6-4049-a588-6f088296c8c8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f86f2e790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.490471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-bb8f0958-1529-46f6-8fd5-640dfcdecd39 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Image not found. Nov 20 20:49:00.491073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb8f0958-1529-46f6-8fd5-640dfcdecd39 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:00.491940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb8f0958-1529-46f6-8fd5-640dfcdecd39 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e" status: 404 len: 62 microversion: 2.1 time: 0.029930 Nov 20 20:49:00.492574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 525/1066] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:49:00 2021] GET /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:49:00.500002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.500702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:00.507363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.507768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.508580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.509678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.714959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:00.727184 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86778146-7501-4cdc-9a6c-0671f5185b3e tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1533 microversion: 2.1 time: 0.230367 Nov 20 20:49:00.728085 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 526/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1533 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:00.732686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.733297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:00.741508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.741508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.741865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.742350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.943414 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67125128-2cc6-4049-a588-6f088296c8c8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4" status: 204 len: 0 microversion: 2.1 time: 0.460591 Nov 20 20:49:00.944285 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 542/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] DELETE /compute/v2.1/images/98e61ac8-d25b-4207-8411-aca76934ffa4 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:49:00.951635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:00.952248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:00.958832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.959287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.960081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.960537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.970747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:00.979305 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8fd1e61b-f8ba-4055-bbeb-687de6168b3b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.249983 Nov 20 20:49:00.980305 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 527/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:00.985148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:00.986229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:00.995495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.996075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:00.996932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:00.997477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.042313 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4bc69012-9899-4efb-977a-6370999ce835 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.060369 Nov 20 20:49:01.043823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 528/1070] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:00 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:01.049091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.049875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.057880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.058366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.059161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.059595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.124855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.132324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e76ff97-f4ba-4c0f-bdbe-c22005af8376 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1494 microversion: 2.1 time: 0.184110 Nov 20 20:49:01.132889 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 543/1071] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:00 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:01.137394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09cd2696-c515-4972-b7cd-1e7bc15b524c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87712f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.140984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.151079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.152646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.153784 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-272dbf5f-4f97-47f6-babd-43591304252c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1319 microversion: 2.25 time: 0.108768 Nov 20 20:49:01.154374 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 529/1072] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1319 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:01.158700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.159457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.171232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.171693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.172496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.172937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.418950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.427483 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9fdf20b-a565-4218-a9d9-4bde5ee124a7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.272118 Nov 20 20:49:01.428062 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 530/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:01.432519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.433103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.438772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.439288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.440021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.440463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.624395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09cd2696-c515-4972-b7cd-1e7bc15b524c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778" status: 204 len: 0 microversion: 2.1 time: 0.490157 Nov 20 20:49:01.624969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 544/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] DELETE /compute/v2.1/images/3cd31ba6-95c3-492c-adb1-7a641d78e778 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:01.629455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.630338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.637455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.637907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.638770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.639374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.704226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da06d02b-c048-490a-85af-40dfd1716a31 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1645 microversion: 2.1 time: 0.275121 Nov 20 20:49:01.715746 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 531/1075] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1645 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:01.720437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.720937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.728174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.728864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.729672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.730150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.759929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:01.792476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:01.799716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b32fa11-e029-43d0-97ad-25320548734b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.173766 Nov 20 20:49:01.800661 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 545/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:01.805183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-82bfa719-e3a1-48f4-9921-0449b1a8dd5d req-f167ccdb-c383-4d8a-9583-f73b753d6d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-unplugged", "status": "completed", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:01.806666 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:01.806666 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:01.813392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82bfa719-e3a1-48f4-9921-0449b1a8dd5d req-f167ccdb-c383-4d8a-9583-f73b753d6d57 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.813837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82bfa719-e3a1-48f4-9921-0449b1a8dd5d req-f167ccdb-c383-4d8a-9583-f73b753d6d57 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.825639 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-82bfa719-e3a1-48f4-9921-0449b1a8dd5d req-f167ccdb-c383-4d8a-9583-f73b753d6d57 service nova] Creating event network-vif-unplugged:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:49:01.830966 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-82bfa719-e3a1-48f4-9921-0449b1a8dd5d req-f167ccdb-c383-4d8a-9583-f73b753d6d57 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029159 Nov 20 20:49:01.831662 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 546/1077] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:01.837455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.838213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.845902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.845902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.846623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.847279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.858894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57fa2e91-45f4-4b02-b19a-cd179c14e3d8 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 204 len: 0 microversion: 2.1 time: 0.141696 Nov 20 20:49:01.860080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 532/1078] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:01 2021] DELETE /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:01.867907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.868745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.874834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.875365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.876223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.876770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.980554 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f3607c2-da24-4f65-86e6-8afe374fdc41 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1645 microversion: 2.1 time: 0.146761 Nov 20 20:49:01.981140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 547/1079] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1645 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:01.985638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:01.986405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:01.992997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.993651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:01.994552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:01.994993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.111910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.120096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e181539-fa4b-4999-b7af-26be9d46b4e9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1539 microversion: 2.1 time: 0.258553 Nov 20 20:49:02.120941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 533/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1539 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:02.131584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.133035 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:02.133035 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:02.134947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.135466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.136579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.137012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.137116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.145090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8be27f2-0eec-4d71-ae63-fa5705eaf3a0 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1474 microversion: 2.1 time: 0.162738 Nov 20 20:49:02.145935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 548/1081] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:01 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:02.161127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.161810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.162308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95996e41-3c4d-414f-9e32-51d3d8a3b821 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040148 Nov 20 20:49:02.162908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 534/1082] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:02.168791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:02.169215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.169733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.170364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.170798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.171304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.177477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.178015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.178789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.179245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.221857 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f8429e6-ffd8-47db-8a84-196c14546d48 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.057257 Nov 20 20:49:02.223199 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 535/1083] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:02 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:02.228224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:02.228879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.235949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.236669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.237168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.238441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.318078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.319511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df754919-e826-456f-b631-274bb2fa6beb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2/action" status: 202 len: 0 microversion: 2.1 time: 0.094867 Nov 20 20:49:02.322410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 536/1084] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:02 2021] POST /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:02.326170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.327920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.330191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74e5fc49-0b37-40ea-940e-d5d1395e9df5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.173352 Nov 20 20:49:02.330846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 549/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:02.335806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.336579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.340895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.341375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.342483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.343062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.344312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.344815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.345639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.346253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.492070 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5d91376-1da0-4deb-8c04-d1045093f296 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1650 microversion: 2.1 time: 0.160028 Nov 20 20:49:02.492632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 550/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1650 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:02.497160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.497664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.505500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.506098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.506915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.507360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.636692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.646414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.648179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.649329 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce4f6d46-cc88-46f2-886e-39c0182410f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.327925 Nov 20 20:49:02.649898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 537/1087] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:02.654642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-59393f6a-d0c5-45c5-b1ee-2c154749aaaa req-dc137315-0d22-45a0-a88a-6741402107af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d", "tag": "45fadff2-da94-4f5f-8340-26c7ac05e1e2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:02.656448 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:02.656448 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:02.665926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-59393f6a-d0c5-45c5-b1ee-2c154749aaaa req-dc137315-0d22-45a0-a88a-6741402107af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.666521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-59393f6a-d0c5-45c5-b1ee-2c154749aaaa req-dc137315-0d22-45a0-a88a-6741402107af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.680310 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-59393f6a-d0c5-45c5-b1ee-2c154749aaaa req-dc137315-0d22-45a0-a88a-6741402107af service nova] Creating event network-changed:45fadff2-da94-4f5f-8340-26c7ac05e1e2 for instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d on nch2-master-1 Nov 20 20:49:02.686236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-59393f6a-d0c5-45c5-b1ee-2c154749aaaa req-dc137315-0d22-45a0-a88a-6741402107af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034863 Nov 20 20:49:02.687110 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 538/1088] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:02.705385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:02.713215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac9c2d3e-6a5c-43d8-bb5b-725144e8539d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.219612 Nov 20 20:49:02.713880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 551/1089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:02.818065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:02.818793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:02.824753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.825204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:02.825985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:02.826452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.025364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.032804 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6af8fc38-729d-4743-94cf-9c979c9033f3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.219954 Nov 20 20:49:03.033375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 539/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:02 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:03.138010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.138640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.144867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.145365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.146175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.146619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.163657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.164398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.170334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.170789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.171585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.172017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.280698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.289262 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a59f8e67-d42e-49ee-814b-bfbf57eb046d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1539 microversion: 2.1 time: 0.154898 Nov 20 20:49:03.294375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 552/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:03.304617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:03.305637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.323372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.323807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.324612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.325059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.373462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1abbd182-5921-4ece-b230-30178068b61d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.077289 Nov 20 20:49:03.375162 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 553/1092] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:03 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:03.379680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.380501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.387387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.387993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.388886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.389431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.402934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.411215 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-488d4759-5a95-4cb4-98b3-5fb10ace0a26 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1474 microversion: 2.1 time: 0.251812 Nov 20 20:49:03.420664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 540/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1474 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:03.509057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.509841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.527417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.527771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.535733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.536358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.568054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.575396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffc3ea03-9490-4ff6-a5ac-c76780caea0b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.199915 Nov 20 20:49:03.576935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 554/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:03.667258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.668360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.675954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.676989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.678352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.678873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.773359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d24cd238-60e7-4d62-afae-3e91b4edc379 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1630 microversion: 2.1 time: 0.268232 Nov 20 20:49:03.785253 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 541/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1630 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:03.790634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:03.791250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.797621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.798449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.799235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.799673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.829234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.840237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.841869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.843290 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1ddf391-8659-4713-98ae-8e00a12c52ca tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.179937 Nov 20 20:49:03.844289 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 555/1096] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:49:03.850487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:03.851759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:03.858121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.858659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.859859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:03.860311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:03.886807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lazy-loading 'flavor' on Instance uuid f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:03.902913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Going to try to live migrate instance to nch1-master-1 {{(pid=140942) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:49:03.942151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:03.949465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa8fa819-c3bb-4f76-be03-949717a748ff tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.163062 Nov 20 20:49:03.950036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 542/1097] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:03 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:04.050496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:04.051137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:04.057258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.057647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.058675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.058994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.203638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:04.212402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da04518c-b02f-444d-aded-6f0fe76202cf tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.165648 Nov 20 20:49:04.212971 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 543/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:04 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:04.307383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:04.307984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:04.314895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.315438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.316380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.317131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.526401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:04.540707 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7bcf2eed-e268-479d-b4bf-ed964b1658ea tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1521 microversion: 2.1 time: 0.238145 Nov 20 20:49:04.544603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 544/1099] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:04 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:04.549894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:04.550962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:04.557091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.557593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.558364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.558801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.603146 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa72c3c0-b0e6-4f40-9b23-d428fcc25457 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.057654 Nov 20 20:49:04.603797 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 545/1100] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:04 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:04.609341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:04.609815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:04.618695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.619147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.620355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.620787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.958756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:04.966294 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff63301c-fe67-415d-bd24-4331d9b899a5 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1474 microversion: 2.1 time: 0.361330 Nov 20 20:49:04.966878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 546/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:04 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:04.971138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:04.971833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:04.978470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.978920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:04.979706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:04.980142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.005868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:05.092171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0cefac8-48df-4fd7-bafa-4e62f0833f1c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 204 len: 0 microversion: 2.1 time: 0.122510 Nov 20 20:49:05.093131 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 547/1102] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:04 2021] DELETE /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:05.098994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.099833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.107284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.107736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.108540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.108975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.294619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.299539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81d6d1b2-06ca-439c-a073-25d90edfc3ce tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2/action" status: 202 len: 0 microversion: 2.1 time: 1.451994 Nov 20 20:49:05.303526 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 556/1103] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:03 2021] POST /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2/action => generated 0 bytes in 1459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:05.307422 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7f93086-4a88-43ca-ba5c-a3e6c51d41df tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.209960 Nov 20 20:49:05.309104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.309752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.318133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 548/1104] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:05.323982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.325121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.331082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.331845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.332744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.332860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.333021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.333339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.333489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.333986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.510560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.530317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.532123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.533525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54af4991-efab-4222-8a4c-6e147574fe10 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.228489 Nov 20 20:49:05.538531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 557/1105] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:05.544074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.545004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.553568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.554407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.555438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.555557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.556239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.568807 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6438d6f4-8fa8-41b0-8c32-ba24b61eed2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.248730 Nov 20 20:49:05.569533 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 549/1106] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:05.588330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f9624ab7-d13d-49af-a364-d4217c281252 req-22fa9f2f-8384-423f-8a1e-9ab19921da91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d01ba62e-c3aa-436b-933b-c4a6533f5f03", "name": "network-vif-deleted", "tag": "5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:05.589930 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:05.589930 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:05.604036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f9624ab7-d13d-49af-a364-d4217c281252 req-22fa9f2f-8384-423f-8a1e-9ab19921da91 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.604545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f9624ab7-d13d-49af-a364-d4217c281252 req-22fa9f2f-8384-423f-8a1e-9ab19921da91 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.620986 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f9624ab7-d13d-49af-a364-d4217c281252 req-22fa9f2f-8384-423f-8a1e-9ab19921da91 service nova] Creating event network-vif-deleted:5e0bce97-bbcb-4b23-8f8b-ede1ff1f23bd for instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 on nch1-master-1 Nov 20 20:49:05.627117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f9624ab7-d13d-49af-a364-d4217c281252 req-22fa9f2f-8384-423f-8a1e-9ab19921da91 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044084 Nov 20 20:49:05.627777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 550/1107] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:05.635051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.635810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.643346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.644502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.646540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.646903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.758844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.766247 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6bb6b9c6-957a-4693-9740-b85bc014eb08 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1527 microversion: 2.1 time: 0.226372 Nov 20 20:49:05.766881 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 558/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1527 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:05.771112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.771712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.777949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.778447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.779234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.779669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.909409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.921764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-992360e8-4b55-4140-a7ff-54a4a8f35de2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.292154 Nov 20 20:49:05.922668 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 551/1109] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:05.928267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b38f6446-5e15-4543-9134-31f13191b43e req-6f597c0e-fcc1-47a3-897a-972d5ed88435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca2999-8a94-4c5f-bc08-7ba55ff79ba4", "name": "network-vif-plugged", "status": "completed", "tag": "1469ba97-d687-4daa-b763-d4b8c0589efb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:05.932289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:05.941439 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:05.941439 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:05.945987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b36be548-33ee-4dc4-a8ea-dcade63f2264 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.175339 Nov 20 20:49:05.946913 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 559/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:05.950635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b38f6446-5e15-4543-9134-31f13191b43e req-6f597c0e-fcc1-47a3-897a-972d5ed88435 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.951653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b38f6446-5e15-4543-9134-31f13191b43e req-6f597c0e-fcc1-47a3-897a-972d5ed88435 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.953503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:05.954622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.963761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.964729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.965787 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b38f6446-5e15-4543-9134-31f13191b43e req-6f597c0e-fcc1-47a3-897a-972d5ed88435 service nova] Creating event network-vif-plugged:1469ba97-d687-4daa-b763-d4b8c0589efb for instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 on nch1-master-1 Nov 20 20:49:05.966376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.966916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.970503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b38f6446-5e15-4543-9134-31f13191b43e req-6f597c0e-fcc1-47a3-897a-972d5ed88435 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046463 Nov 20 20:49:05.971139 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 552/1111] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:05.983756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:05.984455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:05.990975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.991428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:05.992283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:05.992720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.011798 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fca14554-caed-44eb-9ae6-351850bd43f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.063545 Nov 20 20:49:06.013028 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 560/1112] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:05 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:06.027243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.027972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.028585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lazy-loading 'fault' on Instance uuid d01ba62e-c3aa-436b-933b-c4a6533f5f03 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:06.075774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.084914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56509b3f-cdba-4ae9-8c7a-2217b31aa136 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 200 len: 1308 microversion: 2.1 time: 0.105604 Nov 20 20:49:06.085762 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 553/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:05 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:06.324126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.324929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.332898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.333433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.334329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.334846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.473119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.480720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d4b482d-d20b-424d-91ec-b11b47732843 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.160661 Nov 20 20:49:06.481290 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 561/1114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:06.556711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.557317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.563710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.564153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.564966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.565399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.585982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.586710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.592722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.593339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.594247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.594778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.730690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.738976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4e6be40-465a-4796-bd08-0e05d9cb76fa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.155956 Nov 20 20:49:06.739558 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 562/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:06.784589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.784589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.790687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.791139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.791930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.792364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.816901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.825873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.827450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.828562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2bffa92e-09a5-4e65-a6d9-e717abd17a0b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.276081 Nov 20 20:49:06.838630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 554/1116] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:06.934686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:06.939382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.940110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.943327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e42726fa-1bc4-42bb-bcbb-59597ea622d4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1527 microversion: 2.1 time: 0.163425 Nov 20 20:49:06.944009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 563/1117] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:06.946792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.947309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.948175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.948678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.963533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:06.964916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:06.971583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.972816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:06.973804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:06.974288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.122220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:07.130543 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a184c0a7-e642-491a-8f49-28273691ccce tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.170936 Nov 20 20:49:07.135159 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 564/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:07.136416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:07.137504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.143602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.145483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.146088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.146444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.188518 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12322e4d-f864-4bfc-ad81-01d329cc20bd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.056032 Nov 20 20:49:07.190087 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 565/1119] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:07 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:07.194203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.195239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: d01ba62e-c3aa-436b-933b-c4a6533f5f03] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.202268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.202583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.203378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.203814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.219181 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] HTTP exception thrown: Instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 could not be found. Nov 20 20:49:07.219777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Returning 404 to user: Instance d01ba62e-c3aa-436b-933b-c4a6533f5f03 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:07.220600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7520e70f-dafa-4017-aa0f-803ff0d41846 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03" status: 404 len: 111 microversion: 2.1 time: 0.030165 Nov 20 20:49:07.221150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 566/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:07 2021] GET /compute/v2.1/servers/d01ba62e-c3aa-436b-933b-c4a6533f5f03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:07.229456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.230039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.236325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.236773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.237555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.237997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.262707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:07.322362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:07.329648 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c31ec256-9575-4e3b-8f7f-3b24e84a9887 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.393854 Nov 20 20:49:07.330251 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 555/1121] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:06 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:07.370714 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5284812d-ab84-477d-8c6a-90a56551632c tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 204 len: 0 microversion: 2.1 time: 0.144370 Nov 20 20:49:07.374649 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 567/1122] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:07 2021] DELETE /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:07.381334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.382320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.390170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.390880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.391936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.392474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.498888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.499610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.507375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.507375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.508410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.508959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.579891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:07.588222 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19752a9b-7898-49ee-8777-0f1e9508f201 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1472 microversion: 2.1 time: 0.211911 Nov 20 20:49:07.589156 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 556/1123] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:07 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:07.679476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67bb1ce-5e3e-497f-af2f-54d0c33e27e2", "name": "network-vif-unplugged", "status": "completed", "tag": "1ebb075b-0271-4950-a74a-182cc4a744f5"}, {"name": "network-changed", "server_uuid": "f67bb1ce-5e3e-497f-af2f-54d0c33e27e2", "tag": "1ebb075b-0271-4950-a74a-182cc4a744f5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:07.681202 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:07.681202 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:07.688766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.688960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.700711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] Creating event network-vif-unplugged:1ebb075b-0271-4950-a74a-182cc4a744f5 for instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 on nch2-master-1 Nov 20 20:49:07.701211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] Creating event network-changed:1ebb075b-0271-4950-a74a-182cc4a744f5 for instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 on nch2-master-1 Nov 20 20:49:07.707980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-64427ad1-6f69-4b69-ac85-d5ee76df4a2e req-a5195988-7c51-4936-aa48-26dac7ac5b7e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.034209 Nov 20 20:49:07.708615 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 557/1124] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:49:07.756408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.757112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.764600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:07.767629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.768247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.770970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.774024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.781747 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3665600b-1881-46b1-a377-bd7a2f3d78c2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.286795 Nov 20 20:49:07.796450 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 568/1125] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:07 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:07.850682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:07.851557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:07.859827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.860580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:07.861542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:07.862184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.086470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.094858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.096501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.098315 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fbeaabf2-b1be-4fc9-81c3-66e26e67193e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.253543 Nov 20 20:49:08.100004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.100278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 569/1126] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:07 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:49:08.108667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e7a423d-92d6-4d9c-98db-1804c7286e98 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.356169 Nov 20 20:49:08.110387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 558/1127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:07 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:08.114286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:08.114905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.123210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca2999-8a94-4c5f-bc08-7ba55ff79ba4", "name": "network-vif-unplugged", "status": "completed", "tag": "1469ba97-d687-4daa-b763-d4b8c0589efb"}, {"server_uuid": "21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d", "name": "network-vif-plugged", "status": "completed", "tag": "45fadff2-da94-4f5f-8340-26c7ac05e1e2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:08.125088 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:08.125088 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:08.130103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.130565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.131379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.131832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.134794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.135233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.151048 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] Creating event network-vif-unplugged:1469ba97-d687-4daa-b763-d4b8c0589efb for instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 on nch1-master-1 Nov 20 20:49:08.151559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] Creating event network-vif-plugged:45fadff2-da94-4f5f-8340-26c7ac05e1e2 for instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d on nch2-master-1 Nov 20 20:49:08.162249 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e8835d46-10ff-480c-95dd-96be836d39bf req-709f0275-5e12-4687-9b77-e3200b3b454c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050338 Nov 20 20:49:08.163012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 559/1128] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:08.169433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7debec5c-3cfe-405c-9d50-f590cccb9c70 req-1eb643b2-fff2-4023-a60b-45cbdf252e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ca2999-8a94-4c5f-bc08-7ba55ff79ba4", "name": "network-vif-deleted", "tag": "1469ba97-d687-4daa-b763-d4b8c0589efb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:08.171241 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:08.171241 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:08.174852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.176115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.176984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lazy-loading 'fault' on Instance uuid 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:08.179413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7debec5c-3cfe-405c-9d50-f590cccb9c70 req-1eb643b2-fff2-4023-a60b-45cbdf252e6a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.180035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7debec5c-3cfe-405c-9d50-f590cccb9c70 req-1eb643b2-fff2-4023-a60b-45cbdf252e6a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.203615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7debec5c-3cfe-405c-9d50-f590cccb9c70 req-1eb643b2-fff2-4023-a60b-45cbdf252e6a service nova] Creating event network-vif-deleted:1469ba97-d687-4daa-b763-d4b8c0589efb for instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 on nch1-master-1 Nov 20 20:49:08.208577 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7debec5c-3cfe-405c-9d50-f590cccb9c70 req-1eb643b2-fff2-4023-a60b-45cbdf252e6a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043944 Nov 20 20:49:08.209557 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 560/1129] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:08.214407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:08.215104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.221393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.221974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.223306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.223752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.231566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.240000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e794aa20-cef1-462b-969c-c6ab62c4a501 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 200 len: 1314 microversion: 2.1 time: 0.138488 Nov 20 20:49:08.240587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 570/1130] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:08 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:08.245099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:08.246081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.251989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.252440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.253461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.254088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.297184 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54ee5f86-6d94-4370-8ad6-93cfa13632b0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.055206 Nov 20 20:49:08.298637 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 571/1131] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:08 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:08.348040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:08.348742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.355642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.356399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.356893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.357328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.493131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.501772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d68f6ccd-08c4-4993-b326-16a554f27da6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.158203 Nov 20 20:49:08.502647 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 572/1132] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:08 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:08.547199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.555650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-724be6e0-59f6-4f3f-8443-b5bc6a22e64e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.344934 Nov 20 20:49:08.556226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 561/1133] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:08 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:08.607251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:08.607889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.614912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.615365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.616199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.616697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.748572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.756012 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a7a267a9-4084-4d14-8f58-7f291c28f645 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1472 microversion: 2.1 time: 0.152521 Nov 20 20:49:08.756578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 573/1134] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:08 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:08.798656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:08.799269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:08.806514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.806957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.807737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:08.808166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:08.936429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:08.944028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c47038b-9c5d-4cd4-8bf8-1338cf2eca0f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.148949 Nov 20 20:49:08.944593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 562/1135] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:08 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:09.116539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.117144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.123625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.124081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.124889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.125322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.128070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.129248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.135057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.135499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.136272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.136874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.262194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.270285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.271798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.272096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.273161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e74a8d65-9e9e-4198-a6a6-1ef22b842a76 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1361 microversion: 2.25 time: 0.160396 Nov 20 20:49:09.273724 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 574/1136] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:09.277918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.278557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.282797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5669dce9-d151-4dbc-be35-64b0b63b74bc tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.158413 Nov 20 20:49:09.283531 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 563/1137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:09.284284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.285337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.287038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.287595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.303713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. Nov 20 20:49:09.304452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:09.305383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11972f51-66ec-461d-9218-c58710eacde5 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 404 len: 111 microversion: 2.1 time: 0.030728 Nov 20 20:49:09.306080 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 575/1138] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:09.309254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:09.310271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.317073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.317714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.318536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.319506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.356059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2088543771", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e089fcf3-9dcc-485e-b53f-bb119c8c3467"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:09.366813 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0d04d0e-8a68-4666-8447-1ba8f43b85f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.061229 Nov 20 20:49:09.368785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 564/1139] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:09 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:09.408322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] validate_networks() for [('e089fcf3-9dcc-485e-b53f-bb119c8c3467', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:49:09.520172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.520988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.528271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.528808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.529603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.530065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.668660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.676905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc9ec389-8804-4e5c-8e99-9642f20ab11b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.161573 Nov 20 20:49:09.677473 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 565/1140] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:09.681631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.682254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.688349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.688886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.689659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.690112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.921868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:09.932775 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a86338b-5297-4710-9e6d-0667cbd62102 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.254159 Nov 20 20:49:09.933612 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 566/1141] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:09.940297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:09.941418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:09.951694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.952256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:09.952945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:09.953378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.049729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:49:10.050352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:49:10.051234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:49:10.051642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:49:10.052076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:49:10.062248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.062703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.063662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.064109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.081239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:10.086973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Getting quotas for user b9094951b1a24a48a1db5b87e80f6234 and project 1929d2944a034783a75db63f07c146a6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:10.101959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:49:10.104852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:49:10.153075 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c25e0991-2d23-4533-b07b-5c136056df96 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.800849 Nov 20 20:49:10.153939 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 576/1142] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:49:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:49:10.163939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.164556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.172200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.172579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.173372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.173867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.178857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f544fa27eb24a2ebf3f3a931528e373', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d075cbe0444578ada04c262fdd9164', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.187633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eca6c4d1-202a-4ec5-83ba-66e43f160459 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 200 len: 1472 microversion: 2.1 time: 0.252720 Nov 20 20:49:10.198392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 567/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:09 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:10.211700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c38f35ad-9d0b-4b13-9849-f6c2fae02c36 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.212556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c38f35ad-9d0b-4b13-9849-f6c2fae02c36 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.277681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c38f35ad-9d0b-4b13-9849-f6c2fae02c36 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.286664 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c38f35ad-9d0b-4b13-9849-f6c2fae02c36 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1225 microversion: 2.1 time: 0.083179 Nov 20 20:49:10.287552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 568/1144] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:10.293287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.295851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.304416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.305108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.306917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.307527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.396811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.406017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ced55402-6a0b-4550-aedd-32c4f81da268 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1513 microversion: 2.1 time: 0.250962 Nov 20 20:49:10.406905 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 577/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:10.411572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.412195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.417935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.418430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.419232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.419705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.586322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.596204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.596735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.598359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.599959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8632e968-3df2-4efd-b895-e6fe7f79dd29 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1556 microversion: 2.25 time: 0.311038 Nov 20 20:49:10.601048 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 569/1146] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1556 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:10.607085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:10.608359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.615206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.615798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.616675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.617217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.620756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2e1b0fe-6538-4dea-856e-50198b25105c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.212944 Nov 20 20:49:10.622370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 578/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:10.635472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e730b8c7-d5cd-4efd-8767-aeda21046425 req-95342398-5689-4312-bcd7-2eae229bca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026c1aa-a9a9-437b-82e7-7121e7fc4b26", "name": "network-vif-deleted", "tag": "76b5097e-7d85-4157-a179-a00737c678ce"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:10.637161 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:10.637161 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:10.646122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e730b8c7-d5cd-4efd-8767-aeda21046425 req-95342398-5689-4312-bcd7-2eae229bca8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.646571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e730b8c7-d5cd-4efd-8767-aeda21046425 req-95342398-5689-4312-bcd7-2eae229bca8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.667514 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e730b8c7-d5cd-4efd-8767-aeda21046425 req-95342398-5689-4312-bcd7-2eae229bca8a service nova] Creating event network-vif-deleted:76b5097e-7d85-4157-a179-a00737c678ce for instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 on nch2-master-1 Nov 20 20:49:10.671779 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8954a8ed-5627-4fbb-9c2f-02274a78840f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.068345 Nov 20 20:49:10.672242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e730b8c7-d5cd-4efd-8767-aeda21046425 req-95342398-5689-4312-bcd7-2eae229bca8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049766 Nov 20 20:49:10.673175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 579/1148] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:10.677511 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 570/1149] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:10 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:10.681328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.682275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.689458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.689914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.690976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.691615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.700201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.701136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.708740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.709895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.710974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.711455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.854400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:10.870119 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e2f68fd-4da9-4bec-a8d0-f76dd5906ae0 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 2048 microversion: 2.25 time: 0.195476 Nov 20 20:49:10.870916 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 580/1150] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 2048 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:10.877908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:10.888981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9436ea5-2ffe-4f09-a267-b16122591585 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.194838 Nov 20 20:49:10.890584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 571/1151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:10.901743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.903247 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:10.903247 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:10.904918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.905446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.906377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.906975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.932670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd707b99-26fc-45f6-b0ba-9dca98f8ac56 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038399 Nov 20 20:49:10.933326 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 581/1152] 10.222.0.41 () {60 vars in 1216 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:10.950564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:10.951221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:10.958550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.959011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:10.959823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:10.960269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.120518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:11.130199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c185950-e73f-4bed-b137-dade58db1d1c tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.183233 Nov 20 20:49:11.130859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 572/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:10 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:11.216069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.216757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] [instance: 7026c1aa-a9a9-437b-82e7-7121e7fc4b26] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:11.224356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.224648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.225433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.225858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.240004 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] HTTP exception thrown: Instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 could not be found. Nov 20 20:49:11.240759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Returning 404 to user: Instance 7026c1aa-a9a9-437b-82e7-7121e7fc4b26 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:11.241579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7568e3da-0eba-4ab2-95cd-72a4d1176c0f tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26" status: 404 len: 111 microversion: 2.1 time: 0.029938 Nov 20 20:49:11.245163 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 582/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] GET /compute/v2.1/servers/7026c1aa-a9a9-437b-82e7-7121e7fc4b26 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:11.250791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db62c7b4-c880-4e92-b2ca-7653198ab3d1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87930160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.311265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.312175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:11.318893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.319646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.320613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.321210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.393442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:11.416992 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b7b7a92e-085f-4ae0-a930-f319d87a5ed7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1277 microversion: 2.1 time: 0.110135 Nov 20 20:49:11.422171 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 583/1155] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:11.435547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.436081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:11.444057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.444515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.445559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.446006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.569453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db62c7b4-c880-4e92-b2ca-7653198ab3d1 tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7" status: 204 len: 0 microversion: 2.1 time: 0.322155 Nov 20 20:49:11.572171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 573/1156] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] DELETE /compute/v2.1/images/a4ad9863-5b14-47d6-824e-3064015b3bf7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:49:11.580451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8311ef7-8143-4e47-8d6d-7f1e5857852a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87a37820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.708870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:11.716226 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b72ddad-e0de-44ed-8aa7-75c3ef265f69 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1519 microversion: 2.1 time: 0.291085 Nov 20 20:49:11.716807 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 584/1157] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:11.730257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.731000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:11.739173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.739609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.740675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.741279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.809976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8311ef7-8143-4e47-8d6d-7f1e5857852a tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2" status: 204 len: 0 microversion: 2.1 time: 0.234384 Nov 20 20:49:11.810754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 574/1158] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] DELETE /compute/v2.1/images/fe81bb48-7ea0-4e3f-add9-b2f8c6ff5ce2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:49:11.815563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:11.817264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:11.824051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.824505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.825294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:11.825730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:11.865527 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfbe1388-4939-4d7f-9146-b2ca543c5729 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.053592 Nov 20 20:49:11.869596 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 575/1159] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:11 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:11.871237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b39d41a4-9edc-40d5-8833-01a42c73fb1d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] Calling method '.version_select at 0x7f3f87ac4550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.978540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:11.988766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af578cd7-af34-42f3-a2db-22a7dfa0de7b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.270929 Nov 20 20:49:11.989634 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 585/1160] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:11.994393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:11.995035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.001033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.002241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.002893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.004675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.098758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b39d41a4-9edc-40d5-8833-01a42c73fb1d tempest-ListImageFiltersTestJSON-1889297841 tempest-ListImageFiltersTestJSON-1889297841-project] 10.222.0.41 "DELETE /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7" status: 204 len: 0 microversion: 2.1 time: 0.231359 Nov 20 20:49:12.099347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 576/1161] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] DELETE /compute/v2.1/images/3e6e899e-b977-4638-b15d-d1f938c21ee7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:12.148181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:12.148912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.160859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.161769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.163386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.164316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.246867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:12.256000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5dfe91b6-211f-4ac9-893f-e3648974a05e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.264949 Nov 20 20:49:12.256913 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 586/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:11 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:12.331821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3a25071-9204-456d-ad65-141e2d6b0743", "device": "/dev/xvdb"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:12.333803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.339956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.340714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.341729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.342436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.448215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:12.457127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4666aa87-4028-445f-bbd2-c99f508036d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.313509 Nov 20 20:49:12.461982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 577/1163] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:12 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:12.472907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:12.473611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.483493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.483948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.484786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.485320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.674824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-533fee84-e7a1-4725-af8d-81aa12dfff16 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "POST /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.346974 Nov 20 20:49:12.676580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 587/1164] 10.222.0.41 () {62 vars in 1363 bytes} [Sat Nov 20 20:49:12 2021] POST /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:12.737327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:12.739532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.750830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:12.756722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.761787 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69c53151-fc76-494e-bef1-8e687ad34fb7 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.298336 Nov 20 20:49:12.762537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.764317 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 578/1165] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:12 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:12.764442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.764896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.876984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:12.878840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:12.886287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.887425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.888391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:12.888829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:12.942908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e9ec57e-1aa1-4c8f-8985-d1cc6c1fb621 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.069070 Nov 20 20:49:12.947556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 579/1166] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:12 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:13.010468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:13.011461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:13.030204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.031155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.036991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.037798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.104886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:13.115482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a34ba91e-16e2-4a60-9e9b-a4a968bdd0c6 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1519 microversion: 2.1 time: 0.384003 Nov 20 20:49:13.129543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 588/1167] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:12 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1519 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:13.270679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:13.273988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:13.275409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:13.282514 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58beacf1-b505-4a98-a5a3-ed2f0dbe7f19 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.280114 Nov 20 20:49:13.284194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.285777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.286274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 580/1168] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:13 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:13.287332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.298742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.478823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:13.479434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:13.491600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.492047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.492836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.494200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.547443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:13.558999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b83e0e45-59f0-4404-95c8-53fee93d0533 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.288898 Nov 20 20:49:13.570943 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 589/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:13 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:13.739047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-eba348c8-1fcb-4e30-9dc0-39de1fe13bba req-ced6434c-4da9-4dcf-a5c2-f3d1a98e0b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9cc31a-a73e-4fea-b56f-0b57cacab7f1", "tag": "f39a7349-0e42-47d1-8bed-def98fbec976"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:13.742588 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:13.742588 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:13.753835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eba348c8-1fcb-4e30-9dc0-39de1fe13bba req-ced6434c-4da9-4dcf-a5c2-f3d1a98e0b47 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.754566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eba348c8-1fcb-4e30-9dc0-39de1fe13bba req-ced6434c-4da9-4dcf-a5c2-f3d1a98e0b47 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.771246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:13.785034 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a95d8ae-de94-4d12-8eb4-252b1f622ba7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1504 microversion: 2.1 time: 0.309554 Nov 20 20:49:13.786189 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 581/1170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:13 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:13.792399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:13.795454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:13.805620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.811802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.813193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-eba348c8-1fcb-4e30-9dc0-39de1fe13bba req-ced6434c-4da9-4dcf-a5c2-f3d1a98e0b47 service nova] Creating event network-changed:f39a7349-0e42-47d1-8bed-def98fbec976 for instance ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 on nch1-master-1 Nov 20 20:49:13.813492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.815294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.835976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-eba348c8-1fcb-4e30-9dc0-39de1fe13bba req-ced6434c-4da9-4dcf-a5c2-f3d1a98e0b47 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103422 Nov 20 20:49:13.840092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 590/1171] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:13.958382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:13.961657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:13.974797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.975511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:13.977327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:13.978082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.042136 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78932371-a774-46f7-812b-a609178aa3d9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.090064 Nov 20 20:49:14.050733 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 591/1172] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:13 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:14.061435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f365b76d-1329-4458-959a-637c47abcd59 req-e6c05035-af98-418b-99c7-762e50ea16cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60d2233-750a-4b19-b2b7-a577b8091aee", "name": "network-vif-unplugged", "status": "completed", "tag": "3c47ade7-005b-489c-858d-16364f1b0424"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:14.064512 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:14.064512 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:14.095883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f365b76d-1329-4458-959a-637c47abcd59 req-e6c05035-af98-418b-99c7-762e50ea16cc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.097727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f365b76d-1329-4458-959a-637c47abcd59 req-e6c05035-af98-418b-99c7-762e50ea16cc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.120299 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f365b76d-1329-4458-959a-637c47abcd59 req-e6c05035-af98-418b-99c7-762e50ea16cc service nova] Creating event network-vif-unplugged:3c47ade7-005b-489c-858d-16364f1b0424 for instance c60d2233-750a-4b19-b2b7-a577b8091aee on nch2-master-1 Nov 20 20:49:14.136243 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f365b76d-1329-4458-959a-637c47abcd59 req-e6c05035-af98-418b-99c7-762e50ea16cc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081850 Nov 20 20:49:14.138275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 592/1173] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:14.148500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:14.149517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:14.162095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.167102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.168265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.168944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.223410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:14.243585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cafb126-bc9f-488a-80a1-b8896555f1f1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.456028 Nov 20 20:49:14.255280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 582/1174] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:13 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:14.555564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51f31ee5-fb38-44ba-a2e6-3441cff5a66f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f87807e50>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:14.566467 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-51f31ee5-fb38-44ba-a2e6-3441cff5a66f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Nov 20 20:49:14.567350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51f31ee5-fb38-44ba-a2e6-3441cff5a66f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:14.568371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51f31ee5-fb38-44ba-a2e6-3441cff5a66f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.279965 Nov 20 20:49:14.569955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 583/1175] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:14 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 20:49:14.575622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:14.577164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:14.578595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:14.584469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e5251e5-36a9-461b-84d9-d2cc5e86b1dd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1519 microversion: 2.1 time: 0.440900 Nov 20 20:49:14.588321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 593/1176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:14 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:14.596001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.597697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.599031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.599599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.603079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f870e7160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-412272714", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:14.621190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:14.625690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:14.646779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 20 20:49:14.648027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:14.649042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2be8f4f9-823e-49d3-9480-36af6c7828e0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058210 Nov 20 20:49:14.650166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 594/1177] 10.222.0.41 () {60 vars in 1159 bytes} [Sat Nov 20 20:49:14 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:49:14.658822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:14.660283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:14.668089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.668511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.669371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.669829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.841810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:14.858660 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d320fb5e-9665-431f-aac6-f3ae16a1dba5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.287265 Nov 20 20:49:14.859577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 584/1178] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:14 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:14.873587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f87ac4790>, body: {"keypair": {"name": "tempest-keypair-97512147"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:14.908416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:14.915031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:14.951127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:14.962594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-afaf31ba-cb07-40af-8c1d-caef976f90a7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.311106 Nov 20 20:49:14.963828 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 595/1179] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:14 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:14.968088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:14.968694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:14.977537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.977991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:14.978835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:14.979286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.086113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:15.090013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:15.104056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-265a6459-d6f2-432b-8e1d-003adf0f5aba tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.242990 Nov 20 20:49:15.104873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 585/1180] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:14 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:15.111199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:15.112160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:15.119150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.120168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.122483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.123564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.183085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:15.192301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-462b4ff9-056f-4783-a5d3-d94aae441ef6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1479 microversion: 2.1 time: 0.226919 Nov 20 20:49:15.193701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 596/1181] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:14 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1479 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:15.194992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c743a8fd-6bc0-4fa1-a619-9e4983040f73 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.088861 Nov 20 20:49:15.199835 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 586/1182] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:15.204421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f86af8f70>, body: {"keypair": {"name": "tempest-keypair-97512147"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:15.221505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d705f41f-22f5-4032-aa50-2c2a5ba9bb06 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '.version_select at 0x7f3f87a37820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.222947 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:15.222947 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:15.224729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d705f41f-22f5-4032-aa50-2c2a5ba9bb06 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.226180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d705f41f-22f5-4032-aa50-2c2a5ba9bb06 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.228490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:15.233630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:15.240890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d705f41f-22f5-4032-aa50-2c2a5ba9bb06 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 2729 microversion: 2.1 time: 0.025149 Nov 20 20:49:15.241619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 587/1183] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:49:15 2021] GET /compute/v2.1/os-migrations => generated 2729 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:15.257636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.258966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:15.275848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.276643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.277472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.277947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.475953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Key pair 'tempest-keypair-97512147' already exists. Nov 20 20:49:15.476428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 409 to user: Key pair 'tempest-keypair-97512147' already exists. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:15.477253 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e270adf-e026-4ab1-aae8-cda0bf8fac8f tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.281518 Nov 20 20:49:15.480473 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 597/1184] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/os-keypairs => generated 103 bytes in 283 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:49:15.483431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.484833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:15.492132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.492589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.493477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.493920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.684594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:15.694356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4e8be5e-d9cb-459f-9f36-b902e2ee55a1 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.215279 Nov 20 20:49:15.704748 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 598/1185] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:15 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:15.710571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eba5e29e-0ba1-4b59-b3c0-be664cafd8b0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Calling method '.version_select at 0x7f3f86ee7ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.731010 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eba5e29e-0ba1-4b59-b3c0-be664cafd8b0 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97512147" status: 202 len: 0 microversion: 2.1 time: 0.024395 Nov 20 20:49:15.736108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 599/1186] 10.222.0.41 () {58 vars in 1214 bytes} [Sat Nov 20 20:49:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97512147 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:15.741631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.742305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:15.748571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.749017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.749816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.750279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.850960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7335aa2-4121-4ce3-a320-39f2b84b3b28 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1630 microversion: 2.1 time: 0.598898 Nov 20 20:49:15.852564 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 588/1187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:15 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1630 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:15.856790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-217af177-3afb-419b-a0ef-fa6cfce4bbc4 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f87a7fa60>, body: {"keypair": {"name": ""}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:15.857983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-217af177-3afb-419b-a0ef-fa6cfce4bbc4 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:15.858951 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-217af177-3afb-419b-a0ef-fa6cfce4bbc4 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.005652 Nov 20 20:49:15.859639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 589/1188] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:49:15.880026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f87a03700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1979041482", "public_key": " "}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:15.916321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:15.922265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:15.931351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:15.942235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7af6c738-9962-4f15-85d1-0a5645ba17e0 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1519 microversion: 2.1 time: 0.209091 Nov 20 20:49:15.942440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 20 20:49:15.942980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:15.943850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab9ff2ad-2bbc-4188-817b-912c72cb71d7 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.069512 Nov 20 20:49:15.944410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 590/1189] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:49:15.951917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:15.952526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:15.955987 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 600/1190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:15 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:15.958852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.959325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.960124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:15.960554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:15.961325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f985687-4fe5-4281-87ff-adc1f45f61ab tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f86aeea60>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:15.962632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f985687-4fe5-4281-87ff-adc1f45f61ab tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:15.963439 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f985687-4fe5-4281-87ff-adc1f45f61ab tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.006055 Nov 20 20:49:15.963972 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 601/1191] 10.222.0.41 () {60 vars in 1158 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/os-keypairs => generated 627 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:49:15.985874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Action: 'create', calling method: .version_select at 0x7f3f873f2af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2006042120", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:16.005710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:16.010304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Getting quotas for user 7f7fcf57ff144e2288e394b18b6503ea and project 5c2dea7e010246e78bd78146653d8152. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:16.026019 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 20 20:49:16.026854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:16.027834 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa3a003a-cef7-47c2-bcd2-865334df3455 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.048059 Nov 20 20:49:16.028540 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 602/1192] 10.222.0.41 () {60 vars in 1158 bytes} [Sat Nov 20 20:49:15 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:49:16.033452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:16.034096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:16.041516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.042122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.042922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.043439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.118477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:16.127738 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16321acd-232c-4cc3-b9cb-1db63e83552c tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.182142 Nov 20 20:49:16.128880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 591/1193] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:15 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:16.134066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-972c404b-4fbc-494a-9524-9f317ccce996 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Calling method '.version_select at 0x7f3f87a7ed30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:16.146739 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-972c404b-4fbc-494a-9524-9f317ccce996 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2064932670 not found for user 7f7fcf57ff144e2288e394b18b6503ea Nov 20 20:49:16.147680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-972c404b-4fbc-494a-9524-9f317ccce996 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2064932670 not found for user 7f7fcf57ff144e2288e394b18b6503ea {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:16.148553 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-972c404b-4fbc-494a-9524-9f317ccce996 tempest-KeyPairsNegativeTestJSON-922559577 tempest-KeyPairsNegativeTestJSON-922559577-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2064932670" status: 404 len: 145 microversion: 2.1 time: 0.018486 Nov 20 20:49:16.149915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 592/1194] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:49:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2064932670 => generated 145 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:16.155257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-729469941", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "554d0697-db40-4745-a60d-da36ede89e92"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:16.219920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] validate_networks() for [('554d0697-db40-4745-a60d-da36ede89e92', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:49:16.264394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:16.276292 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-697f4ac3-71c4-4597-a1b7-7194b6d184ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.246585 Nov 20 20:49:16.277067 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 603/1195] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:16 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:16.281497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:16.282499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:16.290753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.291207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.292490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.292935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.337408 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-830d7d6b-f94b-42b7-bb5c-896d6aa20e49 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.059296 Nov 20 20:49:16.338334 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 604/1196] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:16 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:16.362289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c876b707-3be8-43d0-b413-99e6b1d2f776 req-141bcea8-532f-4a75-9a85-a5fe367b763d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60d2233-750a-4b19-b2b7-a577b8091aee", "name": "network-vif-plugged", "status": "completed", "tag": "3c47ade7-005b-489c-858d-16364f1b0424"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:16.364062 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:16.364062 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:16.373430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c876b707-3be8-43d0-b413-99e6b1d2f776 req-141bcea8-532f-4a75-9a85-a5fe367b763d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.373430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c876b707-3be8-43d0-b413-99e6b1d2f776 req-141bcea8-532f-4a75-9a85-a5fe367b763d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.386441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c876b707-3be8-43d0-b413-99e6b1d2f776 req-141bcea8-532f-4a75-9a85-a5fe367b763d service nova] Creating event network-vif-plugged:3c47ade7-005b-489c-858d-16364f1b0424 for instance c60d2233-750a-4b19-b2b7-a577b8091aee on nch2-master-1 Nov 20 20:49:16.391446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c876b707-3be8-43d0-b413-99e6b1d2f776 req-141bcea8-532f-4a75-9a85-a5fe367b763d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033373 Nov 20 20:49:16.392799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 605/1197] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:49:16.713470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:16.714346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:16.725050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.725596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.726443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.727209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.728319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:49:16.729226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:49:16.730121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:49:16.730764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:49:16.731371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:49:16.754521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.755050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.758490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.759118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.782159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:16.790081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for user dbb46ce41ca44f57aeef1d6b2191b4cb and project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:16.802792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:49:16.805136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:49:16.853374 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e9499adf-6703-4830-92e1-0839d78c2880 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702204 Nov 20 20:49:16.854746 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 593/1198] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:49:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:49:16.864959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45b17a47-3bb5-41bd-97ca-c545502c1089 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:16.865906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45b17a47-3bb5-41bd-97ca-c545502c1089 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:16.875359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:16.887324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d015b113-d1af-4db7-81a7-7e7337cf3208 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.178941 Nov 20 20:49:16.899146 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 606/1199] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:16 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:16.922099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-45b17a47-3bb5-41bd-97ca-c545502c1089 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:16.935672 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45b17a47-3bb5-41bd-97ca-c545502c1089 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1210 microversion: 2.1 time: 0.074836 Nov 20 20:49:16.936488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 594/1200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:16 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1210 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:16.964911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:16.965670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:16.972784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.973306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:16.974209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:16.974779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.139234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:17.145123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:17.145855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:17.150835 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c023db63-da85-414b-97c6-e219ad3ce507 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1519 microversion: 2.1 time: 0.190902 Nov 20 20:49:17.151601 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 607/1201] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:16 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:17.161114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.161114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.161114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.161114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.294455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:17.295082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:17.306170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.306638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.307413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.307850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.331796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:17.342690 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da105ed2-b19a-439f-9049-04a14212c8aa tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.201663 Nov 20 20:49:17.343740 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 595/1202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:17 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:17.362394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:17.364289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:17.370833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.371276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.372537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.373161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.423666 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5c3ad7a-3e91-4187-a934-4233b9034e75 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.078341 Nov 20 20:49:17.426942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 596/1203] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:17 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:17.515202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:17.532097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0dd2e82-c10a-4418-a8ea-a9e5c7949dde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.240705 Nov 20 20:49:17.533074 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 608/1204] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:17 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:17.907541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:17.908247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:17.916183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.916837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.918001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.918623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.963002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:17.965685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:17.984945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.989402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:17.993497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:17.994105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.096310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:18.137152 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e78564bf-f164-4775-a834-0686c4e4abab tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1262 microversion: 2.1 time: 0.184963 Nov 20 20:49:18.138712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 609/1205] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:17 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1262 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:18.169269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:18.169953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.177914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.178609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.179424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.179865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.337063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:18.350020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03819780-1f14-4d2b-ab33-e59e82020370 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.446416 Nov 20 20:49:18.352795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 597/1206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:17 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:18.375965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:18.381060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.387834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.388470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.389455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.390233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.486262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:18.495245 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0496b158-e1ce-4b53-96ef-d61b8783bf0c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1504 microversion: 2.1 time: 0.330105 Nov 20 20:49:18.496035 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 610/1207] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:18 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:18.500204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:18.500814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.507419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.508161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.509041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.509674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.649757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:18.658804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84998be4-7010-4a10-bb3f-79bf94a03750 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.161200 Nov 20 20:49:18.658804 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 611/1208] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:18 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:18.663567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:18.664782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.672003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.672583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.673477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.673877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.719632 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e063616f-6e87-4dbf-bd1f-0e105d1b0bb3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.059662 Nov 20 20:49:18.721035 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 612/1209] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:18 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:18.727672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:18.728363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.735630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.736081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.736870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.737297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.815592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:18.836464 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2927bf1a-f113-4d27-ac53-ea5751a1595a tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 2126 microversion: 2.25 time: 0.481622 Nov 20 20:49:18.849502 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 598/1210] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:18 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 2126 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:18.849502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:18.849502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:18.860390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.860863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:18.862295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:18.863687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.035921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:19.047036 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-afe44b58-ff7a-4524-b1c8-2d0902e288b3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 200 len: 1504 microversion: 2.1 time: 0.325554 Nov 20 20:49:19.060117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 613/1211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:18 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:19.066414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:19.067808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:19.077326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.077787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.078877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.079549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.123254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:19.133606 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cb8aa8d-10e4-437e-920a-a449081ce5af tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.294645 Nov 20 20:49:19.135113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 599/1212] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:18 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:19.140069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:19.140851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:19.141994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'flavor' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:19.148090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.148817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.149809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.152052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.174441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Going to try to live migrate instance to nch1-master-1 {{(pid=140942) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:49:19.188987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:19.311066 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1304b762-51f6-4dcd-9b87-2bdb1707acaa tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 204 len: 0 microversion: 2.1 time: 0.174189 Nov 20 20:49:19.312219 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 600/1213] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:19 2021] DELETE /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:19.341943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:19.346168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:19.359088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.360394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.361289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.361932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.708114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:19.747853 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9229f264-40ad-410d-b105-a54fbda86104 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.427326 Nov 20 20:49:19.770588 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 601/1214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:19 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:19.780648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:19.781391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:19.790001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.790817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:19.791768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:19.792306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:20.078016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:20.094496 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b57e2173-74c5-41ef-a450-66a34b4ac65c tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.318398 Nov 20 20:49:20.096926 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 602/1215] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:19 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:20.122132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1993180514", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "f82a7818-62f9-41df-8e59-1f9bb434e3d7"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:20.212502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] validate_networks() for [('f82a7818-62f9-41df-8e59-1f9bb434e3d7', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:49:21.433541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:49:21.434291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:49:21.434470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:49:21.434880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:49:21.435293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:49:21.457783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:21.458531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:21.459381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:21.459828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:21.485096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:21.489812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for user 49baaf06032347a1bcf476aa84043eeb and project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:21.524240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:49:21.527145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:49:21.595852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60288793-dcdb-4a7f-9c39-c29043e6bf83 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497548 Nov 20 20:49:21.597353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 603/1216] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:49:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:49:21.602241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:21.603091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:21.615266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:21.617651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:21.618926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:21.619701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.169398 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06d0b89a-62c6-431f-a8d3-1b57cdf50b7b tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/action" status: 202 len: 0 microversion: 2.25 time: 3.107479 Nov 20 20:49:22.171065 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 614/1217] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:49:19 2021] POST /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/action => generated 0 bytes in 3110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:22.180321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:22.185238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:22.211904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.212748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.217558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.220761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.297489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:22.310598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c67b7cbd-9b0f-45fe-976e-e0a8b30bc577 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.136569 Nov 20 20:49:22.312405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01024dd0-c9ee-4266-8866-5bf33318b1d4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.712175 Nov 20 20:49:22.313361 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 615/1218] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:22 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:22.316915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 604/1219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:21 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:22.330889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4390dff8-db55-4be3-a242-aae5abea26bf req-52622180-d13f-42e1-8873-cb804bbf522d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9cc31a-a73e-4fea-b56f-0b57cacab7f1", "name": "network-vif-plugged", "status": "completed", "tag": "f39a7349-0e42-47d1-8bed-def98fbec976"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:22.333012 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:22.333012 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:22.342618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:22.343404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:22.358217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4390dff8-db55-4be3-a242-aae5abea26bf req-52622180-d13f-42e1-8873-cb804bbf522d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.359107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4390dff8-db55-4be3-a242-aae5abea26bf req-52622180-d13f-42e1-8873-cb804bbf522d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.369153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.369809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.370918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.371355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.375123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4390dff8-db55-4be3-a242-aae5abea26bf req-52622180-d13f-42e1-8873-cb804bbf522d service nova] Creating event network-vif-plugged:f39a7349-0e42-47d1-8bed-def98fbec976 for instance ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 on nch1-master-1 Nov 20 20:49:22.380451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4390dff8-db55-4be3-a242-aae5abea26bf req-52622180-d13f-42e1-8873-cb804bbf522d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063517 Nov 20 20:49:22.405124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 616/1220] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:22.413195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:22.414279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:22.430373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.431237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.432338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.442515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.870586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:22.879449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d11deae9-879a-42e4-9828-2b4ec6e7cb4b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.560233 Nov 20 20:49:22.880040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 605/1221] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:22 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:22.894985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:22.895915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:22.902596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.903356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.904668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.905367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:22.921762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:22.933535 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a08444bd-dc15-4f6e-891a-9d93ae6e1fa8 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.526694 Nov 20 20:49:22.938784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 617/1222] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:22 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:22.946011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ef82e6e7-4688-468f-9175-1ffa39e9e5ea req-23308c1a-83c4-4f1f-b593-1b64e40d2f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c352e82a-20f7-44a4-a047-019ee6b6785b", "tag": "870f5ce2-c00b-40f9-84c6-8fa23fcf05bc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:22.951829 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:22.951829 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:22.973011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef82e6e7-4688-468f-9175-1ffa39e9e5ea req-23308c1a-83c4-4f1f-b593-1b64e40d2f8d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:22.984191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef82e6e7-4688-468f-9175-1ffa39e9e5ea req-23308c1a-83c4-4f1f-b593-1b64e40d2f8d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.015248 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ef82e6e7-4688-468f-9175-1ffa39e9e5ea req-23308c1a-83c4-4f1f-b593-1b64e40d2f8d service nova] Creating event network-changed:870f5ce2-c00b-40f9-84c6-8fa23fcf05bc for instance c352e82a-20f7-44a4-a047-019ee6b6785b on nch2-master-1 Nov 20 20:49:23.037499 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ef82e6e7-4688-468f-9175-1ffa39e9e5ea req-23308c1a-83c4-4f1f-b593-1b64e40d2f8d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093897 Nov 20 20:49:23.041112 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 618/1223] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:23.071779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:23.078018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:23.092229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.092687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.095694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.096152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.300363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.308650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-578a7457-5292-4dd3-a262-9b98feb3f31f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1325 microversion: 2.1 time: 0.417749 Nov 20 20:49:23.312545 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 606/1224] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:22 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:23.340288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:23.341202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:23.348861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.351438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.351903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.352731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.353174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.357402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb5856d2-cf68-43a5-acd9-b14779f6a041 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1278 microversion: 2.1 time: 0.313882 Nov 20 20:49:23.358110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 619/1225] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:23 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:23.380617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:23.388845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:23.402226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.402688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.403564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.404023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.475495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-804e8fdf-128e-4ee0-8b30-6533ef22a2b7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.111524 Nov 20 20:49:23.479548 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 620/1226] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:23 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:23.507333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:23.508044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:23.535638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.536844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.539262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.542232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.899179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.919125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.931589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.934227 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ef73451a-7729-46e1-a0a5-9371bda202db tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.619804 Nov 20 20:49:23.935951 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 607/1227] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:23 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:23.943890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:23.944913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:23.955296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.958365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.959720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:23.960667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:23.969036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:23.982030 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49ef6fc7-e1c9-41aa-a764-b81b71391dd1 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1471 microversion: 2.1 time: 0.488655 Nov 20 20:49:23.982791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 621/1228] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:23 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:23.996020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:23.996964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.007437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.010102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.011389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.013488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.288635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:24.301473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d9825c6-af90-4289-ba75-e33dba314016 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.317095 Nov 20 20:49:24.302203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 622/1229] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:23 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:24.331887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:24.333184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.344089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.344906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.345926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.348169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.533106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:24.551857 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df8cd8cf-19d2-482d-a037-d0c7346ff6ad tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.613742 Nov 20 20:49:24.552766 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 608/1230] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:23 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:24.558182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:24.559021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.576290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.577200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.578211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.578926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.645635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:24.656150 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b023fc9-1032-4203-aed9-491444a3add9 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1522 microversion: 2.1 time: 0.329277 Nov 20 20:49:24.657498 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 623/1231] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:24 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:24.666832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:24.668200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.681364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.682080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.683421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.684058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.729197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc38c7ac-c8db-4bad-b434-370c67dd7b42 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.069369 Nov 20 20:49:24.733442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 624/1232] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:24 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:24.740648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:24.747397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:24.749414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.763176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcbe2e04-ca1b-41ea-8b9a-277ee4778646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1276 microversion: 2.1 time: 0.208261 Nov 20 20:49:24.777658 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 609/1233] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:24 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1276 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:24.777823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.778401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.780185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.784328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.825459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:24.954630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:24.956855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.963002 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0276232e-f381-4427-937f-f21bbcef5b03 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 204 len: 0 microversion: 2.1 time: 0.227612 Nov 20 20:49:24.963805 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 625/1234] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:24 2021] DELETE /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:24.968758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.969217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.971003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.973118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.976494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:24.977178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:24.984276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.984851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:24.985645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:24.986242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.424236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.433156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d2c8729-f50e-4ca1-99a9-bb2ed7b8c6ac tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1528 microversion: 2.1 time: 0.460529 Nov 20 20:49:25.437021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 626/1235] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:24 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1528 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:25.448971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:25.449862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:25.451313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.460443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.462437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.463797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3b2822b-e740-4168-9df9-e3eeef5b5e31 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.513881 Nov 20 20:49:25.463924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.464319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.465142 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 610/1236] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:24 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:49:25.476021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.476782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.481119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-88dbca0a-9260-4888-8937-92a4b87a58f4 req-d636a798-dad9-4dd3-9d8f-9258b83df4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60d2233-750a-4b19-b2b7-a577b8091aee", "name": "network-vif-deleted", "tag": "3c47ade7-005b-489c-858d-16364f1b0424"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:25.482786 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:25.482786 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:25.504122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88dbca0a-9260-4888-8937-92a4b87a58f4 req-d636a798-dad9-4dd3-9d8f-9258b83df4d5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.504504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88dbca0a-9260-4888-8937-92a4b87a58f4 req-d636a798-dad9-4dd3-9d8f-9258b83df4d5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.560358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-88dbca0a-9260-4888-8937-92a4b87a58f4 req-d636a798-dad9-4dd3-9d8f-9258b83df4d5 service nova] Creating event network-vif-deleted:3c47ade7-005b-489c-858d-16364f1b0424 for instance c60d2233-750a-4b19-b2b7-a577b8091aee on nch2-master-1 Nov 20 20:49:25.574147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-88dbca0a-9260-4888-8937-92a4b87a58f4 req-d636a798-dad9-4dd3-9d8f-9258b83df4d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107461 Nov 20 20:49:25.574777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 611/1237] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:25.587815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:25.595673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:25.610272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.613073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.616990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.617933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.714466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.723627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89ded994-f891-4b0c-ad2a-cfefab7c17d9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1477 microversion: 2.1 time: 0.285327 Nov 20 20:49:25.733171 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 627/1238] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:25 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:25.733171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:25.733171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:25.736832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.737361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.738325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.739106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.903355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.914901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f19d6ab3-bf6b-4980-929c-ac48147d8329 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.338757 Nov 20 20:49:25.916138 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 612/1239] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:25 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:25.934348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:25.942596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4636667a-d7db-4901-95b9-8cf833488970 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.216921 Nov 20 20:49:25.944310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 628/1240] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:25 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:25.949236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:25.950453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:25.963325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.963952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:25.964922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:25.965700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.003011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'create', calling method: .version_select at 0x7f3f87ac4c10>, body: {"keypair": {"name": "tempest-keypair-788948485"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:26.011686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ff52c6b-b8be-418d-9bd5-ed499236a756 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.065875 Nov 20 20:49:26.013350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 629/1241] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:25 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:26.027271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:26.029041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:26.029188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:26.035404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for user 14079946f53346a3a4373ac0738f5894 and project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:26.037468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.037926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.038798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.039562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.254247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:26.258782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:26.262916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for user 14079946f53346a3a4373ac0738f5894 and project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:26.272204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6eee7b94-ba74-47dc-adda-9396fed88117 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.256648 Nov 20 20:49:26.273021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 630/1242] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:26 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:26.282719 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-189a5ca0-b58e-446f-a17d-9f0dd4951c09 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.364926 Nov 20 20:49:26.283311 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 613/1243] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:49:25 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:26.455085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:26.457205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:26.465644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.466472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.467585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.468434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.483519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:26.484497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:26.495812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.496622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.498280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.498828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.624232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:26.632720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72070211-ffa9-4379-8828-a8b4f1afbd26 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1528 microversion: 2.1 time: 0.182607 Nov 20 20:49:26.633431 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 631/1244] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:26 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1528 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:26.742512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:26.743793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:26.751798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.752258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:26.754283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:26.755463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.027517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.039575 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-96a0a5a0-7529-4ff9-979b-7e45fcafcf71 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1477 microversion: 2.1 time: 0.301970 Nov 20 20:49:27.046205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 632/1245] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:26 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:27.060235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:27.060863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:27.070835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.071671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.072701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.073304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.114518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.124060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.125799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.127382 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-15060e07-6403-4baa-bfb6-a7e9f824610d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.648701 Nov 20 20:49:27.128423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 614/1246] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:26 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:27.143093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:27.144026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:27.151671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.152531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.153824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.155239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.317354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.331658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc06a3f9-94e2-458b-86da-f6ea69a164d7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.283260 Nov 20 20:49:27.342500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 633/1247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:27 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:27.352368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:27.359820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:27.375175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.379883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.380967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.381256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.463377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f27b0f1b-8be7-4f1f-908a-873635f4bc05 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.119219 Nov 20 20:49:27.464042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 634/1248] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:27 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:27.477713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:27.478441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:27.492907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.493827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.495475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.496216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.554020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.568792 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93e3dd7d-a1cc-493f-8955-eba794cd6f11 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.438952 Nov 20 20:49:27.573719 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 615/1249] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:27 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:27.579603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b74e6f6d-13e1-4aba-aab8-d8031f91b3d3 req-746ea456-c46d-4a02-a595-1e4543d72163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9cc31a-a73e-4fea-b56f-0b57cacab7f1", "name": "network-vif-deleted", "tag": "f39a7349-0e42-47d1-8bed-def98fbec976"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:27.589870 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:27.589870 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:27.607366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b74e6f6d-13e1-4aba-aab8-d8031f91b3d3 req-746ea456-c46d-4a02-a595-1e4543d72163 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.608011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b74e6f6d-13e1-4aba-aab8-d8031f91b3d3 req-746ea456-c46d-4a02-a595-1e4543d72163 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.640234 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b74e6f6d-13e1-4aba-aab8-d8031f91b3d3 req-746ea456-c46d-4a02-a595-1e4543d72163 service nova] Creating event network-vif-deleted:f39a7349-0e42-47d1-8bed-def98fbec976 for instance ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 on nch1-master-1 Nov 20 20:49:27.659494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b74e6f6d-13e1-4aba-aab8-d8031f91b3d3 req-746ea456-c46d-4a02-a595-1e4543d72163 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084235 Nov 20 20:49:27.663324 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 616/1250] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:27.669294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.678238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-abcad66c-8707-4300-85c4-c9900e9fa104 req-f54bfdfb-1992-4540-92b2-9a4786bc6247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "743798f2-3de6-473a-b676-6226a4b9ebba", "tag": "701e9eed-1ec3-47ff-a1de-75bfa89aefd7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:27.679757 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:27.679757 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:27.681214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc9f7d08-79c6-4f1d-8b86-7214808240db tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.212708 Nov 20 20:49:27.684050 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 635/1251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:27 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:27.691063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:27.692245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:27.698655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.699409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.700435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.701066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.702377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-abcad66c-8707-4300-85c4-c9900e9fa104 req-f54bfdfb-1992-4540-92b2-9a4786bc6247 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.702824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-abcad66c-8707-4300-85c4-c9900e9fa104 req-f54bfdfb-1992-4540-92b2-9a4786bc6247 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.731699 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-abcad66c-8707-4300-85c4-c9900e9fa104 req-f54bfdfb-1992-4540-92b2-9a4786bc6247 service nova] Creating event network-changed:701e9eed-1ec3-47ff-a1de-75bfa89aefd7 for instance 743798f2-3de6-473a-b676-6226a4b9ebba on nch2-master-1 Nov 20 20:49:27.743176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:27.744206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-abcad66c-8707-4300-85c4-c9900e9fa104 req-f54bfdfb-1992-4540-92b2-9a4786bc6247 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079254 Nov 20 20:49:27.744620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:27.745381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lazy-loading 'fault' on Instance uuid ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:27.747782 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 617/1252] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:27.793315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9094951b1a24a48a1db5b87e80f6234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1929d2944a034783a75db63f07c146a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:27.804671 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a7b87363-2e5c-44d3-a60e-ef5faddcdd10 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 200 len: 1315 microversion: 2.1 time: 0.118839 Nov 20 20:49:27.806110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 636/1253] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:27 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 1315 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:28.059235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:28.060140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:28.078375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.079063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.080223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.081332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.091357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c6203d61-e525-41aa-a26e-e706cec0856b req-83a6b34c-beef-4f22-a1f7-0913ef31237c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352e82a-20f7-44a4-a047-019ee6b6785b", "name": "network-vif-plugged", "status": "completed", "tag": "870f5ce2-c00b-40f9-84c6-8fa23fcf05bc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:28.093415 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:28.093415 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:28.108945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6203d61-e525-41aa-a26e-e706cec0856b req-83a6b34c-beef-4f22-a1f7-0913ef31237c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.110311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6203d61-e525-41aa-a26e-e706cec0856b req-83a6b34c-beef-4f22-a1f7-0913ef31237c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.133512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c6203d61-e525-41aa-a26e-e706cec0856b req-83a6b34c-beef-4f22-a1f7-0913ef31237c service nova] Creating event network-vif-plugged:870f5ce2-c00b-40f9-84c6-8fa23fcf05bc for instance c352e82a-20f7-44a4-a047-019ee6b6785b on nch2-master-1 Nov 20 20:49:28.146690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c6203d61-e525-41aa-a26e-e706cec0856b req-83a6b34c-beef-4f22-a1f7-0913ef31237c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059515 Nov 20 20:49:28.152244 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 637/1254] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:28.157580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:28.163354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:28.174926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.182453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.183665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.184277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.412259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:28.421508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:28.423041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:28.424215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7af476de-5d6b-4e4e-a2e5-86c0087d81da tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.270593 Nov 20 20:49:28.425312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 638/1255] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:28 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:28.443940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:28.444586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:28.469359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.470424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.472657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.473368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.943601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:28.958157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7532e419-e047-4292-8db2-3a8d1dc74a1d tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1477 microversion: 2.1 time: 0.903456 Nov 20 20:49:28.958790 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 618/1256] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:28 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:28.974029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:28.978578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:28.992253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.992678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:28.996039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:28.996724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.106650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.115832 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-348b5d34-ce25-4e52-8ae3-b43355e8abf3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.676469 Nov 20 20:49:29.122612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 639/1257] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:28 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:29.141247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.144637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.153051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.153796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.156531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.157192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.262034 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-158380e1-48eb-47ca-9057-6333e7c676dc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.300198 Nov 20 20:49:29.269438 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 619/1258] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:28 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:29.285146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.287933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.312988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.313461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.314323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.319245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.394281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.403498 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9354c49-553e-49a7-957a-ebba95ca5f78 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1543 microversion: 2.1 time: 0.279403 Nov 20 20:49:29.415743 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 640/1259] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1543 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:29.421110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.422074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: ed9cc31a-a73e-4fea-b56f-0b57cacab7f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.434129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.434678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.435588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.436296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.473708 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 could not be found. Nov 20 20:49:29.474764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:29.476001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dcccf2b0-65d3-43e0-993f-95cf14c98bb0 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1" status: 404 len: 111 microversion: 2.1 time: 0.058992 Nov 20 20:49:29.480534 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 641/1260] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/ed9cc31a-a73e-4fea-b56f-0b57cacab7f1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:29.485889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.486872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.495331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.496916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.498431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.499102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.664316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.675637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.677444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.679372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-955ad4f0-55ab-4c2b-a3e2-3638de9f2b7f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.197490 Nov 20 20:49:29.680619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 642/1261] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:29.685087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afaca708-338a-43bc-a4d7-49f6878efef4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f86ab5f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.751169 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-afaca708-338a-43bc-a4d7-49f6878efef4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Image not found. Nov 20 20:49:29.752689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afaca708-338a-43bc-a4d7-49f6878efef4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:29.753695 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-afaca708-338a-43bc-a4d7-49f6878efef4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e" status: 404 len: 62 microversion: 2.1 time: 0.071919 Nov 20 20:49:29.759210 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 643/1262] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] DELETE /compute/v2.1/images/8e89c135-18fd-4abe-ab76-9ae4e0568b8e => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:49:29.767352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.768132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.783173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.785937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.786715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.790581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.814114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. Nov 20 20:49:29.814114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:29.815804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c711329-62cd-4206-8793-6af74788962f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 404 len: 111 microversion: 2.1 time: 0.053605 Nov 20 20:49:29.815804 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 644/1263] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:29 2021] DELETE /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:29.824208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6cffe438-df3c-45fc-ba18-bc8deb325d05 req-bbf20b39-c046-4424-96de-982c8de53252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d", "name": "network-vif-unplugged", "status": "completed", "tag": "45fadff2-da94-4f5f-8340-26c7ac05e1e2"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:29.826398 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:29.826398 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:29.835194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6cffe438-df3c-45fc-ba18-bc8deb325d05 req-bbf20b39-c046-4424-96de-982c8de53252 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.835786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6cffe438-df3c-45fc-ba18-bc8deb325d05 req-bbf20b39-c046-4424-96de-982c8de53252 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.852533 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6cffe438-df3c-45fc-ba18-bc8deb325d05 req-bbf20b39-c046-4424-96de-982c8de53252 service nova] Creating event network-vif-unplugged:45fadff2-da94-4f5f-8340-26c7ac05e1e2 for instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d on nch2-master-1 Nov 20 20:49:29.858655 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6cffe438-df3c-45fc-ba18-bc8deb325d05 req-bbf20b39-c046-4424-96de-982c8de53252 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037613 Nov 20 20:49:29.859811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 645/1264] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:29.868462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.869413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.878762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:29.879965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.880593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.882904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.884049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.886470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48fbf683-712c-440d-9149-3d05683ca6a2 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.614974 Nov 20 20:49:29.886916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 620/1265] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:29.911630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. Nov 20 20:49:29.912382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:29.913332 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79b7e394-0e29-4076-a2f0-b813acb1f017 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4" status: 404 len: 111 microversion: 2.1 time: 0.051505 Nov 20 20:49:29.917568 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 646/1266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/43ca2999-8a94-4c5f-bc08-7ba55ff79ba4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:29.922970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b79b91ba-8801-4986-a3cb-69ad8351661d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f87b19670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.946096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b79b91ba-8801-4986-a3cb-69ad8351661d tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610147417" status: 202 len: 0 microversion: 2.1 time: 0.026679 Nov 20 20:49:29.952224 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 621/1267] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:49:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610147417 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:29.976107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:29.977003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:29.984075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.984863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:29.985770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:29.986966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.133898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:30.135006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:30.149889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.150801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.152157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.153993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.440944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:30.454767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3e5d025-900c-44ad-bcf3-b7a9f68d7a75 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1477 microversion: 2.1 time: 0.482448 Nov 20 20:49:30.456575 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 647/1268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:29 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1477 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:30.471020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-82c0336c-d134-4503-9871-855b9ab3d1f6 req-ca796947-311e-4fab-a4c6-58c4d26e037f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acf73a5-9605-4b53-83dc-09af84fee3fe", "name": "network-vif-plugged", "status": "completed", "tag": "1f1cf981-26ff-4024-b94c-8e78ef84d154"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:30.474557 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:30.474557 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:30.484024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82c0336c-d134-4503-9871-855b9ab3d1f6 req-ca796947-311e-4fab-a4c6-58c4d26e037f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.484914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82c0336c-d134-4503-9871-855b9ab3d1f6 req-ca796947-311e-4fab-a4c6-58c4d26e037f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.507308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-82c0336c-d134-4503-9871-855b9ab3d1f6 req-ca796947-311e-4fab-a4c6-58c4d26e037f service nova] Creating event network-vif-plugged:1f1cf981-26ff-4024-b94c-8e78ef84d154 for instance 6acf73a5-9605-4b53-83dc-09af84fee3fe on nch1-master-1 Nov 20 20:49:30.524224 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-82c0336c-d134-4503-9871-855b9ab3d1f6 req-ca796947-311e-4fab-a4c6-58c4d26e037f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061970 Nov 20 20:49:30.526021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 648/1269] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:30.543525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:30.544800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:30.576313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.577080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.578114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.578719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.627529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3da8ba3-0036-45a7-bbd6-9e90f7dbd485 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.096669 Nov 20 20:49:30.632792 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 649/1270] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:30 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:30.642427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:30.643494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:30.656852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.658502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.660027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.660771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.904068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:30.915827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd9d3b42-a262-47af-97b7-e8ace7522352 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1310 microversion: 2.1 time: 0.785810 Nov 20 20:49:30.916920 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 622/1271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:30 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1310 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:30.929676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:30.930329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:30.946215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.947490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:30.948528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:30.949203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.116830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.125656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30d13005-399c-475c-a585-f0341059c033 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1542 microversion: 2.1 time: 0.487542 Nov 20 20:49:31.126927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 650/1272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:30 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1542 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:31.133029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.133925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.141287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.144533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.146855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.148968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.345546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.353413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.355146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.356325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cdbb8fb-43fb-4666-8dfc-7a65d9d54fe1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.436205 Nov 20 20:49:31.356889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 623/1273] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:30 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:31.369196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dbe26e58-39c5-4b14-b1e4-8b1c65ca974f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '.version_select at 0x7f3f87b33ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.416390 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-dbe26e58-39c5-4b14-b1e4-8b1c65ca974f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Image not found. Nov 20 20:49:31.417416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dbe26e58-39c5-4b14-b1e4-8b1c65ca974f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:31.418287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dbe26e58-39c5-4b14-b1e4-8b1c65ca974f tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/images/54d1667e-debf-4a14-97a3-8481b2731b12" status: 404 len: 62 microversion: 2.1 time: 0.052669 Nov 20 20:49:31.422591 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 624/1274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:31 2021] DELETE /compute/v2.1/images/54d1667e-debf-4a14-97a3-8481b2731b12 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:49:31.430548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.431239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.441030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.448590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.449874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.454980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.457601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.468155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1def42fa-b682-4990-9f97-d7a020e9757b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.337974 Nov 20 20:49:31.469225 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 651/1275] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:31 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:31.474841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.475909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.484640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.485610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.486840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.488566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.489523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. Nov 20 20:49:31.490222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:31.491075 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4677a0b2-6d74-4060-af90-b091e6f3b8a4 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 404 len: 111 microversion: 2.1 time: 0.067320 Nov 20 20:49:31.492284 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 625/1276] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:31 2021] DELETE /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:31.502278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.505196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] [instance: 60f26975-add1-4d8b-aee6-67a5d77835e4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.528882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.529523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.530521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.531209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.574964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] HTTP exception thrown: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. Nov 20 20:49:31.577423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] Returning 404 to user: Instance 60f26975-add1-4d8b-aee6-67a5d77835e4 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:31.581113 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a2f5e6e-f363-4575-80a1-1873e4289cd2 tempest-ImagesOneServerNegativeTestJSON-1822143224 tempest-ImagesOneServerNegativeTestJSON-1822143224-project] 10.222.0.41 "GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4" status: 404 len: 111 microversion: 2.1 time: 0.082374 Nov 20 20:49:31.584866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 626/1277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:31 2021] GET /compute/v2.1/servers/60f26975-add1-4d8b-aee6-67a5d77835e4 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:31.640868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:31.642409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.651179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.651733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.652953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.653872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.711907 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22cd0795-93d3-4cb4-b9e0-5a606514a6d8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.074878 Nov 20 20:49:31.713557 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 627/1278] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:31 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:31.813470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:31.821785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43c1d75f-bd0a-458d-b35b-fbb9ff1f0e3b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1477 microversion: 2.1 time: 0.351174 Nov 20 20:49:31.826011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 652/1279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:31 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1477 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:31.901632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d", "tag": "45fadff2-da94-4f5f-8340-26c7ac05e1e2"}, {"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-unplugged", "status": "completed", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}, {"name": "network-changed", "server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:31.904292 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:31.904292 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:31.926315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.934311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:31.934794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.935570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:31.945789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.945789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.945789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:31.947475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:31.983284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Creating event network-changed:45fadff2-da94-4f5f-8340-26c7ac05e1e2 for instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d on nch2-master-1 Nov 20 20:49:31.984501 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Creating event network-vif-unplugged:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch2-master-1 Nov 20 20:49:31.985214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Creating event network-changed:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch2-master-1 Nov 20 20:49:31.995295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] Instance 31269560-9cb4-4f4a-915c-60e283225964 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:49:32.026245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b483000c-9d1a-42d2-b962-771eb94fc760 req-d63108d4-a023-4560-adaf-0b37d3e4e0ba service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.134660 Nov 20 20:49:32.027225 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 628/1280] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:32.147848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.148838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.168448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.170237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.171945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.172939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.247320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.256997 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be637448-1ec6-4bd1-a7b2-819a7955bb98 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1492 microversion: 2.1 time: 0.326493 Nov 20 20:49:32.257581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 653/1281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:31 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1492 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:32.277486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.278491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.286331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.286821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.287622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.288066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.457744 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-013b59f8-8577-485d-93d5-30b45ee6666c tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1643 microversion: 2.1 time: 0.186110 Nov 20 20:49:32.458566 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 654/1282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1643 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:32.463054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.463592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.470749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.472015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.473303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.473743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.714450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.726563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.728012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.729172 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56fae4f7-6dbd-45ac-b268-8e9fcb5467d4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.269522 Nov 20 20:49:32.729739 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 655/1283] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:32.736669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.738976 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:32.738976 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:32.741984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.743137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.744223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.745254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.771328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d08418e4-b108-4ff1-be37-85cfac984932 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039433 Nov 20 20:49:32.772467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 656/1284] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:32.777115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.777931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.786634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.787190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.788239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.788910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.840149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.850920 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b625b3c9-b934-4423-93ba-3f296a7bfaed tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1542 microversion: 2.1 time: 0.710499 Nov 20 20:49:32.854216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 629/1285] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1542 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:32.869650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:32.871488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.882923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.883741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.885275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.885950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.951000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09c9e7cb-389f-40cd-bd9a-c67715965c96 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.094711 Nov 20 20:49:32.962820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 630/1286] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:32 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:32.970096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:32.970414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:32.974253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:32.980687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c5c89560-53c0-482c-8b52-a967157074ea tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.206887 Nov 20 20:49:32.982144 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 657/1287] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:32.993719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.995157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:32.996486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:32.996935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:33.748623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:33.749355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:33.759438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:33.759973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:33.761483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:33.763071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:33.828969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:33.848003 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ecf2cd21-ba2c-4c9d-a877-cfaa601a05e9 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1462 microversion: 2.1 time: 0.880503 Nov 20 20:49:33.850497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 631/1288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:32 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1462 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:33.872489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:33.873202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:33.885353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:33.889178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:33.890382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:33.891071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:33.997312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:34.017636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:34.019876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:34.021531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34c0e66d-4e01-4c9b-93c7-8dae183b3e49 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.277579 Nov 20 20:49:34.031666 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 658/1289] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:33 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:49:34.043379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:34.045605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.059128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.059579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.060391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.060823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.296410 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a536f4aa-33ce-462d-9eea-73c3dbde8276 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.263037 Nov 20 20:49:34.297545 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 659/1290] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:34 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:34.305857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:34.306516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:34.313068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.320871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.321117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cb7a305-56ef-43fd-8c17-a0af1e1489ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1542 microversion: 2.1 time: 0.449234 Nov 20 20:49:34.321323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.322149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.323739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.330245 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 632/1291] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:33 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1542 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:34.370474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:34.371504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.384617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e4de10f-686a-4f4f-9ff9-48a0d2ab7b70 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.085355 Nov 20 20:49:34.388899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.389361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.390207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.390820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.391969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 660/1292] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:34 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:34.406252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0ebe50eb-2e2f-4bf6-bfe7-155e0624edf5 req-4bd93f7e-75a6-4461-9680-1aae83968cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743798f2-3de6-473a-b676-6226a4b9ebba", "name": "network-vif-plugged", "status": "completed", "tag": "701e9eed-1ec3-47ff-a1de-75bfa89aefd7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:34.408050 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:34.408050 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:34.418002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0ebe50eb-2e2f-4bf6-bfe7-155e0624edf5 req-4bd93f7e-75a6-4461-9680-1aae83968cd9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.418763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0ebe50eb-2e2f-4bf6-bfe7-155e0624edf5 req-4bd93f7e-75a6-4461-9680-1aae83968cd9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.435177 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0ebe50eb-2e2f-4bf6-bfe7-155e0624edf5 req-4bd93f7e-75a6-4461-9680-1aae83968cd9 service nova] Creating event network-vif-plugged:701e9eed-1ec3-47ff-a1de-75bfa89aefd7 for instance 743798f2-3de6-473a-b676-6226a4b9ebba on nch2-master-1 Nov 20 20:49:34.440145 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0ebe50eb-2e2f-4bf6-bfe7-155e0624edf5 req-4bd93f7e-75a6-4461-9680-1aae83968cd9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045547 Nov 20 20:49:34.441667 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 661/1293] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:34.448610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:34.449305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.455958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.456414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.457224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.457665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.503792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.504331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.504795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lazy-loading 'fault' on Instance uuid 6acf73a5-9605-4b53-83dc-09af84fee3fe {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:34.644282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cbb5bcfb-7e40-48d1-80dc-f3361c2c18a8 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1596 microversion: 2.1 time: 0.200917 Nov 20 20:49:34.645083 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 662/1294] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:34 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1596 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:34.651139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "609b9a90-c344-44ec-95a5-ae6618ae18dd", "device": "/dev/xvdb"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:34.652544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.665618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.666347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.667347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.668548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.903181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:34.912780 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-709757fc-77fe-42bc-ae10-0c1733be2655 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.577106 Nov 20 20:49:34.922351 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 633/1295] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:34 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:34.932238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:34.935706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:34.946803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.947269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:34.948063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:34.948682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.004421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d38dd02-ce6a-4ad6-aa49-4b317203138e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "POST /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.357969 Nov 20 20:49:35.005659 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 663/1296] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:49:34 2021] POST /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:35.054845 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5c465b0-c5b2-4633-8059-43aa6bdb3be2 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.130733 Nov 20 20:49:35.056192 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 634/1297] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:34 2021] POST /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:35.066152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.068107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.079148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.079679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.080563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.082444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.203578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.206639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.207764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.208813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.209359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.245323 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b92f64ef-8058-4a66-a5db-4ebec1a3895b tempest-AZV2TestJSON-673282046 tempest-AZV2TestJSON-673282046-project] 10.222.0.41 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.233641 Nov 20 20:49:35.246149 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 664/1298] 10.222.0.41 () {58 vars in 1163 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:49:35.250582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.251303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.261790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.262150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.263558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.264248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.400095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:35.412559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:35.417020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:35.420683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6c6c6bf-245e-4f8a-ae79-ad14ee6cfced tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.361101 Nov 20 20:49:35.439342 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 635/1299] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:35.444762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.447923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.458823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.459280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.460298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.460900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.482886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7795fa99-22cc-43f4-9e61-4e0d50ca8b84 tempest-ServersAdminTestJSON-326556958 tempest-ServersAdminTestJSON-326556958-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1613 microversion: 2.1 time: 0.234859 Nov 20 20:49:35.494098 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 665/1300] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:35.494098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:35.494098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.497077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.497533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.498368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.498807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.565426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee1d1b80-76d9-4bf4-a9c9-504f72357eac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.080478 Nov 20 20:49:35.566350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 666/1301] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:35 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:35.580375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.581892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.589818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.590658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.592205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.592830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.654393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:35.697405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:35.720675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c801fd3-a80b-4e58-b067-5817f51d5527 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1474 microversion: 2.1 time: 0.279909 Nov 20 20:49:35.721930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 636/1302] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:35.815577 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75fcb77f-f762-4b5b-ad89-3e778b12a850 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 204 len: 0 microversion: 2.1 time: 0.243881 Nov 20 20:49:35.819278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 667/1303] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:35 2021] DELETE /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:35.823967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.824863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.831743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.832437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.833415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.834193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.929116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:35.929812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:35.937092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.937535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:35.938661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:35.939113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.031955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.046139 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-228ba6bf-69ed-4133-8a23-c9521d91a59e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1470 microversion: 2.1 time: 0.225386 Nov 20 20:49:36.048237 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 637/1304] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:36.247381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.257962 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3eda57a-5cf4-456a-b328-d9b74aa9f170 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1318 microversion: 2.1 time: 0.332773 Nov 20 20:49:36.259208 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 668/1305] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:35 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:36.446617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:36.447712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:36.457851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.458332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.459158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.460276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.576796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:36.577946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:36.593198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.593939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.594936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.595542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.662139 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de530848-219f-4a8c-a9d3-e604b199f6e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.088847 Nov 20 20:49:36.663525 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 669/1306] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:36 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:36.707255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.716095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.718662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.720178 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77c9c81a-3d3a-4f83-a213-04419f46660e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.282370 Nov 20 20:49:36.720737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 638/1307] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:36 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:36.738460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:36.739492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:36.749969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.750458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.751264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.751709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.937384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:36.949805 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c75a0eac-9ddb-4c29-bb94-9786536a09b3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1471 microversion: 2.1 time: 0.215581 Nov 20 20:49:36.951058 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 670/1308] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:36 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:36.967586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:36.968385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:36.975808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.976570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:36.977478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:36.977991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.059960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.060951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.062154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.062998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.063572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:37.064183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.074801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.075516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.076581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.077282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.106735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:37.119978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for user cf07bddf00ea4a7da446130a6308cd27 and project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:37.338224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:37.341495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9bb839bd-5608-4852-aae4-5081c860f85c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964/action" status: 202 len: 0 microversion: 2.1 time: 0.372045 Nov 20 20:49:37.346017 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 639/1309] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:36 2021] POST /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:37.348641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-830b622c-3d5f-4632-a40a-72166dd6dfd5 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1470 microversion: 2.1 time: 0.288606 Nov 20 20:49:37.358124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:37.358124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.359509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.360036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.360912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.361722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.363657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 671/1310] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:37 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:37.376095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:37.376880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.385646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.386747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.388476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.389222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.694104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:37.704393 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27ad8453-940d-42b0-bba5-6409388ad462 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1470 microversion: 2.1 time: 0.338335 Nov 20 20:49:37.715323 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 672/1311] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:37 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:37.722014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:37.723481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.730645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.731484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.734504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.735551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.790541 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d9001baa-694a-4a54-8174-8a9ac4b022fe tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.073647 Nov 20 20:49:37.792312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 673/1312] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:37 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:37.796442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:37.802200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:37.803206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.805694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe041553-1525-4db4-9bd1-407c7c791c34 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1506 microversion: 2.1 time: 0.458000 Nov 20 20:49:37.813324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.815013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.816360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.817048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.818699 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 640/1313] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:37 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1506 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:37.823541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:37.825903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:37.841624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.842094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:37.842883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:37.843314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.217937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:38.236963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:38.241308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:38.249839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c1ede36-e261-4fee-ad54-191f5ac5a282 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.455263 Nov 20 20:49:38.250492 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 674/1314] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:37 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:38.365836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:38.367220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:38.375253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.378304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.380232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.386164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.808522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:38.817062 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c1d90c5-5d52-47d0-b573-7fb37cab4ae4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1506 microversion: 2.1 time: 0.997035 Nov 20 20:49:38.828810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 641/1315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:37 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1506 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:38.836602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:38.837472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:38.841737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:38.845822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.847288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.848326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.849080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.859234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-adfb36d9-45b0-4120-b4fd-abc2ebd3506b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 200 len: 1470 microversion: 2.1 time: 0.497731 Nov 20 20:49:38.859937 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 675/1316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:38 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 1470 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:38.865802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:38.866446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:38.880289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.880826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:38.881700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:38.882239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.266240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:39.275657 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f8dd13ce-74b1-4e54-8d8f-268d14b327ee tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1470 microversion: 2.1 time: 0.413763 Nov 20 20:49:39.280273 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 676/1317] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:38 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1470 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:39.294528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:39.296328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:39.314278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.317343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.320338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.322255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.334132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4d02659-7896-47dd-a543-652bcf5ddb1f tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1689 microversion: 2.1 time: 0.500615 Nov 20 20:49:39.336671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 642/1318] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:38 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1689 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:39.345928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:39.348684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:39.356552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.358200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.359971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.383508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.397413 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3bd7afa3-ec00-40a3-805c-b70e95d8f14b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.113685 Nov 20 20:49:39.398150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 677/1319] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:39 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:39.405748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c4d40e7c-fe27-40f7-8614-138a5a0e6839 req-060b3b8a-bf9c-4cfa-a371-70cfc898e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52b80c7-eace-4956-a4bb-9903bc93a9b5", "name": "network-vif-deleted", "tag": "d8a96fcd-0d70-42d9-969c-d580c3b6eb61"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:39.411459 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:39.411459 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:39.431466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c4d40e7c-fe27-40f7-8614-138a5a0e6839 req-060b3b8a-bf9c-4cfa-a371-70cfc898e9f3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.432218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c4d40e7c-fe27-40f7-8614-138a5a0e6839 req-060b3b8a-bf9c-4cfa-a371-70cfc898e9f3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.451250 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c4d40e7c-fe27-40f7-8614-138a5a0e6839 req-060b3b8a-bf9c-4cfa-a371-70cfc898e9f3 service nova] Creating event network-vif-deleted:d8a96fcd-0d70-42d9-969c-d580c3b6eb61 for instance a52b80c7-eace-4956-a4bb-9903bc93a9b5 on nch1-master-1 Nov 20 20:49:39.467826 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c4d40e7c-fe27-40f7-8614-138a5a0e6839 req-060b3b8a-bf9c-4cfa-a371-70cfc898e9f3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067965 Nov 20 20:49:39.478855 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 678/1320] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:39.484349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:39.485332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:39.495155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.506811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.508029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.508691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.554782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-becf400d-8e3b-4b88-9251-43415dbf2e97 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "PUT /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1078 microversion: 2.1 time: 0.214826 Nov 20 20:49:39.564809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 643/1321] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 20:49:39 2021] PUT /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1078 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:39.578802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:39.580224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:39.600940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.602485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.604193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.605482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.663956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lazy-loading 'flavor' on Instance uuid c352e82a-20f7-44a4-a047-019ee6b6785b {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:39.688043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Going to try to live migrate instance to nch1-master-1 {{(pid=140941) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:49:39.767460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:39.780652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:39.783503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:39.790404 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f3b854a-7bbe-4ba8-a6ba-eceff7efdf13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1644 microversion: 2.25 time: 0.308818 Nov 20 20:49:39.791811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 679/1322] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:39 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1644 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:39.822748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:39.824450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:39.831981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.833868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:39.835044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:39.835780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.036868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:40.050636 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e13ae30c-b85f-4ef0-8fa4-dfeafe059d61 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1504 microversion: 2.1 time: 0.253846 Nov 20 20:49:40.062843 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 680/1323] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:39 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:40.079952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:40.083840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: a52b80c7-eace-4956-a4bb-9903bc93a9b5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:40.105108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.106967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.114304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.115122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.145540 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] HTTP exception thrown: Instance a52b80c7-eace-4956-a4bb-9903bc93a9b5 could not be found. Nov 20 20:49:40.147711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Returning 404 to user: Instance a52b80c7-eace-4956-a4bb-9903bc93a9b5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:40.150840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1b3ffc9-bda8-4dce-818d-9e4c52429895 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5" status: 404 len: 111 microversion: 2.1 time: 0.086626 Nov 20 20:49:40.153153 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 681/1324] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:40 2021] GET /compute/v2.1/servers/a52b80c7-eace-4956-a4bb-9903bc93a9b5 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:40.166571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:40.169772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:40.184209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.184781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.185982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.186459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.479352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:40.493370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5193681-d411-4630-93db-d11a6a9a049d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1504 microversion: 2.1 time: 0.337479 Nov 20 20:49:40.496436 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 682/1325] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:40 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:40.506134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:40.508151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:40.518409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.519189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.520216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.520872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.574621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:40.664978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69b5738d-8356-48c2-ba55-4b45e8775ed4 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 204 len: 0 microversion: 2.1 time: 0.166069 Nov 20 20:49:40.670201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 683/1326] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:40 2021] DELETE /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:40.699283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:40.700053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:40.714680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.718737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:40.722760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:40.723386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.014746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:41.075431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d89174ee-fcc0-46ad-9f3b-e02794a79a9a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1470 microversion: 2.1 time: 0.403131 Nov 20 20:49:41.078343 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 684/1327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:40 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1470 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:41.086908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:41.088321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:41.109986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.110840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.112873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.113488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.201506 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75d45ffc-ec91-4aa9-a380-e0afad2b30b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.116648 Nov 20 20:49:41.202632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 685/1328] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:41 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:41.208472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:41.210322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:41.220551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.220781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.222448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.223330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.351541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:49:41.351541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:49:41.351541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:49:41.351541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:49:41.351541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:49:41.432126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:41.438852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.439473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.440924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.441400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.485044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94298682-7b71-491d-9b03-aac6b596109a tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "POST /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba/action" status: 202 len: 1110 microversion: 2.1 time: 0.268718 Nov 20 20:49:41.510452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 686/1329] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:41 2021] POST /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba/action => generated 1110 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 20 20:49:41.519576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-plugged", "status": "completed", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:41.521269 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:41.521269 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:41.532372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.532825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.547788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] Creating event network-vif-plugged:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch2-master-1 Nov 20 20:49:41.554929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] Instance 31269560-9cb4-4f4a-915c-60e283225964 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:49:41.567903 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9d112718-d1da-401c-84e7-481a0b5f86f6 req-59209389-8efc-4456-9af1-4df761195601 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055681 Nov 20 20:49:41.568663 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 687/1330] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:41.574427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:41.575126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:41.603345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.605551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.607731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.608335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.841895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:41.851263 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26ab547d-8f7d-4f58-9e08-45c0603b55f7 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1470 microversion: 2.1 time: 0.280463 Nov 20 20:49:41.859618 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 688/1331] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:41 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:41.859618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:41.859618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:41.864604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.865145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:41.866038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:41.866581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.084145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:42.099522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:42.100996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:42.102215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87492563-2dc0-4938-b754-bce53e3415c2 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1634 microversion: 2.25 time: 0.249200 Nov 20 20:49:42.103111 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 689/1332] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:41 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1634 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:42.107912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:42.108529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:42.116147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.116603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.117719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.118200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.256702 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3adadd7c-6463-47fa-8d0d-ef8f16be287b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/action" status: 202 len: 0 microversion: 2.1 time: 2.686311 Nov 20 20:49:42.257325 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 644/1333] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:39 2021] POST /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/action => generated 0 bytes in 2690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:42.265034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:42.265664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:42.283093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.284183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.299686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.300798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.349304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:42.362550 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73e1e409-f02e-4559-b2d2-b9c122ccf81e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.255368 Nov 20 20:49:42.373001 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 690/1334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:42 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:42.378726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2aa4bcd-38d0-40e5-b8f7-a427c22c0090 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '.version_select at 0x7f3f86aee550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:42.380612 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:42.380612 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:42.382273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2aa4bcd-38d0-40e5-b8f7-a427c22c0090 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.383387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2aa4bcd-38d0-40e5-b8f7-a427c22c0090 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.397718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2aa4bcd-38d0-40e5-b8f7-a427c22c0090 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 4047 microversion: 2.25 time: 0.023205 Nov 20 20:49:42.398380 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 691/1335] 10.222.0.41 () {60 vars in 1183 bytes} [Sat Nov 20 20:49:42 2021] GET /compute/v2.1/os-migrations => generated 4047 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:42.402793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:42.406528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:42.421420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.421865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.422708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.423144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.509302 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b17d3dd-017b-4316-a29e-628c8226ac20 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.109617 Nov 20 20:49:42.515305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 692/1336] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:42 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:42.526840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:42.529308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:42.558441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.559307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.560430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:42.561073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:42.986635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:43.009440 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27ac8889-492a-4b46-8b82-48be1de75416 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1548 microversion: 2.1 time: 0.490674 Nov 20 20:49:43.011378 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 693/1337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:42 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1548 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:43.020612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:43.030593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:43.030944 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-829bd0ec-d886-4184-ab0d-be7f3abf431c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1470 microversion: 2.1 time: 0.771265 Nov 20 20:49:43.031225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:43.041320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.041320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:43.041640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.042441 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 645/1338] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:42 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1470 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:43.048110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:43.051305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:43.053238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:43.073992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.074970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:43.075957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.076562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:43.593650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:43.609962 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1364f70-1e02-40db-a5dc-38c80cf7d8c9 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 2126 microversion: 2.25 time: 0.585984 Nov 20 20:49:43.627136 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 694/1339] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:43 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 2126 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:43.633934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:43.634588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:43.645316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.645886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:43.648099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:43.648553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.032000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:44.049157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a8a362e-843e-430a-9d07-979573a18479 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1470 microversion: 2.1 time: 1.000950 Nov 20 20:49:44.060436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 646/1340] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:43 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1470 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:44.068431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:44.077297 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d06a0b6c-b0eb-4d67-a534-adc3f022d361 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.448376 Nov 20 20:49:44.077896 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 695/1341] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:43 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:44.083361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:44.093419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:44.097316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:44.098096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:44.114556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.115752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.116589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.117039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.143950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.144620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.151718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.155163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.238300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-805266f8-51d9-434b-84a5-18dd437da3e7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.174562 Nov 20 20:49:44.242692 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 647/1342] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:44 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:44.246354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:44.248182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:44.257430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.261454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.261454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.261454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.556646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:44.590563 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ffc4721-acde-480c-a7d7-dd46be6a5b02 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 2126 microversion: 2.25 time: 0.511432 Nov 20 20:49:44.604645 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 696/1343] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:49:44 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 2126 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:49:44.606504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:44.607133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:44.623780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.624470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:44.628402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:44.628872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:45.020874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:45.037619 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b431d510-0b37-421d-9c2a-27d1d5785f15 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1548 microversion: 2.1 time: 0.796264 Nov 20 20:49:45.038410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 648/1344] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:44 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1548 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:45.048049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:45.057254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:45.087401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:45.094752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:45.101562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:45.102254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:45.602671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lazy-loading 'services' on Instance uuid 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:45.797434 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a3daee4-78c8-4696-9b0f-d62096784012 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments/f3a25071-9204-456d-ad65-141e2d6b0743" status: 202 len: 0 microversion: 2.25 time: 0.753235 Nov 20 20:49:45.798062 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 649/1345] 10.222.0.41 () {60 vars in 1456 bytes} [Sat Nov 20 20:49:45 2021] DELETE /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments/f3a25071-9204-456d-ad65-141e2d6b0743 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:45.810722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-unplugged", "status": "completed", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:45.820309 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:45.820309 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:45.840680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:45.843126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:45.874025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] Creating event network-vif-unplugged:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:49:45.888257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] Instance 31269560-9cb4-4f4a-915c-60e283225964 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:49:45.917713 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-50551e35-393b-4784-8c2e-12c0faa7faae req-789c4b08-1841-41d1-8ebb-538ff0cae375 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114875 Nov 20 20:49:45.920396 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 650/1346] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:45.937965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:45.940078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:45.953587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:45.955214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:45.957496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:45.960323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.010510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:46.019478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b0f53012-5b77-44b4-a80b-07b59cdd17d5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1536 microversion: 2.1 time: 1.423573 Nov 20 20:49:46.034501 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 697/1347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:44 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1536 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:46.047388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:46.064176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:46.081727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.082369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.083122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.083854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.084098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lazy-loading 'fault' on Instance uuid 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:46.086413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.088159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.203467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:46.226729 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e586c85a-3d97-44a8-8617-85b4dc44b690 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 200 len: 1304 microversion: 2.1 time: 0.304905 Nov 20 20:49:46.233059 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 651/1348] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:45 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 1304 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:46.245436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:46.246783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:46.254577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.255633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.256686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.257292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.327265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-056d845e-abad-4b7d-acba-3e970cc303df tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.091641 Nov 20 20:49:46.328217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 652/1349] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:46 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:46.337085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:46.338409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:46.358298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.359052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.368988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.369723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.431846 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7b0216b0-ec18-4fb1-a0b8-c8bb280f270e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.102062 Nov 20 20:49:46.433830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 653/1350] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 20:49:46 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:46.440473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:46.443859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:46.457615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.461362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.462445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:46.466875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:46.797230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:46.805514 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-398c2aea-b574-4320-a490-05c830947cc9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.768086 Nov 20 20:49:46.807344 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 698/1351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:46 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:46.832877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:46.851099 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a19fc93-177d-4d1c-a750-e1be2db84d85 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1548 microversion: 2.1 time: 0.415139 Nov 20 20:49:46.861414 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 654/1352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:46 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1548 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:47.052994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.054025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.067175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.071717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.072768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.073370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.244914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.245526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 15b8954e-6602-42a8-ba75-16bd4aa8ecf3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.254010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.257203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.259211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.260579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.301633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] HTTP exception thrown: Instance 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 could not be found. Nov 20 20:49:47.305117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Returning 404 to user: Instance 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:47.306964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1226c1ac-1e2c-415c-987a-5bb4217422c6 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3" status: 404 len: 111 microversion: 2.1 time: 0.066946 Nov 20 20:49:47.309284 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 655/1353] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:47 2021] GET /compute/v2.1/servers/15b8954e-6602-42a8-ba75-16bd4aa8ecf3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:47.324573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.325972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.341767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.344479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.347215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.348825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.409458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:49:47.463460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:47.475228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7533f27d-8822-463c-bbc5-eb2495475f68 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1536 microversion: 2.1 time: 0.427635 Nov 20 20:49:47.487952 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 699/1354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:47 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1536 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:47.495518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:47.497544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.523594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.524506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.527258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.530307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.575904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f560b4bc-fd1b-4140-b35c-f61a92140d2b tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 204 len: 0 microversion: 2.1 time: 0.261810 Nov 20 20:49:47.577637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 656/1355] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:47 2021] DELETE /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:49:47.578931 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e23b287-2fc2-4569-8091-846f44efe717 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.088162 Nov 20 20:49:47.582585 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 700/1356] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:47 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:47.591565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.593276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.602584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.604147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.606425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.607179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.608175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.608804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.612397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.612884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.613654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.614110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.649161 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3896d96b-baf4-4b7c-98cd-b6007713d1b9 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.069988 Nov 20 20:49:47.650241 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 657/1357] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 20:49:47 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:47.828625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:47.831652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:47.855026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.856209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:47.860054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:47.861615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.122836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:48.151338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ae15f229-5bfc-4763-a03e-892531f1b519 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1468 microversion: 2.1 time: 0.567309 Nov 20 20:49:48.159612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 701/1358] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:47 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1468 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:48.178219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:48.178912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:48.198856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.199322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.200680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.202437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.348247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:48.360901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad480013-d09d-4841-955c-10669f874df4 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.537382 Nov 20 20:49:48.362457 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 658/1359] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:47 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:48.379093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8954e-6602-42a8-ba75-16bd4aa8ecf3", "name": "network-vif-deleted", "tag": "4d485831-9d58-4e82-8916-5e43c48e5118"}, {"name": "network-changed", "server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:48.381236 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:48.381236 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:48.390246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.390674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.408618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Creating event network-vif-deleted:4d485831-9d58-4e82-8916-5e43c48e5118 for instance 15b8954e-6602-42a8-ba75-16bd4aa8ecf3 on nch2-master-1 Nov 20 20:49:48.409450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Creating event network-changed:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:49:48.416940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] Instance 31269560-9cb4-4f4a-915c-60e283225964 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:49:48.441415 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-82cc29cc-1a2b-4694-81ba-a491661e0bca req-92e73ba6-0490-4692-94c0-ac7ad30796c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075213 Nov 20 20:49:48.442723 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 659/1360] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:48 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:48.498582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:48.500029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:48.511608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.512904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.515662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.516375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.696480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:48.711233 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5bd779c9-3dbe-46fc-aae2-4e451d6b5f78 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1538 microversion: 2.1 time: 0.546664 Nov 20 20:49:48.713618 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 702/1361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:48 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1538 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:48.741218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:48.742777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:48.749701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.750458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.752902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.753590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.804974 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6f45e01-2ef0-4e24-aacc-bbd494ceb7b2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.076728 Nov 20 20:49:48.806220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 703/1362] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:48 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:48.812339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78d8c590-1260-4650-8196-7cf33001038d tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '.version_select at 0x7f3f873f20d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:48.813587 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:48.813587 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:48.816032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d8c590-1260-4650-8196-7cf33001038d tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.816806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d8c590-1260-4650-8196-7cf33001038d tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.841326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78d8c590-1260-4650-8196-7cf33001038d tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 3495 microversion: 2.1 time: 0.033544 Nov 20 20:49:48.850540 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 704/1363] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:49:48 2021] GET /compute/v2.1/os-migrations => generated 3495 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:48.864894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:48.870586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:48.888008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.888746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:48.889708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:48.890177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:49.494912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:49.534794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28b3d095-c04f-4900-95f4-22a2661ee3e4 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1536 microversion: 2.1 time: 1.031107 Nov 20 20:49:49.538008 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 660/1364] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:48 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1536 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:49.549602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:49.554493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:49.595162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:49.596135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:49.597555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:49.598895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:49.800920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-458b4c5e-9c3d-4ffe-aa45-c89eb09b2f21 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1689 microversion: 2.1 time: 0.948150 Nov 20 20:49:49.805050 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 705/1365] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:48 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1689 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:49.814614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:49.815296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:49.851779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:49.852225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:49.857467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:49.858425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.124223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:50.148710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd1a0d85-810a-4a18-9e84-a69d22a41972 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1468 microversion: 2.1 time: 0.609403 Nov 20 20:49:50.149882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 661/1366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:49 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1468 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:50.166244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:50.168643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:50.182311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.184697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.189010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.189563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.262770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08cc145e-df45-4e9e-8aad-850d6e01439b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.111108 Nov 20 20:49:50.266764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 662/1367] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:50 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:50.286851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:50.288509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:50.308260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.309083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.310089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.310687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.453312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lazy-loading 'services' on Instance uuid c352e82a-20f7-44a4-a047-019ee6b6785b {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:49:50.587583 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24b853f5-3234-45e9-9d6e-bf22175b2724 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments/609b9a90-c344-44ec-95a5-ae6618ae18dd" status: 202 len: 0 microversion: 2.1 time: 0.318130 Nov 20 20:49:50.590212 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 663/1368] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 20:49:50 2021] DELETE /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments/609b9a90-c344-44ec-95a5-ae6618ae18dd => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:49:50.630893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:50.633208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:50.659134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.660164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.661326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.664343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.792409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:50.804792 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a70d3c0-25bd-40cc-9ba1-546ce1e6782d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.998444 Nov 20 20:49:50.806171 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 706/1369] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:49 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:50.811827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:50.813015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:50.834879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.845062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.847843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:50.848989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:50.928690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-898f481a-8c74-4ccf-8286-e9bbf980fb74 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118864 Nov 20 20:49:50.931343 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 707/1370] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:49:50 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:50.963445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:50.976828 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53204e3d-1616-4931-924c-e754e409bb7b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1529 microversion: 2.1 time: 0.384637 Nov 20 20:49:50.977434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 664/1371] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:50 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1529 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:50.993110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:50.994139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:51.002913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.004052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.005091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.005753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.166961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:51.168015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:51.178711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.180133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.182180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.182987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.355857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:51.360318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634f122b90184fd794dd55b6b09fd98d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1a432e5f0bc49dc942d406268442ed3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:51.373979 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-65a0c9b6-5bd6-4660-bdd9-af5bb1940dd2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1529 microversion: 2.1 time: 0.384265 Nov 20 20:49:51.380258 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1a12a4e-ab49-48a1-be4f-3a8fdb715403 tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 200 len: 1426 microversion: 2.1 time: 0.217378 Nov 20 20:49:51.391868 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 665/1372] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:51 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 1426 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:51.399184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-99cd236c-f0fd-4969-af7c-a6495ee446a0 req-7415364f-f83f-4099-a665-966272c71089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6acf73a5-9605-4b53-83dc-09af84fee3fe", "name": "network-vif-deleted", "tag": "1f1cf981-26ff-4024-b94c-8e78ef84d154"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:51.405106 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:51.405106 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:51.414295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 708/1373] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:50 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1529 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:51.425990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:51.427107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:51.437161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-99cd236c-f0fd-4969-af7c-a6495ee446a0 req-7415364f-f83f-4099-a665-966272c71089 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.438323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-99cd236c-f0fd-4969-af7c-a6495ee446a0 req-7415364f-f83f-4099-a665-966272c71089 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.448797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.451414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.453734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.454392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.478083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-99cd236c-f0fd-4969-af7c-a6495ee446a0 req-7415364f-f83f-4099-a665-966272c71089 service nova] Creating event network-vif-deleted:1f1cf981-26ff-4024-b94c-8e78ef84d154 for instance 6acf73a5-9605-4b53-83dc-09af84fee3fe on nch1-master-1 Nov 20 20:49:51.490336 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-99cd236c-f0fd-4969-af7c-a6495ee446a0 req-7415364f-f83f-4099-a665-966272c71089 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103373 Nov 20 20:49:51.495140 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 666/1374] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:51.513112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3eecc1aa-b45a-4d78-844a-da5072ad1ef0 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:51.514662 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:51.514662 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:51.525497 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-3eecc1aa-b45a-4d78-844a-da5072ad1ef0 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] HTTP exception thrown: Flavor 6c542808-031e-40df-b94d-0bdce9c6fb3a could not be found. Nov 20 20:49:51.526257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3eecc1aa-b45a-4d78-844a-da5072ad1ef0 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Returning 404 to user: Flavor 6c542808-031e-40df-b94d-0bdce9c6fb3a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:51.527147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3eecc1aa-b45a-4d78-844a-da5072ad1ef0 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/6c542808-031e-40df-b94d-0bdce9c6fb3a" status: 404 len: 109 microversion: 2.1 time: 0.026670 Nov 20 20:49:51.527987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 667/1375] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:49:51 2021] DELETE /compute/v2.1/flavors/6c542808-031e-40df-b94d-0bdce9c6fb3a => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:51.566800 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fc48cea-42a7-414e-bb51-274156177985 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.151024 Nov 20 20:49:51.571670 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 709/1376] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:51 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:51.766372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-558140399", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:51.821998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:51.822722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:51.837964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.839496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.840336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:51.840768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:51.851375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:49:52.212496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:49:52.212907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:49:52.213423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:49:52.213830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:49:52.214329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:49:52.235131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.235806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.237100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.237727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.257001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:49:52.265489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Getting quotas for user cf07bddf00ea4a7da446130a6308cd27 and project 75d8e50fbc2c4c13be9b56bf0078f315. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:49:52.270331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:52.279396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70fdb917-6f22-462b-8a45-3441bd4cdca9 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.461563 Nov 20 20:49:52.280000 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 710/1377] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:51 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:52.286275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:52.287885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:52.296274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.297135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.298346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.299239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.301249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:49:52.303935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:49:52.340979 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69a14342-7f21-46ad-8956-d79b531d534e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059330 Nov 20 20:49:52.354442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 711/1378] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:49:52 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:49:52.400620 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b950aa3a-8d1c-45ba-8d3c-1ba1f6fc0e8a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638051 Nov 20 20:49:52.401522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:52.402760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] [instance: 6acf73a5-9605-4b53-83dc-09af84fee3fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:52.404009 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 668/1379] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:49:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:49:52.412444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.413185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22fe6714-f487-4a89-8daa-01d685401f6c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:52.414022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22fe6714-f487-4a89-8daa-01d685401f6c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:52.416187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.418422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.421028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.462267 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] HTTP exception thrown: Instance 6acf73a5-9605-4b53-83dc-09af84fee3fe could not be found. Nov 20 20:49:52.463095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] Returning 404 to user: Instance 6acf73a5-9605-4b53-83dc-09af84fee3fe could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:52.464197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85639783-f199-45e3-a5a2-3323a083662e tempest-ServersAdminTestJSON-1309564112 tempest-ServersAdminTestJSON-1309564112-project] 10.222.0.41 "GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe" status: 404 len: 111 microversion: 2.1 time: 0.068581 Nov 20 20:49:52.465280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 712/1380] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:52 2021] GET /compute/v2.1/servers/6acf73a5-9605-4b53-83dc-09af84fee3fe => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:52.578421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22fe6714-f487-4a89-8daa-01d685401f6c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:52.582856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:52.584332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:52.588985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22fe6714-f487-4a89-8daa-01d685401f6c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1212 microversion: 2.1 time: 0.181517 Nov 20 20:49:52.592338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.593163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.594267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:52.595035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:52.601492 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 669/1381] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:52 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1212 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:52.693855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28bf7ea7-b446-4cb6-ab60-deb7b1a65960 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.117781 Nov 20 20:49:52.700061 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 713/1382] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:52 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:53.299231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:53.300719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:53.311499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.313522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.315642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.316628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.615176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:53.616151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:53.636303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.637466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.638939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.647216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.835194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:53.847602 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f11c7a5-dc83-4cfa-b9f5-c9775c713a96 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1208 microversion: 2.1 time: 0.236839 Nov 20 20:49:53.849293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 714/1383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:53 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1208 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:53.855572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:53.858584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:53.879230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.884149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.885296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:53.885950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:53.961025 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fde7408d-fba2-452a-ba93-522bdb08bf78 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.109669 Nov 20 20:49:53.965454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 715/1384] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:53 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:53.995197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:54.006358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f242af86-3d20-4681-9a5e-93c5a5d912fb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.711464 Nov 20 20:49:54.013849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5e562175-3546-4bef-a72a-9081941b63a2 req-9f26b208-a248-4964-a31f-f89814b106af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-plugged", "status": "completed", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:54.015694 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:54.015694 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:54.020701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 670/1385] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:53 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:49:54.034605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5e562175-3546-4bef-a72a-9081941b63a2 req-9f26b208-a248-4964-a31f-f89814b106af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:54.035303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5e562175-3546-4bef-a72a-9081941b63a2 req-9f26b208-a248-4964-a31f-f89814b106af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:54.082771 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5e562175-3546-4bef-a72a-9081941b63a2 req-9f26b208-a248-4964-a31f-f89814b106af service nova] Creating event network-vif-plugged:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:49:54.125539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5e562175-3546-4bef-a72a-9081941b63a2 req-9f26b208-a248-4964-a31f-f89814b106af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079355 Nov 20 20:49:54.129190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 716/1386] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:49:54.866135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:54.866746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:54.878738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:54.880952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:54.881984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:54.884206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:54.979378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:54.982099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:55.000040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:55.002974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:55.004618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:55.007366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:55.009602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:55.016512 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca33d0c7-7abc-48fc-ac33-d1b396739c05 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1270 microversion: 2.1 time: 0.153973 Nov 20 20:49:55.032791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 671/1387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:54 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:55.042377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:55.044975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:55.060275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:55.065858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:55.067924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:55.068916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:55.109561 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f70668f4-c56d-4402-b435-140b489126a5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.137914 Nov 20 20:49:55.113893 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 717/1388] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:54 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:55.527617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:55.540956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d93d48e-93aa-4d3e-a494-147df1f94fbc tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.505904 Nov 20 20:49:55.541645 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 672/1389] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:55 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:56.051203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:56.054320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:56.075925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.077380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.080965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.082629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.130546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:56.132243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:56.147908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.148763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.154828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.157359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.277825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2519d210-07ad-4887-9b77-dbfe9e21f192 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.152196 Nov 20 20:49:56.283761 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 673/1390] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:56 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:56.566252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:56.568663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:56.583496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.586671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.588060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:56.601763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:56.859929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:56.869293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f146791-bd76-4b69-95ad-d88630bf08b2 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.831017 Nov 20 20:49:56.873056 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 718/1391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:56 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:57.062961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:57.074004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ad2bb19-0056-4b49-b686-7c8f5d1c7bd3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.516472 Nov 20 20:49:57.075045 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 674/1392] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:56 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:57.294886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:57.295876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:57.315580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:57.316052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:57.320310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:57.322360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:57.404788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09b72af8-cef3-4331-8bf5-1f553bb9974e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.113433 Nov 20 20:49:57.405941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 719/1393] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:57 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:57.636294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-445b21ee-d7cd-49b6-912c-45b8765ed516 req-4666a4b7-f2fa-4536-a884-0952afd484b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:57.639781 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:57.639781 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:49:57.695827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-445b21ee-d7cd-49b6-912c-45b8765ed516 req-4666a4b7-f2fa-4536-a884-0952afd484b2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:57.696579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-445b21ee-d7cd-49b6-912c-45b8765ed516 req-4666a4b7-f2fa-4536-a884-0952afd484b2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:57.721326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-445b21ee-d7cd-49b6-912c-45b8765ed516 req-4666a4b7-f2fa-4536-a884-0952afd484b2 service nova] Creating event network-changed:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:49:57.735601 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-445b21ee-d7cd-49b6-912c-45b8765ed516 req-4666a4b7-f2fa-4536-a884-0952afd484b2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103444 Nov 20 20:49:57.737571 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 675/1394] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:49:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:49:57.891388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:57.892324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:57.904084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:57.905412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:57.911435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:57.912389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:58.101016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:58.101658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:58.120381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:58.120882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:58.121723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:58.129729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:58.208127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:58.216201 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a04df06-b532-46a5-8ada-b7aece0d0d8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.329364 Nov 20 20:49:58.230863 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 720/1395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:57 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:58.601955 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cebf627c-d61a-4fb9-8020-2e68d9f81cda tempest-TenantUsagesNegativeTestJSON-678281990 tempest-TenantUsagesNegativeTestJSON-678281990-project-admin] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-19T20%3A49%3A58.338213&end=2021-11-21T20%3A49%3A58.338213" status: 404 len: 112 microversion: - time: 0.259739 Nov 20 20:49:58.603652 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 721/1396] 10.222.0.41 () {58 vars in 1315 bytes} [Sat Nov 20 20:49:58 2021] GET /compute/v2.1/os-simple-tenant-usage/?start=2021-11-19T20%3A49%3A58.338213&end=2021-11-21T20%3A49%3A58.338213 => generated 112 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 20:49:58.610126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:58.615888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:58.628653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:58.629798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:58.630841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:58.631449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:58.696236 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-006fb259-c28e-45fc-9ed6-84d4cb05c1b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 32604 microversion: 2.1 time: 0.091165 Nov 20 20:49:58.697135 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 722/1397] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:58 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 32604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:49:58.706837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3b2e18b-6a9a-4dc1-8baf-057a2d9cd88d tempest-TenantUsagesNegativeTestJSON-678281990 tempest-TenantUsagesNegativeTestJSON-678281990-project-admin] Calling method '.version_select at 0x7f3f86a225e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:58.712435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f3b2e18b-6a9a-4dc1-8baf-057a2d9cd88d tempest-TenantUsagesNegativeTestJSON-678281990 tempest-TenantUsagesNegativeTestJSON-678281990-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 20 20:49:58.713244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3b2e18b-6a9a-4dc1-8baf-057a2d9cd88d tempest-TenantUsagesNegativeTestJSON-678281990 tempest-TenantUsagesNegativeTestJSON-678281990-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:58.714344 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3b2e18b-6a9a-4dc1-8baf-057a2d9cd88d tempest-TenantUsagesNegativeTestJSON-678281990 tempest-TenantUsagesNegativeTestJSON-678281990-project-admin] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage/07cdf5ff390b4376a1ed5e7c967a5769?start=2021-11-21T20%3A49%3A58.338213&end=2021-11-19T20%3A49%3A58.338213" status: 400 len: 111 microversion: 2.1 time: 0.012199 Nov 20 20:49:58.715534 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 723/1398] 10.222.0.41 () {58 vars in 1411 bytes} [Sat Nov 20 20:49:58 2021] GET /compute/v2.1/os-simple-tenant-usage/07cdf5ff390b4376a1ed5e7c967a5769?start=2021-11-21T20%3A49%3A58.338213&end=2021-11-19T20%3A49%3A58.338213 => generated 111 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:49:58.922400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:58.929506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-037d9069-3382-4fd3-b944-48a420ae3cab tempest-TenantUsagesNegativeTestJSON-1037604204 tempest-TenantUsagesNegativeTestJSON-1037604204-project] Calling method '.version_select at 0x7f3f869d8310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:58.931870 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:49:58.931870 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:49:58.934115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-037d9069-3382-4fd3-b944-48a420ae3cab tempest-TenantUsagesNegativeTestJSON-1037604204 tempest-TenantUsagesNegativeTestJSON-1037604204-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3e792162bb68408e931c99aa6d9c330c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cdf5ff390b4376a1ed5e7c967a5769', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:58.935360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb67a9f7-8c06-4703-aa0f-b443c2283424 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.846806 Nov 20 20:49:58.935502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-037d9069-3382-4fd3-b944-48a420ae3cab tempest-TenantUsagesNegativeTestJSON-1037604204 tempest-TenantUsagesNegativeTestJSON-1037604204-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:49:58.936570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-037d9069-3382-4fd3-b944-48a420ae3cab tempest-TenantUsagesNegativeTestJSON-1037604204 tempest-TenantUsagesNegativeTestJSON-1037604204-project] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-19T20%3A49%3A58.338213&end=2021-11-21T20%3A49%3A58.338213&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.214780 Nov 20 20:49:58.937838 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 724/1399] 10.222.0.41 () {58 vars in 1334 bytes} [Sat Nov 20 20:49:58 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-19T20%3A49%3A58.338213&end=2021-11-21T20%3A49%3A58.338213&detailed=1 => generated 123 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:49:58.949540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 676/1400] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:58 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:59.239442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:59.240429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:59.257155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.260623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.261629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.263890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.709292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:49:59.710263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:59.779775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:49:59.788682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.801231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.803921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.809303 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d331426-415e-4fb5-8a39-03145399635b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.575894 Nov 20 20:49:59.816995 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 725/1401] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:59 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:49:59.826007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.926125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95a2ab69-082a-4227-aeaf-10babb607a6b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action" status: 200 len: 40753 microversion: 2.1 time: 0.220843 Nov 20 20:49:59.930018 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 677/1402] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:49:59 2021] POST /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef/action => generated 40753 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:49:59.938497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:59.940584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:59.958664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:49:59.959418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:49:59.961010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.961728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.963098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.963770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.991143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.991782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:49:59.993682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:49:59.995260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:00.314887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:00.328446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-808e322e-120c-494e-a4c8-caea5abe49e1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 200 len: 1707 microversion: 2.1 time: 0.394853 Nov 20 20:50:00.329256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 726/1403] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:59 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 1707 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:00.414699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:00.424344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-207a6f1e-d392-4dae-b0b4-ffacd285823e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.472165 Nov 20 20:50:00.436238 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 678/1404] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:49:59 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:00.838398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:00.838991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:00.850927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:00.851384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:00.852558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:00.853294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:01.068183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:01.068598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:01.081238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:01.083238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:01.084275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:01.086879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:01.147712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:01.203753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:01.216435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea099905-1447-43a7-914d-fe810ab5a85d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.380000 Nov 20 20:50:01.217787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 727/1405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:00 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:01.346371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-faba7cf0-7062-4106-a164-f6a3dee8c6fc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 204 len: 0 microversion: 2.1 time: 0.281455 Nov 20 20:50:01.347056 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 679/1406] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:01 2021] DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:01.446412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:01.449444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:01.458972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:01.459778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:01.460841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:01.461558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:01.536300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1585549218", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "347300198", "adminPass": "***", "networks": [{"uuid": "b732d073-2758-47f6-b640-8b10bd32a71a"}], "security_groups": [{"name": "tempest-securitygroup--2054261647"}], "key_name": "tempest-keypair-885863100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:01.741250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:01.770890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c151b305-2fa3-449f-bcc9-cd0b343ba650 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.329759 Nov 20 20:50:01.772087 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 728/1407] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:01 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:01.833767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] validate_networks() for [('b732d073-2758-47f6-b640-8b10bd32a71a', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:02.248595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:02.251716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:02.262199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:02.262922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:02.263929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:02.264534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:02.498802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:02.515062 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac0035f4-3648-4d68-9222-58a6f3dd710a tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.284297 Nov 20 20:50:02.526195 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 729/1408] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:02 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:02.790959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:02.791587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:02.807729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:02.809041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:02.812072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:02.812543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:03.168560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:03.181819 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8f2a4fc3-5b26-4061-8b58-a8e2c2263cdf tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.394045 Nov 20 20:50:03.182940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 730/1409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:02 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:03.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:03.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:03.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:03.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:03.223783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:03.245768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:03.246380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:03.247346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:03.248168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:03.283520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:03.288632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Getting quotas for user 6ca8ada3b9574675821f2b1a25d6c7e2 and project 5857f13b93654bb08bfb0e3045dc0a42. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:03.315281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:03.318970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:03.443207 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-decc3142-60f3-417c-95e9-f7dd3075f9de tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.936014 Nov 20 20:50:03.446766 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 680/1410] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:50:01 2021] POST /compute/v2.1/servers => generated 402 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:50:03.464752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e538cbf-72da-4ffc-ab17-9fe7bb111a95 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:03.466437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e538cbf-72da-4ffc-ab17-9fe7bb111a95 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:03.533244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:03.534223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:03.566869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:03.577701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:03.580672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:03.581185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:03.745023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1e538cbf-72da-4ffc-ab17-9fe7bb111a95 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:03.754389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e538cbf-72da-4ffc-ab17-9fe7bb111a95 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1262 microversion: 2.1 time: 0.293223 Nov 20 20:50:03.765055 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 731/1411] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:03 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1262 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:04.163235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:04.172306 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c55a1331-7866-49da-bfb2-db2333ff0dab tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.643275 Nov 20 20:50:04.179216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 681/1412] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:03 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:04.200453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:04.201484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:04.219795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:04.220299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:04.222456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:04.224262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:04.803616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:04.805492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:04.831964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:04.836825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:04.838417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:04.839121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:04.881486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:04.893125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf0fe6b4-1ccc-4fd3-990a-bd10220f6b2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.695700 Nov 20 20:50:04.912246 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 732/1413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:04 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:04.966427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5a77e916-9a5f-4e89-917d-0e6bb49d907c req-ff5fa1cc-fba3-466a-b256-12f29f22e741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-plugged", "status": "completed", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:04.968389 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:04.968389 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:04.983466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5a77e916-9a5f-4e89-917d-0e6bb49d907c req-ff5fa1cc-fba3-466a-b256-12f29f22e741 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:04.984154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5a77e916-9a5f-4e89-917d-0e6bb49d907c req-ff5fa1cc-fba3-466a-b256-12f29f22e741 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:05.081558 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5a77e916-9a5f-4e89-917d-0e6bb49d907c req-ff5fa1cc-fba3-466a-b256-12f29f22e741 service nova] Creating event network-vif-plugged:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:05.113760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5a77e916-9a5f-4e89-917d-0e6bb49d907c req-ff5fa1cc-fba3-466a-b256-12f29f22e741 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148191 Nov 20 20:50:05.126822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 733/1414] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:05.203207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:05.204132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:05.227120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:05.229193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:05.236911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:05.237588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:05.359903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:05.373119 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f1ad115-72b5-44a2-ad03-9721c7d297c9 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1266 microversion: 2.1 time: 0.591647 Nov 20 20:50:05.385698 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 682/1415] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:04 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1266 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:05.803473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:05.813591 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4800fb0c-35f8-46f8-b01b-f85dc02f6c8f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.616336 Nov 20 20:50:05.814760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 734/1416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:05 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:05.929174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:05.929767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:05.942655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:05.943293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:05.957320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:05.958112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:06.392100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:06.394479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:06.403308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:06.413606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:06.414517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:06.414971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:06.512892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:06.543083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a0a12ae-bd86-4934-b606-2ab907bbc573 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1320 microversion: 2.1 time: 0.154348 Nov 20 20:50:06.551949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 735/1417] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:06 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:06.693856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:06.711842 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40e864a4-242d-4ff0-9734-b7e8526aa141 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.786842 Nov 20 20:50:06.712589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 683/1418] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:05 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:06.836990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:06.837437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:06.871668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:06.876291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:06.883864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:06.885653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:07.223544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d9934c56-ff8d-4cfc-b52b-dd95180f8928 req-2e0d2429-288e-4f0f-9a60-dfa7dbc41239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c757299-9a55-42d6-a189-d689f2c8f7ef", "name": "network-vif-deleted", "tag": "49830bee-e4b8-4568-83a8-d29f300b9690"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:07.225226 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:07.225226 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:07.253465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d9934c56-ff8d-4cfc-b52b-dd95180f8928 req-2e0d2429-288e-4f0f-9a60-dfa7dbc41239 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:07.258547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d9934c56-ff8d-4cfc-b52b-dd95180f8928 req-2e0d2429-288e-4f0f-9a60-dfa7dbc41239 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:07.304138 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d9934c56-ff8d-4cfc-b52b-dd95180f8928 req-2e0d2429-288e-4f0f-9a60-dfa7dbc41239 service nova] Creating event network-vif-deleted:49830bee-e4b8-4568-83a8-d29f300b9690 for instance 2c757299-9a55-42d6-a189-d689f2c8f7ef on nch2-master-1 Nov 20 20:50:07.313493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d9934c56-ff8d-4cfc-b52b-dd95180f8928 req-2e0d2429-288e-4f0f-9a60-dfa7dbc41239 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095737 Nov 20 20:50:07.334101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 684/1419] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 20 20:50:07.380383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:07.394811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3bff6958-a586-4453-9396-19dcae7d1776 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1312 microversion: 2.1 time: 0.563164 Nov 20 20:50:07.399854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 736/1420] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:06 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1312 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:07.570988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:07.571947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:07.583715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:07.589549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:07.590953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:07.591777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:07.726815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:07.730683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:07.731303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:07.741132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-867d044c-1219-4f11-a4e6-eca9aeb53b06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1320 microversion: 2.1 time: 0.175123 Nov 20 20:50:07.748411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 685/1421] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:07 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:07.755711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:07.763945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:07.765809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:07.766202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:08.420919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:08.424274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:08.448276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:08.452152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:08.456451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:08.456931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:08.552446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:08.566367 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8976c3c-9f85-426d-bd00-7a326c6053a5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1515 microversion: 2.1 time: 0.837628 Nov 20 20:50:08.570964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 737/1422] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:07 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1515 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:08.759605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:08.760277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:08.778490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:08.778950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:08.784611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:08.785196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:09.166432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:09.175936 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12061ae7-e508-46ee-9662-27173a676d26 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.420415 Nov 20 20:50:09.176531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 738/1423] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:08 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:09.193840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:09.206220 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90c93e1f-5437-4a0a-ad26-da65d349f571 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1461 microversion: 2.1 time: 0.792255 Nov 20 20:50:09.208180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 686/1424] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:08 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1461 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:09.225196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:09.225807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:09.231767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:09.232222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:09.234981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:09.235599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:09.585011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:09.585633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:09.593235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:09.593687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:09.603029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:09.604446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:09.915406 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-982431f8-61fb-40c2-b44b-eba4a13d4d46 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1612 microversion: 2.1 time: 0.695793 Nov 20 20:50:09.931390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 739/1425] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:09 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1612 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:09.936265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:09.969739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:10.010382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:10.010617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:10.011368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:10.020763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:10.112032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6b1444538c3e4667a01dce32e9b5e7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db732c19328144888d5f96699272f261', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:10.112619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] flavor_id is None. Assuming migration. {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 20 20:50:10.113054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 20:50:10.131404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:10.143036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcd94613-ff3b-4c94-9893-89161971e488 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1521 microversion: 2.1 time: 0.561641 Nov 20 20:50:10.145375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 687/1426] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:09 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:10.158906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9c7c2f69-d74e-483a-83f9-c85cdf312648 req-241f2ac8-9acc-4dcc-9287-5be8668be004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff08833c-234f-4d62-a1a1-b0137fa38bdf", "tag": "77ea4b8e-7206-4f77-ab0e-0eabb045363e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:10.160812 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:10.160812 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:10.181031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9c7c2f69-d74e-483a-83f9-c85cdf312648 req-241f2ac8-9acc-4dcc-9287-5be8668be004 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:10.185482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9c7c2f69-d74e-483a-83f9-c85cdf312648 req-241f2ac8-9acc-4dcc-9287-5be8668be004 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:10.216287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9c7c2f69-d74e-483a-83f9-c85cdf312648 req-241f2ac8-9acc-4dcc-9287-5be8668be004 service nova] Creating event network-changed:77ea4b8e-7206-4f77-ab0e-0eabb045363e for instance ff08833c-234f-4d62-a1a1-b0137fa38bdf on nch2-master-1 Nov 20 20:50:10.226221 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9c7c2f69-d74e-483a-83f9-c85cdf312648 req-241f2ac8-9acc-4dcc-9287-5be8668be004 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075955 Nov 20 20:50:10.226900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 688/1427] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:10.235789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-366960057", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ecb95c56-c11a-4f3b-9cd5-8a7b52baf801"}], "security_groups": [{"name": "tempest-securitygroup--1088097932"}], "key_name": "tempest-keypair-788948485", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b7841b2e-06ba-4d66-a2fd-bd25a876b43c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:10.328969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d8eb284-1200-4fa7-af6c-dd1d51b63a9e tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9/action" status: 202 len: 0 microversion: 2.1 time: 0.396329 Nov 20 20:50:10.331325 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 740/1428] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:09 2021] POST /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:50:10.343858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:10.354710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:10.360312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:10.361522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:10.362534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:10.363132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:10.498601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] validate_networks() for [('ecb95c56-c11a-4f3b-9cd5-8a7b52baf801', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:11.153346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:11.205945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d20c024-aafe-491c-b02f-e9a0ffc755ad tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.865052 Nov 20 20:50:11.211593 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 741/1429] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:10 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:11.229697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:11.242001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:11.253516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.259001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.260046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.263153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.554514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for project 2a9b204d38934eeea9ac2d67611156eb. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:11.561170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for user 14079946f53346a3a4373ac0738f5894 and project 2a9b204d38934eeea9ac2d67611156eb. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:11.577583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:11.578818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:11.579287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:11.580324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:11.580963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:11.598659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.599465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.600285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.601514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.645045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:11.655816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Getting quotas for user 14079946f53346a3a4373ac0738f5894 and project 2a9b204d38934eeea9ac2d67611156eb. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:11.709021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:11.720599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da6a93dd-ff46-4fca-b7b8-bcdb3f5bca8d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1470 microversion: 2.1 time: 0.509126 Nov 20 20:50:11.721380 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 742/1430] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:11 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:11.730142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:11.732645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:11.749200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.749760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.750480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:11.750922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:11.772518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:11.774686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7841b2e-06ba-4d66-a2fd-bd25a876b43c',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:12.125136 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28ba2187-e3b4-40fe-878a-4a8f2aab8c1b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.896605 Nov 20 20:50:12.135553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 689/1431] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:50:10 2021] POST /compute/v2.1/servers => generated 407 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:50:12.141978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d491b734-656f-4f7c-9a11-bd8264e2e0ee tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:12.155576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d491b734-656f-4f7c-9a11-bd8264e2e0ee tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:12.315389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:12.323516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b15ab531-6271-418d-acb0-775862914d2e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1521 microversion: 2.1 time: 0.598551 Nov 20 20:50:12.325897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d491b734-656f-4f7c-9a11-bd8264e2e0ee tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:12.327249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 743/1432] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:11 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:12.340982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:12.342992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d491b734-656f-4f7c-9a11-bd8264e2e0ee tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1120 microversion: 2.1 time: 0.199708 Nov 20 20:50:12.356933 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 690/1433] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:12 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1120 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:12.362365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:12.389253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:12.390029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:12.393917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:12.397201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:12.703874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-50b49a85-87cd-4ccc-a585-eb7efed4d9c3 req-bb2db89c-91b6-49ed-9947-e5f7f26bbde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743798f2-3de6-473a-b676-6226a4b9ebba", "name": "network-vif-unplugged", "status": "completed", "tag": "701e9eed-1ec3-47ff-a1de-75bfa89aefd7"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:12.706333 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:12.706333 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:12.718135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-50b49a85-87cd-4ccc-a585-eb7efed4d9c3 req-bb2db89c-91b6-49ed-9947-e5f7f26bbde1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:12.718803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-50b49a85-87cd-4ccc-a585-eb7efed4d9c3 req-bb2db89c-91b6-49ed-9947-e5f7f26bbde1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:12.734727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-50b49a85-87cd-4ccc-a585-eb7efed4d9c3 req-bb2db89c-91b6-49ed-9947-e5f7f26bbde1 service nova] Creating event network-vif-unplugged:701e9eed-1ec3-47ff-a1de-75bfa89aefd7 for instance 743798f2-3de6-473a-b676-6226a4b9ebba on nch2-master-1 Nov 20 20:50:12.743095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-50b49a85-87cd-4ccc-a585-eb7efed4d9c3 req-bb2db89c-91b6-49ed-9947-e5f7f26bbde1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046857 Nov 20 20:50:12.744330 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 691/1434] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:12.751211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:12.752495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:12.762550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:12.763721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:12.764690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:12.765311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:12.841099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:12.849984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb833480-94b4-42d3-95bc-fc756f5694b5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.519276 Nov 20 20:50:12.860204 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 744/1435] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:12 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:12.978502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:12.986897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1fc86981-b387-4d15-8a33-867cdecc5a02 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1470 microversion: 2.1 time: 0.240478 Nov 20 20:50:12.991053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 692/1436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:12 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:13.344520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:13.346541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:13.353653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.354467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:13.355538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.356244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:13.364610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:13.365465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:13.374783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.376217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:13.377268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.382114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:13.503564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:13.513216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf832cff-a456-49bb-9098-e8f0bd712926 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1218 microversion: 2.1 time: 0.150908 Nov 20 20:50:13.523988 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 693/1437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:13 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1218 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:13.530215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1387707489", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1f07f823-03fd-485f-ad70-6286912e8408"}], "block_device_mapping_v2": [{"uuid": "0803734f-6742-4a4d-8758-d341c66337d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:13.695412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] validate_networks() for [('1f07f823-03fd-485f-ad70-6286912e8408', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:13.928714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:13.939025 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e5f4e53c-6e82-46ae-88cd-5972c9afb646 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1521 microversion: 2.1 time: 0.598511 Nov 20 20:50:13.946642 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 745/1438] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:13 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:13.951743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:13.952703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:13.961316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.962373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:13.963681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:13.964282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:14.506827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:14.515075 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-130ebdd6-6e55-4f51-99ae-2915ec9f9a39 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.567056 Nov 20 20:50:14.515673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 746/1439] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:13 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:14.531250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:14.531875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:14.556941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:14.560043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:14.561237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:14.561878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:15.139319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:15.149570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73d1a6d6-a4fd-483a-8702-655ae4297f2f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.631712 Nov 20 20:50:15.150199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 747/1440] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:14 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:15.160359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:15.170558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:15.180330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:15.189709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:15.191056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:15.191692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:15.312294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:15.328128 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8c6ddb5-c801-4812-9516-30039657c994 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1236 microversion: 2.1 time: 0.171611 Nov 20 20:50:15.344481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 748/1441] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:15 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1236 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:15.351033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-362058899", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "554d0697-db40-4745-a60d-da36ede89e92"}], "block_device_mapping_v2": [{"uuid": "6e2b1f6d-f606-4f0c-a332-219fb5652d9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:15.488702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] validate_networks() for [('554d0697-db40-4745-a60d-da36ede89e92', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:15.530704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:15.532139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:15.534033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:15.534654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:15.535220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:15.552294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:15.553039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:15.554098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:15.555006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:15.583460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:15.589655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Getting quotas for user e417004a75cd4291a2ef4a9d233c9f28 and project ee7537dd85d04e808dc792658afa443e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:15.713288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:15.718261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0803734f-6742-4a4d-8758-d341c66337d2',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:16.016205 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4940f7af-0cd5-4183-8bc7-bf626a845b6b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.490568 Nov 20 20:50:16.016866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 694/1442] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:50:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 20:50:16.024984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:16.025593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:16.064392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.067397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.071398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.071877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.766862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:16.781235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-525c1bf8-522f-4962-91fa-e189fba6f70b tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1521 microversion: 2.1 time: 0.762167 Nov 20 20:50:16.783502 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 695/1443] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:16 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:16.793143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:16.803117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:16.815611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.817374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.833967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.835078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.937176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:16.937805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:16.938692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:16.939361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:16.940126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:16.950516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.951262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.952413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:16.953099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:16.987955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:16.992761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Getting quotas for user dbb46ce41ca44f57aeef1d6b2191b4cb and project 9e5736eff1924fa28c0a00ae3da90174. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:17.083977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:17.086754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e2b1f6d-f606-4f0c-a332-219fb5652d9f',volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:17.165780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:17.176717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d41895f-001b-4f7e-9bbb-4bfc8c712851 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.391960 Nov 20 20:50:17.183777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 696/1444] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:16 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:17.191931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:17.195639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:17.208459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.209163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.210307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.211162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.342692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:17.363260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:17.368237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:17.371319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54be71f5-5eb1-4483-a1b5-eeffc39f1279 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1233 microversion: 2.25 time: 0.184649 Nov 20 20:50:17.373523 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 697/1445] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:17 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1233 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:17.385439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:17.387359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:17.404032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.404483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.407699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.409788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.429385 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-633f57b3-5c2f-4de6-b69d-c5a71c15c93e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081577 Nov 20 20:50:17.430182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 749/1446] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:50:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:50:17.444286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:17.446738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:17.462745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.463207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.466863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:17.467319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:17.978305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:17.989808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfd6aa30-ebfa-4db3-b981-ae7457228d44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.557255 Nov 20 20:50:17.990444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 750/1447] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:17 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:18.010025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-225331e4-2206-462e-93db-fb95ea1ad7db req-e7689a07-3d82-47ee-b9dc-e500cc73c147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743798f2-3de6-473a-b676-6226a4b9ebba", "name": "network-vif-plugged", "status": "completed", "tag": "701e9eed-1ec3-47ff-a1de-75bfa89aefd7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:18.013824 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:18.013824 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:18.050483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:18.060349 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0772e1db-6493-4b08-992a-1808e6056d97 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.684420 Nov 20 20:50:18.063458 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 698/1448] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:17 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:18.064824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-225331e4-2206-462e-93db-fb95ea1ad7db req-e7689a07-3d82-47ee-b9dc-e500cc73c147 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:18.066238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-225331e4-2206-462e-93db-fb95ea1ad7db req-e7689a07-3d82-47ee-b9dc-e500cc73c147 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:18.096598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-225331e4-2206-462e-93db-fb95ea1ad7db req-e7689a07-3d82-47ee-b9dc-e500cc73c147 service nova] Creating event network-vif-plugged:701e9eed-1ec3-47ff-a1de-75bfa89aefd7 for instance 743798f2-3de6-473a-b676-6226a4b9ebba on nch2-master-1 Nov 20 20:50:18.106544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-225331e4-2206-462e-93db-fb95ea1ad7db req-e7689a07-3d82-47ee-b9dc-e500cc73c147 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114746 Nov 20 20:50:18.115283 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 751/1449] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:18.124794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20a88f62-d0d1-4365-be88-6b608371de53 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:18.126108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20a88f62-d0d1-4365-be88-6b608371de53 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:18.253531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20a88f62-d0d1-4365-be88-6b608371de53 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:18.260735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20a88f62-d0d1-4365-be88-6b608371de53 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1052 microversion: 2.1 time: 0.143495 Nov 20 20:50:18.270924 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 752/1450] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:18 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1052 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:18.273551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:18.275245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:18.289025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:18.295853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:18.305453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:18.306546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:18.367278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1868669856", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "5bc0506e-bc72-485c-a0a7-48575db53d86"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:18.436758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] validate_networks() for [('5bc0506e-bc72-485c-a0a7-48575db53d86', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:18.819674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:18.848267 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-afe49eaf-dd47-452e-b052-2cccc6d0fb94 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1521 microversion: 2.1 time: 0.577636 Nov 20 20:50:18.864000 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 753/1451] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:18 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:18.875364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:18.878213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:18.903241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:18.906248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:18.909078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:18.910682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:19.301419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:19.311027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8042c9fc-64a9-4143-ab4d-f3b9889b55c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.444611 Nov 20 20:50:19.314749 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 754/1452] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:18 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:19.324645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-09d2e902-c4f3-45b3-83bd-2c7c5fff2839 req-580d0070-bb34-4e6f-8f3e-3abfd994cc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a604335-3c5c-46dd-879c-5f0d49092a58", "tag": "b8360b4c-cbee-4afe-816b-338cc6a81f67"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:19.327848 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:19.327848 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:19.348244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-09d2e902-c4f3-45b3-83bd-2c7c5fff2839 req-580d0070-bb34-4e6f-8f3e-3abfd994cc70 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:19.354225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-09d2e902-c4f3-45b3-83bd-2c7c5fff2839 req-580d0070-bb34-4e6f-8f3e-3abfd994cc70 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:19.378981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-09d2e902-c4f3-45b3-83bd-2c7c5fff2839 req-580d0070-bb34-4e6f-8f3e-3abfd994cc70 service nova] Creating event network-changed:b8360b4c-cbee-4afe-816b-338cc6a81f67 for instance 0a604335-3c5c-46dd-879c-5f0d49092a58 on nch1-master-1 Nov 20 20:50:19.387927 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-09d2e902-c4f3-45b3-83bd-2c7c5fff2839 req-580d0070-bb34-4e6f-8f3e-3abfd994cc70 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071655 Nov 20 20:50:19.397434 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 755/1453] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:19.403505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:19.407781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:19.436515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:19.442694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:19.444068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:19.444195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:19.594750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:19.604798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:19.616557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:19.617710 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf34af11-8e82-42c3-96e2-869b8260d5dd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1251 microversion: 2.25 time: 0.218283 Nov 20 20:50:19.618614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 756/1454] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:19 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1251 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:19.623095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:19.625983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:19.640871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:19.641520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:19.643131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:19.645913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.138710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:20.152944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cef48c14-68cc-4c40-b047-508d2176136a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.533052 Nov 20 20:50:20.153549 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 757/1455] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:19 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:20.157949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:20.158736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:20.190829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.191285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.192087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.192545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.411707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:20.412197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:20.412599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:20.413014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:20.413641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:20.433535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.434138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.440371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.441161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.514729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Getting quotas for project 2cfe248f7eb34f6e80937503e49fd3ca. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:20.535232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Getting quotas for user 96b2f31cecf74d0793899774dc0d02f9 and project 2cfe248f7eb34f6e80937503e49fd3ca. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:20.588724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:20.596636 ncdv-master-1 devstack@n-api.service[140941]: WARNING nova.utils [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1868669856 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-186866985 Nov 20 20:50:20.597800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:20.719210 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2fc58b66-f7b2-4ea1-8a19-1d8b0005e45b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.651774 Nov 20 20:50:20.727521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 699/1456] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:50:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:50:20.741607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:20.743819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:20.764724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.765335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.767755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.769468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.803021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:20.830794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-391359a4-3a4f-40f7-94e4-4bfe569a1851 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.675995 Nov 20 20:50:20.837550 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 758/1457] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:20 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:20.859230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:20.865917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:20.901489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.903254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:20.905077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:20.905077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:21.729390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:21.743786 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-323665ad-614a-4563-ad84-81d77be76972 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1506 microversion: 2.1 time: 0.904994 Nov 20 20:50:21.744607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 759/1458] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:20 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1506 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:21.759040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e132e886-221a-406a-b0b5-61eb3562f3da req-703b5ae0-c674-4382-88be-5cd2b02f793e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff08833c-234f-4d62-a1a1-b0137fa38bdf", "name": "network-vif-plugged", "status": "completed", "tag": "77ea4b8e-7206-4f77-ab0e-0eabb045363e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:21.762555 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:21.762555 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:21.783928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e132e886-221a-406a-b0b5-61eb3562f3da req-703b5ae0-c674-4382-88be-5cd2b02f793e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:21.784573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e132e886-221a-406a-b0b5-61eb3562f3da req-703b5ae0-c674-4382-88be-5cd2b02f793e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:21.794798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:21.804016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a900b2a8-8961-447b-a546-20ee4a7451f6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1210 microversion: 2.1 time: 1.075348 Nov 20 20:50:21.804731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 700/1459] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:20 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1210 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:21.825368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e132e886-221a-406a-b0b5-61eb3562f3da req-703b5ae0-c674-4382-88be-5cd2b02f793e service nova] Creating event network-vif-plugged:77ea4b8e-7206-4f77-ab0e-0eabb045363e for instance ff08833c-234f-4d62-a1a1-b0137fa38bdf on nch2-master-1 Nov 20 20:50:21.826627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:21.827416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:21.838821 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e132e886-221a-406a-b0b5-61eb3562f3da req-703b5ae0-c674-4382-88be-5cd2b02f793e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092178 Nov 20 20:50:21.840557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:21.848635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:21.850092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:21.850776 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 760/1460] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:21.854767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:21.860307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:21.861851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:21.879946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:21.880409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:21.886123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:21.886594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:22.529697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:22.543822 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49a91934-2815-462b-b915-f5eccf3a1a7c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1388 microversion: 2.1 time: 0.736791 Nov 20 20:50:22.551388 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 701/1461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:21 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1388 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:22.557108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:22.557959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:22.575117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:22.577751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:22.579204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:22.582636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:22.786733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:22.799581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e445e164-c928-4a82-9dc0-f374c19b5f13 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1302 microversion: 2.1 time: 0.246683 Nov 20 20:50:22.809309 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 702/1462] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:22 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:22.820940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:22.824772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:22.848068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:22.848539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:22.849357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:22.849794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.068862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:23.088477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:23.090183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:23.095890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82712d44-ac85-4f58-9dbf-26fff4f9c86c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 1.243223 Nov 20 20:50:23.106280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 761/1463] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:21 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:23.111373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:23.120658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:23.147816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.148277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.149096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.149537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.287564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:23.295910 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd860de5-6f6a-43d3-9ba5-690344db2646 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.494680 Nov 20 20:50:23.298863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 703/1464] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:22 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:23.305287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:23.305840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:23.332132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.332806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.333772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.334424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.687105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:23.696759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1968b781-0f1a-4ede-ac9e-940113be258b tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.396612 Nov 20 20:50:23.703997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 704/1465] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:23 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:23.708708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:23.709317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:23.733373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.736246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:23.739148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:23.739809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.335342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:24.354945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-edfad6d6-bb81-405d-a291-414e38513ec7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.646265 Nov 20 20:50:24.368291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 705/1466] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:23 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:24.386708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:24.394697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:24.409402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.413001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.415553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.419113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.602515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:24.611986 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-531870aa-0831-4ed6-9309-31543732afab tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 200 len: 1506 microversion: 2.1 time: 1.504394 Nov 20 20:50:24.615172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 762/1467] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:23 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 1506 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:24.620823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9bb8e215-f74c-4f59-80eb-15b64d10d735 req-efde49ae-b5f9-486b-b434-b7b0da708334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534bb292-6e42-4114-ae6a-3b608f41a28e", "tag": "119afa00-1f53-43e0-901d-bb72b2a68f15"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:24.622800 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:24.622800 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:24.659539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9bb8e215-f74c-4f59-80eb-15b64d10d735 req-efde49ae-b5f9-486b-b434-b7b0da708334 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.661472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9bb8e215-f74c-4f59-80eb-15b64d10d735 req-efde49ae-b5f9-486b-b434-b7b0da708334 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.700108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9bb8e215-f74c-4f59-80eb-15b64d10d735 req-efde49ae-b5f9-486b-b434-b7b0da708334 service nova] Creating event network-changed:119afa00-1f53-43e0-901d-bb72b2a68f15 for instance 534bb292-6e42-4114-ae6a-3b608f41a28e on nch2-master-1 Nov 20 20:50:24.712198 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9bb8e215-f74c-4f59-80eb-15b64d10d735 req-efde49ae-b5f9-486b-b434-b7b0da708334 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092546 Nov 20 20:50:24.712858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 763/1468] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:24.724730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:24.725427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:24.740976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:24.742206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.742648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.747327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.747786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.748897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1bcf683-27a9-40d7-8318-9f14a91a9462 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1587 microversion: 2.1 time: 0.377784 Nov 20 20:50:24.767756 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 706/1469] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:24 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1587 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:24.774725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:24.786028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:24.798906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.800315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:24.803735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:24.804392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.175116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.192044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52f31bd6-a50d-4e7d-91d5-d35895477856 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1290 microversion: 2.1 time: 0.474053 Nov 20 20:50:25.193292 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 764/1470] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:24 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1290 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:25.199199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:25.206229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:25.216354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.219030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.221796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.224402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.225037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.230944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.233881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.235250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0222d190-5f41-47f8-9e52-95328c0ed439 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.466382 Nov 20 20:50:25.241385 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 707/1471] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:24 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:25.256324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:25.257558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:25.274822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.275813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.277099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.278024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.322994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:25.455847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50ce5198-6fc5-42ce-aaa9-e577acc8a439 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 204 len: 0 microversion: 2.1 time: 0.211744 Nov 20 20:50:25.457154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 708/1472] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:25 2021] DELETE /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:25.463428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:25.464477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:25.473265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.474116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.481010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.482780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.806806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.818640 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb522805-17aa-4154-9b2e-a70b4ab9a889 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.623168 Nov 20 20:50:25.819908 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 765/1473] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:25 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:25.835404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:25.836206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:25.847963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.849384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.854601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.857593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.919344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:25.928240 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c1888d9-0cb3-4bea-803f-56e1f451712e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.469545 Nov 20 20:50:25.928988 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 709/1474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:25 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:25.933636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d6af4290-f753-4d11-a672-bebd23cf433d req-1709466e-cae6-4940-8b93-fbb243e6df6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2454f21-9e06-4ec7-b8d6-656dbdf82c6d", "tag": "997e2cdb-8714-4ff9-a19c-d31c70dd0494"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:25.935979 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:25.935979 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:25.944668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d6af4290-f753-4d11-a672-bebd23cf433d req-1709466e-cae6-4940-8b93-fbb243e6df6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.945410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d6af4290-f753-4d11-a672-bebd23cf433d req-1709466e-cae6-4940-8b93-fbb243e6df6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.960082 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d6af4290-f753-4d11-a672-bebd23cf433d req-1709466e-cae6-4940-8b93-fbb243e6df6e service nova] Creating event network-changed:997e2cdb-8714-4ff9-a19c-d31c70dd0494 for instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d on nch1-master-1 Nov 20 20:50:25.965471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d6af4290-f753-4d11-a672-bebd23cf433d req-1709466e-cae6-4940-8b93-fbb243e6df6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035073 Nov 20 20:50:25.969871 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 710/1475] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:25.981682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:25.984716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:25.992604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.993119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:25.993975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:25.994446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:26.142260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0f7f1d2-5109-478c-bbce-f34c694f2cab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.320722 Nov 20 20:50:26.143592 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 766/1476] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:50:25 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/os-interface => generated 284 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:26.151885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-360209266", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "f82a7818-62f9-41df-8e59-1f9bb434e3d7"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:26.261229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] validate_networks() for [('f82a7818-62f9-41df-8e59-1f9bb434e3d7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:26.276700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:26.285116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df2d6eb0-a089-4cee-b2c7-62bd3a948b79 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.312740 Nov 20 20:50:26.291229 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 711/1477] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:25 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:26.299201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:26.299822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:26.322168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:26.324741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:26.328696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:26.330616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:26.756804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:26.768437 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb1e2c11-0b51-474a-95bd-f7e7fa9b9bd0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.476017 Nov 20 20:50:26.769564 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 712/1478] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:26 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:26.775292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:26.776454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:26.787804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:26.788685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:26.790910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:26.791679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:27.545971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:27.558590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:27.561475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:27.562773 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5473b939-61cd-4fc7-977c-31a26a1dc82e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.791732 Nov 20 20:50:27.574552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 713/1479] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:26 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:27.580094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:27.580718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:27.588907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:27.589135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:27.590002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:27.590483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:27.951083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:27.974110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da8b09bf-12a3-4ae4-8602-f7bff2a2fe0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.397655 Nov 20 20:50:27.975257 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 714/1480] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:27 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:27.982362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:27.983689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:27.992067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:27.992746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:27.993538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:27.993969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.131486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:28.132476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:28.133081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:28.133488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:28.134722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:28.148831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.148831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.149592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.150042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.174936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:28.179444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Getting quotas for user 49baaf06032347a1bcf476aa84043eeb and project 1b0c2ea7352848dcbb0c66efff699f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:28.192361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:28.195704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:28.253795 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5220b3df-f661-4c43-bf7f-22a6bf098a28 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106958 Nov 20 20:50:28.255665 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 767/1481] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:50:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:50:28.266029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:28.268611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:28.279774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.280231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.281158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.281634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.332841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:28.340159 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7b7409b-fb67-4b51-aa4b-448f0f9654f9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.363684 Nov 20 20:50:28.350066 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 715/1482] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:27 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:28.352492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:28.353115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:28.358992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.359448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.361629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.362316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.789546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:28.806069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b824a983-9af3-4587-bec8-7725e95f5cd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.549034 Nov 20 20:50:28.809152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 768/1483] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:28 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:28.823417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7eb93e40-aad2-4e96-bbbb-d907356ad80a req-a435b0c5-450a-4d6d-9ee1-c1f3062bd50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a604335-3c5c-46dd-879c-5f0d49092a58", "name": "network-vif-plugged", "status": "completed", "tag": "b8360b4c-cbee-4afe-816b-338cc6a81f67"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:28.828719 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:28.828719 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:28.850390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7eb93e40-aad2-4e96-bbbb-d907356ad80a req-a435b0c5-450a-4d6d-9ee1-c1f3062bd50c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.851504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7eb93e40-aad2-4e96-bbbb-d907356ad80a req-a435b0c5-450a-4d6d-9ee1-c1f3062bd50c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.872963 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7eb93e40-aad2-4e96-bbbb-d907356ad80a req-a435b0c5-450a-4d6d-9ee1-c1f3062bd50c service nova] Creating event network-vif-plugged:b8360b4c-cbee-4afe-816b-338cc6a81f67 for instance 0a604335-3c5c-46dd-879c-5f0d49092a58 on nch1-master-1 Nov 20 20:50:28.880047 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7eb93e40-aad2-4e96-bbbb-d907356ad80a req-a435b0c5-450a-4d6d-9ee1-c1f3062bd50c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067822 Nov 20 20:50:28.880942 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 769/1484] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:28.886935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c22f6b5f-b4dc-4084-8ecd-004cb827a851 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:28.887921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c22f6b5f-b4dc-4084-8ecd-004cb827a851 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:28.911119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:28.920936 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60ddaf21-3385-451c-8dc6-8ca414eee0c4 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.570635 Nov 20 20:50:28.921556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 716/1485] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:28 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:28.937296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:28.937935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:28.959328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.959992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.960552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:28.960978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:28.979196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c22f6b5f-b4dc-4084-8ecd-004cb827a851 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:28.989006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c22f6b5f-b4dc-4084-8ecd-004cb827a851 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1217 microversion: 2.1 time: 0.106733 Nov 20 20:50:28.999011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 770/1486] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:28 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:29.004406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7c13fc7a-1284-4c04-b31b-c6f7b51e1136 req-63ddfa23-a364-4d47-98d2-f682b491b455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "743798f2-3de6-473a-b676-6226a4b9ebba", "name": "network-vif-deleted", "tag": "701e9eed-1ec3-47ff-a1de-75bfa89aefd7"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:29.006316 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:29.006316 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:29.026904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7c13fc7a-1284-4c04-b31b-c6f7b51e1136 req-63ddfa23-a364-4d47-98d2-f682b491b455 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.033175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7c13fc7a-1284-4c04-b31b-c6f7b51e1136 req-63ddfa23-a364-4d47-98d2-f682b491b455 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.052871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7c13fc7a-1284-4c04-b31b-c6f7b51e1136 req-63ddfa23-a364-4d47-98d2-f682b491b455 service nova] Creating event network-vif-deleted:701e9eed-1ec3-47ff-a1de-75bfa89aefd7 for instance 743798f2-3de6-473a-b676-6226a4b9ebba on nch2-master-1 Nov 20 20:50:29.059641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7c13fc7a-1284-4c04-b31b-c6f7b51e1136 req-63ddfa23-a364-4d47-98d2-f682b491b455 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059002 Nov 20 20:50:29.061089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 771/1487] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:29.068133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:29.069351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:29.081443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.084787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.085909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.088011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.153084 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-262e7a44-5884-4180-92e7-480eb5be875a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.090077 Nov 20 20:50:29.158402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 772/1488] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:29 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:29.165980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:29.169177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:29.197309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.197763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.198602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.199048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.242890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:29.256920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:29.258449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:29.259576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7ba1535-98e8-4d50-a4f3-fe2aac31059b tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.331578 Nov 20 20:50:29.260154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 717/1489] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:28 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:29.290370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-12447006-ba1f-43e3-9f0a-15ba10de9e99 req-b5f9156b-7690-45a9-8922-c8d83aff4528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899d7fb-aca6-4434-9fbc-f7874d362f4a", "tag": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:29.295185 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:29.295185 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:29.324815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-12447006-ba1f-43e3-9f0a-15ba10de9e99 req-b5f9156b-7690-45a9-8922-c8d83aff4528 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.326106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-12447006-ba1f-43e3-9f0a-15ba10de9e99 req-b5f9156b-7690-45a9-8922-c8d83aff4528 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.359025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-12447006-ba1f-43e3-9f0a-15ba10de9e99 req-b5f9156b-7690-45a9-8922-c8d83aff4528 service nova] Creating event network-changed:a8a6b63d-5947-43c3-a9e3-80cd19d532a8 for instance e899d7fb-aca6-4434-9fbc-f7874d362f4a on nch2-master-1 Nov 20 20:50:29.374494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-12447006-ba1f-43e3-9f0a-15ba10de9e99 req-b5f9156b-7690-45a9-8922-c8d83aff4528 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094766 Nov 20 20:50:29.377028 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 718/1490] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:29.391785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:29.395949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:29.415881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.416340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.421928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.424879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.655996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:29.664725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6ac89c0-ffb7-4a48-b9f0-c876aa425e88 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.285524 Nov 20 20:50:29.670187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 719/1491] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:29 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:29.671690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:29.681915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'create', calling method: .version_select at 0x7f3f877984c0>, body: {"keypair": {"name": "tempest-keypair-1798325691"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:29.685154 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ac9aa34-c290-4628-8948-b0ffff1bdeba tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1292 microversion: 2.1 time: 0.525041 Nov 20 20:50:29.694143 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 773/1492] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:29 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1292 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:29.705283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for project ee4ec8b62e354149acb1c43558b168e6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:29.710905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for user dbb40fc2fdc4462bb4abaaf926c7b675 and project ee4ec8b62e354149acb1c43558b168e6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:29.826025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:29.826987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:29.834613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.835459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.836498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.837178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.873157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for project ee4ec8b62e354149acb1c43558b168e6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:29.877877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for user dbb40fc2fdc4462bb4abaaf926c7b675 and project ee4ec8b62e354149acb1c43558b168e6. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:29.896173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6059cfe-8669-4256-acaa-e996b6802260 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.224465 Nov 20 20:50:29.897546 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 720/1493] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 20:50:29 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:50:29.938154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:29.939362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:29.946035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.946542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:29.947344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:29.949760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.152875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.164550 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-110efffd-cd05-40af-8478-9fbb05c89976 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.341905 Nov 20 20:50:30.165488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 774/1494] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:29 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:30.171730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:30.172781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:30.199137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.201515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.203597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.205381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.237893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.253756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1cb33b73-466d-45cc-a623-cff17a78b833 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.315563 Nov 20 20:50:30.265705 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 721/1495] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:29 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:30.277319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:30.278287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:30.287348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.288162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.289338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.289951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.333541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2ccd721-dbe5-4c0a-9fc1-21ca7832a7cc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.063469 Nov 20 20:50:30.334645 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 722/1496] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:30 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:30.340282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:30.341431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:30.349917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.350409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.351201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.351631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.370008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.379849 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc6f66c0-1c41-469b-b978-c99b62cbd9da tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1287 microversion: 2.1 time: 0.212830 Nov 20 20:50:30.384084 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 775/1497] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:30 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:30.519562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.531732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.537373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:30.538693 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a1857169-b03e-4e04-8a1f-399f4223328d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.202427 Nov 20 20:50:30.548768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 723/1498] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:30 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:30.686580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:30.687246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:30.695963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.697710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.697710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.702425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:30.703280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:30.710720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.713730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.714232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:30.716077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:30.716077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.013952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:31.025984 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6fd49e4-5792-495a-b86f-24b9914364d7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1481 microversion: 2.1 time: 0.327072 Nov 20 20:50:31.040518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 724/1499] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:30 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1481 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:31.048561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:31.049334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.057321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.058129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.059847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.062225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.074207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:31.092822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33bd58d9-c726-4da5-bd46-3367d9e1757f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1475 microversion: 2.1 time: 0.411378 Nov 20 20:50:31.104547 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 776/1500] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:30 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1475 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:31.119941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3de66b02-7f0d-4bfb-8da1-59b581003707 req-805cdec5-e68b-499f-9300-e6d925701f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff08833c-234f-4d62-a1a1-b0137fa38bdf", "tag": "77ea4b8e-7206-4f77-ab0e-0eabb045363e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:31.127917 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:31.127917 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:31.137184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3de66b02-7f0d-4bfb-8da1-59b581003707 req-805cdec5-e68b-499f-9300-e6d925701f71 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.138285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3de66b02-7f0d-4bfb-8da1-59b581003707 req-805cdec5-e68b-499f-9300-e6d925701f71 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.154435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3de66b02-7f0d-4bfb-8da1-59b581003707 req-805cdec5-e68b-499f-9300-e6d925701f71 service nova] Creating event network-changed:77ea4b8e-7206-4f77-ab0e-0eabb045363e for instance ff08833c-234f-4d62-a1a1-b0137fa38bdf on nch2-master-1 Nov 20 20:50:31.161719 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3de66b02-7f0d-4bfb-8da1-59b581003707 req-805cdec5-e68b-499f-9300-e6d925701f71 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053193 Nov 20 20:50:31.164019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 777/1501] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:50:31.188199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-376f3e0e-0d98-47fb-9e7b-0b1d58e9c8e2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145266 Nov 20 20:50:31.189586 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 725/1502] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:50:31 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:31.191317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:31.192127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.200520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.201042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.202534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.203283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.271865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:31.273096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.290039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.295537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.297102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.298769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.418535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:31.430912 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6bcbf44-e0d0-4baa-bd14-b53f116cf59d tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.247189 Nov 20 20:50:31.441761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 778/1503] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:31 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:31.448831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:31.449749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.457471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.457913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.458931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.459363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.514922 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95b8d1f9-2a90-47e3-8233-27cbc2f78f3c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.070012 Nov 20 20:50:31.516205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 779/1504] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:31 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:31.523997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:31.525170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.534344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.535179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.536133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.537332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.847885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:31.855678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1dede8b2-11b9-4c0e-9a47-901b48039290 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.337969 Nov 20 20:50:31.856272 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 780/1505] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:31 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:31.862200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:31.862727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:31.869466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.869915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:31.870755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:31.871194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.234888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.243503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36276215-d2f0-46e7-8265-e6d5ff73a133 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.976430 Nov 20 20:50:32.245084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 726/1506] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:31 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:32.250656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:32.251642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:32.258096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.258632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.259666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.260192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.531613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.546537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.550032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.552072 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dbe97046-ad0c-4b50-92ef-e89866edb5ee tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.694863 Nov 20 20:50:32.553622 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 781/1507] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:31 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:32.559331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:32.560004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:32.566765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.567505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.568763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.569659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.785647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.802440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f99d8439-eccc-44c5-9a10-cd0a31d592b5 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1474 microversion: 2.1 time: 0.555811 Nov 20 20:50:32.810837 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 727/1508] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:32 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:32.818437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:32.819487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:32.832197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.832654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.833460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.834105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.895485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-adb150b7-a206-4881-988c-ee39498bc968 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.076543 Nov 20 20:50:32.898686 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 728/1509] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:32 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:32.909708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:32.912476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:32.925473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.926257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.928153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:32.928746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:32.960948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:32.968100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36866be7-747f-4d2c-b154-315f06d4088b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.413050 Nov 20 20:50:32.974684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 782/1510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:32 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:33.129281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9afd4755-c853-455c-a892-69540a7ec64f req-a481d700-b57e-413b-8512-95acaa0512e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534bb292-6e42-4114-ae6a-3b608f41a28e", "name": "network-vif-plugged", "status": "completed", "tag": "119afa00-1f53-43e0-901d-bb72b2a68f15"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:33.130887 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:33.130887 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:33.151470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9afd4755-c853-455c-a892-69540a7ec64f req-a481d700-b57e-413b-8512-95acaa0512e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.151912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9afd4755-c853-455c-a892-69540a7ec64f req-a481d700-b57e-413b-8512-95acaa0512e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.182970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9afd4755-c853-455c-a892-69540a7ec64f req-a481d700-b57e-413b-8512-95acaa0512e3 service nova] Creating event network-vif-plugged:119afa00-1f53-43e0-901d-bb72b2a68f15 for instance 534bb292-6e42-4114-ae6a-3b608f41a28e on nch2-master-1 Nov 20 20:50:33.187868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9afd4755-c853-455c-a892-69540a7ec64f req-a481d700-b57e-413b-8512-95acaa0512e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062267 Nov 20 20:50:33.188768 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 783/1511] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:50:33.195621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-unplugged", "status": "completed", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:33.197328 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:33.197328 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:33.213094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.214015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.249724 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] Creating event network-vif-unplugged:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch2-master-1 Nov 20 20:50:33.263670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] Instance 4617c7fc-1747-4fc8-b17e-023944473df9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:50:33.300502 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d19c1531-4f06-45d3-8d55-640055cddfcd req-1713371a-1e9b-481f-86be-ae73d7fb0d87 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108455 Nov 20 20:50:33.301673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 784/1512] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:33.310448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:33.311639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:33.321219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.321912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.324164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.328767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.567266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:33.589791 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-23cc50a7-da76-48c2-88f3-734edf27f11f tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.689424 Nov 20 20:50:33.591784 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 729/1513] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:32 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:33.604910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:33.606011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:33.621457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.625203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.627288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.628938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.765868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:33.777767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b22a76e8-edfd-48ee-bfff-76ecc9028cf2 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.474627 Nov 20 20:50:33.778644 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 785/1514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:33 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:33.827422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:33.828490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:33.836906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.837929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.839039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:33.839815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:33.993420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.033885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.038626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.041173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-558ab03f-3e2e-41dd-8b5e-f3412ed4286f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1281 microversion: 2.25 time: 0.447429 Nov 20 20:50:34.043003 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 730/1515] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:33 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:34.049173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:34.050510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:34.065969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.074661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.075989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.076611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.134975 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05aa9476-3a7e-4871-adcd-117287bca107 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.090216 Nov 20 20:50:34.136070 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 731/1516] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:34 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:34.141514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:34.142191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:34.149244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.149694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.150507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.150934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.228197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.240254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffe52ca3-27c4-41e8-bc9f-df343becc596 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1474 microversion: 2.1 time: 0.418721 Nov 20 20:50:34.241214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 786/1517] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:33 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1474 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:34.608356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:34.609049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:34.627576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.628538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.629570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.630362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.717061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.727782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd0a055c-d73b-428f-88a5-1c86b8ad7848 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.589495 Nov 20 20:50:34.728725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 732/1518] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:34 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:34.734825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:34.736975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:34.744538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.745343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.746383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.748887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.799940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0876d235-147e-47d3-affd-8cb4c616e23e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.067500 Nov 20 20:50:34.803431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 733/1519] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:34 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:34.814273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e2789f24-e9f0-4f62-9e1e-ec9af312c8de req-0170e3a3-ebc6-4402-bf51-78e636c68b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a604335-3c5c-46dd-879c-5f0d49092a58", "tag": "b8360b4c-cbee-4afe-816b-338cc6a81f67"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:34.820191 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:34.820191 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:34.839914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e2789f24-e9f0-4f62-9e1e-ec9af312c8de req-0170e3a3-ebc6-4402-bf51-78e636c68b2c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.845917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e2789f24-e9f0-4f62-9e1e-ec9af312c8de req-0170e3a3-ebc6-4402-bf51-78e636c68b2c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.870434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:34.873800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e2789f24-e9f0-4f62-9e1e-ec9af312c8de req-0170e3a3-ebc6-4402-bf51-78e636c68b2c service nova] Creating event network-changed:b8360b4c-cbee-4afe-816b-338cc6a81f67 for instance 0a604335-3c5c-46dd-879c-5f0d49092a58 on nch1-master-1 Nov 20 20:50:34.880429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0169c15-e276-41ab-a776-3fb7156a3498 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.275640 Nov 20 20:50:34.894148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e2789f24-e9f0-4f62-9e1e-ec9af312c8de req-0170e3a3-ebc6-4402-bf51-78e636c68b2c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088650 Nov 20 20:50:34.898612 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 734/1520] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:34.906735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:34.907712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:34.909148 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 787/1521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:34 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:50:34.916491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.917057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:34.918208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:34.918797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.007611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-904745333", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "faba2177-d247-4737-8414-396da08b9b04"}, {"port": "d62e09bc-0a07-428d-96cb-5ce7f5c99f7f", "tag": "port-1"}, {"port": "39839f43-d46e-414e-93c9-a7955f617fd1", "tag": "port-2"}, {"uuid": "d6af962d-f566-43ad-aacb-a9c0f2bc8121", "tag": "net-1"}, {"uuid": "d6af962d-f566-43ad-aacb-a9c0f2bc8121"}, {"uuid": "9ab96eba-b67e-47c5-9f2b-383d74c4c2ec", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9ab96eba-b67e-47c5-9f2b-383d74c4c2ec", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "506c87e8-8c5a-4446-b990-9916d5078cd5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c3e7b33d-1239-466a-aa16-3ff43c1eea01", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "71143215-11e7-4aed-8258-31185f04987e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1700050081"}], "key_name": "tempest-keypair-1798325691", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:35.139964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:35.148943 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12dc7b4e-4129-469f-8045-9fe74a150eef tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.247602 Nov 20 20:50:35.149524 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 735/1522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:34 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:35.154486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:35.155272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:35.161959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.162423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.163397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.163826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.231984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] validate_networks() for [('faba2177-d247-4737-8414-396da08b9b04', None, None, None, None, None), (None, None, 'd62e09bc-0a07-428d-96cb-5ce7f5c99f7f', None, None, None), (None, None, '39839f43-d46e-414e-93c9-a7955f617fd1', None, None, None), ('d6af962d-f566-43ad-aacb-a9c0f2bc8121', None, None, None, None, None), ('d6af962d-f566-43ad-aacb-a9c0f2bc8121', None, None, None, None, None), ('9ab96eba-b67e-47c5-9f2b-383d74c4c2ec', '10.2.2.100', None, None, None, None), ('9ab96eba-b67e-47c5-9f2b-383d74c4c2ec', '10.2.2.200', None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:50:35.324345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:35.333278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:35.334803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:35.335978 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83cf4978-066b-4a97-9a7a-6de5303175f4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1477 microversion: 2.25 time: 0.185332 Nov 20 20:50:35.336544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 736/1523] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:35 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:35.341079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:35.342068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:35.349271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.349754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.350588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.351118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.401591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95c9d5cc-8299-4063-b54c-b5b758f1e31a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.063472 Nov 20 20:50:35.402707 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 737/1524] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:35 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:35.409317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-536fe905-1cb7-4c91-b37d-8d244a6f4c2d req-e15235aa-8a30-492d-8635-6f6d5abc4fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2454f21-9e06-4ec7-b8d6-656dbdf82c6d", "name": "network-vif-plugged", "status": "completed", "tag": "997e2cdb-8714-4ff9-a19c-d31c70dd0494"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:35.410886 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:35.410886 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:35.418441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-536fe905-1cb7-4c91-b37d-8d244a6f4c2d req-e15235aa-8a30-492d-8635-6f6d5abc4fc3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.418880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-536fe905-1cb7-4c91-b37d-8d244a6f4c2d req-e15235aa-8a30-492d-8635-6f6d5abc4fc3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.439158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-536fe905-1cb7-4c91-b37d-8d244a6f4c2d req-e15235aa-8a30-492d-8635-6f6d5abc4fc3 service nova] Creating event network-vif-plugged:997e2cdb-8714-4ff9-a19c-d31c70dd0494 for instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d on nch1-master-1 Nov 20 20:50:35.443925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-536fe905-1cb7-4c91-b37d-8d244a6f4c2d req-e15235aa-8a30-492d-8635-6f6d5abc4fc3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039785 Nov 20 20:50:35.444527 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 738/1525] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:35.450166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:35.451422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:35.458685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.459133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.460078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.460529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.675571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:35.683316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a951e2d6-d8bc-4da3-b3ca-97269a6fd98f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1472 microversion: 2.1 time: 0.237461 Nov 20 20:50:35.684190 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 739/1526] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:35 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:35.689493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c4c45e-b6d1-4618-9248-f81c093cd761", "tag": "9fffb655-560d-495c-b4cb-728592a93b09"}, {"name": "network-changed", "server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:35.691371 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:35.691371 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:35.700521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.700965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.715730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Creating event network-changed:9fffb655-560d-495c-b4cb-728592a93b09 for instance 29c4c45e-b6d1-4618-9248-f81c093cd761 on nch1-master-1 Nov 20 20:50:35.716238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Creating event network-changed:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch2-master-1 Nov 20 20:50:35.723804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] Instance 4617c7fc-1747-4fc8-b17e-023944473df9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:50:35.736483 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-617ad2f7-37e7-4790-9705-308f1f19e4cf req-0a5b0374-0117-4182-b315-725cdaa33678 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049878 Nov 20 20:50:35.737248 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 740/1527] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:35 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:35.743686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:35.744317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:35.754109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.754539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.755363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.755778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.934955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 534bb292-6e42-4114-ae6a-3b608f41a28e {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:35.960907 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa641c2b-21f9-4128-9942-c450a5de5066 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1970 microversion: 2.25 time: 0.222469 Nov 20 20:50:35.961749 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 741/1528] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:35 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1970 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:35.966105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:35.966713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:35.974802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.975249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:35.976041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:35.976466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.253996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:36.269647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a205a335-3401-4dc9-afb6-0f906a461fd7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1198 microversion: 2.1 time: 0.306809 Nov 20 20:50:36.271371 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 742/1529] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:35 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1198 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:36.277069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:36.278983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:36.287766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.288487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.289474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.290003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.338707 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbef7bfa-7439-4c34-a8ff-77333f3f2f88 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.061437 Nov 20 20:50:36.340293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 743/1530] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:36 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:36.348426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:36.350254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:36.358891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.359287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.361080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.361614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.612024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:36.619964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4e7164d-7dd0-44ae-ab6f-56fb008a7a1c tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.278293 Nov 20 20:50:36.620548 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 744/1531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:36 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:36.627005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:36.627621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:36.634006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.634495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.635293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.635726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.869195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 534bb292-6e42-4114-ae6a-3b608f41a28e {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:36.903195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7ac6a50-30bc-47fe-90c2-65048940770d tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1970 microversion: 2.25 time: 0.281587 Nov 20 20:50:36.916317 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 745/1532] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:36 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1970 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:36.919539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:36.920162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:36.928145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.929569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:36.930424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:36.932245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.163803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:37.171904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43a6be68-f3dd-4295-abfd-f3a780f6347b tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.258932 Nov 20 20:50:37.181223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 746/1533] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:36 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:37.181223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:37.181223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.184867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.185419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.186357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.186906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.225993 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9cc35618-1fe1-4166-a8e3-a212a5e98419 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 14 microversion: 2.1 time: 0.051355 Nov 20 20:50:37.226702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 747/1534] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:37 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:37.232067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:37.232573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.238902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.239718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.240131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.240556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.445534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:37.453655 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82802ce5-e95f-4697-81fe-1f1159bcdb65 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1469 microversion: 2.1 time: 0.225269 Nov 20 20:50:37.458106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 748/1535] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:37 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:37.460102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:37.461452 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:37.461452 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:37.462986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.463432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.464709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.464709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.489366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0f2e974-1d28-44f9-9a22-a3f54a82433c tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033572 Nov 20 20:50:37.489975 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 749/1536] 10.222.0.41 () {60 vars in 1216 bytes} [Sat Nov 20 20:50:37 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:37.494662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:37.495273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.501760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.502247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.503025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.503461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.638968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:37.647537 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6fc97725-21e3-4cf0-bc95-a02c2018fb41 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1380 microversion: 2.1 time: 0.156584 Nov 20 20:50:37.648113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 750/1537] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:37 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1380 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:37.652417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:37.653365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.659900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.660708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.661498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.661930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.707357 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-efadd1b0-3a3a-483f-bbab-b19575cd4ea8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.058007 Nov 20 20:50:37.711226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 751/1538] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:37 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:37.713343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6ef4dbfa-5dd6-48be-af54-b7047f61d1ed req-15bc16b6-d2a2-49ee-85f7-779a0b019228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899d7fb-aca6-4434-9fbc-f7874d362f4a", "name": "network-vif-plugged", "status": "completed", "tag": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:37.714857 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:37.714857 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:37.723120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6ef4dbfa-5dd6-48be-af54-b7047f61d1ed req-15bc16b6-d2a2-49ee-85f7-779a0b019228 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.723523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6ef4dbfa-5dd6-48be-af54-b7047f61d1ed req-15bc16b6-d2a2-49ee-85f7-779a0b019228 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.735641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6ef4dbfa-5dd6-48be-af54-b7047f61d1ed req-15bc16b6-d2a2-49ee-85f7-779a0b019228 service nova] Creating event network-vif-plugged:a8a6b63d-5947-43c3-a9e3-80cd19d532a8 for instance e899d7fb-aca6-4434-9fbc-f7874d362f4a on nch2-master-1 Nov 20 20:50:37.740885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6ef4dbfa-5dd6-48be-af54-b7047f61d1ed req-15bc16b6-d2a2-49ee-85f7-779a0b019228 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031072 Nov 20 20:50:37.741689 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 752/1539] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:37.746555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:37.747164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.754404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.754618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.755408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.755844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.873050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-388cb364-aede-43e6-818f-38ee33b667a1 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "POST /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9/action" status: 202 len: 0 microversion: 2.1 time: 0.130054 Nov 20 20:50:37.874556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 753/1540] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:37 2021] POST /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:50:37.879966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:37.881519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:37.887456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.887897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.888678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:37.891632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:37.921036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'flavor' on Instance uuid 534bb292-6e42-4114-ae6a-3b608f41a28e {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:37.934852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Going to try to live migrate instance to nch1-master-1 {{(pid=140941) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:50:38.176986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:50:38.177465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:50:38.177901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:50:38.178360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:50:38.178773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:50:38.188193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.189614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:38.190467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.190906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:38.208904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for project ee4ec8b62e354149acb1c43558b168e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:50:38.212926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Getting quotas for user dbb40fc2fdc4462bb4abaaf926c7b675 and project ee4ec8b62e354149acb1c43558b168e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:50:38.388300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:50:38.391583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='506c87e8-8c5a-4446-b990-9916d5078cd5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c3e7b33d-1239-466a-aa16-3ff43c1eea01',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='71143215-11e7-4aed-8258-31185f04987e',volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:50:38.746540 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a65f863-0b88-449c-9d67-095ac873b205 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 3.743126 Nov 20 20:50:38.747304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 788/1541] 10.222.0.41 () {62 vars in 1188 bytes} [Sat Nov 20 20:50:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 3746 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 20 20:50:38.752081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:38.752879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:38.759102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.759545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:38.760336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.760770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:38.941849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:38.950589 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d588f16e-1f5b-4205-8ea6-8c3192f60e14 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.202046 Nov 20 20:50:38.952501 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 789/1542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:38 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:38.957591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:38.958237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:38.964499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.964961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:38.965760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:38.966246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.152900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4425082c-3418-4145-896f-f5fd24267f99 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1531 microversion: 2.1 time: 0.199342 Nov 20 20:50:39.159609 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 790/1543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:38 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1531 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:39.163996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.164595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.171069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.171729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.172507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.173432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.209414 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e21c3d05-9dff-49a4-9e8d-45d9f2b405b8 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e/action" status: 202 len: 0 microversion: 2.25 time: 1.333682 Nov 20 20:50:39.210132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 754/1544] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:50:37 2021] POST /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e/action => generated 0 bytes in 1335 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:39.215934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.217450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.227821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.228200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.231882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.232625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.339561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.349186 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06ea9cb3-eb9d-42f7-aa40-34028433c6ac tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1468 microversion: 2.1 time: 0.188513 Nov 20 20:50:39.349776 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 791/1545] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1468 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:39.354974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:39.355985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.364099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.364841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.365951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.366616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.413277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.420449 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c95c4973-01db-4e08-bbbe-bacefaeb9e8c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 8207 microversion: 2.1 time: 0.068899 Nov 20 20:50:39.421025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc6b3291-d381-4061-a6ed-d56515596e9e tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1332 microversion: 2.1 time: 0.209347 Nov 20 20:50:39.421712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 792/1546] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:39 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 8207 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:39.431166 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 755/1547] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:39.436410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.437294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.445086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:39.445241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.445866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.446945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.447638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.448676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.468504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.469391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.471116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.471685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.536575 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-236933ff-da95-4435-a1ea-0ff0d2962e94 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.110154 Nov 20 20:50:39.540360 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 793/1548] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:39 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:39.542447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.543273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.560089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.560539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.561351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.564194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.636253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.648925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.652655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.654325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-650cbbc7-543b-47d0-8b9e-35c3820260e7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1527 microversion: 2.42 time: 0.221650 Nov 20 20:50:39.655467 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 756/1549] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1527 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:39.661005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.662931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.673448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.674696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.681553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.682158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.726593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-519fa265-50db-4e70-94d8-edca1fe46dc3 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1531 microversion: 2.1 time: 0.187617 Nov 20 20:50:39.727614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 794/1550] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1531 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:39.744091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:39.746498 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:39.746498 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:39.748018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.748469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.749277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.749710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.775429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99840e43-a266-45f1-b325-5ccb26056dfd tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035191 Nov 20 20:50:39.776231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 795/1551] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:39.787793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:39.789967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:39.796131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.796665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.797598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:39.798137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:39.823900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lazy-loading 'flavor' on Instance uuid e2454f21-9e06-4ec7-b8d6-656dbdf82c6d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:39.838266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Going to try to live migrate instance to nch2-master-1 {{(pid=140942) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 20:50:39.977210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.985302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.987537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:39.989015 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9df7d42a-b63f-4ed3-a82b-008575ac190c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1487 microversion: 2.25 time: 0.332415 Nov 20 20:50:39.990947 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 757/1552] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:39 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1487 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:39.995746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3eb016b5-f30c-4650-8b44-3219bebaa6c5 req-019b204f-e055-4ed5-9b22-ee4d25041a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c4c45e-b6d1-4618-9248-f81c093cd761", "name": "network-vif-plugged", "status": "completed", "tag": "9fffb655-560d-495c-b4cb-728592a93b09"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:39.997470 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:39.997470 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:40.005291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3eb016b5-f30c-4650-8b44-3219bebaa6c5 req-019b204f-e055-4ed5-9b22-ee4d25041a4a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.006104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3eb016b5-f30c-4650-8b44-3219bebaa6c5 req-019b204f-e055-4ed5-9b22-ee4d25041a4a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.026901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3eb016b5-f30c-4650-8b44-3219bebaa6c5 req-019b204f-e055-4ed5-9b22-ee4d25041a4a service nova] Creating event network-vif-plugged:9fffb655-560d-495c-b4cb-728592a93b09 for instance 29c4c45e-b6d1-4618-9248-f81c093cd761 on nch1-master-1 Nov 20 20:50:40.031455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3eb016b5-f30c-4650-8b44-3219bebaa6c5 req-019b204f-e055-4ed5-9b22-ee4d25041a4a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039113 Nov 20 20:50:40.033109 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 758/1553] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:40.039423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:40.040921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:40.052458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.052904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.053796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.054224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.315824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:40.326931 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f13ba88f-2d31-417e-a35d-31ecae138b50 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1317 microversion: 2.1 time: 0.292409 Nov 20 20:50:40.327779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 759/1554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:40 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:40.368625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:40.370224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:40.378806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.379798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.380770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.381548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.694080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:40.702069 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50970f7e-c7a2-435c-9ad1-5ed8b683bba0 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1468 microversion: 2.1 time: 0.339250 Nov 20 20:50:40.706614 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 760/1555] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:40 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1468 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:40.721571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:40.734081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:40.750513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.751902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.754315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.755493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.827570 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e3aad78-fd8f-4488-9da8-4ff4db5d7a00 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 16320 microversion: 2.1 time: 0.119534 Nov 20 20:50:40.829435 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 761/1556] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:40 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 16320 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:40.837014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:40.838399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:40.856666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.857135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:40.861603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:40.862560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.369718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:41.381861 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f58e83f6-1ef1-475d-a7a8-f78b5960b715 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1536 microversion: 2.1 time: 0.550450 Nov 20 20:50:41.394813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 762/1557] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:40 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1536 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:41.400404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:41.401691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:41.416142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.417544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.418664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.419306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.484744 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7e6f1ea-343d-4f50-9e99-243370c4682b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.088522 Nov 20 20:50:41.486200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 763/1558] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:41 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:41.493633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:41.494368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:41.504597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.505310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.507261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.507873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.883916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:41.894935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:41.897167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:41.899409 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4df41487-9b15-4963-b647-ef2f0fc555f5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1593 microversion: 2.42 time: 0.411552 Nov 20 20:50:41.900915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 764/1559] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:41 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1593 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:41.908250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:41.908956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:41.919309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.919778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:41.921442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:41.922840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:42.055467 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95536572-9d2b-4b47-8d59-c14e29dfd00b tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d/action" status: 202 len: 0 microversion: 2.1 time: 2.271389 Nov 20 20:50:42.057654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 796/1560] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:39 2021] POST /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d/action => generated 0 bytes in 2275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:50:42.065026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:42.066574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:42.085063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:42.085771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:42.087582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:42.088198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:42.178078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:42.190261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:42.192215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:42.193621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-227f1de6-b179-4900-a4db-e5f435efd5fa tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1487 microversion: 2.25 time: 0.291740 Nov 20 20:50:42.194415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 765/1561] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:41 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1487 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:42.200238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7447d18e-3174-4465-b14c-c8ddbad8880f tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'create', calling method: .version_select at 0x7f3f8779f940>, body: {"pool": "a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:42.695136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:42.711578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-318b8979-85fa-454d-aa03-4c90ba1b64f3 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1506 microversion: 2.1 time: 0.652113 Nov 20 20:50:42.712402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 797/1562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:42 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:42.722993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:42.723899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:42.743557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:42.744012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:42.746405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:42.746855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:43.628392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:43.637821 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffe93ff8-f995-4570-96e0-a32df6ef480f tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1468 microversion: 2.1 time: 0.924201 Nov 20 20:50:43.643349 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 798/1563] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:42 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1468 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:43.654613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:43.657800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:43.675162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:43.678346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:43.679291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:43.679743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:43.751017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd5b42f1-e748-4f0a-af04-5e598db72a44 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 16320 microversion: 2.1 time: 0.105935 Nov 20 20:50:43.752299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 799/1564] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:43 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 16320 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:43.763442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-plugged", "status": "completed", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:43.779116 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:43.779116 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:43.807793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:43.809095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:43.849242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] Creating event network-vif-plugged:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:43.872102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] Instance 4617c7fc-1747-4fc8-b17e-023944473df9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:50:43.886584 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-61b72cb0-1234-4826-b2f6-7b1ef80ea4cd req-af77084e-8e41-4e73-a774-534a7012aad2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127177 Nov 20 20:50:43.888110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 800/1565] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:43.895452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:43.897859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:43.905905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:43.907855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:43.909245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:43.909804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.275918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:44.285938 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-496d183b-b4fd-42b5-9b43-b58541879072 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.396243 Nov 20 20:50:44.288858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 801/1566] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:43 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:44.305427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:44.308443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:44.321714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.323983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.327351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.328043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.405332 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9b28465-5207-46f6-9191-9dda06788850 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 14 microversion: 2.1 time: 0.112517 Nov 20 20:50:44.408794 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 802/1567] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:44 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:50:44.416864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-unplugged", "status": "completed", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:44.424775 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:44.424775 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:44.443763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.444462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.471183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] Creating event network-vif-unplugged:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:44.486478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] Instance 4617c7fc-1747-4fc8-b17e-023944473df9 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 20:50:44.516983 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5f8cff5d-e602-420a-bdf5-71cdf19e7c68 req-071318d2-fae1-439d-8fa8-08f6c956731a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106036 Nov 20 20:50:44.517599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 803/1568] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:44.533068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:44.533844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:44.549009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.549547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.550501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.551065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.831012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:44.841730 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c804642-2c47-4dde-92ae-0855d96e4298 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1506 microversion: 2.1 time: 0.322281 Nov 20 20:50:44.842490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 804/1569] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:44 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:44.847953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:44.849583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:44.856399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.857266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:44.858561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:44.859268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.104372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.118725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.122264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.124469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02c556be-74d2-41bd-9cde-400ea36324ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1708 microversion: 2.42 time: 0.280509 Nov 20 20:50:45.125400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 805/1570] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:44 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1708 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:45.134301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:45.136153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.153982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.155090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.156131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.156770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.336759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.350043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.352394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.353593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea074dbe-8556-46c0-903e-6919b56334fe tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1477 microversion: 2.25 time: 0.226888 Nov 20 20:50:45.354700 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 806/1571] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:45 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:45.359805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:45.360974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.369823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.370329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.371132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.371569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.511419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.521570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21643fa1-b708-414f-8060-c8925aed2194 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1468 microversion: 2.1 time: 0.165153 Nov 20 20:50:45.522400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 807/1572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:45 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:45.532513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:45.532513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.536055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.536512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.537311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.537800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.599501 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8a1b8fd-84cd-485d-9baf-9b48dd1eb69b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.075236 Nov 20 20:50:45.600274 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 808/1573] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:45 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:45.605712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:45.607053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.614578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.615027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.616058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.616498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.685000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94c35826-a930-4a14-a1c8-b42f8a7ef3c7 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "PUT /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1078 microversion: 2.1 time: 0.083418 Nov 20 20:50:45.685982 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 809/1574] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 20:50:45 2021] PUT /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1078 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:45.690713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:45.691559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.698412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.698866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.699667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.700112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.863994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:45.872832 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c06c759-ba62-46e5-8a12-c28570b9a5b6 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.185455 Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 810/1575] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:45 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac340962-d818-4a82-9383-29cdbc8c5539 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '.version_select at 0x7f3f86a0aee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac340962-d818-4a82-9383-29cdbc8c5539 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.883814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac340962-d818-4a82-9383-29cdbc8c5539 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.898438 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac340962-d818-4a82-9383-29cdbc8c5539 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 5309 microversion: 2.25 time: 0.023669 Nov 20 20:50:45.899335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 811/1576] 10.222.0.41 () {60 vars in 1183 bytes} [Sat Nov 20 20:50:45 2021] GET /compute/v2.1/os-migrations => generated 5309 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:45.911208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:45.912242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.918413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.918871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.919670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.920111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.973377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79ea11c5-8db3-4d87-9cc5-7249b3bc6686 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 8203 microversion: 2.1 time: 0.066244 Nov 20 20:50:45.975104 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 812/1577] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:45 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 8203 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:45.981501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:45.982386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:45.990149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.990602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:45.991547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:45.991988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.140250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.158603 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-16b3a1f2-157c-4dc3-b43e-88381cc23756 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1504 microversion: 2.1 time: 0.172590 Nov 20 20:50:46.158603 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 813/1578] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:45 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:46.162700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:46.163429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.170412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.170955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.171757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.172200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.306716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] Lazy-loading 'services' on Instance uuid 534bb292-6e42-4114-ae6a-3b608f41a28e {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:46.320289 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d87257a-755c-4d5e-9784-e00ffe129112 tempest-LiveAutoBlockMigrationV225Test-417514665 tempest-LiveAutoBlockMigrationV225Test-417514665-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1970 microversion: 2.25 time: 0.169105 Nov 20 20:50:46.320880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 814/1579] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:46 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1970 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:46.325096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:46.325695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.331581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.332063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.332852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.333348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.481082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.492709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.494280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.495462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a86501c-cba6-4294-aa34-7843195a1ea5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1696 microversion: 2.42 time: 0.173671 Nov 20 20:50:46.496046 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 815/1580] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:46 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:46.500579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:46.501351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.507221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.507862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.508669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.509103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.525917 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7447d18e-3174-4465-b14c-c8ddbad8880f tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.329133 Nov 20 20:50:46.527423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 766/1581] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:50:42 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:46.543379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:46.544184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.553144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.554233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.555270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.555934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.589716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:46.696402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d5e0f74-1ef3-4fcd-b5ed-e77c5b2899c5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 204 len: 0 microversion: 2.1 time: 0.166833 Nov 20 20:50:46.697501 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 767/1582] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:46 2021] DELETE /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:46.706163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:46.707809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.709652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.718786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.719392 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95d6d0ed-b5e4-44bf-a1a6-54ce0f385da5 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1504 microversion: 2.1 time: 0.222029 Nov 20 20:50:46.719709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.720732 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 816/1583] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:46 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:46.727337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.728994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.735402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: .version_select at 0x7f3f95ebcee0>, body: {"addFloatingIp": {"address": "172.35.1.26"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:46.737340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:46.743651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.744597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.745787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:46.747443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:46.823780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Acquired lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:50:46.957726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:46.988231 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d314ae21-d9e4-435d-96c3-f6c880d04dd7 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1468 microversion: 2.1 time: 0.285538 Nov 20 20:50:46.990728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 768/1584] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:46 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:47.000575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2b25ea4c-011e-44c2-b032-61f29f8f9006 req-a1cb6ed7-0aa9-4e31-bfc7-6ab55086574f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:47.006639 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:47.006639 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:47.016309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2b25ea4c-011e-44c2-b032-61f29f8f9006 req-a1cb6ed7-0aa9-4e31-bfc7-6ab55086574f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.016759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2b25ea4c-011e-44c2-b032-61f29f8f9006 req-a1cb6ed7-0aa9-4e31-bfc7-6ab55086574f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.037131 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2b25ea4c-011e-44c2-b032-61f29f8f9006 req-a1cb6ed7-0aa9-4e31-bfc7-6ab55086574f service nova] Creating event network-changed:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:47.041958 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2b25ea4c-011e-44c2-b032-61f29f8f9006 req-a1cb6ed7-0aa9-4e31-bfc7-6ab55086574f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046053 Nov 20 20:50:47.043112 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 769/1585] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:47.048902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:47.050215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:47.056825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.057548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.058561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.059161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.104655 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-189f1661-4df9-4dbf-b185-805103aff49b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.059667 Nov 20 20:50:47.106011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 770/1586] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:47 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:47.112564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:47.113507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:47.120909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.121615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.122636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.123232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.453386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:47.465106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1cf0fac-0351-491e-9841-5f81f7bb8dac tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1414 microversion: 2.1 time: 0.357420 Nov 20 20:50:47.475986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 771/1587] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:47 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1414 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:47.475986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:47.475986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:47.479905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.480347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.481320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.481747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.562791 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f8157f8-a552-4eaf-852b-f90cc7d05849 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "PUT /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1080 microversion: 2.1 time: 0.095490 Nov 20 20:50:47.564574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 772/1588] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 20:50:47 2021] PUT /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1080 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:47.569341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:47.570390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:47.577911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.578438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.579769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.580308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.955438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:47.964466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec2db9e5-fd0f-401c-84ca-ee207af3aca3 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.398710 Nov 20 20:50:47.965065 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 773/1589] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:47 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:47.978417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:47.979347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:47.988603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.989074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:47.989851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:47.992410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:48.073816 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e66ff614-942f-49e5-8710-8bbafe4f6c68 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 16397 microversion: 2.1 time: 0.107503 Nov 20 20:50:48.075061 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 774/1590] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:47 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 16397 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:48.080673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:48.081373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:48.088431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:48.088881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:48.089696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:48.090623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:48.430183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:50:48.568276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:48.605877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:48.611809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:48.615229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-468e2c08-fe3f-487a-8722-2be934821abe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1790 microversion: 2.42 time: 0.538966 Nov 20 20:50:48.615984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 775/1591] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:48 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1790 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:48.653850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:48.655219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:48.667850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:48.668770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:48.670414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:48.671620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.048578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:49.059922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52c9e1e7-1aa3-4ae0-b018-fbbb615b2963 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1506 microversion: 2.1 time: 0.424838 Nov 20 20:50:49.060858 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 776/1592] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:48 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:49.068184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:49.068984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.082374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.082821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.083824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.084423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.398297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Updating instance_info_cache with network_info: [{"id": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8", "address": "fa:16:3e:f5:a3:05", "network": {"id": "5bc0506e-bc72-485c-a0a7-48575db53d86", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1096424800-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2cfe248f7eb34f6e80937503e49fd3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8a6b63d-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:50:49.421477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Releasing lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:50:49.423840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3bf4766-bd57-4038-888d-2ed43e3fb8af tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 202 len: 0 microversion: 2.1 time: 2.701883 Nov 20 20:50:49.429391 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 817/1593] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:46 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 0 bytes in 2708 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:50:49.437171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:49.439319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.448694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.449495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.451133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.451839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.507325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c36f7e4-4127-4593-9eea-2a93123f3dd3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.074046 Nov 20 20:50:49.508997 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 818/1594] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:49 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:49.519225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:49.522491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.550128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.550890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.552097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.553270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.640890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:49.650919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76e3345b-1d16-44b5-9da6-5f572fb339de tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 200 len: 1372 microversion: 2.1 time: 0.140277 Nov 20 20:50:49.652193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 819/1595] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:49 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 1372 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:49.659899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c857ca80-4f49-4fce-8d63-44d3ed65ee7f req-93a26b34-2f6c-429a-8567-06d715040594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2454f21-9e06-4ec7-b8d6-656dbdf82c6d", "name": "network-vif-unplugged", "status": "completed", "tag": "997e2cdb-8714-4ff9-a19c-d31c70dd0494"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:49.662270 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:49.662270 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:49.673074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c857ca80-4f49-4fce-8d63-44d3ed65ee7f req-93a26b34-2f6c-429a-8567-06d715040594 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.673819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c857ca80-4f49-4fce-8d63-44d3ed65ee7f req-93a26b34-2f6c-429a-8567-06d715040594 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.677493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:49.691094 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c857ca80-4f49-4fce-8d63-44d3ed65ee7f req-93a26b34-2f6c-429a-8567-06d715040594 service nova] Creating event network-vif-unplugged:997e2cdb-8714-4ff9-a19c-d31c70dd0494 for instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d on nch1-master-1 Nov 20 20:50:49.692448 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f1c289e-ddae-4862-addb-7e8d8023c4ea tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1461 microversion: 2.1 time: 0.629418 Nov 20 20:50:49.696413 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 777/1596] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:49 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1461 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:49.696413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:49.696413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.711172 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c857ca80-4f49-4fce-8d63-44d3ed65ee7f req-93a26b34-2f6c-429a-8567-06d715040594 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057167 Nov 20 20:50:49.712586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 820/1597] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:49.712906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.716298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.717719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.718242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.724085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:49.725281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.734665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.735942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.737455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.738526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.952533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:49.961316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-949a40e1-fefc-4a1d-89c3-a915863bd891 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1506 microversion: 2.1 time: 0.246177 Nov 20 20:50:49.973517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 821/1598] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:49 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:49.979469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:49.981328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:49.989624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.990133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:49.991233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:49.992120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.046781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:50.053033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7cd32b36-1499-48d6-8faf-5772edcf1afb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 16397 microversion: 2.1 time: 0.076880 Nov 20 20:50:50.054421 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 822/1599] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:49 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 16397 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:50.059976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99331b90-6d75-4956-8d5f-7506da3d97bd tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.362916 Nov 20 20:50:50.061001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 778/1600] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:49 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:50.061564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f0a1ea1b-3dc5-4ca3-ab13-a412daabefc5 req-2c2e8d2b-9cb3-4ce0-9f66-918a21c4b035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899d7fb-aca6-4434-9fbc-f7874d362f4a", "tag": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:50.063603 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:50.063603 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:50.076514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58b52ba2-a2e5-44ba-a26e-745838622716 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'create', calling method: .version_select at 0x7f3f877065e0>, body: {"pool": "a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:50.081299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f0a1ea1b-3dc5-4ca3-ab13-a412daabefc5 req-2c2e8d2b-9cb3-4ce0-9f66-918a21c4b035 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.081866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f0a1ea1b-3dc5-4ca3-ab13-a412daabefc5 req-2c2e8d2b-9cb3-4ce0-9f66-918a21c4b035 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.098619 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f0a1ea1b-3dc5-4ca3-ab13-a412daabefc5 req-2c2e8d2b-9cb3-4ce0-9f66-918a21c4b035 service nova] Creating event network-changed:a8a6b63d-5947-43c3-a9e3-80cd19d532a8 for instance e899d7fb-aca6-4434-9fbc-f7874d362f4a on nch2-master-1 Nov 20 20:50:50.103943 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f0a1ea1b-3dc5-4ca3-ab13-a412daabefc5 req-2c2e8d2b-9cb3-4ce0-9f66-918a21c4b035 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047965 Nov 20 20:50:50.106148 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 823/1601] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:50.124301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:50.126074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:50.137861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.138547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.139651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.144115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.608923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:50.626925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:50.631680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:50.633768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-46657dc7-01c1-4442-b0c0-3387b33bef9d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1837 microversion: 2.42 time: 0.526223 Nov 20 20:50:50.635866 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 824/1602] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:50 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1837 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:50.651096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:50.652415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:50.673403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.674020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.674841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.675275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.954323 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4964540a-4c22-4fd8-835c-a4b4967a77b1 tempest-MigrationsAdminTest-437941305 tempest-MigrationsAdminTest-437941305-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1612 microversion: 2.1 time: 0.314186 Nov 20 20:50:50.956894 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 825/1603] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:50 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1612 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:50.963825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:50.964624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:50.974040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.974875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:50.975897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:50.976794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.027707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:51.215891 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e026752-35f0-46a8-9213-a6c5b7b17a6d tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 204 len: 0 microversion: 2.1 time: 0.256500 Nov 20 20:50:51.225687 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 826/1604] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:50 2021] DELETE /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:51.235860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:51.238430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.249931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.252130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.255105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.256993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.335161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a961b4fa-64c1-4847-87c0-6bd07ff1b3d1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.104426 Nov 20 20:50:51.341673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 827/1605] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:51 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:51.348129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:51.348951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 534bb292-6e42-4114-ae6a-3b608f41a28e] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.363604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.365659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.366614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.367072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.404326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] HTTP exception thrown: Instance 534bb292-6e42-4114-ae6a-3b608f41a28e could not be found. Nov 20 20:50:51.405157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Returning 404 to user: Instance 534bb292-6e42-4114-ae6a-3b608f41a28e could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:51.406734 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0dd0311c-adaa-49e8-9472-6767ad051de4 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e" status: 404 len: 111 microversion: 2.1 time: 0.063589 Nov 20 20:50:51.407819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 828/1606] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:51 2021] GET /compute/v2.1/servers/534bb292-6e42-4114-ae6a-3b608f41a28e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:51.414044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:51.414573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.426280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.427128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.428592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.429038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.462957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:51.594881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f860d43c-643c-4ae8-80bf-b6472c34ab1e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 204 len: 0 microversion: 2.1 time: 0.184895 Nov 20 20:50:51.596030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 829/1607] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:51 2021] DELETE /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:51.606034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:51.607440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.616063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.619959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.621689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.622742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.680885 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be81411f-0c4c-442d-a928-22d3ffaade31 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 16397 microversion: 2.1 time: 0.082231 Nov 20 20:50:51.681868 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 830/1608] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:51 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 16397 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:51.687263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:51.689275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.696435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.696892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.698292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.698747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.896603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:51.913054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30f8924c-0d15-4321-b9c8-8e4bff9eea90 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.229743 Nov 20 20:50:51.926168 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 831/1609] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:51 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:51.926168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:51.926168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:51.938967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.941242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.942639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:51.944650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:51.993901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:52.092426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Instance is already in deleting state, ignoring this request Nov 20 20:50:52.093751 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8af7d237-a2bc-445d-8de9-4dc09d012abd tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 204 len: 0 microversion: 2.1 time: 0.176798 Nov 20 20:50:52.095971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 832/1610] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:51 2021] DELETE /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:52.103475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:52.104487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:52.116107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.117137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.119025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.119637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.339410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:52.353378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ced81af-eb98-4090-9515-b63c1dbe7494 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1467 microversion: 2.1 time: 0.254870 Nov 20 20:50:52.354092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 833/1611] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:52 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1467 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:52.360606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:52.361606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:52.371241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.371724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.372522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.373416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.555613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:52.566764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:52.569107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:52.570461 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-237b3df0-79eb-4f09-bc45-fed726ebba4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1837 microversion: 2.42 time: 0.215174 Nov 20 20:50:52.571025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 834/1612] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:52 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1837 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:52.580778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6740b390-1a2b-4d36-98fc-d551c711e8de req-8828a1a5-c631-4a59-8a91-3111f9eb8cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2454f21-9e06-4ec7-b8d6-656dbdf82c6d", "tag": "997e2cdb-8714-4ff9-a19c-d31c70dd0494"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:52.582867 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:52.582867 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:52.589718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6740b390-1a2b-4d36-98fc-d551c711e8de req-8828a1a5-c631-4a59-8a91-3111f9eb8cf8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.590429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6740b390-1a2b-4d36-98fc-d551c711e8de req-8828a1a5-c631-4a59-8a91-3111f9eb8cf8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.602122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6740b390-1a2b-4d36-98fc-d551c711e8de req-8828a1a5-c631-4a59-8a91-3111f9eb8cf8 service nova] Creating event network-changed:997e2cdb-8714-4ff9-a19c-d31c70dd0494 for instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d on nch1-master-1 Nov 20 20:50:52.606900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6740b390-1a2b-4d36-98fc-d551c711e8de req-8828a1a5-c631-4a59-8a91-3111f9eb8cf8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034543 Nov 20 20:50:52.607804 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 835/1613] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:52.612540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:52.613244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:52.619422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.619961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.620652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.621285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.770281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:52.779333 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa74cbac-0731-414f-9b30-e12a64894434 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1512 microversion: 2.1 time: 0.170591 Nov 20 20:50:52.780008 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 836/1614] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:52 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:52.785276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1be4541c-6962-4ce1-9a42-d4c1464df1df req-c0572ba3-19db-4633-9ca1-bdf44eb32e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534bb292-6e42-4114-ae6a-3b608f41a28e", "name": "network-vif-deleted", "tag": "119afa00-1f53-43e0-901d-bb72b2a68f15"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:52.787088 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:52.787088 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:52.794529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1be4541c-6962-4ce1-9a42-d4c1464df1df req-c0572ba3-19db-4633-9ca1-bdf44eb32e10 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.794981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1be4541c-6962-4ce1-9a42-d4c1464df1df req-c0572ba3-19db-4633-9ca1-bdf44eb32e10 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.807463 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1be4541c-6962-4ce1-9a42-d4c1464df1df req-c0572ba3-19db-4633-9ca1-bdf44eb32e10 service nova] Creating event network-vif-deleted:119afa00-1f53-43e0-901d-bb72b2a68f15 for instance 534bb292-6e42-4114-ae6a-3b608f41a28e on nch2-master-1 Nov 20 20:50:52.812542 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1be4541c-6962-4ce1-9a42-d4c1464df1df req-c0572ba3-19db-4633-9ca1-bdf44eb32e10 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031335 Nov 20 20:50:52.814353 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 837/1615] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:52.819647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-901c5083-95c4-4dbe-b6d0-c21a5ebfcc0c req-987faa32-277a-463c-a24c-b3e2f2275cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-plugged", "status": "completed", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:52.821288 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:52.821288 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:52.829797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-901c5083-95c4-4dbe-b6d0-c21a5ebfcc0c req-987faa32-277a-463c-a24c-b3e2f2275cbf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.830422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-901c5083-95c4-4dbe-b6d0-c21a5ebfcc0c req-987faa32-277a-463c-a24c-b3e2f2275cbf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.842281 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-901c5083-95c4-4dbe-b6d0-c21a5ebfcc0c req-987faa32-277a-463c-a24c-b3e2f2275cbf service nova] Creating event network-vif-plugged:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:52.847312 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-901c5083-95c4-4dbe-b6d0-c21a5ebfcc0c req-987faa32-277a-463c-a24c-b3e2f2275cbf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Nov 20 20:50:52.851159 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 838/1616] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:52.856440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:52.857492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:52.864663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.865148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.866018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.866521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.909291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-16cf649a-907f-4a8e-8f59-8385dda9bf37 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.056674 Nov 20 20:50:52.909947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 839/1617] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:52 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:52.914963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:52.915591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:52.923412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.923964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.924910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:52.925352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:52.952926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:53.017835 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58b52ba2-a2e5-44ba-a26e-745838622716 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.953999 Nov 20 20:50:53.019345 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 779/1618] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:50:50 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:53.027882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:53.040681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.049779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89cc805b-267e-4b10-9ba6-6379dc8175bd tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 204 len: 0 microversion: 2.1 time: 0.138174 Nov 20 20:50:53.050421 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 840/1619] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:52 2021] DELETE /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:53.051070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.051704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.052825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.053703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.057428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:53.058273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.071033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.071635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.072594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.074352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.116090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d96171a1-1b58-4b21-b6d5-930541d569c9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 16397 microversion: 2.1 time: 0.094533 Nov 20 20:50:53.117196 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 780/1620] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:53 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 16397 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:53.127213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: .version_select at 0x7f3f95eb04c0>, body: {"addFloatingIp": {"address": "172.35.1.108"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:53.131317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.148846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.149902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.163442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.163920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.252039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Acquired lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:50:53.263552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:53.272965 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-298fca96-8cc2-4184-8805-a365447da321 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.221325 Nov 20 20:50:53.273539 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 841/1621] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:53 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:53.278363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:53.278968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.285916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.286403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.287199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.287645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.483311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:53.493828 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de174a16-adc3-4405-9623-a58c4dc22b13 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1524 microversion: 2.1 time: 0.218670 Nov 20 20:50:53.494455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 842/1622] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:53 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1524 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:53.508999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:53.509636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.517901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.518671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.519645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.520556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.877755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:53.886565 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b3b8835-6070-4c10-b699-2dcf3453b078 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1467 microversion: 2.1 time: 0.390845 Nov 20 20:50:53.887784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 843/1623] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:53 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1467 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:53.902770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:53.903975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:53.911022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.911627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:53.912915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:53.913429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.566972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.108 (eeb90ea4-9386-4d6d-a29d-85f30a630606) with port a8a6b63d-5947-43c3-a9e3-80cd19d532a8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb.", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:50:54.567691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Releasing lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:50:54.568902 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.108 (eeb90ea4-9386-4d6d-a29d-85f30a630606) with port a8a6b63d-5947-43c3-a9e3-80cd19d532a8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb. Nov 20 20:50:54.568902 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-ca333b67-6558-4446-bb2b-b4637e7be10c'] Nov 20 20:50:54.570287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Returning 400 to user: Cannot associate floating IP 172.35.1.108 (eeb90ea4-9386-4d6d-a29d-85f30a630606) with port a8a6b63d-5947-43c3-a9e3-80cd19d532a8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb. Nov 20 20:50:54.570287 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-ca333b67-6558-4446-bb2b-b4637e7be10c'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:54.571609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7a7be3a-368a-48a6-a005-600f9e303780 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 400 len: 381 microversion: 2.1 time: 1.452905 Nov 20 20:50:54.572344 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 781/1624] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:53 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 381 bytes in 1454 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:50:54.581047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:54.581981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:54.591095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.591930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.593161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.593894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.634887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:54.645552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:54.647373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:54.648735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03ce2163-6536-4a33-9cf3-81c52b3b5354 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1858 microversion: 2.42 time: 0.749789 Nov 20 20:50:54.649304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 844/1625] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:53 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1858 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:54.654353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:54.655526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:54.662803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.663509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.664486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.665119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.688802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49baaf06032347a1bcf476aa84043eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b0c2ea7352848dcbb0c66efff699f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:54.699511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e9755e0-31bd-4d41-970f-92be2a2df004 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 200 len: 1470 microversion: 2.1 time: 0.124144 Nov 20 20:50:54.700347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 782/1626] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:54 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 1470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:54.705617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:54.706865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:54.713980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.714695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.715662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.716265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.728399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28b8fbcc-3168-4f91-99c1-17c0d7e1236b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.077547 Nov 20 20:50:54.730636 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 845/1627] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:54 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:54.737796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:54.738709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:54.749326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.750042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.752635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.753082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.771880 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8905538-461b-4463-95a5-a3bce22f002f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.069637 Nov 20 20:50:54.774149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 783/1628] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:54 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:54.783791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:54.786472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:54.795369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.796646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:54.798147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:54.798872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:55.096559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:55.105581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-84c2f0ce-8089-4cf6-9555-7611378b1cf5 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 200 len: 1524 microversion: 2.1 time: 0.329930 Nov 20 20:50:55.106176 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 784/1629] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:54 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:55.111610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5fb32262-6fbe-419b-8143-1cc2085f3b0f tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '.version_select at 0x7f3f876db3a0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:55.629141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:55.640599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9813a6f-d8f4-477c-8bdb-dfeed4413f09 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.908447 Nov 20 20:50:55.646440 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 846/1630] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:54 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:55.668183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "a2255729-67f4-48eb-af4e-86e677b04463"}, {"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "d62e09bc-0a07-428d-96cb-5ce7f5c99f7f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:55.673925 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:55.673925 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:55.697497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:55.698394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:55.725147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] Creating event network-changed:a2255729-67f4-48eb-af4e-86e677b04463 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:50:55.727692 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] Creating event network-changed:d62e09bc-0a07-428d-96cb-5ce7f5c99f7f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:50:55.755919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-de5ce021-6ef0-4dd3-9add-d0c05dffcdd8 req-ac8a4541-f2f5-4cb5-9586-3255039a3674 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.107952 Nov 20 20:50:55.760186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 847/1631] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:55 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:55.783498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:55.786489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:55.813179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:55.813493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:55.816522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:55.816975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:55.873541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:55.873984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:55.874644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lazy-loading 'fault' on Instance uuid 4617c7fc-1747-4fc8-b17e-023944473df9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:50:56.087851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:56.126956 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0de27c5-f2d4-4f17-b828-bfcc4add1820 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 200 len: 1302 microversion: 2.1 time: 0.364277 Nov 20 20:50:56.128874 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 848/1632] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:55 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 1302 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:56.143396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e2145e79-939a-465f-a156-287ae0094959 req-c958e791-a539-4930-b203-af18161df8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c4c45e-b6d1-4618-9248-f81c093cd761", "name": "network-vif-deleted", "tag": "9fffb655-560d-495c-b4cb-728592a93b09"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:56.152358 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:56.152358 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:50:56.184205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e2145e79-939a-465f-a156-287ae0094959 req-c958e791-a539-4930-b203-af18161df8b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.185057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e2145e79-939a-465f-a156-287ae0094959 req-c958e791-a539-4930-b203-af18161df8b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.227003 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e2145e79-939a-465f-a156-287ae0094959 req-c958e791-a539-4930-b203-af18161df8b0 service nova] Creating event network-vif-deleted:9fffb655-560d-495c-b4cb-728592a93b09 for instance 29c4c45e-b6d1-4618-9248-f81c093cd761 on nch1-master-1 Nov 20 20:50:56.237544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e2145e79-939a-465f-a156-287ae0094959 req-c958e791-a539-4930-b203-af18161df8b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106030 Nov 20 20:50:56.240140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 849/1633] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:56.252132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:56.253587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:56.266598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.267574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.275017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.276488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.816762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:56.827518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:56.829901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:56.831837 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f775fb7-8fbe-470c-aa5d-9667718a6f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.589564 Nov 20 20:50:56.832684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 850/1634] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:56 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:56.842289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:56.843730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 29c4c45e-b6d1-4618-9248-f81c093cd761] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:56.865183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.866144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.867095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.867801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.885508 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] HTTP exception thrown: Instance 29c4c45e-b6d1-4618-9248-f81c093cd761 could not be found. Nov 20 20:50:56.886596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Returning 404 to user: Instance 29c4c45e-b6d1-4618-9248-f81c093cd761 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:56.887650 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63f1ca1d-75ab-4a48-830c-37d06ebf6692 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761" status: 404 len: 111 microversion: 2.1 time: 0.053690 Nov 20 20:50:56.894236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 851/1635] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:56 2021] GET /compute/v2.1/servers/29c4c45e-b6d1-4618-9248-f81c093cd761 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:56.900487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:56.901548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:56.909187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.909990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:56.910888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:56.912140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.013998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-93535cc5-ff0b-445b-8023-15688586bb56 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.117383 Nov 20 20:50:57.015463 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 852/1636] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:56 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:57.023245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:57.025067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.032879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.033963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.042750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.043240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.102787 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe462f20-52ac-40d8-9821-4238e186aca2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.084383 Nov 20 20:50:57.103546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 853/1637] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:57 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:57.110976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.111692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.120360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.120806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.121664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.122128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.138661 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] HTTP exception thrown: Instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d could not be found. Nov 20 20:50:57.139384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Returning 404 to user: Instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:57.140275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94239d15-6e3b-4669-809c-4299e918ecb0 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d" status: 404 len: 111 microversion: 2.1 time: 0.035659 Nov 20 20:50:57.141833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 854/1638] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:57 2021] GET /compute/v2.1/servers/21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:57.146683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.147292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.153515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.153997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.154827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.155519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.411354 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5fb32262-6fbe-419b-8143-1cc2085f3b0f tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/eeb90ea4-9386-4d6d-a29d-85f30a630606" status: 202 len: 0 microversion: 2.1 time: 2.304060 Nov 20 20:50:57.413381 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 785/1639] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:50:55 2021] DELETE /compute/v2.1/os-floating-ips/eeb90ea4-9386-4d6d-a29d-85f30a630606 => generated 0 bytes in 2306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:50:57.424977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.429210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.443000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.443634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.444569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.445145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.445803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:57.467003 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2c6a0a7-2b40-42fc-9c75-87cbda712d20 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1390 microversion: 2.1 time: 0.324127 Nov 20 20:50:57.470687 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 855/1640] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:57 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1390 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:57.481445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.482299 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] HTTP exception thrown: Instance 743798f2-3de6-473a-b676-6226a4b9ebba could not be found. Nov 20 20:50:57.483151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Returning 404 to user: Instance 743798f2-3de6-473a-b676-6226a4b9ebba could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:57.483821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 4617c7fc-1747-4fc8-b17e-023944473df9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.485362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e38ebd99-54c3-4b90-aeb2-1f4513c5b187 tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 404 len: 111 microversion: 2.1 time: 0.070450 Nov 20 20:50:57.486484 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 786/1641] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:57 2021] DELETE /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:57.492463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.493624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.499874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.500513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.501457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.501906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.503267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.504294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.505666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.506627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.533961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] HTTP exception thrown: Instance 4617c7fc-1747-4fc8-b17e-023944473df9 could not be found. Nov 20 20:50:57.536323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Returning 404 to user: Instance 4617c7fc-1747-4fc8-b17e-023944473df9 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:57.538019 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9bec2f3-7baf-4f1d-be45-02c9455bc41e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9" status: 404 len: 111 microversion: 2.1 time: 0.065409 Nov 20 20:50:57.539021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 856/1642] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:57 2021] GET /compute/v2.1/servers/4617c7fc-1747-4fc8-b17e-023944473df9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:57.548073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: .version_select at 0x7f3f95ebce50>, body: {"removeFloatingIp": {"address": "172.35.1.26"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:57.589676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:57.707955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74378b84-584c-444b-9944-2e321a8dcbab tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 204 len: 0 microversion: 2.1 time: 0.219789 Nov 20 20:50:57.712247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 787/1643] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:57 2021] DELETE /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:57.718641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.720595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: 743798f2-3de6-473a-b676-6226a4b9ebba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.726936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.727389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.728194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.728635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.751732 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] HTTP exception thrown: Instance 743798f2-3de6-473a-b676-6226a4b9ebba could not be found. Nov 20 20:50:57.752927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Returning 404 to user: Instance 743798f2-3de6-473a-b676-6226a4b9ebba could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:57.757741 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa90555d-1f50-4d81-8460-ba90b35a6dfb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba" status: 404 len: 111 microversion: 2.1 time: 0.039875 Nov 20 20:50:57.758974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 788/1644] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:57 2021] GET /compute/v2.1/servers/743798f2-3de6-473a-b676-6226a4b9ebba => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:57.760550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.764304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.764978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.768124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.768578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.769596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.770042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.771867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.772318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.773110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.773550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.800520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:50:57.919362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60b7e86b-eca7-42b9-919b-82802fe727cc tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 204 len: 0 microversion: 2.1 time: 0.158184 Nov 20 20:50:57.920273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 789/1645] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:57 2021] DELETE /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:50:57.935801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:57.936702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:57.944083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.944541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:57.945345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:57.945824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:58.068382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Acquired lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:50:58.418257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:58.429094 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8fcd3b0-afbf-4acd-878f-93327a2edd1f tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1509 microversion: 2.1 time: 0.500586 Nov 20 20:50:58.440193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 790/1646] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:57 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1509 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:58.440193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:58.440193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:58.444552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:58.445000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:58.446317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:58.446753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:58.463732 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] HTTP exception thrown: Instance c60d2233-750a-4b19-b2b7-a577b8091aee could not be found. Nov 20 20:50:58.464600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Returning 404 to user: Instance c60d2233-750a-4b19-b2b7-a577b8091aee could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:50:58.465727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e813b5e-d0cb-409b-872c-cfbe3c0a29bb tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 404 len: 111 microversion: 2.1 time: 0.034775 Nov 20 20:50:58.467097 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 791/1647] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:50:58 2021] DELETE /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:50:58.473597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:58.474551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:58.482886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:58.483643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:58.486349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:58.487144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.019974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:59.031143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:59.034511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:59.036016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1036ab6f-ba29-49c2-9dd0-a289206fd7d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.567521 Nov 20 20:50:59.046205 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 792/1648] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:50:58 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:50:59.056408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:50:59.056924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:59.065530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.066193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.067045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.067488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.459934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:50:59.565185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:50:59.578151 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7044df2-c367-4b68-a60b-fd8745b52718 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1535 microversion: 2.1 time: 0.525305 Nov 20 20:50:59.592290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 793/1649] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:50:59 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1535 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:50:59.599287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-de9d1d42-4d90-48ac-ad12-c8c1c7bd6a45 req-6f67e711-7c9f-45d2-aa90-9ac7801270db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "39839f43-d46e-414e-93c9-a7955f617fd1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:59.601113 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:59.601113 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:59.616923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-de9d1d42-4d90-48ac-ad12-c8c1c7bd6a45 req-6f67e711-7c9f-45d2-aa90-9ac7801270db service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.619122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-de9d1d42-4d90-48ac-ad12-c8c1c7bd6a45 req-6f67e711-7c9f-45d2-aa90-9ac7801270db service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.652447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-de9d1d42-4d90-48ac-ad12-c8c1c7bd6a45 req-6f67e711-7c9f-45d2-aa90-9ac7801270db service nova] Creating event network-changed:39839f43-d46e-414e-93c9-a7955f617fd1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:50:59.658481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-de9d1d42-4d90-48ac-ad12-c8c1c7bd6a45 req-6f67e711-7c9f-45d2-aa90-9ac7801270db service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063108 Nov 20 20:50:59.661728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 794/1650] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:50:59.669934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:59.676091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:59.693369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.704156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.706947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.708002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.819877 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8526027-2e2c-4ba4-ad22-3ba515575d13 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 24508 microversion: 2.1 time: 0.154684 Nov 20 20:50:59.821001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 795/1651] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:59 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 24508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:59.828559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:59.830831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:50:59.838993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.839919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.840932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.841639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.899067 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3e665e1-330c-4220-8059-8921a280080c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.073456 Nov 20 20:50:59.900679 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 796/1652] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:59 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:50:59.910939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4617c7fc-1747-4fc8-b17e-023944473df9", "name": "network-vif-deleted", "tag": "41caa8c1-f0b9-44fe-81d2-76d08d296f68"}, {"server_uuid": "21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d", "name": "network-vif-deleted", "tag": "45fadff2-da94-4f5f-8340-26c7ac05e1e2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:50:59.913600 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:50:59.913600 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:50:59.949531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:50:59.952033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:50:59.994477 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] Creating event network-vif-deleted:41caa8c1-f0b9-44fe-81d2-76d08d296f68 for instance 4617c7fc-1747-4fc8-b17e-023944473df9 on nch1-master-1 Nov 20 20:50:59.995022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] Creating event network-vif-deleted:45fadff2-da94-4f5f-8340-26c7ac05e1e2 for instance 21cfb27a-da22-48dc-ab23-a7bbf6c8fb7d on nch1-master-1 Nov 20 20:51:00.006526 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d90877a5-4abb-4935-a7bf-a74158535a47 req-ba698e55-d9ab-4216-baaf-8a4f283b067b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103423 Nov 20 20:51:00.010964 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 797/1653] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:00.021530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:00.024536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] [instance: c60d2233-750a-4b19-b2b7-a577b8091aee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:00.036436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.037872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.040621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.040621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.070557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] HTTP exception thrown: Instance c60d2233-750a-4b19-b2b7-a577b8091aee could not be found. Nov 20 20:51:00.073267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] Returning 404 to user: Instance c60d2233-750a-4b19-b2b7-a577b8091aee could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:00.073267 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26d361b7-451b-4e70-aed2-a7c0b480697e tempest-ServerDiskConfigTestJSON-1639557811 tempest-ServerDiskConfigTestJSON-1639557811-project] 10.222.0.41 "GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee" status: 404 len: 111 microversion: 2.1 time: 0.059613 Nov 20 20:51:00.073267 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 798/1654] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:00 2021] GET /compute/v2.1/servers/c60d2233-750a-4b19-b2b7-a577b8091aee => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:00.080701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:00.081471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:00.089949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.090628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.091607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.092365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.661487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:00.670373 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2e20352-14dd-4e49-862d-60a7e66fbd52 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1380 microversion: 2.1 time: 0.595605 Nov 20 20:51:00.685111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 799/1655] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:00 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1380 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:00.698511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:00.702769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:00.719459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.720345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.721624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.722362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.845370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.846254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.847417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lazy-loading 'fault' on Instance uuid 06f6126a-4e65-40c1-a727-0559f7cf71ba {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:00.921470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:00.933669 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc6ce3cf-f2cb-45c3-af15-2373b34983f1 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 200 len: 1313 microversion: 2.1 time: 0.245576 Nov 20 20:51:00.935970 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 800/1656] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:00 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:00.945475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:00.946550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:00.956552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.960179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:00.960179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:00.960179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.333814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Updating instance_info_cache with network_info: [{"id": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8", "address": "fa:16:3e:f5:a3:05", "network": {"id": "5bc0506e-bc72-485c-a0a7-48575db53d86", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1096424800-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2cfe248f7eb34f6e80937503e49fd3ca", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa8a6b63d-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:51:01.358473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Releasing lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:51:01.367754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c9501b3-037e-4a6f-ae09-1fd4912bf589 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 202 len: 0 microversion: 2.1 time: 3.826201 Nov 20 20:51:01.369635 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 857/1657] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:50:57 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 0 bytes in 3830 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:51:01.388701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:01.390509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:01.413784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.414915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.418561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.420714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.482355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:01.512025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:01.525001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:01.526595 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aecc776c-955d-4a93-80f7-ae5d4bf20579 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.589087 Nov 20 20:51:01.534335 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 801/1658] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:00 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:01.575494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e42e847-9e1b-4064-835e-2834cf059916 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '.version_select at 0x7f3f8767d670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:01.583786 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:01.583786 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:01.585729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e42e847-9e1b-4064-835e-2834cf059916 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.590302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e42e847-9e1b-4064-835e-2834cf059916 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.620179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e42e847-9e1b-4064-835e-2834cf059916 tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/os-migrations" status: 200 len: 3112 microversion: 2.1 time: 0.082570 Nov 20 20:51:01.621430 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 802/1659] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:51:01 2021] GET /compute/v2.1/os-migrations => generated 3112 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:01.631215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:01.632672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:01.642003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:01.652550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.665639 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-222174c1-3e66-4fc6-b983-73996362cccd tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 200 len: 1364 microversion: 2.1 time: 0.288451 Nov 20 20:51:01.667324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.668018 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 858/1660] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:01 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:01.673884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.674370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.680627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:01.683043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:01.694552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.695451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.696570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.697645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.757409 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-658cc139-b3d0-4eb9-8a1c-c3395a05779e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.087843 Nov 20 20:51:01.758143 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 859/1661] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:01 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:01.765781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-167d47d7-07b4-4a7d-bfdc-23de4573e756 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '.version_select at 0x7f3f87319a60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:01.782182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-330b5da7-a739-4b6c-bd8a-478bbd0c1d3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.158303 Nov 20 20:51:01.782961 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 803/1662] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:01 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:01.795713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:01.800480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:01.822969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.823602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:01.826278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:01.826894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.224353 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d75c1df-2745-4983-83f8-c8101d5dd8eb tempest-LiveMigrationTest-74705102 tempest-LiveMigrationTest-74705102-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1531 microversion: 2.1 time: 0.436261 Nov 20 20:51:02.224874 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 804/1663] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:01 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1531 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:02.238082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "8d29ec6b-5e92-4f5c-9a33-b37b39856ff1"}, {"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "74631941-cda7-49c4-b33a-f60122f88759"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:02.239790 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:02.239790 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:02.255797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.256261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.270598 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] Creating event network-changed:8d29ec6b-5e92-4f5c-9a33-b37b39856ff1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:02.271747 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] Creating event network-changed:74631941-cda7-49c4-b33a-f60122f88759 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:02.278585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-67d343c4-0c3d-40df-8183-90994314adb3 req-1f19b585-b642-4247-8cb9-a2e53d4354b4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052384 Nov 20 20:51:02.280490 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 805/1664] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:02.287047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:02.288117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 06f6126a-4e65-40c1-a727-0559f7cf71ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:02.299056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.300565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.301784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.302556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.321818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] HTTP exception thrown: Instance 06f6126a-4e65-40c1-a727-0559f7cf71ba could not be found. Nov 20 20:51:02.322795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Returning 404 to user: Instance 06f6126a-4e65-40c1-a727-0559f7cf71ba could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:02.323834 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fdcfca58-7bfb-4de1-bd1e-1ba7ff94e51c tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba" status: 404 len: 111 microversion: 2.1 time: 0.041460 Nov 20 20:51:02.325396 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 806/1665] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:02 2021] GET /compute/v2.1/servers/06f6126a-4e65-40c1-a727-0559f7cf71ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:02.331738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e899d7fb-aca6-4434-9fbc-f7874d362f4a", "tag": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8"}, {"server_uuid": "06f6126a-4e65-40c1-a727-0559f7cf71ba", "name": "network-vif-deleted", "tag": "9247b2b9-3787-408f-9910-0d7f430ac7e3"}, {"server_uuid": "31269560-9cb4-4f4a-915c-60e283225964", "name": "network-vif-deleted", "tag": "d17c3e85-73cd-4445-8746-63b4de251722"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:02.334880 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:02.334880 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:02.351907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.352797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.372495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Creating event network-changed:a8a6b63d-5947-43c3-a9e3-80cd19d532a8 for instance e899d7fb-aca6-4434-9fbc-f7874d362f4a on nch2-master-1 Nov 20 20:51:02.373300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Creating event network-vif-deleted:9247b2b9-3787-408f-9910-0d7f430ac7e3 for instance 06f6126a-4e65-40c1-a727-0559f7cf71ba on nch1-master-1 Nov 20 20:51:02.374020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] Creating event network-vif-deleted:d17c3e85-73cd-4445-8746-63b4de251722 for instance 31269560-9cb4-4f4a-915c-60e283225964 on nch1-master-1 Nov 20 20:51:02.387389 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-26a940d4-4bf2-4ca7-8e6a-19442c2c3909 req-63c79e0e-a155-46c4-854b-a6e5c289070c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.060435 Nov 20 20:51:02.388773 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 807/1666] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:02 2021] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:02.397821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:02.398862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:02.410012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.411013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.412279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.412966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.449322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:02.585810 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89496f55-ffaa-4c5d-8356-7ddaaaa3c701 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 204 len: 0 microversion: 2.1 time: 0.195193 Nov 20 20:51:02.591747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 808/1667] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:02 2021] DELETE /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:02.601874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:02.604141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:02.612325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.613408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.615576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.616122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.663493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:02.842735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6df4bf00-f6ff-4c00-846a-ba4e00e9eece tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "DELETE /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 204 len: 0 microversion: 2.1 time: 0.245158 Nov 20 20:51:02.848709 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 809/1668] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:02 2021] DELETE /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:02.856293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:02.858343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:02.891615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.892602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:02.893454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:02.893887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.351915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:03.363575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:03.365373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:03.366580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b86a8f17-670d-4b46-888c-dd4e91c8ccf5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.515977 Nov 20 20:51:03.367521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 810/1669] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:02 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:03.371862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:03.372616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:03.379667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.380298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.381193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.381633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.436158 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-167d47d7-07b4-4a7d-bfdc-23de4573e756 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/fac77207-cbe2-4a9f-810b-53a930a55d5d" status: 202 len: 0 microversion: 2.1 time: 1.676574 Nov 20 20:51:03.441374 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 860/1670] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:51:01 2021] DELETE /compute/v2.1/os-floating-ips/fac77207-cbe2-4a9f-810b-53a930a55d5d => generated 0 bytes in 1683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:03.456766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:03.474231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 31269560-9cb4-4f4a-915c-60e283225964] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:03.491656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.492620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.493623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.495579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.515061 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] HTTP exception thrown: Instance 31269560-9cb4-4f4a-915c-60e283225964 could not be found. Nov 20 20:51:03.520130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Returning 404 to user: Instance 31269560-9cb4-4f4a-915c-60e283225964 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:03.521456 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c6b64f8-575c-4db8-8e1f-6a72c2b0118e tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964" status: 404 len: 111 microversion: 2.1 time: 0.078429 Nov 20 20:51:03.522653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 861/1671] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:03 2021] GET /compute/v2.1/servers/31269560-9cb4-4f4a-915c-60e283225964 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:03.534502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:03.538493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:03.563970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.564439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.565635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.567689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.647144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5eb1a83-6a13-4fc3-8519-4ffe355b90f7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.122851 Nov 20 20:51:03.648858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 862/1672] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:03 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:03.657666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:03.658992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:03.666795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.667510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.668615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.669057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.754194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8db87262-a9f5-4060-a6d3-4e7d8339154a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.103435 Nov 20 20:51:03.755482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 863/1673] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:03 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:03.767836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:03.772858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:03.780182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.780635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.781661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:03.782571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:03.961533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:03.977404 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4800b269-d780-4409-a19b-087b912aa506 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1386 microversion: 2.1 time: 0.608766 Nov 20 20:51:03.978834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 811/1674] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:03 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1386 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:03.984888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41eed26f-eb78-4314-97a5-c19d9b76db27 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:03.987179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41eed26f-eb78-4314-97a5-c19d9b76db27 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:03.988142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41eed26f-eb78-4314-97a5-c19d9b76db27 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 400 len: 142 microversion: 2.1 time: 0.007409 Nov 20 20:51:03.989013 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 812/1675] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:03 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 142 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:51:03.994261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:03.995136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:04.004192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.004880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.005872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.006666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.036397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:04.161283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4b5626e-971a-4149-b380-d20eb6eec90d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 204 len: 0 microversion: 2.1 time: 0.170515 Nov 20 20:51:04.175967 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 813/1676] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:03 2021] DELETE /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:04.188708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:04.190371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:04.200978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.202294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.203067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.204455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.235461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Acquired lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:51:04.458681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Releasing lock "refresh_cache-e899d7fb-aca6-4434-9fbc-f7874d362f4a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:51:04.460562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] HTTP exception thrown: floating IP not found Nov 20 20:51:04.461432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Returning 404 to user: floating IP not found {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:04.462809 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5bf8a0a-1295-4acc-a7c4-222ccf94502d tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 404 len: 67 microversion: 2.1 time: 0.284603 Nov 20 20:51:04.465019 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 814/1677] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:04 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 67 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:04.472906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:04.474482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:04.483232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.483781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.484753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.485260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.746830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:04.764842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-912c4a9b-f8b3-4dd1-87d8-4a67cf50d47e tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1524 microversion: 2.1 time: 1.007975 Nov 20 20:51:04.765448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 864/1678] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:03 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1524 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:04.785492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "1906ffcc-f920-4444-989d-3996e905079f"}, {"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "46000a03-6d74-43bc-957f-eb13e3558ac6"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:04.788238 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:04.788238 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:04.797591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.798581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.809864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] Creating event network-changed:1906ffcc-f920-4444-989d-3996e905079f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:04.810753 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] Creating event network-changed:46000a03-6d74-43bc-957f-eb13e3558ac6 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:04.816981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cd93354a-bfe9-4ff8-b0f3-fbd1c2ce60e0 req-c2cc4baa-f81e-41ee-ab1e-d8b978bbf5d7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046368 Nov 20 20:51:04.818244 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 865/1679] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:04 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:04.824436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:04.825432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:04.833779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.835095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.836645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:04.837242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:04.937448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:04.946764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0016830-6823-4873-a6c0-a29f10a6a5eb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1468 microversion: 2.1 time: 0.482022 Nov 20 20:51:04.947994 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 815/1680] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:04 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1468 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:04.958450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8dffc660-d2df-418e-86f7-9747b4264ad0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Action: 'action', calling method: .version_select at 0x7f3f95eb0430>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:05.264300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:05.313097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:05.324746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:05.332034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a7da974d-e122-4365-8518-8816e1a2d2e0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.512141 Nov 20 20:51:05.335371 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 866/1681] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:04 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:05.341137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:05.343130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:05.353239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.353994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.355259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.356045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.502754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5172b78e-9316-45aa-afbe-4f4d9fdb90b8 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.165790 Nov 20 20:51:05.515186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 867/1682] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:05 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:05.526664 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-8dffc660-d2df-418e-86f7-9747b4264ad0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 20 20:51:05.530258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8dffc660-d2df-418e-86f7-9747b4264ad0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:05.532430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8dffc660-d2df-418e-86f7-9747b4264ad0 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action" status: 404 len: 88 microversion: 2.1 time: 0.582220 Nov 20 20:51:05.535121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 816/1683] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:04 2021] POST /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a/action => generated 88 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:05.542187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:05.548056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:05.552169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:05.553682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:05.561961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.562822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.563946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.564614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.568270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.568731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.569575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.570008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.615023 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c05d891c-f8bf-4243-85b9-35b34398895e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.069143 Nov 20 20:51:05.625248 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 868/1684] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:05 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:05.642321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b4c0fb83-1959-4480-a9fc-9b021cf34738 req-5fdebd08-ff1f-45f3-a2c3-ac6460b1fac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2454f21-9e06-4ec7-b8d6-656dbdf82c6d", "name": "network-vif-deleted", "tag": "997e2cdb-8714-4ff9-a19c-d31c70dd0494"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:05.648350 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:05.648350 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:05.677240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b4c0fb83-1959-4480-a9fc-9b021cf34738 req-5fdebd08-ff1f-45f3-a2c3-ac6460b1fac9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.677699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b4c0fb83-1959-4480-a9fc-9b021cf34738 req-5fdebd08-ff1f-45f3-a2c3-ac6460b1fac9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.693282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b4c0fb83-1959-4480-a9fc-9b021cf34738 req-5fdebd08-ff1f-45f3-a2c3-ac6460b1fac9 service nova] Creating event network-vif-deleted:997e2cdb-8714-4ff9-a19c-d31c70dd0494 for instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d on nch2-master-1 Nov 20 20:51:05.699273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b4c0fb83-1959-4480-a9fc-9b021cf34738 req-5fdebd08-ff1f-45f3-a2c3-ac6460b1fac9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068378 Nov 20 20:51:05.702231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 869/1685] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:05.712053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:05.712971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:05.721393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.722363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.723560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.724249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.760914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:05.767625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:05.779375 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2db2d0b-92d6-4cb2-a679-ee68aee6b2f7 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 200 len: 1183 microversion: 2.1 time: 0.241385 Nov 20 20:51:05.782372 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 817/1686] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:05 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 1183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:05.790880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:05.792212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:05.805576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.806029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.806848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.813134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.912843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:05.913738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:05.914526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lazy-loading 'fault' on Instance uuid 564e731b-fef8-42db-8af6-3500bc8c6798 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:06.036305 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3ff8e9f4-03ac-4956-b794-7686afc4a781 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 204 len: 0 microversion: 2.1 time: 0.325766 Nov 20 20:51:06.038111 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 870/1687] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:05 2021] DELETE /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:06.057849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:06.060269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e417004a75cd4291a2ef4a9d233c9f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee7537dd85d04e808dc792658afa443e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:06.060528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.072937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e122e16-c6cb-44f5-97fe-bbf91050e289 tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 200 len: 1313 microversion: 2.1 time: 0.289021 Nov 20 20:51:06.082109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.083710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.085478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.086467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.087240 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 818/1688] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:05 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:06.092768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:06.094412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.103031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.103966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.105387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.106678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.457204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:06.466306 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-621ec1cb-49be-44da-b898-0c004739d3c3 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 200 len: 1468 microversion: 2.1 time: 0.422423 Nov 20 20:51:06.467742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 871/1689] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:06 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 1468 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:06.481216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:06.485748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.506913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.507865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.509580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.510364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.524939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:06.548659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0c179655-9b8a-47de-b198-77974b223a53 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1542 microversion: 2.1 time: 0.459886 Nov 20 20:51:06.550595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 819/1690] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:06 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1542 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:06.557275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:06.559138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.567751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.568237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.569247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.570569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.630555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c21a7f0-d67d-4239-938c-1542e87a15fb tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.071646 Nov 20 20:51:06.632167 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 820/1691] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:06 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:06.642830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:06.645503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.667291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.668308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.669412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.670404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.772645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d971540-20de-4342-b1e7-503cf6ae3d1f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.138656 Nov 20 20:51:06.778664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 821/1692] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:06 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:06.811098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:06.813469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: e2454f21-9e06-4ec7-b8d6-656dbdf82c6d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:06.832643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.836672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.839611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:06.840992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:06.885000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] HTTP exception thrown: Instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d could not be found. Nov 20 20:51:06.885611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Returning 404 to user: Instance e2454f21-9e06-4ec7-b8d6-656dbdf82c6d could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:06.891638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98a65798-84f9-47c0-bcc4-a994b4821a04 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d" status: 404 len: 111 microversion: 2.1 time: 0.098661 Nov 20 20:51:06.892637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 822/1693] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:06 2021] GET /compute/v2.1/servers/e2454f21-9e06-4ec7-b8d6-656dbdf82c6d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:06.991189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:07.002818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:07.004419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:07.005801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e862d87-7605-4f13-96c1-4d0dde8e3947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.537313 Nov 20 20:51:07.006492 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 872/1694] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:06 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:07.096405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:07.097132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] [instance: 564e731b-fef8-42db-8af6-3500bc8c6798] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:07.104266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.105209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.106390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.107053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.124531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] HTTP exception thrown: Instance 564e731b-fef8-42db-8af6-3500bc8c6798 could not be found. Nov 20 20:51:07.126433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] Returning 404 to user: Instance 564e731b-fef8-42db-8af6-3500bc8c6798 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:07.127609 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d52f10c7-e085-4051-9d43-9390d11a737d tempest-LiveAutoBlockMigrationV225Test-1439503069 tempest-LiveAutoBlockMigrationV225Test-1439503069-project] 10.222.0.41 "GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798" status: 404 len: 111 microversion: 2.1 time: 0.037966 Nov 20 20:51:07.133446 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 873/1695] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:07 2021] GET /compute/v2.1/servers/564e731b-fef8-42db-8af6-3500bc8c6798 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:07.325339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1833190983", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "6ad8ba81-8fae-4627-b230-cf015714cccb"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:07.402099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] validate_networks() for [('6ad8ba81-8fae-4627-b230-cf015714cccb', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:07.484847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:07.485463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:07.502857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.503788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.504908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.505631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.526581 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] HTTP exception thrown: Instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 could not be found. Nov 20 20:51:07.527506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Returning 404 to user: Instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:07.528571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7595ce2c-7937-4f76-bba4-84c2807c2da9 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5" status: 404 len: 111 microversion: 2.1 time: 0.048455 Nov 20 20:51:07.532845 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 874/1696] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:07 2021] GET /compute/v2.1/servers/f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:51:07.540377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:07.541199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:07.552167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.553781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.560079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.564968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.623083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:07.741264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9cd96770-642a-444e-90f0-42afeef1befb tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "DELETE /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 204 len: 0 microversion: 2.1 time: 0.206040 Nov 20 20:51:07.746190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 875/1697] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:07 2021] DELETE /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:07.749646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:07.751754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:07.758912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.759482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:07.760240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:07.760677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.017168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96b2f31cecf74d0793899774dc0d02f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cfe248f7eb34f6e80937503e49fd3ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:08.027565 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-757eeb0e-b93c-494d-bf6b-ac99bd0f5260 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 200 len: 1542 microversion: 2.1 time: 0.282157 Nov 20 20:51:08.028466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 876/1698] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:07 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 1542 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:08.044790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:08.047412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.055551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.056253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.057445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.058144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.128122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21880745-6638-493f-8bd0-2e97a1209575 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.098229 Nov 20 20:51:08.128796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 877/1699] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:08 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:08.136652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:08.137508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.147588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.148164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.149373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.150398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.422739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:08.434122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfc2b2dc-7d45-4828-bb53-59f33959fcde tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1468 microversion: 2.1 time: 0.304099 Nov 20 20:51:08.435241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 878/1700] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:08 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:08.441067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564e731b-fef8-42db-8af6-3500bc8c6798", "name": "network-vif-deleted", "tag": "189ed4ef-80e9-4e25-b461-a33679104e74"}, {"server_uuid": "f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5", "name": "network-vif-deleted", "tag": "d96f4ca5-742f-4e26-8329-f408e9d46a05"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:08.442991 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:08.442991 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:08.453759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:08.454519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:08.455077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:08.455583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:08.456137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:08.460978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.464095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.469659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.470675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.471907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.473748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.480045 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] Creating event network-vif-deleted:189ed4ef-80e9-4e25-b461-a33679104e74 for instance 564e731b-fef8-42db-8af6-3500bc8c6798 on nch1-master-1 Nov 20 20:51:08.480843 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] Creating event network-vif-deleted:d96f4ca5-742f-4e26-8329-f408e9d46a05 for instance f2e8f11f-bc66-4d40-8ef3-1fba3b5f97c5 on nch1-master-1 Nov 20 20:51:08.488418 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1146a2e6-1d01-4d00-a247-986aeb53aa8d req-c1a609ee-5219-4090-b181-eca8b5371a9f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051803 Nov 20 20:51:08.489216 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 879/1701] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:08 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:08.496028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Getting quotas for project 3c45e1adea264b5eacb15659df686802. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:08.499612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:08.501452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.501582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Getting quotas for user 258f39e04c364a7c88e4d025718a160b and project 3c45e1adea264b5eacb15659df686802. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:08.510893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.511510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.517926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:08.518814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.519587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.521498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:08.575030 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4bb82c27-8106-4024-808b-12bbeb467187 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.500691 Nov 20 20:51:08.575664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 823/1702] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 20:51:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 20:51:08.580924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:08.582069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.588804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.589313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.589837 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50765e8b-1375-4f8d-ac75-9cf5d5fbd23e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.099394 Nov 20 20:51:08.590151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.590593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.591184 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 880/1703] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:08 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:08.611991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:08.612594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.629031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.633342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.634383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.634834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.669599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:08.806573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fda5d78a-20ab-4cd3-918b-42e5ada8a255 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 204 len: 0 microversion: 2.1 time: 0.213201 Nov 20 20:51:08.807899 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 881/1704] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:08 2021] DELETE /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:08.816625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:08.817636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.903646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:08.916935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:08.918763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:08.919980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e94ceb17-563f-42f4-98f8-ec68cd68548d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1259 microversion: 2.21 time: 0.110417 Nov 20 20:51:08.934889 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 882/1705] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:08 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1259 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:08.940116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:08.940949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:08.950704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.951323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.954827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:08.955534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:08.992134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:09.003532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:09.005642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:09.006965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ab8c523-72a1-4224-af23-8f65081debac tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.430167 Nov 20 20:51:09.008043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 824/1706] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:08 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:09.048622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:09.051636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] [instance: e899d7fb-aca6-4434-9fbc-f7874d362f4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:09.084980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.085950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.088982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.091810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.112510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] HTTP exception thrown: Instance e899d7fb-aca6-4434-9fbc-f7874d362f4a could not be found. Nov 20 20:51:09.113463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] Returning 404 to user: Instance e899d7fb-aca6-4434-9fbc-f7874d362f4a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:09.114789 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5dd0877-3ff5-40a6-91ce-9d6223fd7e95 tempest-FloatingIPsAssociationNegativeTestJSON-816967404 tempest-FloatingIPsAssociationNegativeTestJSON-816967404-project] 10.222.0.41 "GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a" status: 404 len: 111 microversion: 2.1 time: 0.072769 Nov 20 20:51:09.116132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 825/1707] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:09 2021] GET /compute/v2.1/servers/e899d7fb-aca6-4434-9fbc-f7874d362f4a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:51:09.139379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:09.140669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:09.148200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.148946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.150281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.150986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.231508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9830fbf3-4d16-4adc-9534-fee4bcf7cf08 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.095597 Nov 20 20:51:09.235264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 826/1708] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:09 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:09.324683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:09.347165 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3dd88236-9766-42a0-82b2-69bedd06b4d4 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1498 microversion: 2.1 time: 0.410918 Nov 20 20:51:09.349631 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 883/1709] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:08 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1498 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:09.458488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:09.460210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:09.497385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.499786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.504545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.506662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.602484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:09.603964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:09.618078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.630965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.632474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.634261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.705366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17f0affe-b5ac-4e6a-9446-e00a2bf6753f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.105649 Nov 20 20:51:09.708307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 884/1710] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:09 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:09.849948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:09.861740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5f37a86-73f3-4bd7-8e5f-23405795adf6 tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1468 microversion: 2.1 time: 0.410485 Nov 20 20:51:09.862750 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 827/1711] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:09 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1468 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:09.944338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:09.948104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:09.963760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.964838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:09.965819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:09.967462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.033314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:10.034652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:10.047439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.048153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.049109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.049737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.107352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.137597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.140944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.145036 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7441e67c-fb93-41dd-ab49-9cf7e1909cff tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1311 microversion: 2.21 time: 0.209021 Nov 20 20:51:10.151223 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 885/1712] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:09 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:10.253993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:10.256303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:10.291802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.293373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.295757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.298389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.361373 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c8f78a5-a71a-4955-ab06-a760651081d9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.116621 Nov 20 20:51:10.364184 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 886/1713] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:10 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:10.379257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:10.387081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:10.396349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.397085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.398082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.398679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.525603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.540877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.543490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:10.545220 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8fb1cae-a095-4a66-a01e-72df36247554 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.521804 Nov 20 20:51:10.547149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 828/1714] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:10 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:10.572506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-76249002-6f0d-4459-a610-dc7849daa42d req-4a238326-e439-40dc-98e1-cdefccaaa4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e899d7fb-aca6-4434-9fbc-f7874d362f4a", "name": "network-vif-deleted", "tag": "a8a6b63d-5947-43c3-a9e3-80cd19d532a8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:10.574336 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:10.574336 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:10.592421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-76249002-6f0d-4459-a610-dc7849daa42d req-4a238326-e439-40dc-98e1-cdefccaaa4ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.593539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-76249002-6f0d-4459-a610-dc7849daa42d req-4a238326-e439-40dc-98e1-cdefccaaa4ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.613407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-76249002-6f0d-4459-a610-dc7849daa42d req-4a238326-e439-40dc-98e1-cdefccaaa4ae service nova] Creating event network-vif-deleted:a8a6b63d-5947-43c3-a9e3-80cd19d532a8 for instance e899d7fb-aca6-4434-9fbc-f7874d362f4a on nch2-master-1 Nov 20 20:51:10.619542 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-76249002-6f0d-4459-a610-dc7849daa42d req-4a238326-e439-40dc-98e1-cdefccaaa4ae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052630 Nov 20 20:51:10.620592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 829/1715] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:51:10.721568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:10.722944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:10.738672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.739526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.740571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.741301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.800140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b82da20e-e1ad-4c2f-99aa-4d4d79b2006a tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.080832 Nov 20 20:51:10.810187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 830/1716] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:10 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:10.883713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:10.884593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:10.905020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.913613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.918627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.924099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.994268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:10.994742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:10.995256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lazy-loading 'fault' on Instance uuid 409a187f-c361-49ef-a9a0-2762cda33448 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:11.106708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf07bddf00ea4a7da446130a6308cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75d8e50fbc2c4c13be9b56bf0078f315', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:11.120203 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87f98c5f-8825-492e-881b-85ebd92a3b4d tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 200 len: 1302 microversion: 2.1 time: 0.242373 Nov 20 20:51:11.123026 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 831/1717] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:10 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:11.138453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:11.162067 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99734443-132a-483f-af26-f96ef0aef484 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1498 microversion: 2.1 time: 0.795625 Nov 20 20:51:11.163451 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 887/1718] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:10 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1498 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:11.166530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:11.167386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:11.174620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.175345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.176442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.177203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.282724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:11.295438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:11.299231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:11.300885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4832cc59-a02e-421b-a16f-9b2cfbf0e5a8 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1317 microversion: 2.21 time: 0.138664 Nov 20 20:51:11.314904 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 832/1719] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:11 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:11.372126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:11.373950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:11.382922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.384029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.385270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.385952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.454926 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71f097cc-1beb-4621-a989-d96385c68045 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.084116 Nov 20 20:51:11.456610 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 888/1720] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:11 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:11.568106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:11.570168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:11.587614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.588442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.590702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.591718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.816671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:11.817692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:11.834320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.835027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.837938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:11.838790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:11.904732 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ad25456-176d-4957-8d81-46ee38136932 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.092069 Nov 20 20:51:11.908500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 889/1721] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:11 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:12.145351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:12.147043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] [instance: 409a187f-c361-49ef-a9a0-2762cda33448] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:12.165536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.166502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.167630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.168335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.190760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.195961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] HTTP exception thrown: Instance 409a187f-c361-49ef-a9a0-2762cda33448 could not be found. Nov 20 20:51:12.198097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] Returning 404 to user: Instance 409a187f-c361-49ef-a9a0-2762cda33448 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:12.199945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8c71cb3-f5d2-4d3e-9003-d7ed9d3f523c tempest-MigrationsAdminTest-371107644 tempest-MigrationsAdminTest-371107644-project] 10.222.0.41 "GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448" status: 404 len: 111 microversion: 2.1 time: 0.064748 Nov 20 20:51:12.201862 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 890/1722] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:12 2021] GET /compute/v2.1/servers/409a187f-c361-49ef-a9a0-2762cda33448 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:51:12.209985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:12.211350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:12.220564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.221310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.222615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.223460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.246129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.251957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.258994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6de7d1d4-8c3f-42c6-b973-8a84e0e1bf49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.695704 Nov 20 20:51:12.276120 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 833/1723] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:11 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:12.320567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:12.321525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:12.334568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.335041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.337698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.338592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.480128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.498174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.501749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.503056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22e901ae-16e4-4f00-99f2-7901fbcfc0e5 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1317 microversion: 2.21 time: 0.186872 Nov 20 20:51:12.509681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 834/1724] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:12 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:12.525244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:12.526539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:12.541708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.542171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.543127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.543867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.605634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e698ec22-9bad-4f9d-b9b3-d62d129a328f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.087059 Nov 20 20:51:12.605634 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 835/1725] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:12 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:12.691140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-df2e1c70-488e-4045-ab54-1d1a5670c02b req-eb8a6fbe-7493-4a42-85dd-17c4b3d94e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "409a187f-c361-49ef-a9a0-2762cda33448", "name": "network-vif-deleted", "tag": "28b4900d-02bb-47ff-89c0-42ceb2af1cdc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:12.693324 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:12.693324 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:12.712407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-df2e1c70-488e-4045-ab54-1d1a5670c02b req-eb8a6fbe-7493-4a42-85dd-17c4b3d94e6b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.712893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-df2e1c70-488e-4045-ab54-1d1a5670c02b req-eb8a6fbe-7493-4a42-85dd-17c4b3d94e6b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.742939 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-df2e1c70-488e-4045-ab54-1d1a5670c02b req-eb8a6fbe-7493-4a42-85dd-17c4b3d94e6b service nova] Creating event network-vif-deleted:28b4900d-02bb-47ff-89c0-42ceb2af1cdc for instance 409a187f-c361-49ef-a9a0-2762cda33448 on nch2-master-1 Nov 20 20:51:12.756597 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-df2e1c70-488e-4045-ab54-1d1a5670c02b req-eb8a6fbe-7493-4a42-85dd-17c4b3d94e6b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068274 Nov 20 20:51:12.757618 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 836/1726] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:51:12.910138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:12.921105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:12.921328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ed877d6-4b0a-4285-a969-3d8099ce8cbb tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 200 len: 1498 microversion: 2.1 time: 0.717698 Nov 20 20:51:12.924409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:12.925291 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 891/1727] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:12 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 1498 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:12.941463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.942085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:12.945033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:12.945510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.049698 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afc9c637-0de5-4637-8095-044cbfd80397 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.133928 Nov 20 20:51:13.055019 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 837/1728] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:12 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:13.283307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:13.283924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:13.306354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.307118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.308188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.309014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.529311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:13.530322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:13.542516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.544297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.545199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.555237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.813298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.825968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.829835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.831964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ca15006-e200-4b2e-b6f4-d781f32c3c0d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.307674 Nov 20 20:51:13.832704 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 838/1729] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:13 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:51:13.840044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:13.841379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:13.850158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.850834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.852183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.852799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.911197 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-044a376f-cb46-4ced-93a1-6160cd34166b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.076644 Nov 20 20:51:13.912290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 839/1730] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:13 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:13.919937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.932583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.934745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:13.936945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-539a2e9f-fbce-4115-a621-7dd7e967b6c1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.657789 Nov 20 20:51:13.950235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 892/1731] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:13 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:13.957495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:13.958254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: c352e82a-20f7-44a4-a047-019ee6b6785b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:13.965278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.966344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.967341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:13.967936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:13.991761 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] HTTP exception thrown: Instance c352e82a-20f7-44a4-a047-019ee6b6785b could not be found. Nov 20 20:51:13.992506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Returning 404 to user: Instance c352e82a-20f7-44a4-a047-019ee6b6785b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:13.994378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-164cc235-b384-411c-b5a6-36fff95b046e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b" status: 404 len: 111 microversion: 2.1 time: 0.043056 Nov 20 20:51:13.995856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 893/1732] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:13 2021] GET /compute/v2.1/servers/c352e82a-20f7-44a4-a047-019ee6b6785b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:14.005143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.006274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:14.015221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.016452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.017065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.017755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.056941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:14.168117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7a54180-df77-42d9-bb9a-da7945d824d0 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 204 len: 0 microversion: 2.1 time: 0.167282 Nov 20 20:51:14.169401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 894/1733] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:13 2021] DELETE /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:14.220691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:14.221743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:14.233248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.235810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.238611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.239058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.314916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a196b63-6414-43d4-ac70-219097af5c6f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.143579 Nov 20 20:51:14.320019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 895/1734] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:14 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:14.322082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.323772 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:14.323772 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:14.325654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.326381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:14.326600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.327709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.333384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.335049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.335219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.336091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.337849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.338600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.368091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-648fc356-f435-446a-b89f-82bd3c162327 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.454373 Nov 20 20:51:14.369045 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 840/1735] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:51:13 2021] GET /compute/v2.1/os-services => generated 947 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:14.392165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.394433 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:14.394433 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:14.398427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.398427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.398892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.399647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.434081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44d21b26-aa2e-452e-a2d6-a5652fe20ab6 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.054707 Nov 20 20:51:14.434081 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 841/1736] 10.222.0.41 () {58 vars in 1173 bytes} [Sat Nov 20 20:51:14 2021] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:14.446839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.448503 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:14.448503 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:14.450484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.451057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.452067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.452490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.486255 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2e7c9fd-80fd-4bfc-a8aa-92d098d4bb11 tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042593 Nov 20 20:51:14.490427 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 842/1737] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:51:14 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:51:14.498422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.500459 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:14.500459 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:14.503192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.503794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.504776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.505882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.546563 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05f35dde-b0cd-4ef4-91bb-ac40ab112b3b tempest-ServicesAdminTestJSON-411712539 tempest-ServicesAdminTestJSON-411712539-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.052106 Nov 20 20:51:14.548693 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 843/1738] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:51:14 2021] GET /compute/v2.1/os-services => generated 947 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:14.760957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:14.772340 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-122d8672-d381-41f6-88b7-1667118d9985 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1485 microversion: 2.1 time: 0.449534 Nov 20 20:51:14.786235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 896/1739] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:14 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1485 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:14.794365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3652d772-e75e-4829-a4fe-409b75af8af2 req-b638b8c2-8c37-4348-8ed1-d75ba6f5a74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352e82a-20f7-44a4-a047-019ee6b6785b", "name": "network-vif-deleted", "tag": "870f5ce2-c00b-40f9-84c6-8fa23fcf05bc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:14.798757 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:14.798757 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:14.819531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3652d772-e75e-4829-a4fe-409b75af8af2 req-b638b8c2-8c37-4348-8ed1-d75ba6f5a74e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.821292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3652d772-e75e-4829-a4fe-409b75af8af2 req-b638b8c2-8c37-4348-8ed1-d75ba6f5a74e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.836195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3652d772-e75e-4829-a4fe-409b75af8af2 req-b638b8c2-8c37-4348-8ed1-d75ba6f5a74e service nova] Creating event network-vif-deleted:870f5ce2-c00b-40f9-84c6-8fa23fcf05bc for instance c352e82a-20f7-44a4-a047-019ee6b6785b on nch2-master-1 Nov 20 20:51:14.843108 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3652d772-e75e-4829-a4fe-409b75af8af2 req-b638b8c2-8c37-4348-8ed1-d75ba6f5a74e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054989 Nov 20 20:51:14.844512 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 844/1740] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:14.852425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:14.853057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:14.861397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.862124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.863061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.863558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.925732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:14.926866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:14.944121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.944656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:14.948240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:14.951249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.037015 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4fda6dc-628d-4369-8706-7b37e23423e3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.116260 Nov 20 20:51:15.037836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 845/1741] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:14 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:15.050791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:15.051544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:15.073803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.074214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.076580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.077794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.364576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.381120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.382763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.384209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39cbe2d5-27bf-44e4-93ee-ab88de6f2e12 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.537666 Nov 20 20:51:15.385319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 897/1742] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:14 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:15.396636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:15.401261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:15.419344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.420028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.431184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.431882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.509661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.534789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.536114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:15.537286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1c09a33-7c72-48c5-b58b-4700f566f638 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.496467 Nov 20 20:51:15.537841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 846/1743] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:15 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:15.557375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a6a9798b-d226-47b1-a987-53bfce6798f6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.170062 Nov 20 20:51:15.558372 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 898/1744] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:15 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:15.794343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:15.795375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:15.809098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.811037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:15.813657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:15.814553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.051485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:16.052870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:16.069454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.070892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.073898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.077016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.149381 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a4129d7-724b-41cd-921c-31b89856f5b7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.101637 Nov 20 20:51:16.151142 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 899/1745] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:16 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:16.240888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:16.248613 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-709c8b26-f292-4343-968a-286cfb3f2947 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 200 len: 1485 microversion: 2.1 time: 0.459500 Nov 20 20:51:16.249277 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 847/1746] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:15 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 1485 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:16.407258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:16.408003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:16.418953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.420870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.423639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.424287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.560877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:16.564263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:16.580745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.581219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.594750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.595554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.779773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:16.790337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:16.792241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:16.793754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec8013c0-7930-44be-8570-da34b6331852 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.391722 Nov 20 20:51:16.795107 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 900/1747] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:16 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:16.811209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:16.814272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:16.824111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.825088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.825880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:16.826517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:16.927617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a92fb8a-e3c5-423a-9838-78a5793c8983 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.130152 Nov 20 20:51:16.928341 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 901/1748] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:16 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:17.133999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:17.146028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:17.147720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:17.149006 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-253fee29-859d-4603-a237-954781e63d99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.594140 Nov 20 20:51:17.149895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 848/1749] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:16 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:17.362828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce4d82a-c0e6-4b0d-8432-dda5272c912c", "tag": "e5218971-643c-4f34-9516-8e59cfb95177"}, {"server_uuid": "f67bb1ce-5e3e-497f-af2f-54d0c33e27e2", "name": "network-vif-deleted", "tag": "1ebb075b-0271-4950-a74a-182cc4a744f5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:17.365138 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:17.365138 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:17.378930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.379728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.395034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] Creating event network-changed:e5218971-643c-4f34-9516-8e59cfb95177 for instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c on nch1-master-1 Nov 20 20:51:17.396064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] Creating event network-vif-deleted:1ebb075b-0271-4950-a74a-182cc4a744f5 for instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 on nch1-master-1 Nov 20 20:51:17.404710 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-eb8920be-d747-4ad8-bda3-3664c475dd4e req-d6febd25-97fa-4326-8937-50dc17955be7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.473259 Nov 20 20:51:17.405576 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 902/1750] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:16 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:17.421138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:17.422535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:17.446752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.447605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.448384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.448825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.488585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96f86d3b-59f6-4f0e-a33b-a928e7951362 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f98e2b5e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:17.522780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8dceebb-a75e-4209-96a2-73daf4b02f0d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.115391 Nov 20 20:51:17.526490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 903/1751] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:17 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:17.540753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:17.546256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: f67bb1ce-5e3e-497f-af2f-54d0c33e27e2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:17.571528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.572001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.572924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.573347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.621226 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] HTTP exception thrown: Instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 could not be found. Nov 20 20:51:17.625838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Returning 404 to user: Instance f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:17.629828 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abe9ff22-d36f-4589-b884-0be1beed1bf5 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2" status: 404 len: 111 microversion: 2.1 time: 0.098523 Nov 20 20:51:17.631157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96f86d3b-59f6-4f0e-a33b-a928e7951362 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903" status: 200 len: 371 microversion: 2.1 time: 0.480159 Nov 20 20:51:17.631984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 849/1752] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:51:17 2021] GET /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903 => generated 371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:17.649658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Action: 'update', calling method: .version_select at 0x7f3f98e85550>, body: {"quota_set": {"ram": "5120"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:17.652775 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 904/1753] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:17 2021] GET /compute/v2.1/servers/f67bb1ce-5e3e-497f-af2f-54d0c33e27e2 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:17.653632 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:17.653632 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:17.659295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:17.663086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:17.676424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.681826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.682900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.683649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.753180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:17.786939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.787351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.788153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.802379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.945153 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d08c2421-f076-413d-be84-ce2aeeedfecf tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903" status: 200 len: 328 microversion: 2.1 time: 0.298315 Nov 20 20:51:17.946232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 850/1754] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:51:17 2021] PUT /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903 => generated 328 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:17.959179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:17.960208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:17.972782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30dd8012-ed54-427b-a098-48bb8af1ee88 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 204 len: 0 microversion: 2.1 time: 0.317225 Nov 20 20:51:17.973844 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 905/1755] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:17 2021] DELETE /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:17.974740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.975505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.976855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:17.977712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:17.983086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:17.985217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:18.005986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.006768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:18.007789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.008732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:18.070300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2443a6e-07d4-4f4d-8b06-ee8947aa3d03 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.094223 Nov 20 20:51:18.072178 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 906/1756] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:17 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:18.082435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-024fe8d3-8a53-4d63-a905-27e009df730d tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:18.083954 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:18.083954 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:18.099846 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-024fe8d3-8a53-4d63-a905-27e009df730d tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903" status: 202 len: 0 microversion: 2.1 time: 0.025875 Nov 20 20:51:18.101165 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 907/1757] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 20:51:18 2021] DELETE /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:18.107604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:18.108921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:18.118982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.120116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:18.122159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.122868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:18.273111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:18.290691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:18.294324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:18.297781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b7528e6-4cb7-46fa-9400-080690a100e9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.343110 Nov 20 20:51:18.298910 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 851/1758] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:17 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:18.304618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d8db4ff-bb01-4d10-984c-7039c97464a8 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f8767d8b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:18.584956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d8db4ff-bb01-4d10-984c-7039c97464a8 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903" status: 200 len: 371 microversion: 2.1 time: 0.283680 Nov 20 20:51:18.586332 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 852/1759] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:51:18 2021] GET /compute/v2.1/os-quota-sets/c91387710c784274bcf155138f08b903 => generated 371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:18.606722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:18.608500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:18.633611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.634428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:18.638021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:18.639892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.025619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.039174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.040887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.042899 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-886e0cc5-ffe5-44f0-814a-66987bd5b927 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.454125 Nov 20 20:51:19.044097 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 853/1760] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:18 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:19.050746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:19.052065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:19.060696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.061451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.063186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.063789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.133742 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b61a6f8f-b48e-4620-9592-7edb8e4f2285 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.087652 Nov 20 20:51:19.134643 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 854/1761] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:19 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:19.146723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-efa0e3e9-0b14-4d32-9b76-0a715244b6f5 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f87632c10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:19.209315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.231032 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf47dd2b-95e6-4513-8181-556c529b842b tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1499 microversion: 2.1 time: 1.127644 Nov 20 20:51:19.231657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 908/1762] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:18 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1499 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:19.262778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:19.263690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:19.287259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.287965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.289071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.289676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.352087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b0b97ac-c057-4bc2-a69b-a134051b86e0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.110585 Nov 20 20:51:19.356248 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 909/1763] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:19 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:19.370653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:19.371909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:19.386807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.387626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.389280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:19.391605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:19.623503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-efa0e3e9-0b14-4d32-9b76-0a715244b6f5 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.487463 Nov 20 20:51:19.633252 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 855/1764] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:51:19 2021] GET /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e/defaults => generated 371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:19.814656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.827061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.830370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:19.831767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4097ec3e-7a35-4bd7-bb81-f3d2328a2f51 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.476270 Nov 20 20:51:19.843626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 910/1765] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:19 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:20.070007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:20.072310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:20.099340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.101286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.102614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a4e372a3-8137-4563-8312-25fe5b4ec33e req-9df74f87-97ba-4593-a0ca-8796c99e3836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40", "name": "network-vif-deleted", "tag": "6b6045ba-274e-4026-bce3-97b2ebae1812"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:20.102810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.104847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.105630 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:20.105630 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:20.117900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4e372a3-8137-4563-8312-25fe5b4ec33e req-9df74f87-97ba-4593-a0ca-8796c99e3836 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.118423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4e372a3-8137-4563-8312-25fe5b4ec33e req-9df74f87-97ba-4593-a0ca-8796c99e3836 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.133748 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a4e372a3-8137-4563-8312-25fe5b4ec33e req-9df74f87-97ba-4593-a0ca-8796c99e3836 service nova] Creating event network-vif-deleted:6b6045ba-274e-4026-bce3-97b2ebae1812 for instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 on nch2-master-1 Nov 20 20:51:20.141566 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a4e372a3-8137-4563-8312-25fe5b4ec33e req-9df74f87-97ba-4593-a0ca-8796c99e3836 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Nov 20 20:51:20.147825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 911/1766] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:51:20.153425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:20.155239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:20.164461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.165420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.166497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.167129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.230183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85c21114-fc0b-476f-9b7e-30f598219db6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.076899 Nov 20 20:51:20.232922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 912/1767] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:20 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:20.249145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:20.249875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:20.265700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.267523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.268534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.271643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.348335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.350180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.351289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lazy-loading 'fault' on Instance uuid 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:20.455606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb46ce41ca44f57aeef1d6b2191b4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e5736eff1924fa28c0a00ae3da90174', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:20.470020 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-603bd304-687d-48e8-acdf-f418dc8b4247 tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 200 len: 1301 microversion: 2.1 time: 0.223758 Nov 20 20:51:20.479522 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 913/1768] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:20 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 1301 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:20.479522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Action: 'update', calling method: .version_select at 0x7f3f8737ed30>, body: {"quota_set": {"ram": "5120"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:20.480874 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:20.480874 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:20.571619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:20.597899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:20.600062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:20.601726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a7c717d-e658-4e80-9734-b0cb7f5506fb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.542679 Nov 20 20:51:20.619843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 856/1769] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:20 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:20.627215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:20.628839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:20.637370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.637868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.638792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.639232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.701520 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-beecd500-98b9-4242-ad6d-45c131605afd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.071590 Nov 20 20:51:20.701520 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 857/1770] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:20 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:20.850999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:20.851720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:20.858851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.859736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:20.860733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:20.861377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.035180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:21.046764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:21.048353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:21.049499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec23e939-e54e-4a04-b938-555bb393f42b tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.202558 Nov 20 20:51:21.050094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 858/1771] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:20 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:51:21.087166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.087780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.091270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.091856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.162747 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26559a96-cb98-4cc2-8b87-c7a10bf4b288 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185" status: 200 len: 328 microversion: 2.1 time: 0.690219 Nov 20 20:51:21.168444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 914/1772] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 20:51:20 2021] PUT /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185 => generated 328 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:21.173916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f876329d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:21.253048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:21.255414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:21.264112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.270398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.272323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.273764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.358736 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18f1848b-1ec8-403e-884a-6ef68a4f9fc7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.117331 Nov 20 20:51:21.361612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 915/1773] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:21 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:21.435201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d18f33e-a56a-4f70-9dda-3887e0022f15 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f86fd5af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:21.439602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.440357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.441495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.442216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.472280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c52c1d32-a178-4a67-9232-9a953e511534 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185/detail" status: 200 len: 916 microversion: 2.1 time: 0.301537 Nov 20 20:51:21.474626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 859/1774] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:51:21 2021] GET /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185/detail => generated 916 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:21.506436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:21.507595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] [instance: 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:21.514645 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d18f33e-a56a-4f70-9dda-3887e0022f15 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e" status: 200 len: 637 microversion: 2.1 time: 0.083773 Nov 20 20:51:21.524739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.525358 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 916/1775] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:21 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e => generated 637 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:51:21.525983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.527178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.528020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.534815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71f00af6-f37d-4fca-8378-add9905dd422 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f86f7faf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:21.572843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] HTTP exception thrown: Instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 could not be found. Nov 20 20:51:21.573585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] Returning 404 to user: Instance 7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:21.574536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-227b737c-e5f2-41c8-aee5-d3331fac959e tempest-LiveMigrationTest-514169898 tempest-LiveMigrationTest-514169898-project] 10.222.0.41 "GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40" status: 404 len: 111 microversion: 2.1 time: 0.085849 Nov 20 20:51:21.575656 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 860/1776] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:21 2021] GET /compute/v2.1/servers/7a248eb6-60b6-4f9f-8b2a-1c33cf13ca40 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:51:21.623798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:21.624253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:21.633803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.634522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.635165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:21.635502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:21.636310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-71f00af6-f37d-4fca-8378-add9905dd422 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:21.645553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-71f00af6-f37d-4fca-8378-add9905dd422 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:22.089671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.102146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.106869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.108076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0d2b581-3d24-44c3-b004-cbf75d9cb75b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.488192 Nov 20 20:51:22.111252 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 861/1777] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:21 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:51:22.122190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:22.123460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:22.131720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.132595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.133579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.134494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.185192 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a93a3648-8a86-4b3e-8479-c079fb0dc771 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.071319 Nov 20 20:51:22.188760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 862/1778] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:22 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:22.205174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87731430>, body: {"quota_set": {"ram": "2048"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:22.207792 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:22.207792 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:22.314473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71f00af6-f37d-4fca-8378-add9905dd422 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.786697 Nov 20 20:51:22.315671 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 917/1779] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:21 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:22.320311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:22.321279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:22.330042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.331244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.333552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.335103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.337449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.337819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.338665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.339162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.386212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.386693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.388208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.388824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.485426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-720f6053-0db8-44eb-8e1f-4e8745e48b19 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185?user_id=caa77592a44e4fac89718c6182bc7dd2" status: 200 len: 328 microversion: 2.1 time: 0.293670 Nov 20 20:51:22.488261 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 863/1780] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 20:51:22 2021] PUT /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185?user_id=caa77592a44e4fac89718c6182bc7dd2 => generated 328 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:22.494065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70d2ffd6-4985-45c6-9eb6-34b50e42be58 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f98e9fb80>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:22.736419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.749214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.752545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:22.753929 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b2f46fe-9cc7-407e-ba85-b362db0eb14e tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.437086 Nov 20 20:51:22.754760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 918/1781] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:22 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:22.760158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:22.762434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:22.773112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.773810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.775600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:22.776245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:22.837921 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d843f01-6979-4905-83a9-b587bf46728c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.081602 Nov 20 20:51:22.840312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 919/1782] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:22 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:22.848435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0339055-4f6d-4c10-b59a-7c7f9fcdb7c4 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f86f9fd30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:23.011055 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0339055-4f6d-4c10-b59a-7c7f9fcdb7c4 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185?user_id=caa77592a44e4fac89718c6182bc7dd2" status: 200 len: 370 microversion: 2.1 time: 0.152173 Nov 20 20:51:23.012252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 920/1783] 10.222.0.41 () {58 vars in 1322 bytes} [Sat Nov 20 20:51:22 2021] GET /compute/v2.1/os-quota-sets/ac16093b8c9e4602a5947d3f76008185?user_id=caa77592a44e4fac89718c6182bc7dd2 => generated 370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:23.102937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70d2ffd6-4985-45c6-9eb6-34b50e42be58 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "DELETE /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.612941 Nov 20 20:51:23.103465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 864/1784] 10.222.0.41 () {58 vars in 1295 bytes} [Sat Nov 20 20:51:22 2021] DELETE /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_version => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:23.112888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6e1a9ad-c3f6-45d0-a289-5bbe068470cc tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f8767b280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:23.178885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6e1a9ad-c3f6-45d0-a289-5bbe068470cc tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070783 Nov 20 20:51:23.179876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 865/1785] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:51:23 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:23.194483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3ff50897-dbda-45b2-a5a0-c6c17c0a6c24 req-52b41eeb-1fa0-46d0-ae71-e83bb40aa545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce4d82a-c0e6-4b0d-8432-dda5272c912c", "name": "network-vif-plugged", "status": "completed", "tag": "e5218971-643c-4f34-9516-8e59cfb95177"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:23.196141 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:23.196141 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:23.199423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:23.200957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:23.213403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3ff50897-dbda-45b2-a5a0-c6c17c0a6c24 req-52b41eeb-1fa0-46d0-ae71-e83bb40aa545 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:23.216789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3ff50897-dbda-45b2-a5a0-c6c17c0a6c24 req-52b41eeb-1fa0-46d0-ae71-e83bb40aa545 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:23.226548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:23.226920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:23.228395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:23.230471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:23.249627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3ff50897-dbda-45b2-a5a0-c6c17c0a6c24 req-52b41eeb-1fa0-46d0-ae71-e83bb40aa545 service nova] Creating event network-vif-plugged:e5218971-643c-4f34-9516-8e59cfb95177 for instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c on nch1-master-1 Nov 20 20:51:23.264882 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3ff50897-dbda-45b2-a5a0-c6c17c0a6c24 req-52b41eeb-1fa0-46d0-ae71-e83bb40aa545 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250569 Nov 20 20:51:23.283008 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 921/1786] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:23.294629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5d2e4da-b1aa-442f-b3a5-0c45ebf1aa67 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f873710d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:23.362112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d5d2e4da-b1aa-442f-b3a5-0c45ebf1aa67 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:23.370121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d5d2e4da-b1aa-442f-b3a5-0c45ebf1aa67 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:23.698225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:23.709695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:23.711905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:23.713432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ec9eb02-b479-4b61-82af-f5359f26165d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.532316 Nov 20 20:51:23.714314 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 866/1787] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:23 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:23.719918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:23.721471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:23.730276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:23.730663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:23.731516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:23.732399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:23.785457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5d2e4da-b1aa-442f-b3a5-0c45ebf1aa67 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.499115 Nov 20 20:51:23.786025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a54ca03c-baa1-4148-9419-186eab9f08fd tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.070204 Nov 20 20:51:23.786193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 922/1788] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:23 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:23.787106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 867/1789] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:23 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:23.792159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0ebd840-4321-4088-b2ab-fdb4af00f8dd tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Calling method '.version_select at 0x7f3f87ac4a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:24.045250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1956912579", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7ac3ab90-d288-4bb5-99a9-c81df0147689"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:24.062516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0ebd840-4321-4088-b2ab-fdb4af00f8dd tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e/defaults" status: 200 len: 371 microversion: 2.1 time: 0.273850 Nov 20 20:51:24.071007 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 868/1790] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:51:23 2021] GET /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e/defaults => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:24.086710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:24.088294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:24.096824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.097544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.098763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.099764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.115162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] validate_networks() for [('7ac3ab90-d288-4bb5-99a9-c81df0147689', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:24.269297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:24.279011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:24.281462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:24.288915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40cdb983-9057-499f-a899-11cbdc9071e1 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1359 microversion: 2.21 time: 0.216451 Nov 20 20:51:24.289647 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 869/1791] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:24 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:24.312152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82aecaf3-511e-4f80-9b80-35211eeabbf1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f8767b280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:24.362532 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82aecaf3-511e-4f80-9b80-35211eeabbf1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.060092 Nov 20 20:51:24.363930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 870/1792] 10.222.0.41 () {58 vars in 1289 bytes} [Sat Nov 20 20:51:24 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_distro => generated 33 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:24.370453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:24.371497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:24.378345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.378800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.379597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.380036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.431808 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0588f47-0086-4b45-864a-a5d7bfdff325 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.065522 Nov 20 20:51:24.433817 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 871/1793] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:24 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:24.440261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Action: 'update', calling method: .version_select at 0x7f3f8767baf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:24.443539 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:24.443539 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:24.604626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:24.605215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:24.605795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:24.606285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:24.607052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:24.628115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.628689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.629607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.631869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.661409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:24.668817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for user 48554aa52ebf468fa74262b1bf8ab300 and project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:24.693883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:24.697492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:24.783584 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1d81fdd-818c-4ae8-9541-2ebc43f91986 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996053 Nov 20 20:51:24.784287 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 923/1794] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:51:24.795541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86c4ea02-91a9-4bf4-8f0f-cb81d8a741a5 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f86fd53a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:24.854496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.856057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.860237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:24.861521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:24.936571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-86c4ea02-91a9-4bf4-8f0f-cb81d8a741a5 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:24.944393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-86c4ea02-91a9-4bf4-8f0f-cb81d8a741a5 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:25.248094 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b01d6730-ec99-4578-9fe6-da9ac9684d07 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e" status: 200 len: 329 microversion: 2.1 time: 0.811456 Nov 20 20:51:25.250600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 872/1795] 10.222.0.41 () {60 vars in 1262 bytes} [Sat Nov 20 20:51:24 2021] PUT /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e => generated 329 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:25.265222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:25.265984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:25.282695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.283784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.285851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.286356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.314497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86c4ea02-91a9-4bf4-8f0f-cb81d8a741a5 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.528736 Nov 20 20:51:25.316057 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 924/1796] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:24 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:25.324290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee15d638-3b38-4576-af11-6cab2ad0eb61 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:25.325460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee15d638-3b38-4576-af11-6cab2ad0eb61 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:25.420099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee15d638-3b38-4576-af11-6cab2ad0eb61 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.431544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee15d638-3b38-4576-af11-6cab2ad0eb61 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1208 microversion: 2.1 time: 0.113613 Nov 20 20:51:25.432295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 925/1797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:25 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1208 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:25.449950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:25.451799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:25.458788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.459376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.460625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.460844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.506914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5077bbc3-ab10-4f1c-92a2-1fc914f99eb0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.061779 Nov 20 20:51:25.507949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 926/1798] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:25 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:25.518958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Action: 'update', calling method: .version_select at 0x7f3f86fd5a60>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:25.521417 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:25.521417 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:25.631192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.643832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.650645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.652587 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-046e5652-af2e-4e3c-afe9-440bc899f8e3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.400237 Nov 20 20:51:25.653669 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 873/1799] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:25 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:25.659222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:25.660085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:25.667297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.667997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.669225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.669858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.851746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.860629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.862339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:25.864030 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ca774c3-ead7-426d-b64a-8b79025fd8a9 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1550 microversion: 2.21 time: 0.208570 Nov 20 20:51:25.864926 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 874/1800] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:25 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1550 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:25.869258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-23ce197a-429d-486c-aefc-f45e87c81546 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f98e81c10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:25.915803 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-23ce197a-429d-486c-aefc-f45e87c81546 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.049825 Nov 20 20:51:25.917027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.917530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 875/1801] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:51:25 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:25.918224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.922554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.923365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.927725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "39839f43-d46e-414e-93c9-a7955f617fd1"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "d62e09bc-0a07-428d-96cb-5ce7f5c99f7f"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:25.929379 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:25.929379 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:25.936980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.937619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.950728 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] Creating event network-vif-plugged:39839f43-d46e-414e-93c9-a7955f617fd1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:25.951236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] Creating event network-vif-plugged:d62e09bc-0a07-428d-96cb-5ce7f5c99f7f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:25.957864 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f01db063-af28-41fd-a55c-e9e40e2a3603 req-d777dda1-cc59-440e-b49d-29db0ec8d996 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033727 Nov 20 20:51:25.958513 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 876/1802] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:25 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:25.965248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:25.965248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:25.973742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.973742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:25.974371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:25.974806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.026311 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c900b2b-c417-4bff-9baf-bd80889796df tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 24565 microversion: 2.1 time: 0.065938 Nov 20 20:51:26.033856 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 877/1803] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:25 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 24565 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:26.041561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:26.042716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:26.051497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.051947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.053117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.053356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.101840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:26.244082 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b2182ec-0de5-451c-ad31-dacfdabdeb7c tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 204 len: 0 microversion: 2.21 time: 0.205404 Nov 20 20:51:26.246930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 878/1804] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:26 2021] DELETE /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:26.257907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6493f845-67fb-42c1-82ff-97cbf17be916 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f98e9fa60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:26.362312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6493f845-67fb-42c1-82ff-97cbf17be916 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:26.372945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6493f845-67fb-42c1-82ff-97cbf17be916 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:26.444213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-636b576b-e8f4-4c0d-a9f7-d0f026e16588 tempest-QuotasAdminTestJSON-444104179 tempest-QuotasAdminTestJSON-444104179-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e" status: 200 len: 329 microversion: 2.1 time: 0.932739 Nov 20 20:51:26.455851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 927/1805] 10.222.0.41 () {60 vars in 1262 bytes} [Sat Nov 20 20:51:25 2021] PUT /compute/v2.1/os-quota-sets/e55eb37f1e514f8f84051ddebdb9765e => generated 329 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:26.460970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:26.461926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:26.468985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.469715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.470534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.471125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.732411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:26.741308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:26.742837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:26.744206 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4143de8f-2c04-40dc-b978-e209d804a739 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1556 microversion: 2.21 time: 0.287117 Nov 20 20:51:26.744806 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 928/1806] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:26 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1556 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:26.754324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:26.754794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:26.773019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.774377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.775545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.776219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.888967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:26.899065 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba36e5ed-9180-4062-b65e-e65ad46077f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1266 microversion: 2.1 time: 0.153505 Nov 20 20:51:26.899884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 929/1807] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:26 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:26.913557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6493f845-67fb-42c1-82ff-97cbf17be916 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.665217 Nov 20 20:51:26.918214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:26.919276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 879/1808] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:26 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:26.919420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:26.925404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:26.926176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:26.926624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.927086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.927898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.928349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.932475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.932923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:26.933720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:26.934195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:27.009466 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e4f971d-b6aa-4e43-b79d-5df576545f10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.100813 Nov 20 20:51:27.013581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 930/1809] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:26 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:27.178496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:27.189595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:27.190885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:27.191680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a96f38b1-72ab-4c26-a4f8-7c03d4722491 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.271417 Nov 20 20:51:27.198313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 880/1810] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:26 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:27.198313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12d4098a-d062-40bd-9ba0-337056788fad tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f98e2b550>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:27.258032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-12d4098a-d062-40bd-9ba0-337056788fad tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:27.261958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-12d4098a-d062-40bd-9ba0-337056788fad tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:27.307079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12bf73d6-652f-41ed-b109-b5948b947725 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] Calling method '.version_select at 0x7f3f86ee7ee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:27.606566 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12d4098a-d062-40bd-9ba0-337056788fad tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.412617 Nov 20 20:51:27.607300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 881/1811] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:27 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 64 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:27.615637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:27.616536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:27.621574 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12bf73d6-652f-41ed-b109-b5948b947725 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] 10.222.0.41 "GET /compute/v2.1/os-networks" status: 200 len: 8093 microversion: 2.1 time: 0.610099 Nov 20 20:51:27.622471 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 931/1812] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:51:27 2021] GET /compute/v2.1/os-networks => generated 8093 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:27.627979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:27.628428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:27.628689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0013e609-acd2-411d-9448-4beb6e92757d tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f872599d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:27.629309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:27.634092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:27.677126 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0013e609-acd2-411d-9448-4beb6e92757d tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.053271 Nov 20 20:51:27.677703 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 932/1813] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:51:27 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 64 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:27.682604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e45f603-010b-48d4-bc93-6e8ead86ac42 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] Calling method '.version_select at 0x7f3f8711de50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:27.688695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7589be8-6f09-45fc-a6e2-ffeda65f6e50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.079330 Nov 20 20:51:27.689438 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 882/1814] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:27 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:27.697657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62fbfdd8-75b3-4dd6-905e-6fbd67b6efd1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f8764fee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:27.752478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62fbfdd8-75b3-4dd6-905e-6fbd67b6efd1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:27.759077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62fbfdd8-75b3-4dd6-905e-6fbd67b6efd1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:27.925614 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e45f603-010b-48d4-bc93-6e8ead86ac42 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] 10.222.0.41 "GET /compute/v2.1/os-networks/a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb" status: 200 len: 652 microversion: 2.1 time: 0.246230 Nov 20 20:51:27.928122 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 933/1815] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 20:51:27 2021] GET /compute/v2.1/os-networks/a3dbdbe4-2d8c-4b44-8bf0-0b6d324b5beb => generated 652 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:27.936103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:27.936976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:27.945495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:27.946484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:27.947462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:27.948358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.132088 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62fbfdd8-75b3-4dd6-905e-6fbd67b6efd1 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441292 Nov 20 20:51:28.132936 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 883/1816] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:27 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:28.138703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:28.139432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:28.146689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.147133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.148085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.148514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.294244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:28.302761 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c8305cc-5d57-463d-a6c0-d4699784c63d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.168806 Nov 20 20:51:28.303528 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 884/1817] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:28 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:28.309156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6aba4aa-f3ef-43a9-a5b9-c18fcc9a63a5 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] Calling method '.version_select at 0x7f3f98e2bf70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:28.407350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:28.415709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:28.417497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:28.419390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e61882f-e420-40bf-b36e-15150de38378 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1556 microversion: 2.21 time: 0.489800 Nov 20 20:51:28.419981 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 934/1818] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:27 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1556 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:28.425842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "46000a03-6d74-43bc-957f-eb13e3558ac6"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "8d29ec6b-5e92-4f5c-9a33-b37b39856ff1"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "1906ffcc-f920-4444-989d-3996e905079f"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "74631941-cda7-49c4-b33a-f60122f88759"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-plugged", "status": "completed", "tag": "a2255729-67f4-48eb-af4e-86e677b04463"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:28.428180 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:28.428180 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:28.436327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.436845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.449803 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Creating event network-vif-plugged:46000a03-6d74-43bc-957f-eb13e3558ac6 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:28.450445 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Creating event network-vif-plugged:8d29ec6b-5e92-4f5c-9a33-b37b39856ff1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:28.451042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Creating event network-vif-plugged:1906ffcc-f920-4444-989d-3996e905079f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:28.451612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Creating event network-vif-plugged:74631941-cda7-49c4-b33a-f60122f88759 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:28.452175 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] Creating event network-vif-plugged:a2255729-67f4-48eb-af4e-86e677b04463 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:28.458731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e7de3756-97ba-4342-b3ce-8b796034b73e req-da5aa9d9-ff7e-43c9-b85f-c51b0322922b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.037418 Nov 20 20:51:28.459340 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 935/1819] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:28 2021] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:28.464652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:28.465845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:28.472902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.473358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.474307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.474745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.524426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-820ffecf-a038-4848-a0e3-bdd21024c7c3 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.063112 Nov 20 20:51:28.527854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 936/1820] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:28 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:28.545450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ed860ad-a5a4-42ab-896c-8f158e97a185 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update', calling method: .version_select at 0x7f3f87172ca0>, body: {"meta": {"os_version": "alt"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:28.573961 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6aba4aa-f3ef-43a9-a5b9-c18fcc9a63a5 tempest-NetworksTest-2036631581 tempest-NetworksTest-2036631581-project-admin] 10.222.0.41 "GET /compute/v2.1/os-networks" status: 200 len: 8093 microversion: 2.1 time: 0.269307 Nov 20 20:51:28.574830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 885/1821] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:51:28 2021] GET /compute/v2.1/os-networks => generated 8093 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:28.581386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:28.582281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:28.591966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.592566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.594360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:28.595307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:28.613057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2ed860ad-a5a4-42ab-896c-8f158e97a185 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:28.618610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2ed860ad-a5a4-42ab-896c-8f158e97a185 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:29.021380 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ed860ad-a5a4-42ab-896c-8f158e97a185 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.489243 Nov 20 20:51:29.023027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 937/1822] 10.222.0.41 () {60 vars in 1312 bytes} [Sat Nov 20 20:51:28 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata/os_version => generated 31 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:29.029733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:29.031405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:29.044259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.044975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.045992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.047724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.093739 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea319e93-4e97-428b-954b-bc82b7f8638c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.068902 Nov 20 20:51:29.095624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 938/1823] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:29 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:29.104270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e2cd6ab2-cae7-4b6c-92bf-246532bc3b44 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f873844c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:29.163868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e2cd6ab2-cae7-4b6c-92bf-246532bc3b44 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.066580 Nov 20 20:51:29.165067 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 939/1824] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:51:29 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 58 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:29.170718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f9024b88-0820-4255-a46c-82d175240a1a req-bbd6826c-0872-4627-8d71-a0ecfc0207e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce4d82a-c0e6-4b0d-8432-dda5272c912c", "name": "network-vif-deleted", "tag": "e5218971-643c-4f34-9516-8e59cfb95177"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:29.173412 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:29.173412 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:29.181979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f9024b88-0820-4255-a46c-82d175240a1a req-bbd6826c-0872-4627-8d71-a0ecfc0207e7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.182663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f9024b88-0820-4255-a46c-82d175240a1a req-bbd6826c-0872-4627-8d71-a0ecfc0207e7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.208728 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f9024b88-0820-4255-a46c-82d175240a1a req-bbd6826c-0872-4627-8d71-a0ecfc0207e7 service nova] Creating event network-vif-deleted:e5218971-643c-4f34-9516-8e59cfb95177 for instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c on nch1-master-1 Nov 20 20:51:29.213682 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f9024b88-0820-4255-a46c-82d175240a1a req-bbd6826c-0872-4627-8d71-a0ecfc0207e7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047179 Nov 20 20:51:29.215009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 940/1825] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:29.221361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85c23bf2-8620-48f8-aec4-faf99fffa63c tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'update_all', calling method: .version_select at 0x7f3f86f36dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:29.285406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-85c23bf2-8620-48f8-aec4-faf99fffa63c tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:29.289836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-85c23bf2-8620-48f8-aec4-faf99fffa63c tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:29.307436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.322764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.325373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.327228 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89bfaa16-cb08-4264-8907-748510ceacf2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.750297 Nov 20 20:51:29.328111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 886/1826] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:28 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:29.346999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:29.347732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:29.353983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.354458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.355226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.355827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.527005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.545844 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8129ce9a-06b2-4665-9b12-99524b07739c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.202929 Nov 20 20:51:29.559809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 887/1827] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:29 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:29.566093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:29.566785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:29.578220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.579567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.580837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.581515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.649813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.650225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.650680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lazy-loading 'fault' on Instance uuid 7ce4d82a-c0e6-4b0d-8432-dda5272c912c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:29.738314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.751728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.753258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '258f39e04c364a7c88e4d025718a160b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c45e1adea264b5eacb15659df686802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:29.755614 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab6d28db-8851-4ae4-bbc3-52a1da18917f tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 200 len: 1349 microversion: 2.21 time: 0.194610 Nov 20 20:51:29.756187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 888/1828] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:29 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 1349 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:29.760821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:29.761984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:29.768241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.769480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.770757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:29.771662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:29.820104 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85c23bf2-8620-48f8-aec4-faf99fffa63c tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.603674 Nov 20 20:51:29.824767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 941/1829] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:51:29 2021] PUT /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 61 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:29.830417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-535dc9b9-4b00-401a-a681-000c61b32817 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Action: 'create', calling method: .version_select at 0x7f3f871e7280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:29.863710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90128e4a-7a9a-4e03-b098-40de661f13b4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.106064 Nov 20 20:51:29.870371 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 889/1830] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:29 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:29.913200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-535dc9b9-4b00-401a-a681-000c61b32817 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:29.927526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-535dc9b9-4b00-401a-a681-000c61b32817 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Getting quotas for user 0c7684ec0bd44217a03e2a8f068b03cc and project 6fb2b6afae3f4b9ca77874cd7b08072f. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:30.108387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:30.110472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.127956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.128680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.129684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.130313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.231803 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ceadc1b3-28c7-4954-b663-c8c420244559 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.128406 Nov 20 20:51:30.236629 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 890/1831] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:30 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:30.335984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-535dc9b9-4b00-401a-a681-000c61b32817 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "POST /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.509978 Nov 20 20:51:30.340904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 942/1832] 10.222.0.41 () {60 vars in 1280 bytes} [Sat Nov 20 20:51:29 2021] POST /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 85 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:30.347213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07d94d14-324d-4bf3-9dbf-a4345b255146 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] Calling method '.version_select at 0x7f3f98dfba60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:30.349259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:30.350195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.359073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.359630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.360927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.361586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.402341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07d94d14-324d-4bf3-9dbf-a4345b255146 tempest-ImagesMetadataTestJSON-169235769 tempest-ImagesMetadataTestJSON-169235769-project] 10.222.0.41 "GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.059361 Nov 20 20:51:30.403423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 891/1833] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:51:30 2021] GET /compute/v2.1/images/e0903023-4425-4f36-a961-c91fb0af922e/metadata => generated 85 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:51:30.567428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:30.568513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.585665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.587454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.588352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.590468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.846214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:30.859850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:30.862396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:30.863916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60bb2286-69c5-47f9-b084-942c94508282 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1879 microversion: 2.42 time: 0.520528 Nov 20 20:51:30.865014 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 943/1834] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:30 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1879 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:30.881658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:30.882786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.889093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:30.890944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.891659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.895375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.896396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.900252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2e2b90d-0e7f-4fc3-afb4-28b216d7840f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.337626 Nov 20 20:51:30.911436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 892/1835] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:30 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:30.911436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:30.913361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.922229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.923946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.925220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.925948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.928725 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] HTTP exception thrown: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. Nov 20 20:51:30.929605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Returning 404 to user: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:30.930783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a62440e8-a732-40ab-ab2a-5aaeb462fe7d tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 404 len: 111 microversion: 2.21 time: 0.052706 Nov 20 20:51:30.931265 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 944/1836] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:30 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:51:30.940224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '.version_select at 0x7f3f86f9f550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:30.940736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:30.947345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.947802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:30.948901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:30.949464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.019167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b789c98-4541-4b05-bc7e-7dfd018af01b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.115026 Nov 20 20:51:31.021038 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 893/1837] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:30 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:31.059931 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94d0194f-b280-43f6-a6b8-5b4447f09c07 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.124020 Nov 20 20:51:31.061655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 945/1838] 10.222.0.41 () {60 vars in 1336 bytes} [Sat Nov 20 20:51:30 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c/os-instance-actions => generated 611 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:31.076766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:31.082969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:31.091402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.091935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.093818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.094464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.112614 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] HTTP exception thrown: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. Nov 20 20:51:31.113596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Returning 404 to user: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:31.114534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2138854-a462-4e04-9fc9-9d1887916163 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 404 len: 111 microversion: 2.1 time: 0.042557 Nov 20 20:51:31.118619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 894/1839] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:31 2021] DELETE /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:31.123822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:31.124568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] [instance: 7ce4d82a-c0e6-4b0d-8432-dda5272c912c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:31.131276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.132050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.133970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.134786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.152269 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] HTTP exception thrown: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. Nov 20 20:51:31.153449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] Returning 404 to user: Instance 7ce4d82a-c0e6-4b0d-8432-dda5272c912c could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:31.154354 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-523f2d5e-0cfd-4dc0-acfd-bd00e16eaa21 tempest-InstanceActionsV221TestJSON-1859138932 tempest-InstanceActionsV221TestJSON-1859138932-project] 10.222.0.41 "GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c" status: 404 len: 111 microversion: 2.1 time: 0.034538 Nov 20 20:51:31.155015 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 946/1840] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:31 2021] GET /compute/v2.1/servers/7ce4d82a-c0e6-4b0d-8432-dda5272c912c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:31.244341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:31.245072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7b35a61e-daab-41e4-b696-23c0575fdc2d req-ba61eb4d-8e3f-4021-a55f-31f8274c5aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6030db32-94d0-4d8c-884c-b3469acfa23f", "tag": "cb0435d6-cf6a-457b-b16c-48b724dd5e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:31.245566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:31.248269 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:31.248269 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:31.259075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b35a61e-daab-41e4-b696-23c0575fdc2d req-ba61eb4d-8e3f-4021-a55f-31f8274c5aab service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.259797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b35a61e-daab-41e4-b696-23c0575fdc2d req-ba61eb4d-8e3f-4021-a55f-31f8274c5aab service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.260198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.260859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.261876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.262364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.276768 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7b35a61e-daab-41e4-b696-23c0575fdc2d req-ba61eb4d-8e3f-4021-a55f-31f8274c5aab service nova] Creating event network-changed:cb0435d6-cf6a-457b-b16c-48b724dd5e98 for instance 6030db32-94d0-4d8c-884c-b3469acfa23f on nch1-master-1 Nov 20 20:51:31.283951 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7b35a61e-daab-41e4-b696-23c0575fdc2d req-ba61eb4d-8e3f-4021-a55f-31f8274c5aab service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050135 Nov 20 20:51:31.285182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 895/1841] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:31.335585 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30db454a-3b75-4925-b580-ad4709efab73 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.094764 Nov 20 20:51:31.340409 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 947/1842] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:31 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:31.885541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:31.886354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:31.894954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.895400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.896517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.897047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.920570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:31.922548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:31.956397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.956833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:31.961586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:31.962899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.471992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:32.483725 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9665d31f-d2da-4f41-bbcb-baa205bd04eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.566848 Nov 20 20:51:32.490835 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 948/1843] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:31 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:32.499837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:32.501102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:32.510235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.512126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.513229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.513972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.572170 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63120335-3ff3-47ac-9fb2-c2530678d612 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.079544 Nov 20 20:51:32.573877 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 949/1844] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:32 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:32.602026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:32.612398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:32.613938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:32.615464 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4a45576-fc76-466b-8370-673e9cca6056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2836 microversion: 2.42 time: 0.735368 Nov 20 20:51:32.616294 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 896/1845] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:51:31 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2836 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:32.621498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:32.622458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:32.630659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.631321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.632375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.633035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.678261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c542d40-acaa-43d2-bf5e-827f65b4fced tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.060334 Nov 20 20:51:32.679026 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 897/1846] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:32 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:32.684827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:32.685962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:32.695240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.696007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.696801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:32.697228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:32.875783 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74d1aa22-5439-4bb9-927b-e23d1c1cbdec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.195267 Nov 20 20:51:32.877061 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 898/1847] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 20:51:32 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/os-interface => generated 1831 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:33.066434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2077305890", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:33.164348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:33.418459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:33.419150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:33.419786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:33.420356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:33.421012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:33.433148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.433606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.434618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.435066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.458012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Getting quotas for project 473b91e504264ec5b10c2237ca293087. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:33.464714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Getting quotas for user 4d62b2df3058458abccdd3b425fc26b0 and project 473b91e504264ec5b10c2237ca293087. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:33.480130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:33.483677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:33.506908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:33.507603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:33.522103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.525133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.529557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.530331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.552690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70833f4d-0063-49df-908e-a82e2357e802 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976206 Nov 20 20:51:33.554967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 950/1848] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:51:33.568229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d1ebf621-6a9f-4801-adc6-b6e16e1f31f1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:33.569133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d1ebf621-6a9f-4801-adc6-b6e16e1f31f1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:33.661032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d1ebf621-6a9f-4801-adc6-b6e16e1f31f1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:33.669230 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d1ebf621-6a9f-4801-adc6-b6e16e1f31f1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1222 microversion: 2.1 time: 0.107757 Nov 20 20:51:33.673721 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 951/1849] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:33 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:33.680515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:33.681973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:33.704170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.704696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.705898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.706382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.794873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c830d37d-3525-4c41-9894-4fca92a9d8e6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.119352 Nov 20 20:51:33.802401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 952/1850] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:33 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:33.810242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:33.816623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:33.835499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.836000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.836949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:33.837426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:33.856199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:33.867855 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfdfea6d-1070-4202-8b77-c1fea26a3298 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.366362 Nov 20 20:51:33.879894 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 899/1851] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:33 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:33.919343 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad284904-0b22-4fdc-9467-720ba25d4eb0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.113987 Nov 20 20:51:33.921345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 953/1852] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:33 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:34.401928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f9b26b6-6fa9-4bf3-ad14-bf748789e3a1 tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] Calling method '.version_select at 0x7f3f98e81670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:34.404125 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:34.404125 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:34.427068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f9b26b6-6fa9-4bf3-ad14-bf748789e3a1 tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.387586 Nov 20 20:51:34.428346 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 900/1853] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:51:34 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:34.434276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-31e30948-cbbf-4d9e-adad-1305864e3631 req-2f94364a-603c-44e2-a1bc-60744e14f8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6030db32-94d0-4d8c-884c-b3469acfa23f", "name": "network-vif-plugged", "status": "completed", "tag": "cb0435d6-cf6a-457b-b16c-48b724dd5e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:34.438458 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:34.438458 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:34.450142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-31e30948-cbbf-4d9e-adad-1305864e3631 req-2f94364a-603c-44e2-a1bc-60744e14f8bf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:34.451036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-31e30948-cbbf-4d9e-adad-1305864e3631 req-2f94364a-603c-44e2-a1bc-60744e14f8bf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:34.465412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-31e30948-cbbf-4d9e-adad-1305864e3631 req-2f94364a-603c-44e2-a1bc-60744e14f8bf service nova] Creating event network-vif-plugged:cb0435d6-cf6a-457b-b16c-48b724dd5e98 for instance 6030db32-94d0-4d8c-884c-b3469acfa23f on nch1-master-1 Nov 20 20:51:34.472468 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-31e30948-cbbf-4d9e-adad-1305864e3631 req-2f94364a-603c-44e2-a1bc-60744e14f8bf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042413 Nov 20 20:51:34.473451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 901/1854] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:34.479783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5afce3c-9f42-4f52-bab6-5ee32de82635 tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] Action: 'update', calling method: .version_select at 0x7f3f876b5700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:34.482228 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:34.482228 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:34.483008 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8385110a-54cf-4ad3-9c5f-c3050f27940e tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.226232 Nov 20 20:51:34.485969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 954/1855] 10.222.0.41 () {58 vars in 1127 bytes} [Sat Nov 20 20:51:34 2021] DELETE /compute/v2.1/images/ => generated 112 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 20 20:51:34.502567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08c1c7dd-e4a8-4428-add2-e7828bc47ed4 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Calling method '.version_select at 0x7f3f86a0f790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:34.553045 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-08c1c7dd-e4a8-4428-add2-e7828bc47ed4 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] HTTP exception thrown: Image not found. Nov 20 20:51:34.554129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08c1c7dd-e4a8-4428-add2-e7828bc47ed4 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:34.555690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08c1c7dd-e4a8-4428-add2-e7828bc47ed4 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.064215 Nov 20 20:51:34.556364 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 955/1856] 10.222.0.41 () {58 vars in 1133 bytes} [Sat Nov 20 20:51:34 2021] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:51:34.572597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0b1c7df-e86d-408b-87b3-4c46b6370357 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Calling method '.version_select at 0x7f3f87360820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:34.615638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c0b1c7df-e86d-408b-87b3-4c46b6370357 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] HTTP exception thrown: Image not found. Nov 20 20:51:34.616560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0b1c7df-e86d-408b-87b3-4c46b6370357 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:34.617545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0b1c7df-e86d-408b-87b3-4c46b6370357 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/c226cdfc-aecd-4551-956f-e6d8de083e4j" status: 404 len: 62 microversion: 2.1 time: 0.056001 Nov 20 20:51:34.618656 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 956/1857] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:34 2021] DELETE /compute/v2.1/images/c226cdfc-aecd-4551-956f-e6d8de083e4j => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:34.644176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-522b40d4-d607-4b19-b5ef-8b7947792be7 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Calling method '.version_select at 0x7f3f86fd53a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:34.674861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-522b40d4-d607-4b19-b5ef-8b7947792be7 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] HTTP exception thrown: Image not found. Nov 20 20:51:34.675730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-522b40d4-d607-4b19-b5ef-8b7947792be7 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:34.676846 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-522b40d4-d607-4b19-b5ef-8b7947792be7 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/98fd6955-382b-40d2-a8f8-365921904e251" status: 404 len: 62 microversion: 2.1 time: 0.052644 Nov 20 20:51:34.680896 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 957/1858] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:34 2021] DELETE /compute/v2.1/images/98fd6955-382b-40d2-a8f8-365921904e251 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:34.691297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:34.693960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:34.714613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:34.715171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:34.718744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:34.719137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:34.798995 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b3f63d1-b1a2-43dc-9b04-3b2f9f5892cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.116397 Nov 20 20:51:34.800222 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 958/1859] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:34.972988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4dd20179-bfe2-47aa-8a54-aa0b89ecc8f1 req-03134c8a-628b-4cc8-b504-faec2bd9d5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "tag": "a2255729-67f4-48eb-af4e-86e677b04463"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:34.975853 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:34.975853 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:34.984437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4dd20179-bfe2-47aa-8a54-aa0b89ecc8f1 req-03134c8a-628b-4cc8-b504-faec2bd9d5f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:34.986638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4dd20179-bfe2-47aa-8a54-aa0b89ecc8f1 req-03134c8a-628b-4cc8-b504-faec2bd9d5f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.003499 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4dd20179-bfe2-47aa-8a54-aa0b89ecc8f1 req-03134c8a-628b-4cc8-b504-faec2bd9d5f2 service nova] Creating event network-changed:a2255729-67f4-48eb-af4e-86e677b04463 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:51:35.010374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4dd20179-bfe2-47aa-8a54-aa0b89ecc8f1 req-03134c8a-628b-4cc8-b504-faec2bd9d5f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208271 Nov 20 20:51:35.011091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5afce3c-9f42-4f52-bab6-5ee32de82635 tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.535739 Nov 20 20:51:35.012051 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 959/1860] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:35.017667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 902/1861] 10.222.0.41 () {60 vars in 1205 bytes} [Sat Nov 20 20:51:34 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:35.018979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:35.019313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:35.025806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-601efb7c-2bd0-47d5-8f00-f1fa3e4f27d6 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Calling method '.version_select at 0x7f3f86ae4d30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:35.026512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.026941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.027762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.028291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.066651 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-601efb7c-2bd0-47d5-8f00-f1fa3e4f27d6 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] HTTP exception thrown: Image not found. Nov 20 20:51:35.067978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-601efb7c-2bd0-47d5-8f00-f1fa3e4f27d6 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:35.068987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-601efb7c-2bd0-47d5-8f00-f1fa3e4f27d6 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/tempest-invalid-1544136330" status: 404 len: 62 microversion: 2.1 time: 0.047532 Nov 20 20:51:35.069555 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 960/1862] 10.222.0.41 () {58 vars in 1205 bytes} [Sat Nov 20 20:51:35 2021] DELETE /compute/v2.1/images/tempest-invalid-1544136330 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:35.080628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:35.082998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:35.093881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.094372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.096254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.096955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.123467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:35.138106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18212c85-e20c-4634-85e6-b0a7e2b304e5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1274 microversion: 2.1 time: 0.123911 Nov 20 20:51:35.138557 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 903/1863] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:35 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:35.148694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:35.149333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:35.153829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07426300-ffa3-43c6-81a8-bd33bf14c613 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.081651 Nov 20 20:51:35.160726 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 961/1864] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:35 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:35.169861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.170357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.171911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.172178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.173433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:35.177171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:35.192487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.193384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.194334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.194779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.252574 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2a85545-a1a7-476f-97f2-b18a1086fa12 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.087168 Nov 20 20:51:35.256571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 962/1865] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:35 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:35.268170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffb95308-f609-4781-b9ba-eac76606507b tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] Calling method '.version_select at 0x7f3f870efaf0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:35.269007 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:35.269007 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:35.289947 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffb95308-f609-4781-b9ba-eac76606507b tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.032012 Nov 20 20:51:35.297003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 963/1866] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 20:51:35 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:35.302587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f5729d7-1158-4053-9ccb-0d6d3f3c4f50 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Calling method '.version_select at 0x7f3f871fd310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:35.335527 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1f5729d7-1158-4053-9ccb-0d6d3f3c4f50 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] HTTP exception thrown: Image not found. Nov 20 20:51:35.336609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f5729d7-1158-4053-9ccb-0d6d3f3c4f50 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:35.337865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f5729d7-1158-4053-9ccb-0d6d3f3c4f50 tempest-ImagesDeleteNegativeTestJSON-115920476 tempest-ImagesDeleteNegativeTestJSON-115920476-project] 10.222.0.41 "DELETE /compute/v2.1/images/f47065e8-c8d4-4fb0-a4d8-99b2cdc286bb" status: 404 len: 62 microversion: 2.1 time: 0.039637 Nov 20 20:51:35.338915 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 964/1867] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:35 2021] DELETE /compute/v2.1/images/f47065e8-c8d4-4fb0-a4d8-99b2cdc286bb => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:51:35.345021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d66ff5d-e446-40ba-9290-08fc842e5b6a tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] Action: 'update', calling method: .version_select at 0x7f3f869189d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:35.346882 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:35.346882 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:35.589658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d66ff5d-e446-40ba-9290-08fc842e5b6a tempest-QuotaClassesAdminTestJSON-1344453315 tempest-QuotaClassesAdminTestJSON-1344453315-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.248656 Nov 20 20:51:35.606276 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 965/1868] 10.222.0.41 () {60 vars in 1205 bytes} [Sat Nov 20 20:51:35 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:35.622118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:35.632701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02552e47-1357-4c98-afc4-f0b4185b5504 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1308 microversion: 2.1 time: 0.489987 Nov 20 20:51:35.645991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 904/1869] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:35 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:35.810530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:35.812784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:35.820340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.845757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.847072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:35.850518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:35.946105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09eabd2a-6693-4226-a5ba-d3e146c3e331 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.139206 Nov 20 20:51:35.952857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 966/1870] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:35 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:36.162652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:36.163260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:36.168902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:36.170438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:36.171954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.182879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.183740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.184170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.189502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.190165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.190848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.191299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.285424 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80d021f2-e00b-4c32-b212-8ccba1ae5946 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.122151 Nov 20 20:51:36.287018 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 967/1871] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:36 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:36.294363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:36.295612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:36.305353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.306410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.307626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.308785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.389608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:36.391597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18406b7e-0576-4d53-a16f-182b6c4ff5d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.100550 Nov 20 20:51:36.394014 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 968/1872] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:36 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:36.403635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e089ee1e-e0c9-41d0-bdbf-908ea3de66a1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1280 microversion: 2.1 time: 0.251081 Nov 20 20:51:36.404432 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 905/1873] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:36 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:36.649315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:36.650243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:36.662370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.662835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.665209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.665941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.807170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1321660929", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "0594ba2f-b532-43f1-b099-cad17106db9f"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:36.880932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:36.887425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] validate_networks() for [('0594ba2f-b532-43f1-b099-cad17106db9f', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:36.893286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42d2b2c6-7ad4-4936-9f44-5358192d6de2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1486 microversion: 2.1 time: 0.248082 Nov 20 20:51:36.908898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 906/1874] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:36 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1486 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:36.916529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:36.917246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:36.926876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.927509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:36.928351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:36.929006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.024572 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a712072-cb2f-4cd3-b96e-ed4d3a2b1529 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f/action" status: 202 len: 0 microversion: 2.1 time: 0.114136 Nov 20 20:51:37.029440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 907/1875] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:36 2021] POST /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:37.039259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:37.041699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:37.050912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.052018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.053835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.056148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.133174 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d39063b-b912-4dee-a1f3-21a0627366a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.099868 Nov 20 20:51:37.134835 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 908/1876] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:37 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:37.149275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:37.150708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:37.163665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.166269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.167303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.169449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.476154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:37.488691 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-909abddd-7613-48ab-94e6-4a77f6063d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1491 microversion: 2.1 time: 0.349348 Nov 20 20:51:37.498256 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 909/1877] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:37 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1491 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:37.498256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:37.498256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:37.506285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.506734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.508402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.509249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.581665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8624401-9cec-464c-9df6-b8596409881f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.090912 Nov 20 20:51:37.582406 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 910/1878] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:37 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:37.588865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:37.589940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:37.598513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.598956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.601084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.601547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.651295 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e6f3124-10d2-41c6-856a-71e5d7cc492d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.066487 Nov 20 20:51:37.654567 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 911/1879] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:37 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:37.661178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:37.661887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:37.690403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.690875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.695640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.697601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.943889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:37.948035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:37.950121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:37.952161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:37.966324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:37.992641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.994431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:37.995696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:37.996605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.021051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Getting quotas for project d58479ec1e22447588aae115ec314452. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:38.029412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Getting quotas for user e07f797dec4a477c9d4ffa07339fec74 and project d58479ec1e22447588aae115ec314452. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:38.049065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:38.051773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:38.127430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:38.138516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72c1f486-b66e-4969-ada2-fc4b7fdf7e9d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.481406 Nov 20 20:51:38.139631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 912/1880] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:37 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:38.140845 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ab02b79-32c0-4382-80ad-170389b6bbb1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575110 Nov 20 20:51:38.147499 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 969/1881] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:51:38.152731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:38.154513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:38.156281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-966668e6-3cd0-44eb-968e-34b556267b5c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:38.156950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-966668e6-3cd0-44eb-968e-34b556267b5c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:38.165226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.167590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.168799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.169519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.270661 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3451f26b-56fc-404d-8bcf-42475289911f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.128001 Nov 20 20:51:38.271706 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 913/1882] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:38 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:38.272337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-966668e6-3cd0-44eb-968e-34b556267b5c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:38.282338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-966668e6-3cd0-44eb-968e-34b556267b5c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1212 microversion: 2.1 time: 0.132716 Nov 20 20:51:38.292974 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 970/1883] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:38 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1212 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:38.524905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:38.528664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:38.569521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.578477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.581345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.582030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.595340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:38.596876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:38.611389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.625865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.627087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.629866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.767948 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b8e47d5-99ac-4b8d-a817-586ce206b5c7 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.177434 Nov 20 20:51:38.781809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 971/1884] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:38 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:38.797760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:38.802448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:38.824629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.826323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.828986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:38.831860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:38.902013 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85aa6a98-0f1f-4e9c-8d05-b3ef498ed75e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.114756 Nov 20 20:51:38.904001 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 972/1885] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:38 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:38.982615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:38.998806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67d423c8-eef0-49d3-afaa-a8633fd0fc03 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 200 len: 1471 microversion: 2.1 time: 0.494756 Nov 20 20:51:39.010404 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 914/1886] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:38 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 1471 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:39.022042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1348185957"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:39.024002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:39.034606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.035983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.036917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.037876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.314035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-606476372", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:39.432652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:39.523454 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb2ed1c0-9f37-4736-b213-b57c7d3ecba9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f/action" status: 202 len: 0 microversion: 2.1 time: 0.506594 Nov 20 20:51:39.524796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 973/1887] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:39 2021] POST /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:51:39.543554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9daed657-8001-4a64-8a75-8077977e3301 req-7c479e37-0208-43a0-8fe6-59ff7917c146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a642def2-5524-4143-abf6-0da0402a5457", "tag": "55b92c4e-47ff-40f3-9809-f84c75701b8e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:39.545431 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:39.545431 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:39.556642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9daed657-8001-4a64-8a75-8077977e3301 req-7c479e37-0208-43a0-8fe6-59ff7917c146 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.557147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9daed657-8001-4a64-8a75-8077977e3301 req-7c479e37-0208-43a0-8fe6-59ff7917c146 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.573274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9daed657-8001-4a64-8a75-8077977e3301 req-7c479e37-0208-43a0-8fe6-59ff7917c146 service nova] Creating event network-changed:55b92c4e-47ff-40f3-9809-f84c75701b8e for instance a642def2-5524-4143-abf6-0da0402a5457 on nch1-master-1 Nov 20 20:51:39.579873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9daed657-8001-4a64-8a75-8077977e3301 req-7c479e37-0208-43a0-8fe6-59ff7917c146 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053341 Nov 20 20:51:39.580993 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 974/1888] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:39.587729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:39.588550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:39.602696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.603160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.604842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.605463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.795437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:39.795861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:39.797389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:39.798004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:39.798603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:39.814891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.815505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.816499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.817318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.840177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Getting quotas for project ebffc7faac2d4069a182969e23268495. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:39.847748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Getting quotas for user 13e833cff86e40ef9e81edbb790c348b and project ebffc7faac2d4069a182969e23268495. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:39.863730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:39.867252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:39.945364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43f993f1-4762-423e-b2df-3ea19957bb72 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916364 Nov 20 20:51:39.946970 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 915/1889] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:51:39.955405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:39.957974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:39.967167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.968543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:39.969882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:39.970552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.031806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b37ad0e-487a-4e19-8a08-9a27a642dc7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.081819 Nov 20 20:51:40.034066 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 916/1890] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:40.037333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:40.045599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e21c5881-2061-4619-a53b-376ca039ddca tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.463305 Nov 20 20:51:40.046772 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 975/1891] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:39 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:40.046979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:40.048168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:40.057134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa5ec4fc-182a-4633-b5d1-183040555c90 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86f9fee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:40.064417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.065251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.066136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.066651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.125648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa5ec4fc-182a-4633-b5d1-183040555c90 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.071951 Nov 20 20:51:40.126255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 976/1892] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:40 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:40.136404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:40.137413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:40.157563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.158081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.158940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.159548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.167382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:40.190419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-202341db-e2ff-4e12-9ab4-860cbc64806b tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1270 microversion: 2.1 time: 0.152756 Nov 20 20:51:40.191260 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 917/1893] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:40 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:40.200909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:40.203382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:40.223097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.223778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.228780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:40.232673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:40.237852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d16ba8c-d7f9-4bde-9b99-0498b56a5df8 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.104890 Nov 20 20:51:40.242362 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 977/1894] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:40 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:40.249337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3f74eb1-b05b-4640-b7a3-5be5a24d55d9 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:40.250113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3f74eb1-b05b-4640-b7a3-5be5a24d55d9 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:40.307213 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-caf9533a-a3f6-4db6-98eb-a3ef77d552cf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.112175 Nov 20 20:51:40.308096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 918/1895] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:40 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:40.357027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3f74eb1-b05b-4640-b7a3-5be5a24d55d9 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:40.364573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3f74eb1-b05b-4640-b7a3-5be5a24d55d9 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1215 microversion: 2.1 time: 0.120215 Nov 20 20:51:40.365682 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 978/1896] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:40 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:40.981854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1869474330", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:41.036495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:41.046742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:41.047911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.055118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.055842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.056627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.056627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.111085 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09963154-a57c-421e-bef6-d89761f1268a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.070464 Nov 20 20:51:41.113138 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 979/1897] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:41.120423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:41.121126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.132172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.132172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.132172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.134087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.282170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:41.282703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:41.283280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:41.285118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:41.285599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:41.297108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.297629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.298484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.298954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.317821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Getting quotas for project e3b8141b335a46009c54d270ec68ea26. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:41.323510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Getting quotas for user 173ed40ec5274fb799d4982f3ee93493 and project e3b8141b335a46009c54d270ec68ea26. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:41.339613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:41.343480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:41.390533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-472c451a-e011-4382-8461-be268507058c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516929 Nov 20 20:51:41.391256 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 919/1898] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:51:41.395969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c465672-c1bd-4f0e-aa73-5c78cc57e901 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98e2bc10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:41.443664 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c465672-c1bd-4f0e-aa73-5c78cc57e901 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.051170 Nov 20 20:51:41.444238 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 920/1899] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:41 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:41.453938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:41.454772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.461922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.462502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.463548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.464082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.553404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:41.579150 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21789700-4758-4e8c-98b1-3e6d27e6a77c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1270 microversion: 2.1 time: 0.127349 Nov 20 20:51:41.581551 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 921/1900] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:41 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:41.586418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:41.587588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.596690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.597308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.598365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.598775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.646895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fce16ee-ee9e-4518-97f4-01d080783270 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.063914 Nov 20 20:51:41.648018 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 922/1901] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:41 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:41.655382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:41.656418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.673906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.674404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.675461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.675919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.693954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:41.701739 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e32232a-2c3f-42f1-9bd8-0b3fd0f0b3c1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.587338 Nov 20 20:51:41.702877 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 980/1902] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:41 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:41.708787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:41.709834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.719249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.719756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.721162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:41.722176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:41.757851 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ddca8d93-2b38-4bcd-806a-9971b6aedf28 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.108865 Nov 20 20:51:41.760207 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 923/1903] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:41 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:41.768611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad7472fa-1830-4af6-aec4-4f392adda90d tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:41.769651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad7472fa-1830-4af6-aec4-4f392adda90d tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:41.838110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad7472fa-1830-4af6-aec4-4f392adda90d tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:41.846424 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad7472fa-1830-4af6-aec4-4f392adda90d tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1223 microversion: 2.1 time: 0.082811 Nov 20 20:51:41.847811 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 924/1904] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:41 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:41.867029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:41.879840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa621393-55d5-4db4-8623-249faae90fd5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1273 microversion: 2.1 time: 0.175311 Nov 20 20:51:41.880477 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 981/1905] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:41 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1273 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:42.126691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:42.128605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:42.139530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.142392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.143459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.144102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.200219 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75b44ae2-650f-418a-9d44-585fe1a44e2e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.080705 Nov 20 20:51:42.201153 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 925/1906] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:42 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:42.459266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7451bc8-b17e-4945-9b15-234b19ef16a1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86f365e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:42.531131 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7451bc8-b17e-4945-9b15-234b19ef16a1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.075497 Nov 20 20:51:42.531809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 982/1907] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:42 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:42.598732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:42.599653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:42.628400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.631421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.632877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.633337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.661400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:42.680462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:42.709038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.712078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.713318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.723146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.815146 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a53d0b0c-ca21-4ee4-bd7e-932b9873e91f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.159627 Nov 20 20:51:42.815874 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 983/1908] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:42 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:42.821386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:42.824810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:42.846005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.848699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:42.850034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:42.851221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.210254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:43.219531 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0740df85-da6d-4f78-a5ee-977b005f7fe1 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.626930 Nov 20 20:51:43.220118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 926/1909] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:42 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:43.226121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:43.227797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:43.247869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.250774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.254381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.255036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.323097 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f73272d1-cee5-4827-956d-3d3dba00f9a7 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.101660 Nov 20 20:51:43.324348 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 927/1910] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:43 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:43.328483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:43.331713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:43.332620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:43.337300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-77aa5362-157c-4f66-b1e8-bde1e3b6064e tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.519913 Nov 20 20:51:43.339882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.340659 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 984/1911] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:42 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:43.341060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.342993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.344108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.351282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:43.354024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:43.367911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.368743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.370166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.371892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.526826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:43.547345 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-194463a1-0593-4b10-b0d6-bfa4f86dc558 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1281 microversion: 2.1 time: 0.220427 Nov 20 20:51:43.565509 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 928/1912] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:43 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1281 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:43.580658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:43.583362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:43.600195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.605556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.611767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.612229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.684388 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f0902c6-4302-4d4b-aa15-4d670185e7b1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 14 microversion: 2.42 time: 0.116288 Nov 20 20:51:43.688596 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 929/1913] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:43 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:43.696581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8978be43-6010-4bd8-9ff1-3079de603f00 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8779f670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:43.808884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8978be43-6010-4bd8-9ff1-3079de603f00 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.118682 Nov 20 20:51:43.816721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 930/1914] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:43 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:43.826175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f505b4fe-0f00-4905-b634-cb50dc2a8d45 req-3596f994-2d7c-4730-a8b4-1dc4ea7ddbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4450abf6-2433-4e78-97e4-5e9afed3b26a", "tag": "bdfe8d89-e22c-4a72-a2ed-490198efb612"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:43.831825 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:43.831825 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:43.840747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f505b4fe-0f00-4905-b634-cb50dc2a8d45 req-3596f994-2d7c-4730-a8b4-1dc4ea7ddbf1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.841549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f505b4fe-0f00-4905-b634-cb50dc2a8d45 req-3596f994-2d7c-4730-a8b4-1dc4ea7ddbf1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.859603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f505b4fe-0f00-4905-b634-cb50dc2a8d45 req-3596f994-2d7c-4730-a8b4-1dc4ea7ddbf1 service nova] Creating event network-changed:bdfe8d89-e22c-4a72-a2ed-490198efb612 for instance 4450abf6-2433-4e78-97e4-5e9afed3b26a on nch2-master-1 Nov 20 20:51:43.865471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f505b4fe-0f00-4905-b634-cb50dc2a8d45 req-3596f994-2d7c-4730-a8b4-1dc4ea7ddbf1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046418 Nov 20 20:51:43.866762 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 931/1915] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:43.872366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:43.873713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:43.881479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.882331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.883365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:43.884008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:43.939575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db33bbba-e639-4839-88d8-ecac49fbc71c tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.070811 Nov 20 20:51:43.941556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 932/1916] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:43 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:44.165339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:44.174756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01cd6c34-cbbb-45a6-857c-eab36970ace5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.831309 Nov 20 20:51:44.182728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 985/1917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:43 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:44.238701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:44.239963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:44.258971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.259738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.266249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.266942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.336476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:44.337647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:44.355796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.361713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.362888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.363495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.446100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d521a0ee-795f-49d1-b667-da763179597e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.113725 Nov 20 20:51:44.451464 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 986/1918] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:44 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:44.458711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:44.459732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:44.471217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.472225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.473355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.479534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.673308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:44.687930 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1fd88419-0643-4ee6-9995-676de73d9587 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.454275 Nov 20 20:51:44.698631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 933/1919] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:44 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:44.706182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:44.706811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:44.730073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.730449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:44.734773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:44.735470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.226215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:45.236946 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7f989aa-739d-414a-b8f1-7ba55f83a28a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.537096 Nov 20 20:51:45.237576 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 934/1920] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:44 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:45.242324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5195c5b8-e4e1-42c9-b3d2-45f3cefcad26 req-eaae7d4b-6dcf-40f0-8c9b-32deba6cbef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a642def2-5524-4143-abf6-0da0402a5457", "name": "network-vif-plugged", "status": "completed", "tag": "55b92c4e-47ff-40f3-9809-f84c75701b8e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:45.243889 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:45.243889 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:45.257504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5195c5b8-e4e1-42c9-b3d2-45f3cefcad26 req-eaae7d4b-6dcf-40f0-8c9b-32deba6cbef1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.257875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5195c5b8-e4e1-42c9-b3d2-45f3cefcad26 req-eaae7d4b-6dcf-40f0-8c9b-32deba6cbef1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.287994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5195c5b8-e4e1-42c9-b3d2-45f3cefcad26 req-eaae7d4b-6dcf-40f0-8c9b-32deba6cbef1 service nova] Creating event network-vif-plugged:55b92c4e-47ff-40f3-9809-f84c75701b8e for instance a642def2-5524-4143-abf6-0da0402a5457 on nch1-master-1 Nov 20 20:51:45.303632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5195c5b8-e4e1-42c9-b3d2-45f3cefcad26 req-eaae7d4b-6dcf-40f0-8c9b-32deba6cbef1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064708 Nov 20 20:51:45.306024 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 935/1921] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:45.313260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:45.320522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:45.334350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.336930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.338570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.339908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:45.341091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.351087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b80a6be1-234b-4fd6-bda0-c1e0bd613280 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.897254 Nov 20 20:51:45.355987 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 987/1922] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:44 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:45.368626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9660efdb-783d-49b6-b12c-f14a6145e8ef tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f870efb80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:45.442425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a17cc76e-a046-4633-8bd5-f18b38baad9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 8154 microversion: 2.42 time: 0.134640 Nov 20 20:51:45.443675 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 936/1923] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:45 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 8154 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:51:45.450520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:45.454843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:45.460602 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9660efdb-783d-49b6-b12c-f14a6145e8ef tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.103373 Nov 20 20:51:45.461189 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 988/1924] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:45 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:45.470405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.471116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.471240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:45.471746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:45.472751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.473451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.495240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.495711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.496543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.496981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.532405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6501d480-8951-4ef7-af15-5bba755d170e tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.086512 Nov 20 20:51:45.533539 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 937/1925] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:45 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:45.545662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:45.548685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:45.564620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.565605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.566751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.567417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.657195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8669236e-dc55-4a26-9a3c-2d2d1cb9a5a9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.121588 Nov 20 20:51:45.661511 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 938/1926] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:45 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:45.711343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:45.712084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:45.734600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.750583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.751659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:45.752115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:45.994320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:46.009679 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d1d98b5a-09d0-45bc-9c67-3aee89a8c334 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.303862 Nov 20 20:51:46.010686 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 939/1927] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:45 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:46.016489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f61d58c6-a364-43b7-bbc0-a1cbcaa2cfe5 req-234e06bf-9bb6-4993-95d4-483c194b4e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69968770-eafc-407f-a324-fbed2db929f1", "tag": "5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:46.018118 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:46.018118 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:46.041175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f61d58c6-a364-43b7-bbc0-a1cbcaa2cfe5 req-234e06bf-9bb6-4993-95d4-483c194b4e8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.042592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f61d58c6-a364-43b7-bbc0-a1cbcaa2cfe5 req-234e06bf-9bb6-4993-95d4-483c194b4e8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.067778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f61d58c6-a364-43b7-bbc0-a1cbcaa2cfe5 req-234e06bf-9bb6-4993-95d4-483c194b4e8a service nova] Creating event network-changed:5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece for instance 69968770-eafc-407f-a324-fbed2db929f1 on nch1-master-1 Nov 20 20:51:46.082701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f61d58c6-a364-43b7-bbc0-a1cbcaa2cfe5 req-234e06bf-9bb6-4993-95d4-483c194b4e8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068607 Nov 20 20:51:46.086360 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 940/1928] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:46.136727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:46.151559 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ecd585b8-245a-47e0-9862-488581a2735c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.685863 Nov 20 20:51:46.152720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 989/1929] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:45 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:46.263934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:46.266493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f116aa08-2830-4e89-860d-76bbc0b63de7 req-1d6204d3-deb0-4835-ba08-b37e8c9d81e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb911596-5396-4ef5-8709-370aaa7dd2b2", "tag": "a6b22f7b-c9e9-43ed-8e4c-cac104488fa6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:46.269266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:46.277332 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:46.277332 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:46.291759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f116aa08-2830-4e89-860d-76bbc0b63de7 req-1d6204d3-deb0-4835-ba08-b37e8c9d81e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.293246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.296956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f116aa08-2830-4e89-860d-76bbc0b63de7 req-1d6204d3-deb0-4835-ba08-b37e8c9d81e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.298846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.299955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.300645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.337600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f116aa08-2830-4e89-860d-76bbc0b63de7 req-1d6204d3-deb0-4835-ba08-b37e8c9d81e3 service nova] Creating event network-changed:a6b22f7b-c9e9-43ed-8e4c-cac104488fa6 for instance fb911596-5396-4ef5-8709-370aaa7dd2b2 on nch2-master-1 Nov 20 20:51:46.350152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f116aa08-2830-4e89-860d-76bbc0b63de7 req-1d6204d3-deb0-4835-ba08-b37e8c9d81e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092352 Nov 20 20:51:46.351619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 941/1930] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:46.386667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:46.387720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:46.398670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.399585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.400723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.411827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.823670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:46.839209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e159931-dda8-49a0-b7b5-930873c0616c tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1322 microversion: 2.1 time: 0.465939 Nov 20 20:51:46.842105 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 942/1931] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:46 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:46.858794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:46.860090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:46.870855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.871306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.872107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.872544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.925473 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c46df7af-7c88-4b72-95bf-a1ca41a5c5c9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 16347 microversion: 2.42 time: 0.072333 Nov 20 20:51:46.926745 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 943/1932] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:46 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 16347 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:46.931518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:46.941334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6413f9ab-b043-41ee-b10d-4395081c61b4 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.687591 Nov 20 20:51:46.941932 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 990/1933] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:46 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:46.946818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34ead7e4-7a38-40d1-bccb-d76356acd9c3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f877701f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:46.956521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:46.957754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:46.966007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.966951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:46.969376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:46.970189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.034011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34ead7e4-7a38-40d1-bccb-d76356acd9c3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.106587 Nov 20 20:51:47.034667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 944/1934] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:46 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:47.039487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:47.040770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:47.048215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ed4e29a-e3c3-43a8-bc72-4e1f75deffee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.093088 Nov 20 20:51:47.049028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.049926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.053827 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 991/1935] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:46 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:47.055726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.056186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.061103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:47.062439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:47.080001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.080452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.081438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.082085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.122388 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a1d8cd3d-0328-4eb5-9ae1-8e8cbf72ba0c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.086420 Nov 20 20:51:47.126536 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 945/1936] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:47 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:47.171844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:47.172837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:47.197014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.198192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.199188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.201603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.476262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:47.487600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d027d6e0-45cf-46ba-b8e3-f0b794222425 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.319568 Nov 20 20:51:47.489816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 946/1937] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:47 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:47.494744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0c9cabe2-f98b-4cd8-85a6-b3199fa77fe9 req-6dd9143a-8c0a-470a-ace3-c7cec541f116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6030db32-94d0-4d8c-884c-b3469acfa23f", "name": "network-vif-plugged", "status": "completed", "tag": "cb0435d6-cf6a-457b-b16c-48b724dd5e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:47.496484 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:47.496484 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:47.537605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c9cabe2-f98b-4cd8-85a6-b3199fa77fe9 req-6dd9143a-8c0a-470a-ace3-c7cec541f116 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.538681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c9cabe2-f98b-4cd8-85a6-b3199fa77fe9 req-6dd9143a-8c0a-470a-ace3-c7cec541f116 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.551467 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0c9cabe2-f98b-4cd8-85a6-b3199fa77fe9 req-6dd9143a-8c0a-470a-ace3-c7cec541f116 service nova] Creating event network-vif-plugged:cb0435d6-cf6a-457b-b16c-48b724dd5e98 for instance 6030db32-94d0-4d8c-884c-b3469acfa23f on nch1-master-1 Nov 20 20:51:47.569398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0c9cabe2-f98b-4cd8-85a6-b3199fa77fe9 req-6dd9143a-8c0a-470a-ace3-c7cec541f116 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078188 Nov 20 20:51:47.570310 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 947/1938] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:47.604710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:47.628813 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5a5eac5-02df-4c28-b182-67b62222fcec tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.560472 Nov 20 20:51:47.629559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 992/1939] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:47 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:47.869959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:47.872852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:47.889110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.893456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.895188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.896143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.937560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:47.939257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:47.965189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.965817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:47.966777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:47.967322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.031221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a5403e9-36b5-4a30-a750-76d1a375c1fd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 16347 microversion: 2.42 time: 0.098091 Nov 20 20:51:48.032604 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 993/1940] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:47 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 16347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:51:48.038815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:48.040072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.052687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.053530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.054607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.055275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.231633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:48.242245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afdf6d0e-b25f-4162-bac2-7db7d764ee3a tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1471 microversion: 2.1 time: 0.387011 Nov 20 20:51:48.246316 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 948/1941] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:47 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1471 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:48.247475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79b89a11-79e6-4b0a-85d0-f68145dfe691 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87706160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:48.300893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79b89a11-79e6-4b0a-85d0-f68145dfe691 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.056889 Nov 20 20:51:48.306434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 949/1942] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:48 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:48.312444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:48.313436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.320336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.321038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.322018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.322624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.373576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b159214-4954-48a3-a8ed-0979aca66dae tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.065446 Nov 20 20:51:48.375824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 950/1943] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:48 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:48.383243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:48.387384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.395049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.396374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.396792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.397243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.449402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d2c8cf6-7502-43ae-93af-3a8839d8a69a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.072295 Nov 20 20:51:48.453940 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 951/1944] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:48 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:48.508616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:48.527580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f6f3071-f3c6-4d00-86e4-3dfa688711fa tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.492827 Nov 20 20:51:48.528163 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 994/1945] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:48 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:48.541984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:48.542745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.554208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.554941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.555901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.556514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.630731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc02ddc2-d303-4e5c-8e57-1303ece787ec tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:48.632146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc02ddc2-d303-4e5c-8e57-1303ece787ec tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] [instance: eff76048-0ece-451a-a0d9-de9c76a0ca76] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.644461 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-fc02ddc2-d303-4e5c-8e57-1303ece787ec tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] HTTP exception thrown: Instance eff76048-0ece-451a-a0d9-de9c76a0ca76 could not be found. Nov 20 20:51:48.646425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc02ddc2-d303-4e5c-8e57-1303ece787ec tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Returning 404 to user: Instance eff76048-0ece-451a-a0d9-de9c76a0ca76 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:48.650257 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc02ddc2-d303-4e5c-8e57-1303ece787ec tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/eff76048-0ece-451a-a0d9-de9c76a0ca76/action" status: 404 len: 111 microversion: 2.1 time: 0.198430 Nov 20 20:51:48.651315 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 952/1946] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:48 2021] POST /compute/v2.1/servers/eff76048-0ece-451a-a0d9-de9c76a0ca76/action => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:48.661315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:48.662754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:48.677703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.678544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.680192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:48.680875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:48.900985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:48.909062 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfa66968-079f-49be-82c4-43d055faa800 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.256445 Nov 20 20:51:48.911088 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 953/1947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:48 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:48.925099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-833664961", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:48.964197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:48.980994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f3eb11b-c782-4e91-8da4-85967594857e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.451781 Nov 20 20:51:48.984768 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 995/1948] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:48 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:48.987625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:51:49.044627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:49.049744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.058071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.059572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.060645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.061359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.146823 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98b5cd3d-242d-49b2-bea2-5ea5cb539fe1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 16347 microversion: 2.42 time: 0.106689 Nov 20 20:51:49.149167 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 996/1949] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:49 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 16347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:49.315661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-279d52eb-82dc-43aa-b60d-fba2b97d41b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98e6f940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:49.316326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:51:49.317036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:51:49.317743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:51:49.318408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:51:49.319175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:51:49.333905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.334694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.336069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.336749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.364512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Getting quotas for project 473b91e504264ec5b10c2237ca293087. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:51:49.371630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Getting quotas for user 4d62b2df3058458abccdd3b425fc26b0 and project 473b91e504264ec5b10c2237ca293087. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:51:49.383212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-279d52eb-82dc-43aa-b60d-fba2b97d41b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.072768 Nov 20 20:51:49.390854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 997/1950] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:49 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:49.395763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:51:49.398423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:51:49.409033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:49.414279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.427757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.428737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.429779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.430548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.469010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e1bf580-1082-4549-af70-460955075e61 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547247 Nov 20 20:51:49.470188 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 954/1951] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:51:49.478253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:49.479250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.481697 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f271885-d2a4-484f-a07a-4a637e71ac43 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.079034 Nov 20 20:51:49.483231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 998/1952] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:49 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:49.487987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.488442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.489243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.489682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.491309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84197141-aab8-4970-adc3-7306fb59037b tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:49.492597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84197141-aab8-4970-adc3-7306fb59037b tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.589517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-84197141-aab8-4970-adc3-7306fb59037b tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:49.590775 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e01fce50-8266-4a37-8257-71ab77783b44 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.119253 Nov 20 20:51:49.591590 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 955/1953] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:49 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:49.600113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:49.601797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.603103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84197141-aab8-4970-adc3-7306fb59037b tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1221 microversion: 2.1 time: 0.116649 Nov 20 20:51:49.603810 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 999/1954] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:49 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:49.613623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.614106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.614913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.615377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.792239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:49.809534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6c0e0d9-cc34-4b89-b6ec-bde49e3e8bee tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.216017 Nov 20 20:51:49.818099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 956/1955] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:49 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:49.931732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:49.932652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:49.942954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.943408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:49.944213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:49.944652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.007146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:50.008005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.018214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.019522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.021323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.022174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.181131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:50.194662 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68a268d0-673f-4b39-82b4-59c5ff99478f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.270422 Nov 20 20:51:50.196157 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1000/1956] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:49 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:50.208418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:50.213231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.225359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.226107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.227658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.228344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.290327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11d1da0d-5c3d-4ef7-b82a-8f3f7e10d7d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 16347 microversion: 2.42 time: 0.092521 Nov 20 20:51:50.291593 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1001/1957] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 16347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:50.316504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:50.328122 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6dcaa3b9-05cd-4145-8b93-549acdac48c3 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.327597 Nov 20 20:51:50.328844 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 957/1958] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:49 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:50.399829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-548cc35d-00d8-41a0-80a0-23dddb02a603 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8695daf0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:50.454653 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-548cc35d-00d8-41a0-80a0-23dddb02a603 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.060651 Nov 20 20:51:50.455660 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1002/1959] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:50 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:50.496071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:50.497393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.504445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.504986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.505863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.506476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.570123 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34d7885c-a6ee-4e38-953a-19bfee2854d0 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.076545 Nov 20 20:51:50.579114 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 958/1960] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:50 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:50.604588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:50.605650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.613822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.614582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.615751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.616427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.632538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:50.643514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.656926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.656926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.657756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.658355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.674859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45c61d6b-461c-4b04-95f4-428868ce3942 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.075071 Nov 20 20:51:50.677047 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1003/1961] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:50 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:50.740217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:50.754068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a526940-f8cb-4d1f-9199-68f8041926a8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1273 microversion: 2.1 time: 0.136407 Nov 20 20:51:50.757261 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 959/1962] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:50 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:50.834882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:50.836080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:50.854788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.855638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:50.856856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:50.857584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.156827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:51.167051 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-164ba84b-3911-4f34-84da-342208af395c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.340755 Nov 20 20:51:51.167635 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1004/1963] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:50 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:51.212779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:51.213446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.238518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.239494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.240434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.240956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.303034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:51.304045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.313217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.313723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.314714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.315199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.382324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d6ae7643-517d-400a-ae7a-04312043079e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.083193 Nov 20 20:51:51.392190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1005/1964] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:51 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:51.400396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:51.401104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.409931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.410776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.411307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.411752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.621842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:51.631331 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8832a903-26b2-4c15-a3c3-6233dcbefd6c tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.240776 Nov 20 20:51:51.632198 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1006/1965] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:51 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:51.647670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6f08cf65-90fe-410a-baca-d2ed8e424872 req-67137f7e-a92d-4aa6-9b1d-a60ec9cb54e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4450abf6-2433-4e78-97e4-5e9afed3b26a", "name": "network-vif-plugged", "status": "completed", "tag": "bdfe8d89-e22c-4a72-a2ed-490198efb612"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:51.649382 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:51.649382 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:51.659228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6f08cf65-90fe-410a-baca-d2ed8e424872 req-67137f7e-a92d-4aa6-9b1d-a60ec9cb54e1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.659689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6f08cf65-90fe-410a-baca-d2ed8e424872 req-67137f7e-a92d-4aa6-9b1d-a60ec9cb54e1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.675368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6f08cf65-90fe-410a-baca-d2ed8e424872 req-67137f7e-a92d-4aa6-9b1d-a60ec9cb54e1 service nova] Creating event network-vif-plugged:bdfe8d89-e22c-4a72-a2ed-490198efb612 for instance 4450abf6-2433-4e78-97e4-5e9afed3b26a on nch2-master-1 Nov 20 20:51:51.685620 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6f08cf65-90fe-410a-baca-d2ed8e424872 req-67137f7e-a92d-4aa6-9b1d-a60ec9cb54e1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051480 Nov 20 20:51:51.686980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1007/1966] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:51.695611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccb1d5ef-dea0-4fe7-8524-3add525d951b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f877c2160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:51.791432 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccb1d5ef-dea0-4fe7-8524-3add525d951b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.102803 Nov 20 20:51:51.798849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1008/1967] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:51 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:51.804095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:51.806070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.817136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.817954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.820926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.821608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.888383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bee49ef0-c0e6-4a44-9d88-1d671d06dd06 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.087782 Nov 20 20:51:51.890598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1009/1968] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:51 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:51.898590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:51.900068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.912140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.913823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.915166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:51.915989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:51.981441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aab85edf-93c3-40ed-a49e-dc896f0a730a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.089024 Nov 20 20:51:51.986079 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1010/1969] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:51 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:51.991451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:51.992280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:51.998224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:52.002016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.002016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.002016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.003136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.010783 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5f8ca70-c63f-473b-bae9-2379ee75c034 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.802225 Nov 20 20:51:52.014269 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 960/1970] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:51 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:52.094407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:52.103064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cccff0ca-c0c4-4950-879c-641175f30ba7 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1279 microversion: 2.1 time: 0.115446 Nov 20 20:51:52.110658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1011/1971] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:51 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:52.185646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:52.188096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:52.199982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.200454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.205179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.205479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.420693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:52.433481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:52.454760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.455496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.456781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.457577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.516817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c637713c-a558-4d72-a1b3-982f72622a41 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.115943 Nov 20 20:51:52.518252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1012/1972] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:52 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:52.583634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:52.593917 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3c2ed01-779c-4f08-9095-78e4c4b2de32 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.413075 Nov 20 20:51:52.607094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 961/1973] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:52 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:52.655085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:52.655823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:52.663894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.664402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.665252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.665744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.817926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99e95e49-6162-4078-884d-f4f0fc86745f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87716a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:52.892212 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99e95e49-6162-4078-884d-f4f0fc86745f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.084383 Nov 20 20:51:52.893344 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 962/1974] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:52 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:52.901150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:52.905991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:52.910507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:52.921717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.929011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3378575-968f-47ed-a023-8570f7da3a56 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.280530 Nov 20 20:51:52.938404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:52.940211 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1013/1975] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:52 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:52.941269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:52.942513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.001210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:53.002613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:53.028913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.029372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.031314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.031752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.050167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f49cc0f9-7ff8-43be-82d2-652e1cdb03ab tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.151791 Nov 20 20:51:53.056091 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 963/1976] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:52 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:53.081429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:53.086806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:53.115381 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0cf8399-0be1-43fd-98a1-d39c5eb2e08e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.125391 Nov 20 20:51:53.117299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1014/1977] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:52 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:51:53.126171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:53.127141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:53.130273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.130728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.131527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.131961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.135364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.136171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.137022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.137532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.356736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:53.367777 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9429b152-6e19-4bda-b89e-c1511d3dc658 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.247757 Nov 20 20:51:53.371736 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1015/1978] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:53 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:53.530161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:53.531057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:53.540307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.546791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.547973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.548407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.601298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:53.610957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fab0718-7eed-41b6-a839-c7b9a5795a3e tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1312 microversion: 2.1 time: 0.550470 Nov 20 20:51:53.618155 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 964/1979] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:53 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1312 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:53.618155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:53.618155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:53.626511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a4a0fe7c-93eb-4bd5-acc9-6a6ee52bf649 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.085145 Nov 20 20:51:53.627933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1016/1980] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:53 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:51:53.628194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.628639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.629468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.630112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.705983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69968770-eafc-407f-a324-fbed2db929f1", "name": "network-vif-plugged", "status": "completed", "tag": "5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece"}, {"server_uuid": "fb911596-5396-4ef5-8709-370aaa7dd2b2", "name": "network-vif-plugged", "status": "completed", "tag": "a6b22f7b-c9e9-43ed-8e4c-cac104488fa6"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:53.707672 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:53.707672 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:51:53.726582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:53.727021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:53.752066 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] Creating event network-vif-plugged:5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece for instance 69968770-eafc-407f-a324-fbed2db929f1 on nch1-master-1 Nov 20 20:51:53.752610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] Creating event network-vif-plugged:a6b22f7b-c9e9-43ed-8e4c-cac104488fa6 for instance fb911596-5396-4ef5-8709-370aaa7dd2b2 on nch2-master-1 Nov 20 20:51:53.763963 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7a86480b-e8f9-41aa-b7d5-bb938d7c6336 req-1e7155fb-4914-4928-94f5-68134ec410b4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062746 Nov 20 20:51:53.764940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1017/1981] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:53 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:53.912746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cf17051-ee1a-4555-b3d4-53b3d0e12959 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8695d700>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:54.007065 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cf17051-ee1a-4555-b3d4-53b3d0e12959 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.100708 Nov 20 20:51:54.008346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1018/1982] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:53 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:54.013360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:54.015821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.026619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.027540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.028510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.029585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.131003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:54.154033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ef586527-d899-4589-99fd-d6a9221ec043 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.541102 Nov 20 20:51:54.156426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 965/1983] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:53 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:54.168892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b7d2ccf2-6653-479d-952f-be76de2ae2c8 req-8b4307b0-e8df-4683-ad3c-18f5733f8d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571af42-6de9-4267-bc67-00d68e0c57b9", "tag": "04d6d4f7-592b-48c3-9bab-1420504a6390"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:54.172729 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:54.172729 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:54.189179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b7d2ccf2-6653-479d-952f-be76de2ae2c8 req-8b4307b0-e8df-4683-ad3c-18f5733f8d41 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.190185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b7d2ccf2-6653-479d-952f-be76de2ae2c8 req-8b4307b0-e8df-4683-ad3c-18f5733f8d41 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.226429 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b7d2ccf2-6653-479d-952f-be76de2ae2c8 req-8b4307b0-e8df-4683-ad3c-18f5733f8d41 service nova] Creating event network-changed:04d6d4f7-592b-48c3-9bab-1420504a6390 for instance c571af42-6de9-4267-bc67-00d68e0c57b9 on nch2-master-1 Nov 20 20:51:54.232719 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b7d2ccf2-6653-479d-952f-be76de2ae2c8 req-8b4307b0-e8df-4683-ad3c-18f5733f8d41 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074834 Nov 20 20:51:54.235916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 966/1984] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:54.243689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:54.246155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.253870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.254953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.256326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.257509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.265225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:54.273500 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8766eb1-8c85-475e-8176-5508a00a604f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.263943 Nov 20 20:51:54.276229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1019/1985] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:54 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:54.289594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:54.291127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.300291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.302760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.303847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.307546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.349438 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8a1c802-064a-449d-b490-54406838a5f5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.111818 Nov 20 20:51:54.350220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 967/1986] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:54 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:54.370466 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-113cac9e-30bb-4d8c-9010-dcca5911ca14 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.092548 Nov 20 20:51:54.371796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1020/1987] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:54 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:54.395548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:54.397135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.409032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.409476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.410491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.411093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.627982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:54.628675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.642565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.647114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.648260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.649481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.673529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:54.690568 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6cd676f9-8cb4-4068-9554-4ae5c414dfc8 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.299094 Nov 20 20:51:54.692569 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 968/1988] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:54 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:54.700559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:54.701676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.722650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.725104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.726285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.726742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.800465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-464fa101-96a5-47ff-86ed-5d1568fed041 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.104745 Nov 20 20:51:54.801574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 969/1989] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:54.885635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:54.900009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39432df5-b000-44df-802d-aef01cd64a5d tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1497 microversion: 2.1 time: 0.276437 Nov 20 20:51:54.912660 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1021/1990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:54 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1497 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:54.917952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f8779fc10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:54.937645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.938120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.938695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:54.949880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.950353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.951143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.951576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:54.999204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:54.999966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.017189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.017950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.022924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1eb8dbc-5830-4593-9a0b-ab8a90b6ea4e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8737ed30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.055847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:55.096591 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1eb8dbc-5830-4593-9a0b-ab8a90b6ea4e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.079000 Nov 20 20:51:55.105125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1022/1991] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:55.169882 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aac3ec5d-fcda-4c7b-bfa3-6f7eb0559384 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1850153784" status: 201 len: 0 microversion: 2.26 time: 0.256027 Nov 20 20:51:55.171273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 970/1992] 10.222.0.41 () {62 vars in 1379 bytes} [Sat Nov 20 20:51:54 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1850153784 => generated 0 bytes in 258 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 20 20:51:55.173642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.174277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.194881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.195904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.197425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.212886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.218087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40bfcc96-ddc7-49a2-935b-9b8114e2a589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f87872160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.256092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40bfcc96-ddc7-49a2-935b-9b8114e2a589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.256887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40bfcc96-ddc7-49a2-935b-9b8114e2a589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.312558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40bfcc96-ddc7-49a2-935b-9b8114e2a589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1850153784" status: 204 len: 0 microversion: 2.26 time: 0.123180 Nov 20 20:51:55.322076 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 971/1993] 10.222.0.41 () {60 vars in 1360 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1850153784 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:55.335923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.338893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.360692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.360692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.365301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.366385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.505710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:55.518353 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c5414c7-b6d2-4fa0-9b70-8fed1546d91e tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1323 microversion: 2.1 time: 0.348847 Nov 20 20:51:55.533569 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1023/1994] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:55.551166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f86a3eee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.565158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.567502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.568318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.579161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.579828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.581036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.581668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.616659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.618074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.646536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:55.720876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f02fa203-5e81-4f7a-ae6e-4a150d10d847 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 204 len: 0 microversion: 2.26 time: 0.185654 Nov 20 20:51:55.722377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1024/1995] 10.222.0.41 () {60 vars in 1294 bytes} [Sat Nov 20 20:51:55 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:55.731814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:55.733323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.740130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.740860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.741846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.742753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.793939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:55.805316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0628c27-2099-4c29-b2e5-83de26a1eb9f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.080834 Nov 20 20:51:55.806825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1025/1996] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:55 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:55.816056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f9f8096-5cca-47bd-ac15-254bc88ff9e1 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1315 microversion: 2.1 time: 0.491861 Nov 20 20:51:55.816378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:55.816963 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 972/1997] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:55.817939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.831572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.832821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.834369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.835382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.836588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.838140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.845261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.845809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.847051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.847783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.903162 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a454df0-0a2c-45cd-8609-a08e78119b72 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.094764 Nov 20 20:51:55.905235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1026/1998] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:55 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:55.911379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50a584d0-f655-489c-b072-96ffb336a2f3 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f869181f0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:55.921736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a584d0-f655-489c-b072-96ffb336a2f3 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.922337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a584d0-f655-489c-b072-96ffb336a2f3 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.938418 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50a584d0-f655-489c-b072-96ffb336a2f3 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 12 microversion: 2.26 time: 0.031694 Nov 20 20:51:55.939857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1027/1999] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:55.946207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:55.947399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:55.957863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.958458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:55.960143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:55.960632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.023957 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a25e718a-1ce1-4c31-a814-43068d64aa59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.081165 Nov 20 20:51:56.028003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1028/2000] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:55 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:56.032481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f98e6fa60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.043441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.044155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.044808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.061644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:56.064523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.065776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.066880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.067358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.070580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38545bf8-2ad0-47a6-aa65-9a290f23678d tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.240085 Nov 20 20:51:56.071172 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 973/2001] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:55 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:56.101314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.102102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.113906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-052f1f66-b45a-457a-8d62-bfd84ccd104e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87731ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.131419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.132189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.175549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.200567 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-052f1f66-b45a-457a-8d62-bfd84ccd104e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.092323 Nov 20 20:51:56.207197 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 974/2002] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:56.207428 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a96ef6dc-4e64-47fa-a676-6599cd91c433 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-792087291" status: 201 len: 0 microversion: 2.26 time: 0.178919 Nov 20 20:51:56.207428 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1029/2003] 10.222.0.41 () {62 vars in 1376 bytes} [Sat Nov 20 20:51:56 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-792087291 => generated 0 bytes in 180 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 20 20:51:56.219407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c20f395a-e529-403a-80a7-248576813cd5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f877be8b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.228436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c20f395a-e529-403a-80a7-248576813cd5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.228999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c20f395a-e529-403a-80a7-248576813cd5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.240625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c20f395a-e529-403a-80a7-248576813cd5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 35 microversion: 2.26 time: 0.025755 Nov 20 20:51:56.242082 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 975/2004] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 35 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:56.251297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f86a3e820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.263522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.264067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.264830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.270611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.271131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.271966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.272488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.297993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.299146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.328386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.346107 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b219d115-13c6-4de7-a162-7e43aac52589 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-792087291" status: 204 len: 0 microversion: 2.26 time: 0.098878 Nov 20 20:51:56.346819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1030/2005] 10.222.0.41 () {60 vars in 1360 bytes} [Sat Nov 20 20:51:56 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-792087291 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:56.356764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2ad3dc1-3ad1-4ea7-87cb-1811b30ba134 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f87872ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.367725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2ad3dc1-3ad1-4ea7-87cb-1811b30ba134 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.368536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2ad3dc1-3ad1-4ea7-87cb-1811b30ba134 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.378891 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2ad3dc1-3ad1-4ea7-87cb-1811b30ba134 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 12 microversion: 2.26 time: 0.027741 Nov 20 20:51:56.379493 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 976/2006] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:56.390184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f86ee7e50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.400674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.401250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.401831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.408388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.408923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.409769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.410358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.434335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.434991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.449154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.465513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5643015e-3546-47fd-949c-0eae8548311c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 204 len: 0 microversion: 2.26 time: 0.079541 Nov 20 20:51:56.468640 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1031/2007] 10.222.0.41 () {60 vars in 1294 bytes} [Sat Nov 20 20:51:56 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:56.479874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f877beaf0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.489866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.490349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.491053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.497441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.497886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.498914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.499351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.542416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.542871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.551266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.552314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.555846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.556447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.563311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.568994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.572344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.572999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.588389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.608973 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a3db3008-0c04-4df7-8f05-e8d04215c1ea tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1452015986" status: 201 len: 0 microversion: 2.26 time: 0.132282 Nov 20 20:51:56.610066 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 977/2008] 10.222.0.41 () {62 vars in 1379 bytes} [Sat Nov 20 20:51:56 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1452015986 => generated 0 bytes in 135 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 20 20:51:56.620030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f877b88b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.630640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.631329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.631986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.637981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.638667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.639805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.640480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.673556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.674319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.684426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.684899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.710338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.736720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a24a4412-67df-413a-9eeb-3dd48adde3d5 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-723854931" status: 201 len: 0 microversion: 2.26 time: 0.121292 Nov 20 20:51:56.742665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 978/2009] 10.222.0.41 () {62 vars in 1376 bytes} [Sat Nov 20 20:51:56 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-723854931 => generated 0 bytes in 128 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Nov 20 20:51:56.749621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f876321f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.759717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.760222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.760816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.767860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.768311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.769162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.769607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.788368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:56.798971 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dfff8b82-d20f-4f65-ab0e-a6dbb88a8542 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1472 microversion: 2.1 time: 0.252109 Nov 20 20:51:56.800242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1032/2010] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1472 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:56.815626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.815626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.824715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.825966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.837568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.838336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.840043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:56.846940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.847401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.860825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c485fcb-59b8-4206-bf02-c52ef4f7c6cb tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 204 len: 0 microversion: 2.26 time: 0.116395 Nov 20 20:51:56.862271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 979/2011] 10.222.0.41 () {60 vars in 1294 bytes} [Sat Nov 20 20:51:56 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:56.870556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:56.871641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.879314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.879764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.880626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.881068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.885631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:56.886506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:51:56.887599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a31c34a3-76fe-43ea-a836-7ae4caf6020c tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.069995 Nov 20 20:51:56.888464 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1033/2012] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2/diagnostics => generated 117 bytes in 75 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:51:56.902742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.903363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:56.911822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.913924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.915597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.916213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.945725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a384d14-60c8-470e-a3a2-c68179a8298f tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.078624 Nov 20 20:51:56.950149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 980/2013] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:56 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:56.955672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e24e1509-baeb-4075-9a64-2cb6c090286a tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f87706280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.967258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e24e1509-baeb-4075-9a64-2cb6c090286a tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:56.968299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e24e1509-baeb-4075-9a64-2cb6c090286a tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:56.979686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e24e1509-baeb-4075-9a64-2cb6c090286a tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 12 microversion: 2.26 time: 0.030651 Nov 20 20:51:56.985619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 981/2014] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:56.991529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:56.992619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.001572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.002026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.002875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.003319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.033770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:57.158000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6bbc765-be56-48f9-97d2-2a56d9bf0532 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 204 len: 0 microversion: 2.1 time: 0.158196 Nov 20 20:51:57.161891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 982/2015] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:56 2021] DELETE /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:57.166825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:57.168612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.177337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.177834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.178805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.179279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.216990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:57.226017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4de0e8aa-b5a9-41e3-8d9d-d505b055ec9a tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1465 microversion: 2.1 time: 0.335988 Nov 20 20:51:57.231214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3103171-4523-40ea-8613-9593c1ef6e66 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.070508 Nov 20 20:51:57.234577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 983/2016] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:57 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:57.238311 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1034/2017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:56 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1465 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:57.240803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f87703e50>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.243397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:57.244741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.251611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.251803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.252056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.252435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.253120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.253259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.253626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.262991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.263605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.264532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.265193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.293890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.294991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.304105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6909981e-8045-4080-bb01-d86e3eef038d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.064410 Nov 20 20:51:57.305246 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1035/2018] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:57 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:57.309584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:57.310556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.311452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.318814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.319301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.320280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.320723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.328223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-789722ea-7ba5-41fd-b8d0-5264b950f6fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 204 len: 0 microversion: 2.26 time: 0.091998 Nov 20 20:51:57.329127 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 984/2019] 10.222.0.41 () {60 vars in 1294 bytes} [Sat Nov 20 20:51:57 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:57.340581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.341488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.351547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.352579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.353584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.354158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.565039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:57.575218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2d12243-9656-439a-b086-991875bb41f5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.268292 Nov 20 20:51:57.580223 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1036/2020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:57 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:57.593127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a188dd83-3622-4679-a5b9-5e1632b7fb68 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98df1280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.617653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:57.633851 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24fa2ebf-e00b-4fed-87ed-c3fcb913918a tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1478 microversion: 2.1 time: 0.299950 Nov 20 20:51:57.635423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 985/2021] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:57 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:57.645497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.647054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.656299 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a188dd83-3622-4679-a5b9-5e1632b7fb68 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1412 microversion: 2.1 time: 0.074975 Nov 20 20:51:57.662105 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1037/2022] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:57 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:57.662292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.662292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.662292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.662292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.669162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f870e7160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.679017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.679473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.679946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.685636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.686200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.687247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.687686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.710099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:57.718398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.719313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.728556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.729551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.774221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:57.809828 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ffc5383-5ee2-47db-9495-7134d0f31949 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 204 len: 0 microversion: 2.1 time: 0.171599 Nov 20 20:51:57.815800 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 986/2023] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:57 2021] DELETE /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:57.819961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e104684b-da27-4416-bb79-2339027a1706 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-397092622" status: 201 len: 0 microversion: 2.26 time: 0.161304 Nov 20 20:51:57.824811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1038/2024] 10.222.0.41 () {62 vars in 1376 bytes} [Sat Nov 20 20:51:57 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-397092622 => generated 0 bytes in 163 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 20 20:51:57.824977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.824977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.829362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.829857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.830735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.831278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.834927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f873608b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:57.845024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.845575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.846226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.854990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.855507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.857768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.858493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.887468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.888042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.901617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.902796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.942658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:57.959970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b059924-2f8d-4a51-ba8d-c6dfe1341057 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1095953075" status: 201 len: 0 microversion: 2.26 time: 0.130289 Nov 20 20:51:57.960980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1039/2025] 10.222.0.41 () {62 vars in 1379 bytes} [Sat Nov 20 20:51:57 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags/tempest-tag-1095953075 => generated 0 bytes in 134 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 20 20:51:57.965296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:57.966454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:57.973611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.974086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:57.974882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:57.975335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.019706 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f484888-fece-4922-9812-20aca4f8e4ee tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.057532 Nov 20 20:51:58.021108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1040/2026] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:57 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:58.026986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Action: 'update_all', calling method: .version_select at 0x7f3f86ee7ee0>, body: {"tags": ["tempest-tag-1099525866", "tempest-tag-1601739915"]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:58.028360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:58.037405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9990cdad-daba-4d61-9e21-e2ab6351f10e tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1471 microversion: 2.1 time: 0.219896 Nov 20 20:51:58.037861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 987/2027] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:57 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.051147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.051661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.052290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.059410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.059944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.060834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.061362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.087670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.088190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.109480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:58.125721 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1911e76f-9c2a-497b-a69b-1f4e0f880b39 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 62 microversion: 2.26 time: 0.103318 Nov 20 20:51:58.131179 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1041/2028] 10.222.0.41 () {62 vars in 1311 bytes} [Sat Nov 20 20:51:58 2021] PUT /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 62 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.136292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6bbefcdb-bdf4-430c-bea6-ddb11b0bbc57 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f87872ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.144874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbefcdb-bdf4-430c-bea6-ddb11b0bbc57 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.145575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbefcdb-bdf4-430c-bea6-ddb11b0bbc57 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.154265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6bbefcdb-bdf4-430c-bea6-ddb11b0bbc57 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 200 len: 62 microversion: 2.26 time: 0.021791 Nov 20 20:51:58.155566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 988/2029] 10.222.0.41 () {60 vars in 1291 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 62 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.165290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '.version_select at 0x7f3f98e7ab80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.174411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.174861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.175333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.180664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.181108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.181864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.182329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.205627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.206124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.219544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lazy-loading 'flavor' on Instance uuid 4450abf6-2433-4e78-97e4-5e9afed3b26a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:51:58.233184 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a20a5c6-9abe-42fb-b912-e3a0958da0a7 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags" status: 204 len: 0 microversion: 2.26 time: 0.071776 Nov 20 20:51:58.233777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1042/2030] 10.222.0.41 () {60 vars in 1294 bytes} [Sat Nov 20 20:51:58 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:51:58.242728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.242935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:58.243247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.243910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.249587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.249882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.250020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.250425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.250958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.251251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.251420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.251694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.277068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:58.357259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c8293be-dc5e-4108-b9f8-7f69699d3623 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 204 len: 0 microversion: 2.1 time: 0.117138 Nov 20 20:51:58.359266 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1043/2031] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:58 2021] DELETE /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:58.369331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:58.371213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.376881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86ed36bc-5a69-4845-a5c3-dfc17a11aa7c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.136890 Nov 20 20:51:58.382639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 989/2032] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:58 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:58.383584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.384381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.385799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.386968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.392357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.393508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.403126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.403988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.406627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.407393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.474627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-628439c2-6846-4f76-afee-81de4a466884 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.111923 Nov 20 20:51:58.474938 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1044/2033] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:58.581219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:58.589518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6828c577-a944-447e-bb01-b1a188075b3c tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1503 microversion: 2.1 time: 0.204864 Nov 20 20:51:58.590268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 990/2034] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.601255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.602083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.609839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.610323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.611124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.611570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.652750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.653296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:58.660209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.663025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.663025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.663025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.801147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:58.816646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb83f06e-e4ea-44ea-91fe-7fdb20053072 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.221461 Nov 20 20:51:58.817722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1045/2035] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.823422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd6a0658-10fc-4d8b-a02b-b7c36aede085 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693dee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.889746 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd6a0658-10fc-4d8b-a02b-b7c36aede085 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1421 microversion: 2.1 time: 0.070199 Nov 20 20:51:58.890700 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1046/2036] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:58.902198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01b2e7c7-dc4e-4f04-b71a-aab56308567e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8748ec10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.919341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:58.928906 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5007f311-adab-41cb-aa18-8baf830e1d09 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1478 microversion: 2.1 time: 0.280044 Nov 20 20:51:58.930250 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 991/2037] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:58.935381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b00f006a-c101-4ed8-9768-7dc5a39a0c43 req-888e3e3b-1790-45a3-ae26-546e3c9b93de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571af42-6de9-4267-bc67-00d68e0c57b9", "name": "network-vif-plugged", "status": "completed", "tag": "04d6d4f7-592b-48c3-9bab-1420504a6390"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:58.937690 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:58.937690 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:58.951689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b00f006a-c101-4ed8-9768-7dc5a39a0c43 req-888e3e3b-1790-45a3-ae26-546e3c9b93de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:58.952355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b00f006a-c101-4ed8-9768-7dc5a39a0c43 req-888e3e3b-1790-45a3-ae26-546e3c9b93de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:58.962354 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01b2e7c7-dc4e-4f04-b71a-aab56308567e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 200 len: 1421 microversion: 2.1 time: 0.064179 Nov 20 20:51:58.963278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1047/2038] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:51:58 2021] GET /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:51:58.972943 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b00f006a-c101-4ed8-9768-7dc5a39a0c43 req-888e3e3b-1790-45a3-ae26-546e3c9b93de service nova] Creating event network-vif-plugged:04d6d4f7-592b-48c3-9bab-1420504a6390 for instance c571af42-6de9-4267-bc67-00d68e0c57b9 on nch2-master-1 Nov 20 20:51:58.976066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad4e22f6-ee73-46b3-8c72-e0e88c85849d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693df70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:58.980093 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b00f006a-c101-4ed8-9768-7dc5a39a0c43 req-888e3e3b-1790-45a3-ae26-546e3c9b93de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048099 Nov 20 20:51:58.981485 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 992/2039] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:59.032628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:59.033638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.047592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.048267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.049061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.050683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.101223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0095e4f0-0fcf-4c17-9ee5-787b9a116256 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.073014 Nov 20 20:51:59.102283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 993/2040] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:59 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:59.107204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:59.108095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.115097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.115543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.116329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.116754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.349660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:59.359533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3abfd6d6-f860-4352-bb9f-5779886628a4 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1471 microversion: 2.1 time: 0.255830 Nov 20 20:51:59.360209 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 994/2041] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:59 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:51:59.391502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:59.392569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.402168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.402913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.404430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.405318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.480983 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6c3f435-390c-4fdd-be44-97f51dea3192 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.094231 Nov 20 20:51:59.481984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 995/2042] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:51:59 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:51:59.495171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:59.496549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.505942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.506602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.507581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.508312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.592330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94bb55c4-a285-4c9a-8405-fe75354fe2b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.107282 Nov 20 20:51:59.594282 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 996/2043] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:51:59 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:51:59.603510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fe9b465a-22a8-4fe1-937a-58d37be2692d req-b910758a-ce57-4ab3-a357-fd2693678d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb911596-5396-4ef5-8709-370aaa7dd2b2", "name": "network-vif-deleted", "tag": "a6b22f7b-c9e9-43ed-8e4c-cac104488fa6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:51:59.614179 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:51:59.614179 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:51:59.621070 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad4e22f6-ee73-46b3-8c72-e0e88c85849d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 204 len: 0 microversion: 2.1 time: 0.650119 Nov 20 20:51:59.621960 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1048/2044] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:58 2021] DELETE /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:51:59.628650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:59.628986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fe9b465a-22a8-4fe1-937a-58d37be2692d req-b910758a-ce57-4ab3-a357-fd2693678d14 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.629557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.630572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fe9b465a-22a8-4fe1-937a-58d37be2692d req-b910758a-ce57-4ab3-a357-fd2693678d14 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.647148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fe9b465a-22a8-4fe1-937a-58d37be2692d req-b910758a-ce57-4ab3-a357-fd2693678d14 service nova] Creating event network-vif-deleted:a6b22f7b-c9e9-43ed-8e4c-cac104488fa6 for instance fb911596-5396-4ef5-8709-370aaa7dd2b2 on nch2-master-1 Nov 20 20:51:59.647897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.648365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.652624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.653404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.653738 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fe9b465a-22a8-4fe1-937a-58d37be2692d req-b910758a-ce57-4ab3-a357-fd2693678d14 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056802 Nov 20 20:51:59.654837 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 997/2045] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:51:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:51:59.660770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:59.661384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.668104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.668790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.671277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.672439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.703660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:51:59.805035 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7816675-45e5-46fa-b990-2ba348fce855 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 204 len: 0 microversion: 2.1 time: 0.148216 Nov 20 20:51:59.805998 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 998/2046] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:51:59 2021] DELETE /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:51:59.835610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:51:59.836615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:51:59.843385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.844009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.845142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:51:59.845732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:51:59.984552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:51:59.993735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cc5b50b-4c61-440f-a61d-9cf451eb61fd tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1503 microversion: 2.1 time: 0.370535 Nov 20 20:51:59.994696 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1049/2047] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:59 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:00.002846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-927754408", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7ac3ab90-d288-4bb5-99a9-c81df0147689"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:00.012407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:00.024096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c180c3d8-55d5-45b8-8f2b-33a578039f7f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1321 microversion: 2.1 time: 0.192575 Nov 20 20:52:00.030273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 999/2048] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:51:59 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:00.031527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:00.032042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.040713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.041309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.042642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.043473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.082481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] validate_networks() for [('7ac3ab90-d288-4bb5-99a9-c81df0147689', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:00.112404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.112978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.113502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lazy-loading 'fault' on Instance uuid fb911596-5396-4ef5-8709-370aaa7dd2b2 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:00.164759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '173ed40ec5274fb799d4982f3ee93493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3b8141b335a46009c54d270ec68ea26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:00.175531 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05cc4086-287f-4e12-8e7e-a9f58d501ed9 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 200 len: 1313 microversion: 2.1 time: 0.148531 Nov 20 20:52:00.177209 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1000/2049] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:00 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:00.182816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:00.183881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.190969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.191636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.193072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.193634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.254384 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3ad049e-2246-495a-a8c0-079df3935113 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.075063 Nov 20 20:52:00.255408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1001/2050] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:00 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:00.330030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-70a690fc-e224-44fc-9cc2-08932f29e623 req-816126bb-2c23-443c-80a2-2b563f92c444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69968770-eafc-407f-a324-fbed2db929f1", "name": "network-vif-deleted", "tag": "5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:00.332263 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:00.332263 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:00.350237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-70a690fc-e224-44fc-9cc2-08932f29e623 req-816126bb-2c23-443c-80a2-2b563f92c444 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.351012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-70a690fc-e224-44fc-9cc2-08932f29e623 req-816126bb-2c23-443c-80a2-2b563f92c444 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.371921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-70a690fc-e224-44fc-9cc2-08932f29e623 req-816126bb-2c23-443c-80a2-2b563f92c444 service nova] Creating event network-vif-deleted:5ef40f9c-dbe0-4dbf-ba69-6bdd8f403ece for instance 69968770-eafc-407f-a324-fbed2db929f1 on nch1-master-1 Nov 20 20:52:00.378486 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-70a690fc-e224-44fc-9cc2-08932f29e623 req-816126bb-2c23-443c-80a2-2b563f92c444 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053807 Nov 20 20:52:00.379422 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1002/2051] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:00.384913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:00.385962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.394077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.395006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.396282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.396941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.554102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13e833cff86e40ef9e81edbb790c348b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebffc7faac2d4069a182969e23268495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:00.563908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a622849f-8dbe-4c42-98bb-d406f289632d tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 200 len: 1300 microversion: 2.1 time: 0.183008 Nov 20 20:52:00.564964 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1003/2052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:00 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 1300 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:00.570830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:00.571763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.579526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.580245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.581462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.582184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.629101 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c8a11e0-e866-4cab-bcac-f810bb0f73d1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.062402 Nov 20 20:52:00.629836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1004/2053] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:00 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:00.637361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:00.638386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.648693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.649187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.650038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.650532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.700091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:52:00.700814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:52:00.701293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:52:00.702261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:52:00.702679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:52:00.703904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3affada-6f21-427a-99ea-670fe6c24f44 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.072253 Nov 20 20:52:00.704968 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1005/2054] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:00 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:00.712078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.712603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.713484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:00.713991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:00.733600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:00.740919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for user 48554aa52ebf468fa74262b1bf8ab300 and project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:00.755512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:52:00.757824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:00.808404 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0be99c2f-728c-41a4-a13e-cbb2fc0b8404 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812268 Nov 20 20:52:00.809559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1050/2055] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:51:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:52:00.821630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6f0ecfa-75cf-45ac-b450-9a51a8b1d651 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:00.822321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6f0ecfa-75cf-45ac-b450-9a51a8b1d651 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:00.934445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6f0ecfa-75cf-45ac-b450-9a51a8b1d651 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:00.943271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6f0ecfa-75cf-45ac-b450-9a51a8b1d651 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1207 microversion: 2.1 time: 0.127207 Nov 20 20:52:00.945735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1006/2056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:00 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1207 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:01.013745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.017804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.029512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.029512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.030894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.031414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.042398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.044060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.060425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.063190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.064958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.065429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.171774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e07f797dec4a477c9d4ffa07339fec74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd58479ec1e22447588aae115ec314452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:01.181617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-089e7cbf-e2b0-4a4f-ad32-f1b1efba1d0f tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 200 len: 1297 microversion: 2.1 time: 0.173072 Nov 20 20:52:01.182857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1051/2057] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 1297 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:01.197098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.198683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] [instance: fb911596-5396-4ef5-8709-370aaa7dd2b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.206893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.206893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.207855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.208307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.235743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] HTTP exception thrown: Instance fb911596-5396-4ef5-8709-370aaa7dd2b2 could not be found. Nov 20 20:52:01.236526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] Returning 404 to user: Instance fb911596-5396-4ef5-8709-370aaa7dd2b2 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.237582 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d2bb1fa-8070-4e66-b5c9-f4829a134466 tempest-ServerDiagnosticsNegativeTest-1467139335 tempest-ServerDiagnosticsNegativeTest-1467139335-project] 10.222.0.41 "GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2" status: 404 len: 111 microversion: 2.1 time: 0.047778 Nov 20 20:52:01.241801 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1052/2058] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/fb911596-5396-4ef5-8709-370aaa7dd2b2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.267589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.270846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.275471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:01.284493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.285337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.286558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.287201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.287330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca555ce6-7be3-4835-83fe-168bb1a2b6c5 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1471 microversion: 2.1 time: 0.248860 Nov 20 20:52:01.301765 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1007/2059] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1471 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:01.308345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.309567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.318817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.319616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.322011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.322600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.336718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1dc88b23-24c9-4a68-8d1c-90a66b7593bc tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.072764 Nov 20 20:52:01.337474 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1053/2060] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:01.354545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lazy-loading 'flavor' on Instance uuid c571af42-6de9-4267-bc67-00d68e0c57b9 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:01.461833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7fca37d-09fe-4433-b826-d8935b347dea tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9/action" status: 202 len: 0 microversion: 2.1 time: 0.157764 Nov 20 20:52:01.463979 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1008/2061] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:01.475878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.476946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.485145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.485964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.488818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.490107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.582922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.583911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.597173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.598329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.599778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.600836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.623843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. Nov 20 20:52:01.624969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.626410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f423e7d8-13fe-48a4-8936-abf32f5634f5 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 404 len: 111 microversion: 2.1 time: 0.048269 Nov 20 20:52:01.631220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1009/2062] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:52:01.636774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1450860760", "metadata": {"image_type": "test"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.638254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.645847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.646580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.647619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.648249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.674016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. Nov 20 20:52:01.674862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.676254 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-088fb858-2c5a-438c-882c-04bd021b6f63 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "POST /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1/action" status: 404 len: 111 microversion: 2.1 time: 0.043132 Nov 20 20:52:01.677002 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1010/2063] 10.222.0.41 () {60 vars in 1278 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.688049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.689057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.696546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.697002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.698119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.698561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.756179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c076160-bc49-47d4-9e88-de9445e3117f tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.077902 Nov 20 20:52:01.757505 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1011/2064] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:01.763929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-199a2ebb-767f-4c3c-9137-9a94adcf968d req-9fb0be1b-b0d8-4c5c-8ac2-e5f4fa733723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4450abf6-2433-4e78-97e4-5e9afed3b26a", "name": "network-vif-deleted", "tag": "bdfe8d89-e22c-4a72-a2ed-490198efb612"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.766142 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:01.766142 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:01.776466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-199a2ebb-767f-4c3c-9137-9a94adcf968d req-9fb0be1b-b0d8-4c5c-8ac2-e5f4fa733723 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.777087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-199a2ebb-767f-4c3c-9137-9a94adcf968d req-9fb0be1b-b0d8-4c5c-8ac2-e5f4fa733723 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.794906 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-199a2ebb-767f-4c3c-9137-9a94adcf968d req-9fb0be1b-b0d8-4c5c-8ac2-e5f4fa733723 service nova] Creating event network-vif-deleted:bdfe8d89-e22c-4a72-a2ed-490198efb612 for instance 4450abf6-2433-4e78-97e4-5e9afed3b26a on nch2-master-1 Nov 20 20:52:01.803201 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-199a2ebb-767f-4c3c-9137-9a94adcf968d req-9fb0be1b-b0d8-4c5c-8ac2-e5f4fa733723 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043557 Nov 20 20:52:01.804285 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1012/2065] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:01.811712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5fe1415-40ba-47f9-98e0-2b302eb7951f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1844546456", "metadata": {"image_type": "test"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.812541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5fe1415-40ba-47f9-98e0-2b302eb7951f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Failed to fetch instance by id tempest-invalid-1663857792 {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 20:52:01.813267 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e5fe1415-40ba-47f9-98e0-2b302eb7951f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance tempest-invalid-1663857792 could not be found. Nov 20 20:52:01.814229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5fe1415-40ba-47f9-98e0-2b302eb7951f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance tempest-invalid-1663857792 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.815158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5fe1415-40ba-47f9-98e0-2b302eb7951f tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "POST /compute/v2.1/servers/tempest-invalid-1663857792/action" status: 404 len: 101 microversion: 2.1 time: 0.009309 Nov 20 20:52:01.816008 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1013/2066] 10.222.0.41 () {60 vars in 1248 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/tempest-invalid-1663857792/action => generated 101 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.821939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.824013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.833983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.834234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.835298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.835569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.853374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6002951f-e499-4c4c-ad53-a3ad63fc67de tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1630 microversion: 2.1 time: 0.382995 Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1054/2067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1630 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc8bd27a-f363-4ebf-9693-6516af2d1a94 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-641757823"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc8bd27a-f363-4ebf-9693-6516af2d1a94 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-bc8bd27a-f363-4ebf-9693-6516af2d1a94 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc8bd27a-f363-4ebf-9693-6516af2d1a94 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.862235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc8bd27a-f363-4ebf-9693-6516af2d1a94 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.006791 Nov 20 20:52:01.866480 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1055/2068] 10.222.0.41 () {60 vars in 1274 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.871477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f722dca5-8da0-4adf-8c43-703e370d93d0 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2018742189"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:01.873327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f722dca5-8da0-4adf-8c43-703e370d93d0 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 20:52:01.874390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f722dca5-8da0-4adf-8c43-703e370d93d0 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 20 20:52:01.874934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f722dca5-8da0-4adf-8c43-703e370d93d0 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.875742 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f722dca5-8da0-4adf-8c43-703e370d93d0 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.008322 Nov 20 20:52:01.880327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1056/2069] 10.222.0.41 () {60 vars in 1280 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.884283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d033ad8a-19ba-43c3-8bb4-1bdfe99a764c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.067071 Nov 20 20:52:01.885672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1014/2070] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:01 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:01.889950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.889950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.900389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.901284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.902305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.903735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.920486 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. Nov 20 20:52:01.921607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.922494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92ba24c7-5c63-4434-a355-769dc20d67a8 tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "DELETE /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 404 len: 111 microversion: 2.1 time: 0.041256 Nov 20 20:52:01.923639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1057/2071] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:01 2021] DELETE /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.932487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.933282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] [instance: 69968770-eafc-407f-a324-fbed2db929f1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.942559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.943169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.944268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.944958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.965272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:01.965959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] HTTP exception thrown: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. Nov 20 20:52:01.966360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:01.967364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] Returning 404 to user: Instance 69968770-eafc-407f-a324-fbed2db929f1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:01.969543 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77fa7742-4bb0-4f3f-9d7b-448dec661a6b tempest-ImagesNegativeTestJSON-427895141 tempest-ImagesNegativeTestJSON-427895141-project] 10.222.0.41 "GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1" status: 404 len: 111 microversion: 2.1 time: 0.040928 Nov 20 20:52:01.973050 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1015/2072] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/69968770-eafc-407f-a324-fbed2db929f1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:01.978950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.979409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:01.980206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:01.980637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.185053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:02.198844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9f7a1a8-75bc-42bc-9c47-be2acf67ae7c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1259 microversion: 2.1 time: 0.235287 Nov 20 20:52:02.200739 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1058/2073] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:01 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1259 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:02.203258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:02.205533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] [instance: 4450abf6-2433-4e78-97e4-5e9afed3b26a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:02.216435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.218766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.221195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.221865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.261599 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] HTTP exception thrown: Instance 4450abf6-2433-4e78-97e4-5e9afed3b26a could not be found. Nov 20 20:52:02.264153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] Returning 404 to user: Instance 4450abf6-2433-4e78-97e4-5e9afed3b26a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:02.266909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-833d3502-311f-469d-8c54-8ae352c00923 tempest-ServerTagsTestJSON-1218005993 tempest-ServerTagsTestJSON-1218005993-project] 10.222.0.41 "GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a" status: 404 len: 111 microversion: 2.1 time: 0.071629 Nov 20 20:52:02.269943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1016/2074] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:02 2021] GET /compute/v2.1/servers/4450abf6-2433-4e78-97e4-5e9afed3b26a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:52:02.318541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-10aea8d7-7501-4a39-9909-26010e328b25 req-88a4b851-5cc7-4159-b62f-de8e7c5d2294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6030db32-94d0-4d8c-884c-b3469acfa23f", "name": "network-vif-unplugged", "status": "completed", "tag": "cb0435d6-cf6a-457b-b16c-48b724dd5e98"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:02.320467 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:02.320467 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:02.347528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-10aea8d7-7501-4a39-9909-26010e328b25 req-88a4b851-5cc7-4159-b62f-de8e7c5d2294 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.349317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-10aea8d7-7501-4a39-9909-26010e328b25 req-88a4b851-5cc7-4159-b62f-de8e7c5d2294 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.355820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:02.359034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:02.382704 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-10aea8d7-7501-4a39-9909-26010e328b25 req-88a4b851-5cc7-4159-b62f-de8e7c5d2294 service nova] Creating event network-vif-unplugged:cb0435d6-cf6a-457b-b16c-48b724dd5e98 for instance 6030db32-94d0-4d8c-884c-b3469acfa23f on nch1-master-1 Nov 20 20:52:02.392284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.394243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.401236 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-10aea8d7-7501-4a39-9909-26010e328b25 req-88a4b851-5cc7-4159-b62f-de8e7c5d2294 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086470 Nov 20 20:52:02.402943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.406213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1059/2075] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:02.406420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.526654 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e053761-afa5-45a8-8fb2-635223b54fb4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.180763 Nov 20 20:52:02.528681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1017/2076] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:02 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:02.769957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:02.772082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:02.804781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.805264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.807245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.807790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.857318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37d18225-1ac5-408b-a3d7-3f5cd2d6df8b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.092674 Nov 20 20:52:02.862569 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1060/2077] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:02 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:02.873252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:02.875060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:02.889689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.890948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.893327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.894025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.900435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:02.908945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:02.919440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.921291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.923777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:02.924490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:02.991778 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18d0f21d-b5ec-4af0-83bc-ab53f33ed314 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.097263 Nov 20 20:52:02.996179 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1061/2078] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:02 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:03.212413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d258f929-601b-4426-81e4-ad89064e3f01 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1613 microversion: 2.1 time: 0.343441 Nov 20 20:52:03.214013 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1018/2079] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:02 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1613 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:03.221399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:03.222778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.232251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.233455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.234112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.234288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.235296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.235930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.250545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.253379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.256708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.257164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.408941 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] HTTP exception thrown: Cannot 'migrate' instance c571af42-6de9-4267-bc67-00d68e0c57b9 while it is in vm_state suspended Nov 20 20:52:03.409552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Returning 409 to user: Cannot 'migrate' instance c571af42-6de9-4267-bc67-00d68e0c57b9 while it is in vm_state suspended {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:03.410526 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac4ef9f2-df98-4ebc-a66d-ff48b8713453 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9/action" status: 409 len: 148 microversion: 2.1 time: 0.183815 Nov 20 20:52:03.411625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1019/2080] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9/action => generated 148 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:52:03.423371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18f857cc-95a2-497e-8911-92c75c008307 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.426355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18f857cc-95a2-497e-8911-92c75c008307 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:03.427278 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18f857cc-95a2-497e-8911-92c75c008307 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457/action" status: 400 len: 144 microversion: 2.1 time: 0.008623 Nov 20 20:52:03.428572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1020/2081] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457/action => generated 144 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:52:03.431500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:03.440205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fa6be40-9b0f-45fa-b832-41a2c792bdc4 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.441710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fa6be40-9b0f-45fa-b832-41a2c792bdc4 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:03.443005 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fa6be40-9b0f-45fa-b832-41a2c792bdc4 tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457/action" status: 400 len: 120 microversion: 2.1 time: 0.008170 Nov 20 20:52:03.443563 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1021/2082] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457/action => generated 120 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:52:03.446350 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b05ceb07-dc92-404f-a004-b67a64c378a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1265 microversion: 2.1 time: 0.228862 Nov 20 20:52:03.457710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5550115-7d40-4dbb-af3e-eb4202a2f2af tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.459383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5550115-7d40-4dbb-af3e-eb4202a2f2af tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Failed to fetch instance by id 999 {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 20:52:03.459511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1062/2083] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:03 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:03.460229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f5550115-7d40-4dbb-af3e-eb4202a2f2af tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 20 20:52:03.461068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5550115-7d40-4dbb-af3e-eb4202a2f2af tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:03.462539 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5550115-7d40-4dbb-af3e-eb4202a2f2af tempest-ServersAdminNegativeTestJSON-1374327517 tempest-ServersAdminNegativeTestJSON-1374327517-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.009687 Nov 20 20:52:03.465457 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1022/2084] 10.222.0.41 () {60 vars in 1178 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/999/action => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:03.475017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:03.477700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.491035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.491938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.492875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.497861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.543084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.544260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.556266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.557744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:52:03.559998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.565123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.565749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.652079 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a0c6301-3d0e-4676-8080-dc90ba07a416 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.115304 Nov 20 20:52:03.653106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1023/2085] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:03.733354 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-654027af-5e10-415b-b4d5-6f7a4748cef9 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 204 len: 0 microversion: 2.1 time: 0.261851 Nov 20 20:52:03.735385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1063/2086] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:03 2021] DELETE /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:52:03.745108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:03.746075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.771163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.774554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.775433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.775882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.858493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0ac57e8b-4669-4872-93c8-afa17d5a1eef req-8a16e938-9463-4555-8f0d-a9a7f95bbce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6030db32-94d0-4d8c-884c-b3469acfa23f", "name": "network-vif-deleted", "tag": "cb0435d6-cf6a-457b-b16c-48b724dd5e98"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.860229 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:03.860229 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:03.873876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0ac57e8b-4669-4872-93c8-afa17d5a1eef req-8a16e938-9463-4555-8f0d-a9a7f95bbce0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.874549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0ac57e8b-4669-4872-93c8-afa17d5a1eef req-8a16e938-9463-4555-8f0d-a9a7f95bbce0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.904359 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0ac57e8b-4669-4872-93c8-afa17d5a1eef req-8a16e938-9463-4555-8f0d-a9a7f95bbce0 service nova] Creating event network-vif-deleted:cb0435d6-cf6a-457b-b16c-48b724dd5e98 for instance 6030db32-94d0-4d8c-884c-b3469acfa23f on nch1-master-1 Nov 20 20:52:03.917963 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0ac57e8b-4669-4872-93c8-afa17d5a1eef req-8a16e938-9463-4555-8f0d-a9a7f95bbce0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063919 Nov 20 20:52:03.918825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1064/2087] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:03.926802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:03.927867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:03.943214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.946690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:03.947715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:03.948372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.019038 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32a1a6a7-a9e7-40f9-a6ea-6a66dd83b7c1 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.098082 Nov 20 20:52:04.020404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1065/2088] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:03 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:04.026396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:04.027837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:04.044815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:04.047779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.048479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.049455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.050084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.064766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-196623f9-f3e6-4745-b4ec-3ea365069d21 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1468 microversion: 2.1 time: 0.324317 Nov 20 20:52:04.065352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1024/2089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:03 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:04.139370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20d5634f-b7a4-4976-b69e-f0c971ecc91f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.113052 Nov 20 20:52:04.143849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1066/2090] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:04 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:04.472769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:04.473575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:04.487478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.488075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.490096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.490729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.666541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:04.667595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:04.680779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.682540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.683719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:04.685098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:04.709435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:04.723316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66e78305-6938-4cc9-b3bf-05b300f7d74b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.257155 Nov 20 20:52:04.725712 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1025/2091] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:04 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:04.743080 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57ed4765-1969-4fc8-9223-d4d9bd129082 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.081095 Nov 20 20:52:04.744307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1067/2092] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:04 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:05.034268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:05.037116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:05.047065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.048137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.050196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.051054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.086974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:05.088922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:05.105428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.106510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.109120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.109960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.117678 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-377225aa-d641-48d8-9dec-365a01099f60 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.087160 Nov 20 20:52:05.121209 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1026/2093] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:05 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:05.153571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:05.155507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:05.178240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.178743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.179588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.180028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.282798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9436d6e7-d8af-4d6d-a0a3-34d3324d6e26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.133745 Nov 20 20:52:05.283566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1027/2094] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:05 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:05.384764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:05.397430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-304432d0-94d8-43f3-817d-ff437d1a9831 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1468 microversion: 2.1 time: 0.316762 Nov 20 20:52:05.398043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1068/2095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:05 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:05.735223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-247888086", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:05.852341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-795466e1-4319-48a5-97cc-1b87c6620227 tempest-ListImageFiltersNegativeTestJSON-1368259697 tempest-ListImageFiltersNegativeTestJSON-1368259697-project] Calling method '.version_select at 0x7f3f98dbf790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:05.853737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:05.898296 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-795466e1-4319-48a5-97cc-1b87c6620227 tempest-ListImageFiltersNegativeTestJSON-1368259697 tempest-ListImageFiltersNegativeTestJSON-1368259697-project] HTTP exception thrown: Image not found. Nov 20 20:52:05.899178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-795466e1-4319-48a5-97cc-1b87c6620227 tempest-ListImageFiltersNegativeTestJSON-1368259697 tempest-ListImageFiltersNegativeTestJSON-1368259697-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:05.900164 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-795466e1-4319-48a5-97cc-1b87c6620227 tempest-ListImageFiltersNegativeTestJSON-1368259697 tempest-ListImageFiltersNegativeTestJSON-1368259697-project] 10.222.0.41 "GET /compute/v2.1/images/475c27b9-c25c-4c3f-a3e7-af8c1517e489" status: 404 len: 62 microversion: 2.1 time: 0.337255 Nov 20 20:52:05.900907 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1069/2096] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:05 2021] GET /compute/v2.1/images/475c27b9-c25c-4c3f-a3e7-af8c1517e489 => generated 62 bytes in 340 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:05.917318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:05.918305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:05.932249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.932897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:05.933929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:05.934821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.359064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:52:06.359529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:52:06.360073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:52:06.361251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:52:06.361737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:52:06.373087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:06.376745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.377462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.378586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.379242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.388195 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8bbb3675-ca64-480f-a11a-34f0aae7e9c4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.481372 Nov 20 20:52:06.389955 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1070/2097] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:05 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:06.394887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:06.396515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:06.404286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.406088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.407428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.407850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.416689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Getting quotas for project 89d37f61bf9c4afcb21e044f0d2da2c4. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:06.427566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Getting quotas for user bee1e5b42cae4b57a2b191ff14f10b92 and project 89d37f61bf9c4afcb21e044f0d2da2c4. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:06.454297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:52:06.457449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:06.462147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e421803e-39bc-4c45-896a-5755c8a7e5a4 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.069204 Nov 20 20:52:06.463944 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1071/2098] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:06 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:06.475566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3243bffa-8618-4282-a64b-16ce0890788b req-b680339b-cfef-454b-a65c-01ab8a6af8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b2f6df-58af-4fe3-a73b-eac474989b6a", "tag": "95a284b7-4c01-4cac-b5d2-4dc06cbf81ba"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:06.479663 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:06.479663 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:06.494230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3243bffa-8618-4282-a64b-16ce0890788b req-b680339b-cfef-454b-a65c-01ab8a6af8af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.495021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3243bffa-8618-4282-a64b-16ce0890788b req-b680339b-cfef-454b-a65c-01ab8a6af8af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.511122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3243bffa-8618-4282-a64b-16ce0890788b req-b680339b-cfef-454b-a65c-01ab8a6af8af service nova] Creating event network-changed:95a284b7-4c01-4cac-b5d2-4dc06cbf81ba for instance b3b2f6df-58af-4fe3-a73b-eac474989b6a on nch1-master-1 Nov 20 20:52:06.518391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-352e7b0d-d1b3-4c80-a554-0b5d02b3cdd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035146 Nov 20 20:52:06.519896 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1028/2099] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:52:06.526409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:06.528385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:06.532376 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3243bffa-8618-4282-a64b-16ce0890788b req-b680339b-cfef-454b-a65c-01ab8a6af8af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065422 Nov 20 20:52:06.533039 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1072/2100] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:06.541059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.541713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.544188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.545139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.552043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571af42-6de9-4267-bc67-00d68e0c57b9", "name": "network-vif-deleted", "tag": "04d6d4f7-592b-48c3-9bab-1420504a6390"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:06.553540 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:06.553540 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:06.565987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.566816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.584765 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] Creating event network-vif-deleted:04d6d4f7-592b-48c3-9bab-1420504a6390 for instance c571af42-6de9-4267-bc67-00d68e0c57b9 on nch2-master-1 Nov 20 20:52:06.591321 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050081 Nov 20 20:52:06.596644 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1073/2101] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:06.598451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:06.599716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f3449297-ae6d-4b2b-b1b8-97aec0164eab req-8762a50e-f5e0-4f42-9a25-90320a2249d0 service nova] 10.222.0.41 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001783 Nov 20 20:52:06.600490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1074/2102] 10.222.0.41 () {56 vars in 885 bytes} [Sat Nov 20 20:52:06 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 20 20:52:06.614634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:06.621069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:06.631628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3e8d13b-d37d-4b93-9519-94754b87c165 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.107155 Nov 20 20:52:06.633628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1029/2103] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:06 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:06.636746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.639671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.643991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.645012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.658258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:06.660802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:06.674472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.675420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.679800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.681897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.710246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4caa2e2c-a8af-41a0-b8d4-f64a6932e612 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.107514 Nov 20 20:52:06.713587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1075/2104] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:06 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:06.732509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f79ab10-4307-43ef-bbac-1d255c4f7518 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:06.736141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f79ab10-4307-43ef-bbac-1d255c4f7518 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:06.783552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:06.786324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:06.789702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lazy-loading 'fault' on Instance uuid c571af42-6de9-4267-bc67-00d68e0c57b9 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:06.922623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:06.936927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b2fdb61-974b-4aa8-8186-baa4b7dca065 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 200 len: 1311 microversion: 2.1 time: 0.293086 Nov 20 20:52:06.937908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1030/2105] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:06 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:06.970196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f79ab10-4307-43ef-bbac-1d255c4f7518 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:06.978868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f79ab10-4307-43ef-bbac-1d255c4f7518 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1216 microversion: 2.1 time: 0.259954 Nov 20 20:52:06.980685 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1076/2106] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:06 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:07.413640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:07.414212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:07.434275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.434733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.435558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.436073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.475943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:07.477336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:07.489263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.491303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.492385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.493394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.572699 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9bf32696-5065-4e23-91bd-b338a663133d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.101477 Nov 20 20:52:07.578901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1077/2107] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:07 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:07.650449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:07.652343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:07.695515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:07.703642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.704428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.705204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.705636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.708502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5120a701-45c5-4c7e-af2c-ecc9f3e0ee8c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.305335 Nov 20 20:52:07.709938 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1031/2108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:07 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:07.724807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:07.725763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:07.731874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.732551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.733871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.734506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.784507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d14abea-aec9-42ed-bbcd-fed2b3745dfe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.062246 Nov 20 20:52:07.792223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1032/2109] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:07 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:07.799428 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53d0fdf7-a8de-4bd7-979f-c3b6d01d27d3 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.157016 Nov 20 20:52:07.800264 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1078/2110] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:07 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:07.960293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:07.961003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: c571af42-6de9-4267-bc67-00d68e0c57b9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:07.978179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.979452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.980519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:07.981403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:07.997415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:07.999201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:08.009542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.017915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.020792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.022678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.039380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] HTTP exception thrown: Instance c571af42-6de9-4267-bc67-00d68e0c57b9 could not be found. Nov 20 20:52:08.046895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Returning 404 to user: Instance c571af42-6de9-4267-bc67-00d68e0c57b9 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:08.048148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0dadb13-9095-4e9d-879d-4ecf2916ad08 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9" status: 404 len: 111 microversion: 2.1 time: 0.096444 Nov 20 20:52:08.050166 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1033/2111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:07 2021] GET /compute/v2.1/servers/c571af42-6de9-4267-bc67-00d68e0c57b9 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:08.069174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:08.069767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:08.089696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.090624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.091915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.093518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.128117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:08.137889 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2dfa1aa7-bfae-4db0-8700-023180eb5c7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1286 microversion: 2.1 time: 0.144742 Nov 20 20:52:08.140632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1079/2112] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:07 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:08.173990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:52:08.302419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5ea4505-9457-4b90-9cc7-b432e955b564 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 204 len: 0 microversion: 2.1 time: 0.242824 Nov 20 20:52:08.303520 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1034/2113] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:08 2021] DELETE /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:52:08.312100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:08.313027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:08.327285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.327904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.329060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.330713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.510950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:08.522608 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8f38a582-d78c-4051-af60-d2b467ca1257 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1477 microversion: 2.1 time: 0.214788 Nov 20 20:52:08.523824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1080/2114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:08 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1477 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:08.591619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:08.593005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:08.608813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.609928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.612011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.613028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.661207 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da29337e-41bd-4635-993f-f3f08f2e665b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.076178 Nov 20 20:52:08.661932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1035/2115] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:08 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:08.726508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:08.727203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:08.740593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.741077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.741908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:08.742374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:08.995684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Calling method '.version_select at 0x7f3f98dbff70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:09.007340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.008062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.008771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.009223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.031178 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-031e40f9-6ef8-41d6-9e39-fa46134e9b41 tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] 10.222.0.41 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.331870 Nov 20 20:52:09.031789 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1081/2116] 10.222.0.41 () {58 vars in 1121 bytes} [Sat Nov 20 20:52:08 2021] GET /compute/v2.1/limits => generated 511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:09.036378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:09.037299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:09.048591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.049054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.049856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.050346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.094826 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4dc1f14e-5fba-4a07-9c70-b6846dd58ed2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.061727 Nov 20 20:52:09.095503 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1082/2117] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:09 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:09.100497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:09.101504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:09.109246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.109691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.110536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.111004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.153387 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3e36d0e9-5519-4ddd-96e8-06d773abc389 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.056484 Nov 20 20:52:09.157468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1083/2118] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:09 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:09.210894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d01b4eb-7573-4ffd-a891-864bb579563e tempest-ExtensionsTest-1521881596 tempest-ExtensionsTest-1521881596-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:09.212729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d01b4eb-7573-4ffd-a891-864bb579563e tempest-ExtensionsTest-1521881596 tempest-ExtensionsTest-1521881596-project] 10.222.0.41 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.057516 Nov 20 20:52:09.213276 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1084/2119] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:52:09 2021] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:09.221313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-229444718", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:09.280874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:09.297788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:09.307152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcceea56-df3d-4155-8a5a-4cbb166ed3e3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.584589 Nov 20 20:52:09.317430 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1036/2120] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:08 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:09.317430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:09.317430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:09.324282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.324771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.325634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.327666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.527535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Getting quotas for project f7f5ef7fee154267a306c5a426f6bb12. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:09.535809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Getting quotas for user 43d63358eb384021802c0bc2b72ea712 and project f7f5ef7fee154267a306c5a426f6bb12. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:09.553137 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 20 20:52:09.554314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:09.555137 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-646e5fc6-1c00-4719-850b-6cc491f2925d tempest-AbsoluteLimitsNegativeTestJSON-4577451 tempest-AbsoluteLimitsNegativeTestJSON-4577451-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.340944 Nov 20 20:52:09.560244 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1085/2121] 10.222.0.41 () {60 vars in 1147 bytes} [Sat Nov 20 20:52:09 2021] POST /compute/v2.1/servers => generated 87 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:09.568808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-583ef9a0-405f-4e62-8d08-effa33836f96 tempest-ExtensionsTest-1521881596 tempest-ExtensionsTest-1521881596-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:09.571394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-583ef9a0-405f-4e62-8d08-effa33836f96 tempest-ExtensionsTest-1521881596 tempest-ExtensionsTest-1521881596-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.013952 Nov 20 20:52:09.572153 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1086/2122] 10.222.0.41 () {58 vars in 1133 bytes} [Sat Nov 20 20:52:09 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:09.577532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:09.578386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:09.585211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.585737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.586667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.587320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.723726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:09.733406 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59e98840-0e93-4a27-93ff-6a8a381ef75d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.424387 Nov 20 20:52:09.734190 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1037/2123] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:09 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:09.760730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:09.767217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:09.781730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.783105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.785463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:09.786778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:09.805669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:09.815008 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b4d24eb-5a32-4ed1-a9e9-b2785b861e75 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1477 microversion: 2.1 time: 0.241446 Nov 20 20:52:09.819855 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1087/2124] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:09 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1477 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:09.854290 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-676a7e67-c326-4944-88bc-652f2e9eb436 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.102411 Nov 20 20:52:09.858516 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1038/2125] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:09 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:10.106903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:10.108815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:10.121166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.121626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.125561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.126044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.170727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:10.172329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:10.179705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.181889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.184067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.185934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.198138 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13b6c3eb-be01-499e-b7a2-2efcc556a755 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.094676 Nov 20 20:52:10.198829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1088/2126] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:10 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:10.243241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57898409-2e81-4f1c-b61f-9540f2ad405d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.080388 Nov 20 20:52:10.247165 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1039/2127] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:10 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:10.327625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:10.328520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:10.347221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.347481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.348754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.349839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.387047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6a46c709-01a4-42b8-a7a3-be1964b66b8a req-05ba2ffb-07a4-4cc4-b209-010cdceaf0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a642def2-5524-4143-abf6-0da0402a5457", "name": "network-vif-deleted", "tag": "55b92c4e-47ff-40f3-9809-f84c75701b8e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:10.389363 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:10.389363 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:10.398267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6a46c709-01a4-42b8-a7a3-be1964b66b8a req-05ba2ffb-07a4-4cc4-b209-010cdceaf0d1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.399875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6a46c709-01a4-42b8-a7a3-be1964b66b8a req-05ba2ffb-07a4-4cc4-b209-010cdceaf0d1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.449992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6a46c709-01a4-42b8-a7a3-be1964b66b8a req-05ba2ffb-07a4-4cc4-b209-010cdceaf0d1 service nova] Creating event network-vif-deleted:55b92c4e-47ff-40f3-9809-f84c75701b8e for instance a642def2-5524-4143-abf6-0da0402a5457 on nch1-master-1 Nov 20 20:52:10.473067 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6a46c709-01a4-42b8-a7a3-be1964b66b8a req-05ba2ffb-07a4-4cc4-b209-010cdceaf0d1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085993 Nov 20 20:52:10.475503 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1040/2128] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:10.495203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c5975f3e-b6c6-440e-8779-02cca3f2472e req-884d6a55-a48c-4720-8245-427583701bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b2f6df-58af-4fe3-a73b-eac474989b6a", "name": "network-vif-plugged", "status": "completed", "tag": "95a284b7-4c01-4cac-b5d2-4dc06cbf81ba"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:10.499344 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:10.499344 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:10.520296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5975f3e-b6c6-440e-8779-02cca3f2472e req-884d6a55-a48c-4720-8245-427583701bc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.522629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5975f3e-b6c6-440e-8779-02cca3f2472e req-884d6a55-a48c-4720-8245-427583701bc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.564227 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c5975f3e-b6c6-440e-8779-02cca3f2472e req-884d6a55-a48c-4720-8245-427583701bc7 service nova] Creating event network-vif-plugged:95a284b7-4c01-4cac-b5d2-4dc06cbf81ba for instance b3b2f6df-58af-4fe3-a73b-eac474989b6a on nch1-master-1 Nov 20 20:52:10.578765 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c5975f3e-b6c6-440e-8779-02cca3f2472e req-884d6a55-a48c-4720-8245-427583701bc7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097473 Nov 20 20:52:10.579388 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1041/2129] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:10.631537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:10.641952 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a0a9302-c175-48e5-8727-bdb9cc558014 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.320710 Nov 20 20:52:10.643360 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1089/2130] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:10 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:10.753254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:10.754302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:10.767749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.768587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.770295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.771241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.836930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:10.838151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:10.845742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.847057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.848140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.848876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.891769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:10.892292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:10.893442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lazy-loading 'fault' on Instance uuid a642def2-5524-4143-abf6-0da0402a5457 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:10.964187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d62b2df3058458abccdd3b425fc26b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '473b91e504264ec5b10c2237ca293087', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:10.981314 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-511b5fc3-0254-42a5-883b-6af7e0492e5f tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 200 len: 1312 microversion: 2.1 time: 0.148236 Nov 20 20:52:10.983578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1090/2131] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:10 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:10.988080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:10.989284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:11.006713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.007291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.022929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.024520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.098298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8b3791b-6643-4d5a-9dda-c274d53effd2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.113084 Nov 20 20:52:11.099927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1091/2132] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:10 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:11.108553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0f5248c1-7dcb-4f34-959e-a3928451cda1 req-9272b972-8fae-4299-99db-06b897db902e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:11.111969 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:11.111969 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:11.121318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0f5248c1-7dcb-4f34-959e-a3928451cda1 req-9272b972-8fae-4299-99db-06b897db902e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.121850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0f5248c1-7dcb-4f34-959e-a3928451cda1 req-9272b972-8fae-4299-99db-06b897db902e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.136529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0f5248c1-7dcb-4f34-959e-a3928451cda1 req-9272b972-8fae-4299-99db-06b897db902e service nova] Creating event network-changed:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:52:11.162972 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0f5248c1-7dcb-4f34-959e-a3928451cda1 req-9272b972-8fae-4299-99db-06b897db902e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053075 Nov 20 20:52:11.163777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1092/2133] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:11.207892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:11.213046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:11.214210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:11.219901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6274c0b-d598-4de9-b828-7b88a92e856b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.472747 Nov 20 20:52:11.222427 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1042/2134] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:10 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:11.226417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.229993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.232232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.233007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.260216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:11.261518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:11.273744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.274234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.283400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.283874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.314602 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f382c5d9-949c-4d66-ad2d-2561fced89bf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.106196 Nov 20 20:52:11.318467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1093/2135] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:11 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:11.353507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33e1e3ff-ceb1-46c7-b657-fbbf5b301355 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.096736 Nov 20 20:52:11.355223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1043/2136] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:11 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:11.660820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:11.661526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:11.669369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.670520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.672247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:11.672955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:11.858992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:11.875678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-493e662b-591b-493f-8325-ae83366ae0ec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1307 microversion: 2.1 time: 0.219259 Nov 20 20:52:11.879105 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1094/2137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:11 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:12.000549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:12.001817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] [instance: a642def2-5524-4143-abf6-0da0402a5457] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.010584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.011274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.012269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.012871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.030769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] HTTP exception thrown: Instance a642def2-5524-4143-abf6-0da0402a5457 could not be found. Nov 20 20:52:12.031555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] Returning 404 to user: Instance a642def2-5524-4143-abf6-0da0402a5457 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:12.032561 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95dcdda8-74c8-445c-b6cb-d52d76d08fb1 tempest-ServersAdminNegativeTestJSON-1490667175 tempest-ServersAdminNegativeTestJSON-1490667175-project] 10.222.0.41 "GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457" status: 404 len: 111 microversion: 2.1 time: 0.037205 Nov 20 20:52:12.036665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1044/2138] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:11 2021] GET /compute/v2.1/servers/a642def2-5524-4143-abf6-0da0402a5457 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:12.111807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:12.114011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.122369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.123097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.124030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.124768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.177869 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aaaefe38-8b36-4c5a-8464-5a6465e77aa5 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 32591 microversion: 2.1 time: 0.070435 Nov 20 20:52:12.183320 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1095/2139] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:12 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 32591 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:12.239255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:12.241539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.253156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.253601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.254420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.254859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.327101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:12.328213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.335647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.336395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.338184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.338858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.393404 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2b86ac8-5f7e-4bc8-b61e-e3d6f23216ec tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.070682 Nov 20 20:52:12.394405 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1096/2140] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:12 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:12.403728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:12.405986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.415338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.416361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.417396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.418085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.470109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c5dab3a-9920-41bb-a66a-00843c2e6eb6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.072611 Nov 20 20:52:12.470683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1097/2141] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:12 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:12.612750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:12.624152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0828dab0-7a92-4fe1-895e-99df506a2de7 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.388726 Nov 20 20:52:12.625218 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1045/2142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:12 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:12.656053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d8b3e98-02f1-4429-986b-507d47f3d275 tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] Calling method '.version_select at 0x7f3f98e71a60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:12.765377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d8b3e98-02f1-4429-986b-507d47f3d275 tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da/defaults" status: 200 len: 371 microversion: 2.1 time: 0.293123 Nov 20 20:52:12.766507 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1098/2143] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:12 2021] GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da/defaults => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:12.777544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26701fad-e0a9-459b-9ba3-9685ca167fde tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] Calling method '.version_select at 0x7f3f87770af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:12.893680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:12.895886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:12.904972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.907846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.908949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:12.909583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:12.968083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26701fad-e0a9-459b-9ba3-9685ca167fde tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da" status: 200 len: 371 microversion: 2.1 time: 0.194381 Nov 20 20:52:12.973922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1046/2144] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:52:12 2021] GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da => generated 371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:12.984183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bbbcdaeb-cc93-4459-9941-5e7797d404df tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] Calling method '.version_select at 0x7f3f87ac4dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:13.082848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:13.096110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c97822e0-c31c-43b2-bdc4-81926ab164dd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1485 microversion: 2.1 time: 0.205962 Nov 20 20:52:13.107559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1099/2145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:12 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1485 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:13.117805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-999479b0-3a03-4dd5-9d00-6313a5112e3d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:13.124698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-999479b0-3a03-4dd5-9d00-6313a5112e3d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.125745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-999479b0-3a03-4dd5-9d00-6313a5112e3d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.151938 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bbbcdaeb-cc93-4459-9941-5e7797d404df tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da/defaults" status: 200 len: 371 microversion: 2.1 time: 0.171969 Nov 20 20:52:13.163226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1047/2146] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:12 2021] GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da/defaults => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:13.169791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f68b6a7-f851-4425-ab35-e152382cf452 tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] Calling method '.version_select at 0x7f3f87864ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:13.267309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-999479b0-3a03-4dd5-9d00-6313a5112e3d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Going to try to stop instance {{(pid=140942) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 20:52:13.330478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-999479b0-3a03-4dd5-9d00-6313a5112e3d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a/action" status: 202 len: 0 microversion: 2.1 time: 0.220049 Nov 20 20:52:13.331281 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1100/2147] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:13 2021] POST /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:13.343901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:13.346197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:13.355067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.359060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.362765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.365653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.431824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f70ef13-ede3-452b-a292-633de2e2d5f2 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action" status: 200 len: 40724 microversion: 2.1 time: 0.096493 Nov 20 20:52:13.432656 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1101/2148] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:13 2021] POST /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf/action => generated 40724 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:13.441209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:13.441918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:13.453722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.456733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.459340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.459968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.498978 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6f68b6a7-f851-4425-ab35-e152382cf452 tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da" status: 200 len: 371 microversion: 2.1 time: 0.333721 Nov 20 20:52:13.501451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1048/2149] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 20:52:13 2021] GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da => generated 371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:13.511877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:13.515669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:13.532129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.532579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.533385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.533820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.582640 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b64cc25-ef07-4877-bb88-24f489122cd3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.079633 Nov 20 20:52:13.583406 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1049/2150] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:13.588495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:13.589589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:13.597786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.598406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.599486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.600033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.637530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:13.647759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-524be73a-86e9-4436-9547-d78ce59e1141 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.212455 Nov 20 20:52:13.648476 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1102/2151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:13 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:13.760985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:13.771280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3be62cd-7948-46f3-9719-49cf4e92500d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1705 microversion: 2.1 time: 0.186317 Nov 20 20:52:13.771859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1050/2152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:13 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1705 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:13.776771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:13.778340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:13.786437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.787108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.788426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:13.789119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:13.834926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-560243c3-0c3b-4b99-b070-5c91e1b7ff52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.061675 Nov 20 20:52:13.835787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1051/2153] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:13 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:13.840682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c73dc98b-79ec-4c40-bb90-9e3f85ea676e tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] Calling method '.version_select at 0x7f3f87798f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:13.866668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43f0f894-becd-4f0d-a3a7-da7955f30838 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f98d921f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-817287364", "description": "tempest-description-1608833546"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.038754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43f0f894-becd-4f0d-a3a7-da7955f30838 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.388909 Nov 20 20:52:14.039674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1103/2154] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:13 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:14.043999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:14.044769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:14.055999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.056699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.058569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.059382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.115482 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c73dc98b-79ec-4c40-bb90-9e3f85ea676e tempest-QuotasTestJSON-897448996 tempest-QuotasTestJSON-897448996-project] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da?user_id=a3b3f42c914942dfa28a90f18e359902" status: 200 len: 371 microversion: 2.1 time: 0.278358 Nov 20 20:52:14.116071 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1052/2155] 10.222.0.41 () {58 vars in 1322 bytes} [Sat Nov 20 20:52:13 2021] GET /compute/v2.1/os-quota-sets/387d3077f0ca43a0954d37dcffea87da?user_id=a3b3f42c914942dfa28a90f18e359902 => generated 371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:14.120883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec550ee0-9695-474b-b333-c1e3151fce6d tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f87b330d0>, body: {"security_group_rule": {"parent_group_id": "0600aea9-8f5b-4817-b51d-23e550545415", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.223619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:14.231290 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47e95d4f-59be-412c-98e4-1a268214b183 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.190594 Nov 20 20:52:14.231866 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1104/2156] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:14 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:14.344004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec550ee0-9695-474b-b333-c1e3151fce6d tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.226703 Nov 20 20:52:14.344961 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1053/2157] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:14 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:14.354724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8295f1ce-e6d6-4f3a-a462-b0252a7f2846 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f871e7e50>, body: {"security_group_rule": {"parent_group_id": "0600aea9-8f5b-4817-b51d-23e550545415", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.375331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:14.376152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:14.384007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.384896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.385927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.386543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.413531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-8295f1ce-e6d6-4f3a-a462-b0252a7f2846 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: This rule already exists in group 0600aea9-8f5b-4817-b51d-23e550545415 Nov 20 20:52:14.414275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8295f1ce-e6d6-4f3a-a462-b0252a7f2846 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: This rule already exists in group 0600aea9-8f5b-4817-b51d-23e550545415 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:14.415231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:52:14.415376 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8295f1ce-e6d6-4f3a-a462-b0252a7f2846 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.064275 Nov 20 20:52:14.415965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1105/2158] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:14 2021] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:52:14.425058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37c155f3-4d79-4e3c-ab14-b36809438222 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f86fd59d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:14.518828 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ceb0e095-9292-4e35-9ebb-b1f595c6a799 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 204 len: 0 microversion: 2.1 time: 0.146940 Nov 20 20:52:14.522194 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1054/2159] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:14 2021] DELETE /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:52:14.540772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:14.541907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:14.550850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.551427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.552532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.553046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.667512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37c155f3-4d79-4e3c-ab14-b36809438222 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-group-rules/70f7c7ce-d078-4fa8-8a9e-782a1af16c56" status: 202 len: 0 microversion: 2.1 time: 0.247055 Nov 20 20:52:14.668358 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1106/2160] 10.222.0.41 () {58 vars in 1286 bytes} [Sat Nov 20 20:52:14 2021] DELETE /compute/v2.1/os-security-group-rules/70f7c7ce-d078-4fa8-8a9e-782a1af16c56 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:14.675433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.676622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:14.685352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.686901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.687717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.688335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.718776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:14.731788 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cb8453e-8a51-48bb-a450-8f7f62033cac tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1711 microversion: 2.1 time: 0.204047 Nov 20 20:52:14.733440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1055/2161] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:14 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1711 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:14.735180 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99fd374c-763d-4c64-bbdd-311f5c3d7af6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.065108 Nov 20 20:52:14.736724 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1107/2162] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:14 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:14.738402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:14.739172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:14.746389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.747085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.749577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:14.750521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:14.753929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da8718ac-9ce8-49ef-9f11-0f6e7edc78d8 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f98d92790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-333298534", "description": "tempest-description-1331402683"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.985624 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da8718ac-9ce8-49ef-9f11-0f6e7edc78d8 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.247416 Nov 20 20:52:14.986572 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1108/2163] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:14 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:14.991466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:14.992943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:15.007145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:15.008457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.009560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.011778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.012925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.017429 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd347603-b198-4076-816e-363ebe85c782 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.282589 Nov 20 20:52:15.019312 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1056/2164] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:14 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:15.026255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df00dfee-74ab-4abc-a6e1-a02c5eb15fda tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f87b9d310>, body: {"security_group_rule": {"parent_group_id": "995da19c-4421-4107-bb81-9e645766b75b", "ip_protocol": "tcp", "from_port": 1543718908, "to_port": 22}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.080012 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8367f66c-585f-4491-9585-68a44ffcaf92 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.091492 Nov 20 20:52:15.084683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1109/2165] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:14 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:15.102315 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-df00dfee-74ab-4abc-a6e1-a02c5eb15fda tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Invalid port range 1543718908:22. Former value cannot be greater than the later Nov 20 20:52:15.103879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df00dfee-74ab-4abc-a6e1-a02c5eb15fda tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: Invalid port range 1543718908:22. Former value cannot be greater than the later {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:15.104759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df00dfee-74ab-4abc-a6e1-a02c5eb15fda tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.083797 Nov 20 20:52:15.105462 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1057/2166] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:52:15.118180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f42b1fb5-58f9-4510-9898-be28b677cc36 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f98df1d30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1892549433", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.122405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f42b1fb5-58f9-4510-9898-be28b677cc36 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Security group id should be uuid Nov 20 20:52:15.123762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f42b1fb5-58f9-4510-9898-be28b677cc36 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: Security group id should be uuid {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:15.124871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f42b1fb5-58f9-4510-9898-be28b677cc36 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013098 Nov 20 20:52:15.125883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1110/2167] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:52:15.135954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9202922f-a78d-428a-99c9-440c6cac43f1 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f87a7f940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-948944816", "description": "tempest-description-682481630"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.253237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:15.255592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:15.271505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.273285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.274456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.275166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.333578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9202922f-a78d-428a-99c9-440c6cac43f1 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.202135 Nov 20 20:52:15.340628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1058/2168] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:15.349827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfd42c23-852d-4040-b93d-e34df099d761 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f87ac43a0>, body: {"security_group_rule": {"parent_group_id": "43b0cad9-5517-40a0-b91e-4ce77d45a617", "ip_protocol": "tempest-999-454528232", "from_port": 22, "to_port": 22}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.417022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-dfd42c23-852d-4040-b93d-e34df099d761 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Invalid IP protocol tempest-999-454528232. Nov 20 20:52:15.417723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfd42c23-852d-4040-b93d-e34df099d761 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: Invalid IP protocol tempest-999-454528232. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:15.418647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfd42c23-852d-4040-b93d-e34df099d761 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.077027 Nov 20 20:52:15.419213 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1059/2169] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:52:15.435130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:15.443290 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5489e9a-544b-495f-bb24-2eba65471b7f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.198087 Nov 20 20:52:15.444397 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1111/2170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:15 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:15.448929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd8ffca0-b5fe-426a-96cd-09fcbf5c0a2f tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f98df1d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-145144617", "description": "tempest-description-822419182"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.606252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1544665697", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.662925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:15.670124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd8ffca0-b5fe-426a-96cd-09fcbf5c0a2f tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.224359 Nov 20 20:52:15.670720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1112/2171] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:15.681933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36bb0cfd-84c9-4bf4-a982-d34db30a8fb0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f98dcbf70>, body: {"security_group_rule": {"parent_group_id": "114c986c-23d6-4445-98d8-5b76901e7649", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.735031 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-36bb0cfd-84c9-4bf4-a982-d34db30a8fb0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 20 20:52:15.735709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36bb0cfd-84c9-4bf4-a982-d34db30a8fb0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:15.736668 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36bb0cfd-84c9-4bf4-a982-d34db30a8fb0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.058618 Nov 20 20:52:15.737328 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1113/2172] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 20:52:15.747391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd49e0e8-7a1a-4efc-92dd-f8464120dcf3 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f870ef3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1453355545", "description": "tempest-description-1337380393"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:15.904821 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd49e0e8-7a1a-4efc-92dd-f8464120dcf3 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.161958 Nov 20 20:52:15.907273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:52:15.908021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:52:15.908715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:52:15.909530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:52:15.910118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:52:15.917766 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1114/2173] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/os-security-groups => generated 256 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:15.920968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.921645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.923074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.923506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.929269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:15.931200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:15.938541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.939080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.939957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:15.940469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:15.945577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:15.949102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:15.964110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:52:15.967347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:16.015031 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e74e7e84-f3f6-4086-9a8a-1da60e487248 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593286 Nov 20 20:52:16.016223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1060/2174] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:52:16.022263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:16.023832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:16.038609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.039323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.041666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.042474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.153242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62d90328-2d2f-4145-a1f1-e34a682dba79 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.135492 Nov 20 20:52:16.153887 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1061/2175] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:16.163099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f3b5a43-572e-4047-845c-1738547a6f6c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f877be430>, body: {"security_group_rule": {"parent_group_id": "938be0a3-bc3c-48d8-b908-0429869cc86e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1524612600}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:16.168693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:16.178689 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4dd104e-53ee-4bfa-8a5b-03386da93c10 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1711 microversion: 2.1 time: 0.259689 Nov 20 20:52:16.190439 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1115/2176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:15 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1711 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:16.197747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3353090-9b74-4fb8-9fb0-50527409e550 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:16.198962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e3353090-9b74-4fb8-9fb0-50527409e550 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:16.287027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3353090-9b74-4fb8-9fb0-50527409e550 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:16.304587 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3353090-9b74-4fb8-9fb0-50527409e550 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1217 microversion: 2.1 time: 0.111490 Nov 20 20:52:16.307614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1116/2177] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:16 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:16.320532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:16.323638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:16.338682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.338829 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7f3b5a43-572e-4047-845c-1738547a6f6c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Invalid port range 22:1524612600. Valid TCP ports should be between 1-65535 Nov 20 20:52:16.338949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.339058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f3b5a43-572e-4047-845c-1738547a6f6c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 400 to user: Invalid port range 22:1524612600. Valid TCP ports should be between 1-65535 {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:16.341275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.342669 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f3b5a43-572e-4047-845c-1738547a6f6c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.180479 Nov 20 20:52:16.343289 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1062/2178] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:16 2021] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:52:16.343632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.357275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:16.359132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:16.369803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.370291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.371094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.371533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.494143 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66cb0c3d-9088-4ca8-8ff4-64e640e45de4 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.146708 Nov 20 20:52:16.503507 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1063/2179] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:16 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:16.518520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Action: 'create', calling method: .version_select at 0x7f3f87a8e8b0>, body: {"security_group_rule": {"parent_group_id": "6e72428a-721a-4d74-803f-1ab90ff63b21", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:16.561572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:16.569779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-887b8155-5ade-47fc-8c0d-b8af2558c011 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.259670 Nov 20 20:52:16.571131 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1117/2180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:16 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:16.594952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:16.597227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:16.612547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.613035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.613843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:16.614343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:16.637038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e72428a-721a-4d74-803f-1ab90ff63b21 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:52:16.637698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Neutron security group 6e72428a-721a-4d74-803f-1ab90ff63b21 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:52:16.638389 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Security group 6e72428a-721a-4d74-803f-1ab90ff63b21 does not exist Nov 20 20:52:16.638389 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-e5535b75-ed84-46f7-a185-2ee5497be1a6'] Nov 20 20:52:16.639518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 404 to user: Security group 6e72428a-721a-4d74-803f-1ab90ff63b21 does not exist Nov 20 20:52:16.639518 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-e5535b75-ed84-46f7-a185-2ee5497be1a6'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:16.641854 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45b40e52-4ac8-4023-8f01-2c5b1f8229d5 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.135761 Nov 20 20:52:16.642555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1064/2181] 10.222.0.41 () {60 vars in 1194 bytes} [Sat Nov 20 20:52:16 2021] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:16.652051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f87b278b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:16.717538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 215e8508-ad32-4222-a277-46ae4d626f92 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:52:16.718607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Neutron security group rule 215e8508-ad32-4222-a277-46ae4d626f92 not found {{(pid=140941) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 20 20:52:16.719167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] HTTP exception thrown: Security group rule 215e8508-ad32-4222-a277-46ae4d626f92 does not exist Nov 20 20:52:16.719167 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-eec3c59b-4b43-4b4f-8dc2-6b1b8015d4c7'] Nov 20 20:52:16.719811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Returning 404 to user: Security group rule 215e8508-ad32-4222-a277-46ae4d626f92 does not exist Nov 20 20:52:16.719811 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-eec3c59b-4b43-4b4f-8dc2-6b1b8015d4c7'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:16.722320 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12177199-38e1-43eb-ad24-50e126b6ab8b tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-group-rules/215e8508-ad32-4222-a277-46ae4d626f92" status: 404 len: 199 microversion: 2.1 time: 0.073349 Nov 20 20:52:16.723074 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1065/2182] 10.222.0.41 () {58 vars in 1286 bytes} [Sat Nov 20 20:52:16 2021] DELETE /compute/v2.1/os-security-group-rules/215e8508-ad32-4222-a277-46ae4d626f92 => generated 199 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:52:16.731729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca10a823-3704-4cc2-bfa3-aa3d65f71898 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f87706550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:16.812418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:16.822818 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a8ce226f-f9ea-4ee1-b323-f927fe8cd5f0 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.249993 Nov 20 20:52:16.823967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1118/2183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:16 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:17.025818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6d397500-e054-4d68-b866-2c09d4dae0b1 req-b78f8ae5-9cac-42de-abf4-61ee0513b6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-plugged", "status": "completed", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:17.028083 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:17.028083 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:17.038736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6d397500-e054-4d68-b866-2c09d4dae0b1 req-b78f8ae5-9cac-42de-abf4-61ee0513b6fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.039443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6d397500-e054-4d68-b866-2c09d4dae0b1 req-b78f8ae5-9cac-42de-abf4-61ee0513b6fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.059311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6d397500-e054-4d68-b866-2c09d4dae0b1 req-b78f8ae5-9cac-42de-abf4-61ee0513b6fc service nova] Creating event network-vif-plugged:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:52:17.065826 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6d397500-e054-4d68-b866-2c09d4dae0b1 req-b78f8ae5-9cac-42de-abf4-61ee0513b6fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 Nov 20 20:52:17.066564 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1119/2184] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:52:17.168437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:17.171066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.183191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.187150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.191093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.191577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.247332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca10a823-3704-4cc2-bfa3-aa3d65f71898 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/938be0a3-bc3c-48d8-b908-0429869cc86e" status: 202 len: 0 microversion: 2.1 time: 0.519052 Nov 20 20:52:17.248047 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1066/2185] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:16 2021] DELETE /compute/v2.1/os-security-groups/938be0a3-bc3c-48d8-b908-0429869cc86e => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:17.255984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:17.257214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.273677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.274267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.276407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.277796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.292933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3ef85f7-3222-40c9-8fed-bda56c70b8ed tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.130906 Nov 20 20:52:17.296041 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1120/2186] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:17 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:17.306276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3dce559c-be49-4fac-bf47-a67325877ce0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f98e71ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:17.381244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:17.393185 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c52daf50-7ecc-4408-a9c1-5fb62034ab66 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1643 microversion: 2.1 time: 0.143716 Nov 20 20:52:17.394339 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1067/2187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:17 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1643 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:17.406496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:17.407596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.423756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.424498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.425326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.425748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.579747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:17.593148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21fc5544-7466-467f-a34a-ad1018a06aa4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1277 microversion: 2.1 time: 0.193940 Nov 20 20:52:17.597056 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1068/2188] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:17 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:17.607861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:17.610494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.619336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.620209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.621754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.622876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.678193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb294c0d-c143-4e2c-859d-60f2b23f6f52 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.078213 Nov 20 20:52:17.681540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1069/2189] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:17 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:17.689756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:17.691066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.701091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.701958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.703635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.704375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.882863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3dce559c-be49-4fac-bf47-a67325877ce0 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/114c986c-23d6-4445-98d8-5b76901e7649" status: 202 len: 0 microversion: 2.1 time: 0.583133 Nov 20 20:52:17.883510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1121/2190] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:17 2021] DELETE /compute/v2.1/os-security-groups/114c986c-23d6-4445-98d8-5b76901e7649 => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:17.890308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:17.891573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:17.908299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.909210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:17.911368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:17.913655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.151524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:18.163273 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffd3189b-9c3c-4fe5-b94c-de05a67c97cd tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.479822 Nov 20 20:52:18.164867 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1070/2191] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:17 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:18.180614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3793bea9-9ee2-4767-a28b-74a4ab3b814d tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f87bd0040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:18.212219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:18.233522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-815b82c1-2f92-42e2-995c-1f765c39030c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1316 microversion: 2.1 time: 0.345243 Nov 20 20:52:18.236255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1122/2192] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:17 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:18.254739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-fe8b8430-46fa-482f-84a0-a91d3ad7b34f req-1a5918cb-39c6-4117-be10-c3bc3d7f7dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff08833c-234f-4d62-a1a1-b0137fa38bdf", "name": "network-vif-deleted", "tag": "77ea4b8e-7206-4f77-ab0e-0eabb045363e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:18.267100 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:18.267100 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:18.290023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fe8b8430-46fa-482f-84a0-a91d3ad7b34f req-1a5918cb-39c6-4117-be10-c3bc3d7f7dad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.291227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fe8b8430-46fa-482f-84a0-a91d3ad7b34f req-1a5918cb-39c6-4117-be10-c3bc3d7f7dad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.328540 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-fe8b8430-46fa-482f-84a0-a91d3ad7b34f req-1a5918cb-39c6-4117-be10-c3bc3d7f7dad service nova] Creating event network-vif-deleted:77ea4b8e-7206-4f77-ab0e-0eabb045363e for instance ff08833c-234f-4d62-a1a1-b0137fa38bdf on nch2-master-1 Nov 20 20:52:18.341924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-fe8b8430-46fa-482f-84a0-a91d3ad7b34f req-1a5918cb-39c6-4117-be10-c3bc3d7f7dad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102244 Nov 20 20:52:18.346173 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1123/2193] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:18.358640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:18.362622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:18.381155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.381960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.383906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.384572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.514262 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4f6045c-4d80-430b-8127-0a605e9276fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.165788 Nov 20 20:52:18.518517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1124/2194] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:18 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:18.538344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:18.542666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:18.555434 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3793bea9-9ee2-4767-a28b-74a4ab3b814d tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/43b0cad9-5517-40a0-b91e-4ce77d45a617" status: 202 len: 0 microversion: 2.1 time: 0.388614 Nov 20 20:52:18.560236 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1071/2195] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:18 2021] DELETE /compute/v2.1/os-security-groups/43b0cad9-5517-40a0-b91e-4ce77d45a617 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:18.567396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-649205e8-5663-4880-a667-11f3fb4b76c9 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f87a37430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:18.590217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.597038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.600827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.601597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.719649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.720117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.724027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lazy-loading 'fault' on Instance uuid ff08833c-234f-4d62-a1a1-b0137fa38bdf {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:18.806090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca8ada3b9574675821f2b1a25d6c7e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5857f13b93654bb08bfb0e3045dc0a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:18.819120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ae2e509d-aa22-4610-ac7e-14f4e80f098b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 200 len: 1352 microversion: 2.1 time: 0.301854 Nov 20 20:52:18.822739 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1125/2196] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:18 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 1352 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:18.829845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:18.841635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:18.859530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.860274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:18.861397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:18.862267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.046297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-649205e8-5663-4880-a667-11f3fb4b76c9 tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/995da19c-4421-4107-bb81-9e645766b75b" status: 202 len: 0 microversion: 2.1 time: 0.484725 Nov 20 20:52:19.047108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1072/2197] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:18 2021] DELETE /compute/v2.1/os-security-groups/995da19c-4421-4107-bb81-9e645766b75b => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:19.053315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:19.054458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:19.070609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.074113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.075228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.078132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.154883 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-55acf1b6-fe06-4d7f-ba34-640329696853 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.105642 Nov 20 20:52:19.159886 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1073/2198] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:19 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:19.171968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7611bc43-8f16-4f08-83ef-81afe4eefa9c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] Calling method '.version_select at 0x7f3f87a854c0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:19.372152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:19.385801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-38e3d4b0-93a2-4400-a701-373ef45479ca tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.561171 Nov 20 20:52:19.387575 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1126/2199] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:18 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:19.400347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:19.405354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:19.424206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.425389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.425513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.426070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.582353 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7611bc43-8f16-4f08-83ef-81afe4eefa9c tempest-SecurityGroupRulesNegativeTestJSON-1258857484 tempest-SecurityGroupRulesNegativeTestJSON-1258857484-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/0600aea9-8f5b-4817-b51d-23e550545415" status: 202 len: 0 microversion: 2.1 time: 0.420604 Nov 20 20:52:19.583820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1074/2200] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:19 2021] DELETE /compute/v2.1/os-security-groups/0600aea9-8f5b-4817-b51d-23e550545415 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:19.589442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:19.592585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:19.609643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.613159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.614305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.615023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.910797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:19.916647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:19.925913 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d1cecc75-ae4b-441a-ab57-b15aa9b3e8c3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1465 microversion: 2.1 time: 0.340477 Nov 20 20:52:19.926572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1075/2201] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:19 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1465 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:19.931018 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8cb1f3f4-49fd-4dbb-a495-471d6909fc0e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.537328 Nov 20 20:52:19.932968 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1127/2202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:19 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:19.936311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:19.938132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:19.946851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:19.947804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:19.948720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.949551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.950927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.952929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.964172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.966912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:19.968195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:19.968736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.015991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. Nov 20 20:52:20.017012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:20.018006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc477fe8-6412-4147-b490-6c028189e6c6 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 404 len: 111 microversion: 2.1 time: 0.082127 Nov 20 20:52:20.018869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6df16ef5-e41f-4cba-8ab8-70cc2533536f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.089529 Nov 20 20:52:20.019247 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1128/2203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:19 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:20.024774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1828056825", "metadata": {"image_type": "test"}}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:20.025166 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1076/2204] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:19 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:20.038838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.041379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.042482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.055108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.055400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.055642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.056885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.057593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.057837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.058997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.059700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.094836 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. Nov 20 20:52:20.096530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:20.104186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c209cf62-3806-4e08-aeda-b9443de44ccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 404 len: 111 microversion: 2.1 time: 0.077216 Nov 20 20:52:20.104882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1077/2205] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:20 2021] DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:20.117505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.118602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.128210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.129302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.131320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.132067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.141343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Getting quotas for project 89d37f61bf9c4afcb21e044f0d2da2c4. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:20.152173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. Nov 20 20:52:20.153065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:20.154091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c18978b2-61e7-4411-8748-7de8b64fc8ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 404 len: 111 microversion: 2.1 time: 0.042827 Nov 20 20:52:20.154448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Getting quotas for user bee1e5b42cae4b57a2b191ff14f10b92 and project 89d37f61bf9c4afcb21e044f0d2da2c4. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:20.158635 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1078/2206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:20 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:20.172548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e9492002-a5a2-4c14-b1b7-cd1d0e035e3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '.version_select at 0x7f3f8779f940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.224914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e9492002-a5a2-4c14-b1b7-cd1d0e035e3b tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885863100" status: 202 len: 0 microversion: 2.1 time: 0.062990 Nov 20 20:52:20.230382 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1079/2207] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:52:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885863100 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:20.241460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:20.245390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.272168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.272662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.273506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.274012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.375431 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9278e223-d2bd-4c60-9cb5-bcde01ec4ac9 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.142683 Nov 20 20:52:20.376198 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1080/2208] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:20 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:20.412528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.413680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.432167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.433035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.434377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.438729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.815976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fae0e3e2-9115-4353-b29a-a1c96e2f8e57 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "POST /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.794669 Nov 20 20:52:20.817926 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1129/2209] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:20 2021] POST /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:52:20.833846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fac8cef9-e344-4130-a6a9-815bf02556b4 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98df1160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.943001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fac8cef9-e344-4130-a6a9-815bf02556b4 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.118239 Nov 20 20:52:20.944379 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1130/2210] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:20 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:20.950456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:20.952760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:20.985267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.986385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:20.987702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:20.988485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.323025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:21.334498 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e77608b0-6810-4c85-93e0-b32c1cc23e4b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.931736 Nov 20 20:52:21.335085 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1081/2211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:20 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:21.344415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:21.347751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:21.361898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:21.362468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.363451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:21.364084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.441545 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87cbe798-85d1-4bc5-81b6-b821bafbfd2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.104264 Nov 20 20:52:21.445735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1082/2212] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:21 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:21.453889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:21.455635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:21.465915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:21.466690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.469400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:21.470084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.529732 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04324c22-3776-4da6-bd38-20ae8ac27415 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.079524 Nov 20 20:52:21.531996 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1083/2213] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:21 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:21.588482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:21.603870 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6046fd3f-b189-4158-b42c-372dd914c6be tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.657977 Nov 20 20:52:21.604718 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1131/2214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:20 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:21.766832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-87cfa2a8-79ce-4fed-a5f2-c5fbb443625d req-1e8e390f-2ce6-4449-9edf-f892981deeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0202d45-4861-4548-b517-c5a02af49a0d", "tag": "23ec6af6-e448-4b84-a688-acf291e1c23c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:21.771039 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:21.771039 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:21.793588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-87cfa2a8-79ce-4fed-a5f2-c5fbb443625d req-1e8e390f-2ce6-4449-9edf-f892981deeef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:21.794291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-87cfa2a8-79ce-4fed-a5f2-c5fbb443625d req-1e8e390f-2ce6-4449-9edf-f892981deeef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:21.840873 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-87cfa2a8-79ce-4fed-a5f2-c5fbb443625d req-1e8e390f-2ce6-4449-9edf-f892981deeef service nova] Creating event network-changed:23ec6af6-e448-4b84-a688-acf291e1c23c for instance d0202d45-4861-4548-b517-c5a02af49a0d on nch1-master-1 Nov 20 20:52:21.858033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-87cfa2a8-79ce-4fed-a5f2-c5fbb443625d req-1e8e390f-2ce6-4449-9edf-f892981deeef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120331 Nov 20 20:52:21.859499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1084/2215] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:21.958451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7049f9f2-47fd-476c-b005-8219b48ef267 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d92310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.034252 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7049f9f2-47fd-476c-b005-8219b48ef267 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.080639 Nov 20 20:52:22.040301 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1132/2216] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:21 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:22.156745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1789e8d4-9812-4b72-9bcd-48a07b45a50b tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.157603 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:22.157603 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:22.180621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1789e8d4-9812-4b72-9bcd-48a07b45a50b tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1475795247" status: 202 len: 0 microversion: 2.1 time: 0.030653 Nov 20 20:52:22.182205 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1085/2217] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:52:22 2021] DELETE /compute/v2.1/flavors/1475795247 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:22.192384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68db3efc-95f1-4951-b54d-a3a01c0dd146 tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.226016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68db3efc-95f1-4951-b54d-a3a01c0dd146 tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.038084 Nov 20 20:52:22.242280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1133/2218] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:22.246791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-170ddf0a-4895-4fe1-a3c7-d4a7d44770ec tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.270649 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-170ddf0a-4895-4fe1-a3c7-d4a7d44770ec tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/347300198" status: 202 len: 0 microversion: 2.1 time: 0.025634 Nov 20 20:52:22.274401 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1086/2219] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:52:22 2021] DELETE /compute/v2.1/flavors/347300198 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:22.280905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee956721-8603-4444-9c24-a263cf45a46d tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.304851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee956721-8603-4444-9c24-a263cf45a46d tempest-ServersWithSpecificFlavorTestJSON-16235617 tempest-ServersWithSpecificFlavorTestJSON-16235617-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028748 Nov 20 20:52:22.305662 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1134/2220] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:22.359711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.363674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.370907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.371670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.372734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.373858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.435340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.437041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.446511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.448594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.451860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.452682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.474483 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. Nov 20 20:52:22.475335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:22.476544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ed9516d-62db-4d0b-b897-8c153c11f1f1 tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 404 len: 111 microversion: 2.1 time: 0.047762 Nov 20 20:52:22.477238 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1135/2221] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:22 2021] DELETE /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:22.486778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:22.489043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.500889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.501822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.503048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.503720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.590775 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-247ba56a-7f13-4b47-a88c-7427c79bf83b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.111832 Nov 20 20:52:22.592109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1136/2222] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:22 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:22.595529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:22.603718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.606841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: ff08833c-234f-4d62-a1a1-b0137fa38bdf] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.612800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-447ce0c3-df43-4e3d-8669-ec47db0fc1b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.263179 Nov 20 20:52:22.613457 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1087/2223] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:22.620319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:22.621389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.627573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.628765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.630316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.630895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.633283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.634573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.635698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.636670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.653722 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. Nov 20 20:52:22.655111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance ff08833c-234f-4d62-a1a1-b0137fa38bdf could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:22.656485 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9b16a35-31ea-4e9d-9269-dc7356de812d tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf" status: 404 len: 111 microversion: 2.1 time: 0.062742 Nov 20 20:52:22.657519 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1137/2224] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/servers/ff08833c-234f-4d62-a1a1-b0137fa38bdf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:22.664764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.665859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.676315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.676822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.677926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.678432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.695753 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95e91b4b-3a17-4d71-8dee-5b21154dc3ab tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.078695 Nov 20 20:52:22.700667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1088/2225] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:22 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:22.716514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.717472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.735854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.736484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.737855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.737855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.761212 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. Nov 20 20:52:22.762223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:22.763691 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0643cdb-19b6-4d22-a69a-990f9ac1bccf tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 404 len: 111 microversion: 2.1 time: 0.058791 Nov 20 20:52:22.764470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1089/2226] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:22 2021] DELETE /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:22.776406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:22.776573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] [instance: 2c757299-9a55-42d6-a189-d689f2c8f7ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:22.784896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.785591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.786857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:22.787565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:22.804521 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] HTTP exception thrown: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. Nov 20 20:52:22.805718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] Returning 404 to user: Instance 2c757299-9a55-42d6-a189-d689f2c8f7ef could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:22.806758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1459103e-e36a-4f23-9f7b-573a3ac467ed tempest-ServersWithSpecificFlavorTestJSON-434933112 tempest-ServersWithSpecificFlavorTestJSON-434933112-project] 10.222.0.41 "GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef" status: 404 len: 111 microversion: 2.1 time: 0.035322 Nov 20 20:52:22.807825 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1090/2227] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/servers/2c757299-9a55-42d6-a189-d689f2c8f7ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:22.974414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:22.987600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0799098f-acf3-4e80-a3df-b91bc4d78d4b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.327442 Nov 20 20:52:22.988384 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1138/2228] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:22 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:23.049581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a50a5129-01bd-48c4-86c3-26074038e017 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87b41700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:23.135510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a50a5129-01bd-48c4-86c3-26074038e017 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.091443 Nov 20 20:52:23.136706 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1091/2229] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:23 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:23.604012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:23.604979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:23.622926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.625448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.636081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:23.637103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:23.644502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.646199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.656623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.661023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.662946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.663865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.743950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f926489-66ea-4b0b-9eed-0f92e0fe0eb1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.141052 Nov 20 20:52:23.746856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1139/2230] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:23 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:23.756343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:23.757721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:23.769431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.770816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.772049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:23.772797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:23.877977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3dac3bd5-dd83-4948-bcd4-a26e6dfd210b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.128647 Nov 20 20:52:23.879800 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1140/2231] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:23 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:24.011528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:24.012393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:24.023165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.024012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:24.025079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.025748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:24.119119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:24.132070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82ceff3a-c739-40ed-9788-70a0736a084f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.503021 Nov 20 20:52:24.134137 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1092/2232] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:23 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:24.151077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7131c676-88f5-4c25-8b1d-1c3a1f7ee53b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87a14280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:24.266748 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7131c676-88f5-4c25-8b1d-1c3a1f7ee53b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.119619 Nov 20 20:52:24.267551 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1093/2233] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:24 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:24.379296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:24.406112 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa5a6425-1148-473a-b5cd-90ded2ab700d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.399673 Nov 20 20:52:24.411531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1141/2234] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:24 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:24.755914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:24.756913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:24.777109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.777833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:24.778958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.780506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:24.861730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-655d81a1-2087-4884-a2dd-b9004ac6c577 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.109373 Nov 20 20:52:24.862776 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1094/2235] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:24.902096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:24.905520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:24.928778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.929901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:24.933205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:24.937215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:25.061466 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e27c8d2-6be1-49cf-952a-7f234fb72158 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.161523 Nov 20 20:52:25.063812 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1142/2236] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:24 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:25.160827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:25.161802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:25.179227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:25.181601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:25.184053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:25.185296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:25.282831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fd14066-a3ed-4557-8156-9f37a9a52bb1 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d955e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:25.438462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fd14066-a3ed-4557-8156-9f37a9a52bb1 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.152052 Nov 20 20:52:25.442566 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1143/2237] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:25 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:25.455174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:25.456380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:25.479483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:25.480484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:25.483890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:25.484717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:25.840521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:25.865608 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ef07cc60-0144-41be-99a7-bf1e82b1cebf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.711462 Nov 20 20:52:25.868240 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1095/2238] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:25 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:25.948813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:25.964001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fad35c7-dc2d-42a9-adeb-53bc1c91765c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.518140 Nov 20 20:52:25.966735 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1144/2239] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:25 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:25.977167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9a51c447-7a44-44ef-b4b1-e71f98bfb142 req-6134ba50-80f1-4b09-bfcb-a2c7184326e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-plugged", "status": "completed", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:25.983513 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:25.983513 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:25.999794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9a51c447-7a44-44ef-b4b1-e71f98bfb142 req-6134ba50-80f1-4b09-bfcb-a2c7184326e8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.005016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9a51c447-7a44-44ef-b4b1-e71f98bfb142 req-6134ba50-80f1-4b09-bfcb-a2c7184326e8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.037862 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9a51c447-7a44-44ef-b4b1-e71f98bfb142 req-6134ba50-80f1-4b09-bfcb-a2c7184326e8 service nova] Creating event network-vif-plugged:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:52:26.054318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9a51c447-7a44-44ef-b4b1-e71f98bfb142 req-6134ba50-80f1-4b09-bfcb-a2c7184326e8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082594 Nov 20 20:52:26.058666 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1145/2240] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:26.073160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:26.078245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:26.099442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.100521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.101742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.103982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.206441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79d3edf4-abb0-443d-94bc-c3873106c736 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f87a03700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-940220942", "description": "tempest-description-2096058836"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:26.218833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9576adec-458e-4027-ba3c-1c34d0d9cedd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.155777 Nov 20 20:52:26.220922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1146/2241] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:26 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:26.240013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:26.243860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:26.264832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.265475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.266837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.267519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.355791 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-243c5563-fe9e-42b0-b36f-8bfb9d276909 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.129139 Nov 20 20:52:26.356945 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1147/2242] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:26 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:26.458288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a46b8d7-ad84-4c87-aa25-599803058d37 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d958b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:26.558448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a46b8d7-ad84-4c87-aa25-599803058d37 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.106161 Nov 20 20:52:26.559034 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1148/2243] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:26 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:26.933891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:26.934919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:26.940605 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79d3edf4-abb0-443d-94bc-c3873106c736 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.071108 Nov 20 20:52:26.941377 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1096/2244] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:25 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:26.953451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a322c403-4741-4f01-b717-324b778973cb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f87a373a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1733145787", "description": "tempest-description-521478487"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:26.990947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.992184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:26.993203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:26.993806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.329009 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a322c403-4741-4f01-b717-324b778973cb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.380056 Nov 20 20:52:27.329756 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1097/2245] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:26 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:27.351557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:27.354149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:27.372407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.373935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.375775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.376422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.440550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:27.450661 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3148a5d2-31e3-446f-b84e-33f7b76b56ec tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.563835 Nov 20 20:52:27.452250 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1149/2246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:26 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:27.458026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:27.460046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:27.480963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.484178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.494814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.495855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.576687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47c0d2ec-e637-42af-a61b-06a4b1562b36 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.122815 Nov 20 20:52:27.581056 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1150/2247] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:27 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:27.585532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:27.588492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:27.589901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:27.597707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.598788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.599471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:27.600073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:27.602306 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cee4017-157c-4642-91c4-c8ee47c70d04 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.257011 Nov 20 20:52:27.611692 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1098/2248] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:27 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:27.630563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1103652249", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "b78e4ec9-b593-412e-8e50-3a8f61366198"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:27.663421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3731ac5-86e0-4612-96c5-2f804c15298b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.077917 Nov 20 20:52:27.664978 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1151/2249] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:27 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:27.678606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f4f1e9d-c0d2-430b-9212-561656c52673 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98dc88b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:27.820845 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f4f1e9d-c0d2-430b-9212-561656c52673 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.153281 Nov 20 20:52:27.828275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] validate_networks() for [('b78e4ec9-b593-412e-8e50-3a8f61366198', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:27.829272 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1152/2250] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:27 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:28.470322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:28.472534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:28.499485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:28.502862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:28.505654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:28.512755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:28.997136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:52:28.998249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:52:28.998998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:52:28.999736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:52:29.000240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:52:29.019722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.020689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.021786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.022643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.071672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Getting quotas for project d006f43b28c243da9c910fd530b7958b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:29.097981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Getting quotas for user e25d358e868f40728a6e968216d25f2e and project d006f43b28c243da9c910fd530b7958b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:29.147310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:52:29.149930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:29.261986 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1acb4a98-744c-46ec-a716-c4c8edebc5ba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648040 Nov 20 20:52:29.264178 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1099/2251] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:52:29.275388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:29.281476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:29.300826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.304165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.306488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.307107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.338339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:29.352126 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91a1687b-cb87-4a7b-a720-a4c10ce41441 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.888253 Nov 20 20:52:29.356967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1153/2252] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:28 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:29.364748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:29.383521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:29.400468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.408020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.411175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.417827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.481118 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91877f89-13ce-4f4c-954c-3a38cfb075a9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.215363 Nov 20 20:52:29.482202 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1100/2253] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:29 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:29.508270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:29.511458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:29.526027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.526938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.528550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.529571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.672717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-504f1cea-3f7f-4bd9-ab04-e63c867d8dd0 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.184579 Nov 20 20:52:29.675161 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1101/2254] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:29 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:29.688334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f8c8c475-15a7-4b9e-8a4a-b7ae66e1cd4c req-51ba4ef4-ee59-4cb5-a720-0a4ca2bc40dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0202d45-4861-4548-b517-c5a02af49a0d", "name": "network-vif-plugged", "status": "completed", "tag": "23ec6af6-e448-4b84-a688-acf291e1c23c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:29.689936 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:29.689936 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:29.709791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8c8c475-15a7-4b9e-8a4a-b7ae66e1cd4c req-51ba4ef4-ee59-4cb5-a720-0a4ca2bc40dd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:29.710277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8c8c475-15a7-4b9e-8a4a-b7ae66e1cd4c req-51ba4ef4-ee59-4cb5-a720-0a4ca2bc40dd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:29.752433 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f8c8c475-15a7-4b9e-8a4a-b7ae66e1cd4c req-51ba4ef4-ee59-4cb5-a720-0a4ca2bc40dd service nova] Creating event network-vif-plugged:23ec6af6-e448-4b84-a688-acf291e1c23c for instance d0202d45-4861-4548-b517-c5a02af49a0d on nch1-master-1 Nov 20 20:52:29.766721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f8c8c475-15a7-4b9e-8a4a-b7ae66e1cd4c req-51ba4ef4-ee59-4cb5-a720-0a4ca2bc40dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080908 Nov 20 20:52:29.767861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1102/2255] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:29.784010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1cd88aac-4ce1-44ca-86b3-56323f5b8885 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87a143a0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:29.879404 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1cd88aac-4ce1-44ca-86b3-56323f5b8885 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.110065 Nov 20 20:52:29.880086 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1103/2256] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:29 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:29.891455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bcacf67-8ce5-4485-932b-cef0e23bffb5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:29.895254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5bcacf67-8ce5-4485-932b-cef0e23bffb5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:30.038957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5bcacf67-8ce5-4485-932b-cef0e23bffb5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:30.049782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bcacf67-8ce5-4485-932b-cef0e23bffb5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1216 microversion: 2.1 time: 0.168199 Nov 20 20:52:30.052103 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1104/2257] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:29 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:30.149670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:30.178522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-90fcb3b1-27a1-405f-a1ac-7c1524b5675c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.817344 Nov 20 20:52:30.187138 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1154/2258] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:29 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:30.375200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:30.376180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:30.384170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.386870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.392016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.392682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.493873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:30.494924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:30.514892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.516750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.540309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.546012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.664458 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f29415eb-dac9-44ed-b219-6515e61c364c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.171379 Nov 20 20:52:30.665210 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1155/2259] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:30 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:30.692643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:30.697048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:30.739511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.740814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.748725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:30.764421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:30.849516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e3a0352-59e5-4160-aa65-d725e65628f2 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.163626 Nov 20 20:52:30.851859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1156/2260] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:30 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:30.910493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff7615da-682c-49e5-8265-ee33307af27e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98e15b80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:30.926870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:30.940888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4177eebc-6250-4bf6-b6a1-10deddfd9137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1317 microversion: 2.1 time: 0.571776 Nov 20 20:52:30.943086 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1105/2261] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:30 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:31.003841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff7615da-682c-49e5-8265-ee33307af27e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.113468 Nov 20 20:52:31.004675 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1157/2262] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:30 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:31.069273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:31.070079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:31.080053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.087780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.088736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.089450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.197340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:31.198255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:31.213694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.214768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.219818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.220837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.329584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:31.342301 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b35a4c3-9a67-4fa3-8f91-caa6912e9ac5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1268 microversion: 2.1 time: 0.275976 Nov 20 20:52:31.343749 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1106/2263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:31 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:31.677744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:31.679284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:31.735306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.735951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.739541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.740791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.815918 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba56478a-3e16-4991-a8b4-e9fbdd70011f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.140786 Nov 20 20:52:31.821415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1107/2264] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:31 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:31.864379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:31.865837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:31.885982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.888558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.892044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:31.893611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:31.974986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:31.985386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cd9e7743-5604-4e2e-887b-50fba74a6be1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.792129 Nov 20 20:52:31.998472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10d01a05-4d97-4b40-a08a-e4c70cb0301c tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.130355 Nov 20 20:52:31.998472 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1108/2265] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:31 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:31.999788 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1158/2266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:31 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:32.006623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:32.007916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:32.018641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d621f97-83d1-44fd-8ff6-d496b6070e36 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d921f0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:32.028485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.029514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.030626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.032352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.136646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d621f97-83d1-44fd-8ff6-d496b6070e36 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.121859 Nov 20 20:52:32.137829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1159/2267] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:32 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:32.361513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:32.362871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:32.370999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:32.376566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.378517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.380099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.381744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.383977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-190cc421-824b-4f37-a557-00f37a39e388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1467 microversion: 2.1 time: 0.379632 Nov 20 20:52:32.384688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1109/2268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:31 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1467 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:32.671675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:32.683604 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad665b85-9b21-49b5-b69f-7b6f4fa762aa tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1274 microversion: 2.1 time: 0.326933 Nov 20 20:52:32.684466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1160/2269] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:32 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1274 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:32.832803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:32.834183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:32.851099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.853487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.856563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:32.858509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:32.951597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59fb3ecf-84e9-4e21-ae22-dc4ee2c1c56d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.125839 Nov 20 20:52:32.952729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1161/2270] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:32 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:33.007306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:33.008696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:33.019263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.022356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.023419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.025260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.124658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-608a2c93-ae65-48da-b895-145352e39e9d tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.122955 Nov 20 20:52:33.140537 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1162/2271] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:33 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:33.157133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:33.158115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:33.158736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:33.160758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:33.176185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.176605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.178304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.179953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.183316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.189376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.190403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.191057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.471865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:33.480421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1c78ab5-a677-43fd-902f-0a4a0199a3f5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.338409 Nov 20 20:52:33.485064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1163/2272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:33 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:33.490253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cbd7aae-dc0f-4382-a1aa-62c475bc3bd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98e09670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:33.605360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cbd7aae-dc0f-4382-a1aa-62c475bc3bd8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.118911 Nov 20 20:52:33.608474 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1164/2273] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:33 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:33.702661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:33.703332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:33.715691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.716162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.721983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:33.722561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:33.997237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c348d9b1-b278-4103-b178-2cae2d5286e8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1618 microversion: 2.1 time: 1.598956 Nov 20 20:52:34.011989 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1110/2274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:32 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1618 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:34.019935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:34.021164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:34.028123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.030202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.031247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.031866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.088855 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d189be09-bc39-4e35-9922-1e67c2ebff2d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 24511 microversion: 2.42 time: 0.074981 Nov 20 20:52:34.089760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1111/2275] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 24511 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:34.100760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: .version_select at 0x7f3f87ac4430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1005768441", "policies": ["affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:34.122806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:34.130503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:34.214333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:34.227745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:34.262458 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9884d517-52fa-4c1c-bfce-e8354639c123 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.165639 Nov 20 20:52:34.264771 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1112/2276] 10.222.0.41 () {60 vars in 1173 bytes} [Sat Nov 20 20:52:34 2021] POST /compute/v2.1/os-server-groups => generated 188 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:34.272300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:34.293158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:34.304352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.305073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.306105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.306710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.368893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45469419-6e76-4977-9cda-c7f9cf3c5019 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.102142 Nov 20 20:52:34.370224 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1113/2277] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:34 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:34.502636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:34.503865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:34.516761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.517217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.518026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:34.521542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:34.712048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:34.721898 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fc38dc6a-2400-40eb-9a73-9c87a68dddb9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 1.023483 Nov 20 20:52:34.725760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1165/2278] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:33 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:34.741667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-693687374", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8d723fe2-62cd-49cf-a344-895994e71bc0"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:34.829333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:52:35.001097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:35.012578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b6c5317-5cf0-4944-ac8c-3bde8213a051 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.515281 Nov 20 20:52:35.014642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1114/2279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:34 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:35.034789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-beead50b-5935-4da9-b5e1-76bedded23ec tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87b41550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:35.124371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-beead50b-5935-4da9-b5e1-76bedded23ec tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.106836 Nov 20 20:52:35.132780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1115/2280] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:35 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:35.139430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4eda1bce-d932-4abd-90b1-414b78700c3c req-d71de24c-2e7d-485a-8500-39d6f2ccf9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa040e2b-b12a-4df9-b751-18927bb85bbc", "tag": "f45eebd5-aed0-4beb-a5fe-f44aba552d89"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:35.142169 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:35.142169 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:35.157160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4eda1bce-d932-4abd-90b1-414b78700c3c req-d71de24c-2e7d-485a-8500-39d6f2ccf9c3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.158021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4eda1bce-d932-4abd-90b1-414b78700c3c req-d71de24c-2e7d-485a-8500-39d6f2ccf9c3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.175730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4eda1bce-d932-4abd-90b1-414b78700c3c req-d71de24c-2e7d-485a-8500-39d6f2ccf9c3 service nova] Creating event network-changed:f45eebd5-aed0-4beb-a5fe-f44aba552d89 for instance fa040e2b-b12a-4df9-b751-18927bb85bbc on nch2-master-1 Nov 20 20:52:35.188754 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4eda1bce-d932-4abd-90b1-414b78700c3c req-d71de24c-2e7d-485a-8500-39d6f2ccf9c3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053034 Nov 20 20:52:35.190171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1116/2281] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:35.206594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:35.209409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:35.233363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.234268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.238395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.239378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.253795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:52:35.254245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:52:35.254905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:52:35.255477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:52:35.256051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:52:35.315689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.316440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.317430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.318076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.342032 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-507f58e5-755f-4ce0-9573-592a7964976a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 32547 microversion: 2.42 time: 0.148318 Nov 20 20:52:35.342864 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1117/2282] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:35 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 32547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:35.343487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:35.360538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:35.381552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 2 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:52:35.382842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:35.384642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:35.390570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:35.428402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140942) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Nov 20 20:52:35.431561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.432445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.436575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.440620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.481973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:35.492801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:35.574558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f297d92-72fe-434e-9248-f26d16126b9a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.196080 Nov 20 20:52:35.577666 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1118/2283] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:35 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:35.596601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:35.601720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:35.616763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=bce35b01-3e47-43e4-ae72-64a117b6366f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:52:35.703769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:35.717627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:35.739802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:35.740877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:35.773120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.779041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.783765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:52:35.788061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.789434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.798077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:52:35.875759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-554949cd-e8fa-4360-9ac1-1caa56ffae97 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.148781 Nov 20 20:52:35.882796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1166/2284] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:34 2021] POST /compute/v2.1/servers => generated 32 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 20 20:52:35.895633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:35.901556 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:35.901556 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:35.904857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:35.907785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Searching by: {'deleted': False, 'project_id': '60778bfeb31b496081c05ccc33a74a1c'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:52:35.947105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.948187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:35.949186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:35.949960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.052474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:52:36.182630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12f6e69a-fe98-49bd-b2f0-fc8f6f30af15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.292753 Nov 20 20:52:36.188307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1167/2285] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:52:35 2021] GET /compute/v2.1/servers => generated 1002 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:36.194575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:36.199363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:36.212826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.214245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.217259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.221503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.472395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:36.483556 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1cd67c62-d65e-4239-914c-4ff4d70ac884 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 0.749469 Nov 20 20:52:36.484294 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1119/2286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:35 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:36.516500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4eef7bb4-ae37-47d5-8d48-82bb9bd4de44 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87a85820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:36.599784 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4eef7bb4-ae37-47d5-8d48-82bb9bd4de44 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.102501 Nov 20 20:52:36.600700 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1120/2287] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:36 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:36.611319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54cc7678-bad4-41b9-8932-ed164ab7f10c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:36.612338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54cc7678-bad4-41b9-8932-ed164ab7f10c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:36.792370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:36.809817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d42ee77-293c-4138-82da-908328610810 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.611978 Nov 20 20:52:36.813100 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1168/2288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:36 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:36.831200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:36.838221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:36.848652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54cc7678-bad4-41b9-8932-ed164ab7f10c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:36.857135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.863181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.863181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.863181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.866408 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54cc7678-bad4-41b9-8932-ed164ab7f10c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1218 microversion: 2.1 time: 0.264384 Nov 20 20:52:36.868967 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1121/2289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:36 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:36.881393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:36.889144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:36.903606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.906166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:36.907672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:36.909536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:37.008661 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c4f6205-ef67-46b3-a34b-51fc023e9703 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 32547 microversion: 2.42 time: 0.192922 Nov 20 20:52:37.008853 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40af3cfc-1ae3-407a-be0f-6dd20b44cc1a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.133153 Nov 20 20:52:37.010799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1169/2290] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:36 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 32547 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:37.018080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1122/2291] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:36 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:37.510071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:37.511367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:37.532088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:37.532885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:37.585183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:37.589178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.054s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:37.615157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cba9c29f-59d1-40ca-9e17-d3526aa3a105 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f877b0ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:37.746251 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cba9c29f-59d1-40ca-9e17-d3526aa3a105 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.136726 Nov 20 20:52:37.747919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1123/2292] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:37 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:37.831492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:37.832364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:37.845563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:37.846419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:37.848141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:37.851208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.128133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:38.138977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9fce5544-e4e5-4b30-ba0f-13db39074438 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 0.640551 Nov 20 20:52:38.141112 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1170/2293] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:37 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:38.152564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:38.154741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:38.176690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.178565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.181043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.182850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.241904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:38.251442 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1cfd0f09-77a2-49f5-ac4c-544fd81a4ec1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1495 microversion: 2.1 time: 0.425238 Nov 20 20:52:38.252603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1124/2294] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:37 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1495 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:38.258036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:38.259452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:38.274295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.275176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.276236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.276912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.338866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2a21cb9-3b30-4923-840f-4ef9fd883901 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 32547 microversion: 2.42 time: 0.084379 Nov 20 20:52:38.340053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1125/2295] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:38 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 32547 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:38.363446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:38.365895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:38.403824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.406535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.409104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:38.410506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:38.416019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:38.420905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1daff89-6f99-47f9-9fe2-43a4c997d236 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1214 microversion: 2.1 time: 0.276423 Nov 20 20:52:38.431674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1171/2296] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:38 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:38.509735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fecbfe96-8e09-440c-8adf-d62f21f80862 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.167874 Nov 20 20:52:38.515857 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1126/2297] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:38 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:38.761736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28f4e0f1-f863-4a89-b6a6-20a6f6a0be26 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d45280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:38.871171 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28f4e0f1-f863-4a89-b6a6-20a6f6a0be26 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.113788 Nov 20 20:52:38.890091 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1172/2298] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:38 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:39.159527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:39.160384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:39.210002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.211150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:39.212161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.212781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:39.269078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:39.270708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:39.282314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.282767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:39.283562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.289873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:39.924868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:39.933475 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8769c4e-a22d-46ef-80b8-348c56764947 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 0.779934 Nov 20 20:52:39.939497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1127/2299] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:39 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:39.953555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:39.960589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:39.979702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.985075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:39.988594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:39.992626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.109372 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-627324bd-50b4-4679-a145-5fbca4d4d0e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 32547 microversion: 2.42 time: 0.168378 Nov 20 20:52:40.115113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1128/2300] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 32547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:40.124937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:40.127529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:40.136260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:40.149381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.150932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.153091 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0a0fc04-d432-40f6-a4c1-edb7f3ec2cc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 200 len: 1472 microversion: 2.1 time: 0.887377 Nov 20 20:52:40.153264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.156339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.168952 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1173/2301] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:39 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 1472 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:40.178791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:40.180510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:40.189058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.194334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.196106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.197044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.284597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0eb2f17-e1b2-46a7-924b-1e4670f3d707 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.111978 Nov 20 20:52:40.287323 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1174/2302] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:40 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:40.298569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfc93e52-db02-4081-b03c-192a6c0d7394 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98da6dc0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:40.330333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:40.339328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a5181984-1b6e-47b6-99b9-e31cc8daa7e2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1276 microversion: 2.1 time: 0.222756 Nov 20 20:52:40.346796 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1129/2303] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:40 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:40.361739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-434520190"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:40.363695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:40.378100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.378534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.384334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.384809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.399522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfc93e52-db02-4081-b03c-192a6c0d7394 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.110631 Nov 20 20:52:40.400236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1175/2304] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:40 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:40.783034 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f26dc0db-7d0b-4b3d-b21d-d3e661464c51 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a/action" status: 202 len: 0 microversion: 2.1 time: 0.434097 Nov 20 20:52:40.787022 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1130/2305] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:40 2021] POST /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:52:40.798791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34bf2f86-5052-438d-a29e-3f94619996ab tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c330d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:40.942703 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34bf2f86-5052-438d-a29e-3f94619996ab tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.149658 Nov 20 20:52:40.944083 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1176/2306] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:40 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:40.953395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:40.954575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:40.970554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.974409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:40.975667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:40.978137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.130736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:41.133132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:41.147149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.148178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.149377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.150206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.226486 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a403723e-459c-41d2-905f-ea7f02fc2c0f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 32547 microversion: 2.42 time: 0.107990 Nov 20 20:52:41.230920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1177/2307] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 32547 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:52:41.300459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:41.306170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:41.355711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.357545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.364455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.366835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.485563 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c9bfe93-d0f0-4cd0-928a-8e9b6426b4f6 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.190038 Nov 20 20:52:41.491692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1178/2308] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:41 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:52:41.532558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:41.541040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:41.567919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.571024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.572434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:41.574884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:41.874949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:41.900935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2612b2ef-6a4a-486f-97b4-87432c55a5bc tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 0.954120 Nov 20 20:52:41.907472 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1131/2309] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:40 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:52:41.929046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36e32a3e-aff4-4075-a3f4-057a67dced9f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f879ee1f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:42.092794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36e32a3e-aff4-4075-a3f4-057a67dced9f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.179927 Nov 20 20:52:42.099669 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1132/2310] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:41 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:42.107183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe704a23-b021-40cb-92df-5b1891ea46e4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87ac4940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:42.175174 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe704a23-b021-40cb-92df-5b1891ea46e4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.073421 Nov 20 20:52:42.176971 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1133/2311] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:42 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:42.244669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:42.246435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:42.255563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:42.256539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.257331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:42.258818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.259659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:42.262863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9b60d1b-699f-4260-a5b8-d12eabbd9e16 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.769177 Nov 20 20:52:42.271658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1179/2312] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:41 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:42.333872 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98b54346-f6d6-4eb4-a89e-5cf279e36d01 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094804 Nov 20 20:52:42.335356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1134/2313] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:42 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:42.501340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:42.507599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:42.538447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.538903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:42.547035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.547463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:42.672808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0a84c2c-fbc4-484a-8777-cd89a2f78bcf tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.175396 Nov 20 20:52:42.680692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1180/2314] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:42 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:42.925043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:42.926610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:42.942492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.943106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:42.944026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:42.944812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:43.107374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3a40ed3-94a4-418b-b93c-d2f80ac8aeb3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d45af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:43.235392 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3a40ed3-94a4-418b-b93c-d2f80ac8aeb3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 0.132372 Nov 20 20:52:43.242674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1181/2315] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:43 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:43.254124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6c419ee-89b3-444a-84a7-2e2f31116cec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c35ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:43.360095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6c419ee-89b3-444a-84a7-2e2f31116cec tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.113447 Nov 20 20:52:43.361109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1182/2316] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:43 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:43.374918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:43.384265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:43.418560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:43.421447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:43.427820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:43.431075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.032644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:44.043965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b30d07d-02d5-422d-8205-dfc4f74d3af1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1316 microversion: 2.1 time: 1.122969 Nov 20 20:52:44.055485 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1135/2317] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:42 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:44.067529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c5d4149e-ca65-4fa7-8d2b-72d334eea820 req-b396b7b7-a385-4101-9ed4-ff5b41e11c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce35b01-3e47-43e4-ae72-64a117b6366f", "tag": "7dceb653-952e-453b-b961-0478a94a32a1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:44.071867 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:44.071867 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:44.095860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5d4149e-ca65-4fa7-8d2b-72d334eea820 req-b396b7b7-a385-4101-9ed4-ff5b41e11c6f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.096717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5d4149e-ca65-4fa7-8d2b-72d334eea820 req-b396b7b7-a385-4101-9ed4-ff5b41e11c6f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.124499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c5d4149e-ca65-4fa7-8d2b-72d334eea820 req-b396b7b7-a385-4101-9ed4-ff5b41e11c6f service nova] Creating event network-changed:7dceb653-952e-453b-b961-0478a94a32a1 for instance bce35b01-3e47-43e4-ae72-64a117b6366f on nch2-master-1 Nov 20 20:52:44.133230 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c5d4149e-ca65-4fa7-8d2b-72d334eea820 req-b396b7b7-a385-4101-9ed4-ff5b41e11c6f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076041 Nov 20 20:52:44.137638 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1136/2318] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:44.157664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:44.161156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:44.174828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.184169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.186001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.188652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.205427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:44.226111 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82db1807-35e3-44ca-84b2-e35725e923f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.863474 Nov 20 20:52:44.235815 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1183/2319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:43 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:44.261415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:44.270777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:44.307838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.309591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.317894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-346c753b-5123-49af-88bb-8f5416182edb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.175260 Nov 20 20:52:44.319697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1137/2320] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:44 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:44.320163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.323646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.336658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-867b3bbd-0a0e-4102-be16-182f2b1431ea req-3e24e78f-b0f6-4413-a6c7-7af5926d330b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa040e2b-b12a-4df9-b751-18927bb85bbc", "name": "network-vif-plugged", "status": "completed", "tag": "f45eebd5-aed0-4beb-a5fe-f44aba552d89"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:44.339294 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:44.339294 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:44.358331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-867b3bbd-0a0e-4102-be16-182f2b1431ea req-3e24e78f-b0f6-4413-a6c7-7af5926d330b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:44.364045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-867b3bbd-0a0e-4102-be16-182f2b1431ea req-3e24e78f-b0f6-4413-a6c7-7af5926d330b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:44.404115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-867b3bbd-0a0e-4102-be16-182f2b1431ea req-3e24e78f-b0f6-4413-a6c7-7af5926d330b service nova] Creating event network-vif-plugged:f45eebd5-aed0-4beb-a5fe-f44aba552d89 for instance fa040e2b-b12a-4df9-b751-18927bb85bbc on nch2-master-1 Nov 20 20:52:44.444737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-867b3bbd-0a0e-4102-be16-182f2b1431ea req-3e24e78f-b0f6-4413-a6c7-7af5926d330b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095325 Nov 20 20:52:44.447457 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1138/2321] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:44.461746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcec13a0-04c9-4cf2-8779-88b1b97a31c6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87872ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:44.531186 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e521625a-a385-4790-80fc-c72034b6b119 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 32636 microversion: 2.1 time: 0.287023 Nov 20 20:52:44.540621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1184/2322] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:44 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 32636 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:44.591729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3ac441ca-ade9-4717-8437-39a47902d396 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c35dc0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:48.111312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcec13a0-04c9-4cf2-8779-88b1b97a31c6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1422 microversion: 2.1 time: 3.659733 Nov 20 20:52:48.112011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1139/2323] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:44 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1422 bytes in 3663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:48.127608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f4910ae3-9c1b-478a-acfe-9b5c02fa10a3 req-26514d95-3015-4d10-a40f-7c7da3f1f6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8073278e-06ca-46aa-9b23-ba4cde569a47", "tag": "fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:48.129521 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:48.129521 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:48.152606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4910ae3-9c1b-478a-acfe-9b5c02fa10a3 req-26514d95-3015-4d10-a40f-7c7da3f1f6a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.153266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4910ae3-9c1b-478a-acfe-9b5c02fa10a3 req-26514d95-3015-4d10-a40f-7c7da3f1f6a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.182806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f4910ae3-9c1b-478a-acfe-9b5c02fa10a3 req-26514d95-3015-4d10-a40f-7c7da3f1f6a2 service nova] Creating event network-changed:fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc for instance 8073278e-06ca-46aa-9b23-ba4cde569a47 on nch2-master-1 Nov 20 20:52:48.195014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f4910ae3-9c1b-478a-acfe-9b5c02fa10a3 req-26514d95-3015-4d10-a40f-7c7da3f1f6a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075754 Nov 20 20:52:48.196634 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1140/2324] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:48.232375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:48.234329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:48.253264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.255670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.257303 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3ac441ca-ade9-4717-8437-39a47902d396 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 3.706220 Nov 20 20:52:48.258225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.258777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.258935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1185/2325] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:44 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 3715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:48.276244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:48.289093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:48.314480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.316158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.319963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.320748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.799940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:48.817482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9d33a43-347e-4aba-abfe-f70a113eb350 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.557532 Nov 20 20:52:48.830327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1186/2326] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:48 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:48.837242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:48.844423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:48.860038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.864424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.865608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.867187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.941378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a987f5c3-9d96-40fd-b27f-b33127a20ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.109402 Nov 20 20:52:48.951275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1187/2327] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:48 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:48.959199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:48.968515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:48.990921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.991691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:48.992922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:48.993942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.102475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6522da58-e9b6-48ab-804c-30de0858c863 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action" status: 200 len: 40789 microversion: 2.1 time: 0.148319 Nov 20 20:52:49.103592 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1188/2328] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:48 2021] POST /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58/action => generated 40789 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:52:49.109774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-770250de-c862-4b55-ac4c-fc4455de2782 req-ea2e2ef8-8fe4-4816-b315-bbe11f89e5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b2f6df-58af-4fe3-a73b-eac474989b6a", "name": "network-vif-plugged", "status": "completed", "tag": "95a284b7-4c01-4cac-b5d2-4dc06cbf81ba"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:49.112602 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:49.112602 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:49.123577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-770250de-c862-4b55-ac4c-fc4455de2782 req-ea2e2ef8-8fe4-4816-b315-bbe11f89e5ee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.124293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-770250de-c862-4b55-ac4c-fc4455de2782 req-ea2e2ef8-8fe4-4816-b315-bbe11f89e5ee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.145825 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-770250de-c862-4b55-ac4c-fc4455de2782 req-ea2e2ef8-8fe4-4816-b315-bbe11f89e5ee service nova] Creating event network-vif-plugged:95a284b7-4c01-4cac-b5d2-4dc06cbf81ba for instance b3b2f6df-58af-4fe3-a73b-eac474989b6a on nch1-master-1 Nov 20 20:52:49.155173 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-770250de-c862-4b55-ac4c-fc4455de2782 req-ea2e2ef8-8fe4-4816-b315-bbe11f89e5ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048390 Nov 20 20:52:49.156186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1189/2329] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:49.179023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:49.180471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:49.193030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.194838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.196006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.202922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.353282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:49.370813 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03ee483d-d57d-4998-b1bd-144144b3d59a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1504 microversion: 2.1 time: 1.170598 Nov 20 20:52:49.371971 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1141/2330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:48 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1504 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:49.378861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f68b46b-3df9-44d4-8a71-76797172155b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87820550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:49.500398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f68b46b-3df9-44d4-8a71-76797172155b tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1431 microversion: 2.1 time: 0.125473 Nov 20 20:52:49.501525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1142/2331] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:49 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1431 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:49.520953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f9c8b63-b912-4e22-9b5f-96056c11e6f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87927820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:49.632952 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f9c8b63-b912-4e22-9b5f-96056c11e6f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.129689 Nov 20 20:52:49.634163 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1143/2332] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:49 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:49.638884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-940220942"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:49.645651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:49.658267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.659027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.660015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.662466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.683678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:49.698670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c99dd2e2-bf02-4e45-8a40-453a1d26f642 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1600 microversion: 2.1 time: 0.538938 Nov 20 20:52:49.699475 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1190/2333] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:49 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1600 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:49.724654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-179fe380-a36d-46f2-8bf4-db8abf728366 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98c3dca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:49.837420 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-179fe380-a36d-46f2-8bf4-db8abf728366 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 200 len: 1431 microversion: 2.1 time: 0.130754 Nov 20 20:52:49.837420 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1191/2334] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:49 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 1431 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:49.865448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:49.866525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:49.912020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.916769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:49.922099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:49.925838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.131529 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.security_group_api [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Adding security group 60965fec-030a-46ba-96d7-c86fbee2f90f to port f45eebd5-aed0-4beb-a5fe-f44aba552d89 Nov 20 20:52:50.249377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:50.259639 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-edbf3e0d-2a26-4713-8564-4198ae913f13 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.420045 Nov 20 20:52:50.274391 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1192/2335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:49 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:50.282389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:50.283486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:50.291116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.304863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.306923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.310226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.629080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:50.636867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3548eab9-8691-46ac-b119-4bddfa288887 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1465 microversion: 2.1 time: 0.360971 Nov 20 20:52:50.637450 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1193/2336] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:50 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1465 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:50.648443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:50.653683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:50.663106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.663562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.664371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.664810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.741759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc0a7ec8-e66f-4c11-8302-293c22138b6f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.103000 Nov 20 20:52:50.742609 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1194/2337] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:50.850905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0129ab2-98e6-4763-9648-aae29a888c7b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/action" status: 202 len: 0 microversion: 2.1 time: 1.215463 Nov 20 20:52:50.854700 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1144/2338] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:49 2021] POST /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/action => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:50.858859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:50.866533 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:50.866533 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:50.867664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:50.868435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Searching by: {'deleted': False, 'project_id': '2a9b204d38934eeea9ac2d67611156eb'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:52:50.886573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.888921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:50.891016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:50.892595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.032787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:52:51.157859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d917c46b-9459-43b2-af3b-8b4a14d46807 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.304253 Nov 20 20:52:51.173220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1145/2339] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:52:50 2021] GET /compute/v2.1/servers => generated 343 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:51.179658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44ad288b-fb79-4051-b75c-4281651e1d11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87706ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:51.253725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44ad288b-fb79-4051-b75c-4281651e1d11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.078877 Nov 20 20:52:51.259915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1da03653-2232-408c-9846-e32488b73a0b tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1312776796", "id": 2059233731, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:51.260903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1146/2340] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:51 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:51.261484 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:51.261484 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:51.266110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30002cc0-ad97-4b01-ac37-9c63cc68d6d8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87bd0c10>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:51.309288 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1da03653-2232-408c-9846-e32488b73a0b tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.565452 Nov 20 20:52:51.318582 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1195/2341] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:50 2021] POST /compute/v2.1/flavors => generated 439 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:51.341946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1733145787"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:51.343831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:51.359131 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30002cc0-ad97-4b01-ac37-9c63cc68d6d8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059" status: 200 len: 784 microversion: 2.1 time: 0.096658 Nov 20 20:52:51.359727 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1147/2342] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:51 2021] GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059 => generated 784 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:51.376712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-16dd928a-e59b-4847-9681-539c7aa400db req-8e822a5b-adb6-478e-a47d-ff377b44a516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa040e2b-b12a-4df9-b751-18927bb85bbc", "tag": "f45eebd5-aed0-4beb-a5fe-f44aba552d89"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:51.377306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.378801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.379860 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:51.379860 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:51.380832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.381847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.398035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-16dd928a-e59b-4847-9681-539c7aa400db req-8e822a5b-adb6-478e-a47d-ff377b44a516 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.398878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-16dd928a-e59b-4847-9681-539c7aa400db req-8e822a5b-adb6-478e-a47d-ff377b44a516 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.440265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-16dd928a-e59b-4847-9681-539c7aa400db req-8e822a5b-adb6-478e-a47d-ff377b44a516 service nova] Creating event network-changed:f45eebd5-aed0-4beb-a5fe-f44aba552d89 for instance fa040e2b-b12a-4df9-b751-18927bb85bbc on nch2-master-1 Nov 20 20:52:51.451045 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-16dd928a-e59b-4847-9681-539c7aa400db req-8e822a5b-adb6-478e-a47d-ff377b44a516 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085747 Nov 20 20:52:51.461784 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1148/2343] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:51.477063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:51.482150 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:51.482150 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:51.506038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:51.508199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Searching by: {'deleted': False, 'project_id': '2a9b204d38934eeea9ac2d67611156eb'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:52:51.540927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.541795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.543121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.544013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.631597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:52:51.803950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:51.819119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:51.821230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:51.837637 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.network.security_group_api [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Adding security group 28c6b215-a994-40c5-acb3-309dabf90d76 to port f45eebd5-aed0-4beb-a5fe-f44aba552d89 Nov 20 20:52:52.108250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61ddad41-be74-4648-b9e4-772e2cf69006 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.646269 Nov 20 20:52:52.109434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1149/2344] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:51 2021] GET /compute/v2.1/servers/detail => generated 1603 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:52.114094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7b075ad2-a6b4-45c9-8896-63d72db2d679 req-8dbe3bd7-615c-4a50-9724-463be2da002a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:52.115767 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:52.115767 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:52.129062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b075ad2-a6b4-45c9-8896-63d72db2d679 req-8dbe3bd7-615c-4a50-9724-463be2da002a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:52.134611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b075ad2-a6b4-45c9-8896-63d72db2d679 req-8dbe3bd7-615c-4a50-9724-463be2da002a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:52.151924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7b075ad2-a6b4-45c9-8896-63d72db2d679 req-8dbe3bd7-615c-4a50-9724-463be2da002a service nova] Creating event network-vif-unplugged:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:52:52.166897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7b075ad2-a6b4-45c9-8896-63d72db2d679 req-8dbe3bd7-615c-4a50-9724-463be2da002a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056000 Nov 20 20:52:52.175529 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1150/2345] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:52.181516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:52.182236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:52.204128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:52.204548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:52.205358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:52.205783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:52.560298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:52.569394 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ad41319-d136-4d49-9fcb-8a68a0e13324 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.392149 Nov 20 20:52:52.582134 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1151/2346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:52 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:52.587923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7aa3bd5-c793-4202-98d0-65553dd0d0d4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:52.592628 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:52.592628 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:52.823275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-127886c3-c1a3-42aa-8c41-9f6c52580046 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/action" status: 202 len: 0 microversion: 2.1 time: 1.495737 Nov 20 20:52:52.824330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1196/2347] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:51 2021] POST /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/action => generated 0 bytes in 1497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:52.833866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9022b83-67db-4804-8a2e-bb298f5c6563 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:52.853760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9022b83-67db-4804-8a2e-bb298f5c6563 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027774 Nov 20 20:52:52.855184 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1197/2348] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:52:52 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:52.867821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:52.869810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:52.881909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:52.882652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:52.883712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:52.884383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:52.973622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2b4fa53-d0d8-4122-ba52-4463881919ad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.108696 Nov 20 20:52:52.980242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1198/2349] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:52 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:53.002167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7aa3bd5-c793-4202-98d0-65553dd0d0d4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/2059233731/action" status: 200 len: 97 microversion: 2.1 time: 0.416901 Nov 20 20:52:53.003514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1152/2350] 10.222.0.41 () {60 vars in 1199 bytes} [Sat Nov 20 20:52:52 2021] POST /compute/v2.1/flavors/2059233731/action => generated 97 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:52:53.008685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-10d867b2-f4ad-4567-92aa-03f45e27a432 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:53.019231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7e638cf-9bff-4a07-b60d-d4cd190cbe05 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87b41940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:53.042878 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-10d867b2-f4ad-4567-92aa-03f45e27a432 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.058924 Nov 20 20:52:53.059513 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1199/2351] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:52:52 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:53.073649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:53.074926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:53.136781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:53.138232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:53.139611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:53.140362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:53.155972 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7e638cf-9bff-4a07-b60d-d4cd190cbe05 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.149791 Nov 20 20:52:53.156730 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1153/2352] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:53 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:53.183666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5396a8c2-b41c-4c72-8bb6-613b8d6bdebc req-2b71460e-a7c9-4ac7-98e9-b8c2d849c7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa040e2b-b12a-4df9-b751-18927bb85bbc", "tag": "f45eebd5-aed0-4beb-a5fe-f44aba552d89"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:53.187990 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:53.187990 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:53.216822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5396a8c2-b41c-4c72-8bb6-613b8d6bdebc req-2b71460e-a7c9-4ac7-98e9-b8c2d849c7e2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:53.217709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5396a8c2-b41c-4c72-8bb6-613b8d6bdebc req-2b71460e-a7c9-4ac7-98e9-b8c2d849c7e2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:53.235230 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5396a8c2-b41c-4c72-8bb6-613b8d6bdebc req-2b71460e-a7c9-4ac7-98e9-b8c2d849c7e2 service nova] Creating event network-changed:f45eebd5-aed0-4beb-a5fe-f44aba552d89 for instance fa040e2b-b12a-4df9-b751-18927bb85bbc on nch2-master-1 Nov 20 20:52:53.259007 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5396a8c2-b41c-4c72-8bb6-613b8d6bdebc req-2b71460e-a7c9-4ac7-98e9-b8c2d849c7e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095665 Nov 20 20:52:53.260683 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1154/2353] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:53.280888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb8de845-5034-40a3-abe9-6174bbee9b0d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87b41ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:54.118612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59ebcde1-3220-459e-ac6b-b2d3b81c6679 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.050443 Nov 20 20:52:54.119247 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1200/2354] 10.222.0.41 () {58 vars in 1292 bytes} [Sat Nov 20 20:52:53 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc/os-security-groups => generated 1157 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:54.134952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1354cd85-baf4-4b0f-b185-12d881db67a8 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:54.136318 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:54.136318 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:54.352781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb8de845-5034-40a3-abe9-6174bbee9b0d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "DELETE /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 204 len: 0 microversion: 2.1 time: 1.090197 Nov 20 20:52:54.359522 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1155/2355] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:53 2021] DELETE /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:52:54.365760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:54.367182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:54.385889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.388730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.389826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.391246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.463477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:52:54.541208 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1354cd85-baf4-4b0f-b185-12d881db67a8 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] HTTP exception thrown: Flavor access already exists for flavor 33 and project 9a3d0b44424c4ae7a22e946bdb5a294a combination. Nov 20 20:52:54.541832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1354cd85-baf4-4b0f-b185-12d881db67a8 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Returning 409 to user: Flavor access already exists for flavor 33 and project 9a3d0b44424c4ae7a22e946bdb5a294a combination. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:54.543017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1354cd85-baf4-4b0f-b185-12d881db67a8 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/2059233731/action" status: 409 len: 152 microversion: 2.1 time: 0.422916 Nov 20 20:52:54.543947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1201/2356] 10.222.0.41 () {60 vars in 1199 bytes} [Sat Nov 20 20:52:54 2021] POST /compute/v2.1/flavors/2059233731/action => generated 152 bytes in 424 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:54.552559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:54.553416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:54.559364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.560273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.561446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.562063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.599525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d45cd97-47b9-47ad-abe3-c62f86c0447e tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 204 len: 0 microversion: 2.1 time: 0.238368 Nov 20 20:52:54.606622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1156/2357] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:52:54 2021] DELETE /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:52:54.613555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:54.616344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:54.623305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.624010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.624983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.625574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.682365 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8fc1efc7-ca4b-4281-822c-30416daf6f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.072625 Nov 20 20:52:54.684040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1157/2358] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:54.692619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85bfeb07-f884-4b8c-87f8-61c93516a630 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f87a3f790>, body: {"security_group": {"name": " tempest-securitygroup -1122798251 ", "description": "tempest-description-2107311289"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:54.771037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:54.783398 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd3c32fb-6154-4e93-92a6-c5a9f43b4fb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.235684 Nov 20 20:52:54.785073 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1202/2359] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:54 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:54.794713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55dc17f1-8430-455b-9b15-c763604a3a65 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c59160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:54.871330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55dc17f1-8430-455b-9b15-c763604a3a65 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.081140 Nov 20 20:52:54.879359 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1203/2360] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:54 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:54.886853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d7a0c92e-f1f6-4831-b7b2-7cac2ba5a229 req-54a4adc5-5402-4b33-b7c5-4b5650d6a99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8073278e-06ca-46aa-9b23-ba4cde569a47", "name": "network-vif-plugged", "status": "completed", "tag": "fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:54.889227 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:54.889227 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:54.904967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d7a0c92e-f1f6-4831-b7b2-7cac2ba5a229 req-54a4adc5-5402-4b33-b7c5-4b5650d6a99f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:54.907397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d7a0c92e-f1f6-4831-b7b2-7cac2ba5a229 req-54a4adc5-5402-4b33-b7c5-4b5650d6a99f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:54.925192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d7a0c92e-f1f6-4831-b7b2-7cac2ba5a229 req-54a4adc5-5402-4b33-b7c5-4b5650d6a99f service nova] Creating event network-vif-plugged:fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc for instance 8073278e-06ca-46aa-9b23-ba4cde569a47 on nch2-master-1 Nov 20 20:52:54.936818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85bfeb07-f884-4b8c-87f8-61c93516a630 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.250071 Nov 20 20:52:54.937481 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1158/2361] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:54 2021] POST /compute/v2.1/os-security-groups => generated 224 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:54.938308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d7a0c92e-f1f6-4831-b7b2-7cac2ba5a229 req-54a4adc5-5402-4b33-b7c5-4b5650d6a99f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053595 Nov 20 20:52:54.940336 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1204/2362] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:54.948401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5210438-495d-4238-ab4f-1426c0865a8e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87819dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:54.967245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2090cce5-75bc-40a9-a562-f9542b93a7ce tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:54.972599 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:54.972599 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:54.995953 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a5210438-495d-4238-ab4f-1426c0865a8e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] HTTP exception thrown: Image not found. Nov 20 20:52:54.997204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5210438-495d-4238-ab4f-1426c0865a8e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:54.998525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a5210438-495d-4238-ab4f-1426c0865a8e tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 404 len: 62 microversion: 2.1 time: 0.059834 Nov 20 20:52:54.999478 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1159/2363] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:54 2021] GET /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:55.017887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.021571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:55.055954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.057438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.061388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.064715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.101191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2090cce5-75bc-40a9-a562-f9542b93a7ce tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/2059233731/action" status: 200 len: 21 microversion: 2.1 time: 0.159268 Nov 20 20:52:55.102304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1205/2364] 10.222.0.41 () {60 vars in 1199 bytes} [Sat Nov 20 20:52:54 2021] POST /compute/v2.1/flavors/2059233731/action => generated 21 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:52:55.118076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-51b54209-9a06-473b-b5b4-ca0e531217ce tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98d59160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.229341 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-51b54209-9a06-473b-b5b4-ca0e531217ce tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250" status: 200 len: 224 microversion: 2.1 time: 0.125873 Nov 20 20:52:55.230265 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1206/2365] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:55 2021] GET /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 => generated 224 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:55.235440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1858428855"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:55.237130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:55.247980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.248513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.253948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.254449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.298315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:55.308029 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4c2fc94-8380-4736-bde3-7d41fc378d50 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1606 microversion: 2.1 time: 0.307492 Nov 20 20:52:55.319041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1160/2366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:54 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1606 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:55.330431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acf50293-6e97-49e2-a3e6-a655106cbd3a tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.331887 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:55.331887 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:55.359275 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acf50293-6e97-49e2-a3e6-a655106cbd3a tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/2059233731" status: 202 len: 0 microversion: 2.1 time: 0.047644 Nov 20 20:52:55.360889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1161/2367] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:52:55 2021] DELETE /compute/v2.1/flavors/2059233731 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:55.368461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1add87c1-5a81-41a5-894b-5b647b7be9e0 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f87819ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.635586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-940eccaf-e126-4b5e-8457-5d2611a9c0be tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "POST /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec/action" status: 202 len: 0 microversion: 2.1 time: 0.403369 Nov 20 20:52:55.636750 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1add87c1-5a81-41a5-894b-5b647b7be9e0 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250" status: 202 len: 0 microversion: 2.1 time: 0.274791 Nov 20 20:52:55.642399 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1162/2368] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:55 2021] DELETE /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:55.642651 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1207/2369] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:52:55 2021] POST /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:52:55.650318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37aa84fd-8ead-457b-b4d1-c2080f601db9 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d95f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.652545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d140777-8f39-4a5d-8f4d-909925fb4323 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.711422 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d140777-8f39-4a5d-8f4d-909925fb4323 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067243 Nov 20 20:52:55.712445 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1163/2370] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:55 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:55.727286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f87b41160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.757460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:52:55.758090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:52:55.758748 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist Nov 20 20:52:55.758748 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-d67ce4ef-dd0f-4df2-8ca2-e6029264708b'] Nov 20 20:52:55.759978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist Nov 20 20:52:55.759978 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-d67ce4ef-dd0f-4df2-8ca2-e6029264708b'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:55.761050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4474d3a7-6ded-4b93-adcc-f34e7d7eee2b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250" status: 404 len: 194 microversion: 2.1 time: 0.047640 Nov 20 20:52:55.766584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1164/2371] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:55 2021] GET /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:55.768967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:55.771085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:55.781503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.781965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.782114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37aa84fd-8ead-457b-b4d1-c2080f601db9 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.136281 Nov 20 20:52:55.782806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.783246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.786510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1208/2372] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:55 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:55.793568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b25d115-ab4c-4f86-95d2-9ec34901153e tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-970045668", "id": 579576955, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:55.797469 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:55.797469 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:55.817083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b25d115-ab4c-4f86-95d2-9ec34901153e tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.029495 Nov 20 20:52:55.818296 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1209/2373] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:55 2021] POST /compute/v2.1/flavors => generated 434 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:55.822841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d588106-7bbe-40b3-828a-e2accf18faa5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f98d59280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1188373965", "description": "tempest-description-512199878"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:55.846144 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5fa361f8-5e54-4723-839e-9ec7c9441f9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.082424 Nov 20 20:52:55.847079 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1165/2374] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:55 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:55.855025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:55.856086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:55.872399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.873371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:55.874506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:55.876067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:56.077195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:56.091316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd0eeabb-bf2f-4af8-a225-ec86c3f7afb1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1318 microversion: 2.1 time: 0.240771 Nov 20 20:52:56.092347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1166/2375] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:55 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:56.101357 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d588106-7bbe-40b3-828a-e2accf18faa5 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.281797 Nov 20 20:52:56.103286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1210/2376] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:55 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:56.105643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb9764f-7909-4f40-8950-6fd01320a8c9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.106859 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:56.106859 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:56.108986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d423090-f282-49a4-b55a-0740e2cf69eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c59af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.127802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-8cb9764f-7909-4f40-8950-6fd01320a8c9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 20 20:52:56.128404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb9764f-7909-4f40-8950-6fd01320a8c9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:56.129228 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cb9764f-7909-4f40-8950-6fd01320a8c9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/579576955/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.035680 Nov 20 20:52:56.129782 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1167/2377] 10.222.0.41 () {58 vars in 1205 bytes} [Sat Nov 20 20:52:56 2021] GET /compute/v2.1/flavors/579576955/os-flavor-access => generated 91 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:52:56.136517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34e27817-6dae-4715-bfe6-845afcc2c585 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f878b9d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1829759363", "description": "tempest-description-745453092"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:56.171849 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d423090-f282-49a4-b55a-0740e2cf69eb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.067000 Nov 20 20:52:56.172456 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1211/2378] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:56 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:56.178601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a4326f5-e4ea-4973-816d-802dce8e6ae1 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.179351 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:56.179351 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:56.202851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a4326f5-e4ea-4973-816d-802dce8e6ae1 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/579576955" status: 202 len: 0 microversion: 2.1 time: 0.029038 Nov 20 20:52:56.203681 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1212/2379] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:52:56 2021] DELETE /compute/v2.1/flavors/579576955 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:56.211613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-649e0c62-2764-4d01-a8e9-8d8922c2924e tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.233167 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-649e0c62-2764-4d01-a8e9-8d8922c2924e tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025101 Nov 20 20:52:56.234515 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1213/2380] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:56 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:56.261361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4605fed-049f-4bd5-80ba-f519ad71c919 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1755492705", "id": 58741143, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:56.291433 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4605fed-049f-4bd5-80ba-f519ad71c919 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.037442 Nov 20 20:52:56.298210 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1214/2381] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:56 2021] POST /compute/v2.1/flavors => generated 433 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:56.385864 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34e27817-6dae-4715-bfe6-845afcc2c585 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.254868 Nov 20 20:52:56.386807 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1168/2382] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:56 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:56.391860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.392612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:56.427772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:56.428280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:56.428915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:56.435450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:56.782151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:56.787673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b28f22c-79cb-46dc-93e5-35ae2a197f05 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:56.790307 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:56.790307 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:56.790307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b28f22c-79cb-46dc-93e5-35ae2a197f05 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f97941f738d24bc89e4c3b8bfb15c7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3d0b44424c4ae7a22e946bdb5a294a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:56.791925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ed6b136-f7f7-4f83-90df-92465b646c26 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1606 microversion: 2.1 time: 0.402628 Nov 20 20:52:56.792691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b28f22c-79cb-46dc-93e5-35ae2a197f05 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:56.792826 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1169/2383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:56 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1606 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:56.793519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b28f22c-79cb-46dc-93e5-35ae2a197f05 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] 10.222.0.41 "POST /compute/v2.1/flavors/58741143/action" status: 403 len: 130 microversion: 2.1 time: 0.493790 Nov 20 20:52:56.797622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56658e19-ff46-4a1c-ae70-a146f439b3b8 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f878da3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-220024669", "description": "tempest-description-418996033"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:56.798436 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1215/2384] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 20:52:56 2021] POST /compute/v2.1/flavors/58741143/action => generated 130 bytes in 499 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:56.809206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-90e4346a-83f3-4e1c-a89e-e524068c7d14 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98c35790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.899254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-90e4346a-83f3-4e1c-a89e-e524068c7d14 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.099846 Nov 20 20:52:56.899963 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1216/2385] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:56 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:56.913217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c9c2b40-dde5-489e-a956-21513f208de4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:56.945141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c9c2b40-dde5-489e-a956-21513f208de4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/58741143" status: 202 len: 0 microversion: 2.1 time: 0.044109 Nov 20 20:52:56.946150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1217/2386] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:52:56 2021] DELETE /compute/v2.1/flavors/58741143 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:56.963780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:56.967500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:56.983752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:56.984544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:56.986462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:56.988318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.074146 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20961353-ad72-423b-9f3f-66ed2df4f87a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.126609 Nov 20 20:52:57.075581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1218/2387] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:56 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:57.086532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9beca98d-84d7-4763-a141-7fac316128ce tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.090042 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56658e19-ff46-4a1c-ae70-a146f439b3b8 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.296152 Nov 20 20:52:57.091908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1170/2388] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:52:56 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:57.097082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b53a4eda-d50f-41bf-934f-31a0e343f584 req-d49dc440-16e4-4666-89b8-8791ffc13b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce35b01-3e47-43e4-ae72-64a117b6366f", "name": "network-vif-plugged", "status": "completed", "tag": "7dceb653-952e-453b-b961-0478a94a32a1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:57.099737 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:57.099737 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:57.126407 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9beca98d-84d7-4763-a141-7fac316128ce tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045634 Nov 20 20:52:57.138099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1219/2389] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:57.138099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d7f7c6e-a2f6-4b5a-a4d6-87816a46389c tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98c598b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.143742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b53a4eda-d50f-41bf-934f-31a0e343f584 req-d49dc440-16e4-4666-89b8-8791ffc13b3e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.144677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b53a4eda-d50f-41bf-934f-31a0e343f584 req-d49dc440-16e4-4666-89b8-8791ffc13b3e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.158308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b53a4eda-d50f-41bf-934f-31a0e343f584 req-d49dc440-16e4-4666-89b8-8791ffc13b3e service nova] Creating event network-vif-plugged:7dceb653-952e-453b-b961-0478a94a32a1 for instance bce35b01-3e47-43e4-ae72-64a117b6366f on nch2-master-1 Nov 20 20:52:57.165247 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b53a4eda-d50f-41bf-934f-31a0e343f584 req-d49dc440-16e4-4666-89b8-8791ffc13b3e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071756 Nov 20 20:52:57.166356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1171/2390] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:57.173356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.174577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:57.181487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.181945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.182965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.183421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.399224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:57.408079 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a6faf21-ccf3-4872-89e7-572c6849fb99 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1468 microversion: 2.1 time: 0.240306 Nov 20 20:52:57.408902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1172/2391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:57.413669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5683971e-1e34-438e-b8dc-4ca6c445c2c4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-297140279", "id": 318533272, "os-flavor-access:is_public": "False"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:57.415547 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:57.415547 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:57.434974 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5683971e-1e34-438e-b8dc-4ca6c445c2c4 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023985 Nov 20 20:52:57.436302 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1173/2392] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:57 2021] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:57.442105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-128127c1-f447-448e-b2a4-d2223ace1c40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87927f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.503558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-128127c1-f447-448e-b2a4-d2223ace1c40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.065764 Nov 20 20:52:57.505549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1174/2393] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:57.516949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.517789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:57.524882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.525511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.526610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.527239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.717563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:57.725362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5369bf86-f435-4787-927e-061fb7e924cb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1318 microversion: 2.1 time: 0.212712 Nov 20 20:52:57.726753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1175/2394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:57.732168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e765b06e-a51c-4b70-b80a-ed0637b8a2ab tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:57.733500 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:57.733500 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:52:57.864380 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d7f7c6e-a2f6-4b5a-a4d6-87816a46389c tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.735844 Nov 20 20:52:57.872030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1220/2395] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:57.877883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:57.878828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:57.890425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.896846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.898037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:57.898713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:57.983080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e765b06e-a51c-4b70-b80a-ed0637b8a2ab tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/318533272/action" status: 200 len: 96 microversion: 2.1 time: 0.254926 Nov 20 20:52:57.984245 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1176/2396] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:52:57 2021] POST /compute/v2.1/flavors/318533272/action => generated 96 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:52:57.996010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-302a63c0-9c83-4bee-9c58-a69dd471fed4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f878b99d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.049954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:58.059147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a771cb3f-5dcf-4bff-a9ee-ac6fbef4197b tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1538 microversion: 2.1 time: 0.185627 Nov 20 20:52:58.059833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1221/2397] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:57 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1538 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:58.064026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b966739-95b4-4033-9914-861c7813c6b3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98d45280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.166420 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b966739-95b4-4033-9914-861c7813c6b3 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.105543 Nov 20 20:52:58.172054 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1222/2398] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:58 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:58.172054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40c6ab42-b458-4a5c-9df3-fd8c85430e62 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:58.173152 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:58.173152 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:58.185585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40c6ab42-b458-4a5c-9df3-fd8c85430e62 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f97941f738d24bc89e4c3b8bfb15c7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a3d0b44424c4ae7a22e946bdb5a294a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:58.186836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40c6ab42-b458-4a5c-9df3-fd8c85430e62 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:58.187148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40c6ab42-b458-4a5c-9df3-fd8c85430e62 tempest-FlavorsAccessNegativeTestJSON-761967673 tempest-FlavorsAccessNegativeTestJSON-761967673-project] 10.222.0.41 "POST /compute/v2.1/flavors/318533272/action" status: 403 len: 133 microversion: 2.1 time: 0.019235 Nov 20 20:52:58.187709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1223/2399] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:52:58 2021] POST /compute/v2.1/flavors/318533272/action => generated 133 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:58.198447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:58.200851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:58.211274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:58.211733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:58.214820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:58.218280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:58.325814 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2995224b-c5cb-42b0-8356-ec8c8154630c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.132756 Nov 20 20:52:58.327581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1224/2400] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:58.340368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6269823a-3605-4b31-be01-b0913fee3837 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9a3d0b44424c4ae7a22e946bdb5a294a"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:58.342478 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:58.342478 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:58.429841 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-302a63c0-9c83-4bee-9c58-a69dd471fed4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5" status: 202 len: 0 microversion: 2.1 time: 0.444474 Nov 20 20:52:58.430486 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1177/2401] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:57 2021] DELETE /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:58.438703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f878b9ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.534537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:52:58.536308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:52:58.537289 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist Nov 20 20:52:58.537289 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-4012e30f-c3a5-44fd-aca2-6e1b11fcb077'] Nov 20 20:52:58.538293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist Nov 20 20:52:58.538293 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-4012e30f-c3a5-44fd-aca2-6e1b11fcb077'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:58.539513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4321ae35-e540-484a-8263-378ec4ca4df3 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5" status: 404 len: 194 microversion: 2.1 time: 0.104380 Nov 20 20:52:58.540549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1178/2402] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:58 2021] GET /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:52:58.546259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7875033e-350e-4d38-9bc3-00a11c9a1d7e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f878b9550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.551897 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6269823a-3605-4b31-be01-b0913fee3837 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/318533272/action" status: 200 len: 21 microversion: 2.1 time: 0.216569 Nov 20 20:52:58.554559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1225/2403] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:52:58 2021] POST /compute/v2.1/flavors/318533272/action => generated 21 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:52:58.582041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b4c67608-a9a6-40a2-ad53-7a3c960ac096 req-81a1b220-41e4-4003-9755-6f0af2e0fb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a604335-3c5c-46dd-879c-5f0d49092a58", "name": "network-vif-deleted", "tag": "b8360b4c-cbee-4afe-816b-338cc6a81f67"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:58.593343 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:58.593343 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:58.619600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b4c67608-a9a6-40a2-ad53-7a3c960ac096 req-81a1b220-41e4-4003-9755-6f0af2e0fb23 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:58.631580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7875033e-350e-4d38-9bc3-00a11c9a1d7e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.089765 Nov 20 20:52:58.632188 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1179/2404] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:58 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:58.649534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b4c67608-a9a6-40a2-ad53-7a3c960ac096 req-81a1b220-41e4-4003-9755-6f0af2e0fb23 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:58.653711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-594b907c-9579-4a48-a27f-01bfbdc7acdb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f879271f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.688250 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b4c67608-a9a6-40a2-ad53-7a3c960ac096 req-81a1b220-41e4-4003-9755-6f0af2e0fb23 service nova] Creating event network-vif-deleted:b8360b4c-cbee-4afe-816b-338cc6a81f67 for instance 0a604335-3c5c-46dd-879c-5f0d49092a58 on nch1-master-1 Nov 20 20:52:58.697839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b4c67608-a9a6-40a2-ad53-7a3c960ac096 req-81a1b220-41e4-4003-9755-6f0af2e0fb23 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141837 Nov 20 20:52:58.701386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1226/2405] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:52:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:58.714240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c3ae4df-ee5d-4b91-a369-d14ed1a82e6c tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.715616 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:58.715616 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:58.757256 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c3ae4df-ee5d-4b91-a369-d14ed1a82e6c tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/318533272" status: 202 len: 0 microversion: 2.1 time: 0.053026 Nov 20 20:52:58.761428 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1227/2406] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:52:58 2021] DELETE /compute/v2.1/flavors/318533272 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:58.790480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:58.792219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:58.812125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:58.815970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:58.819347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:58.819920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.212148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:59.224314 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-594b907c-9579-4a48-a27f-01bfbdc7acdb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e" status: 202 len: 0 microversion: 2.1 time: 0.589995 Nov 20 20:52:59.224943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1180/2407] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:58 2021] DELETE /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:59.232531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f487975-65c4-4450-91f9-35c1769b8fba tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.283043 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-19af51b8-8fd6-4c43-af75-de654e71be00 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1318 microversion: 2.1 time: 0.520049 Nov 20 20:52:59.296832 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1228/2408] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:58 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:59.313116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f487975-65c4-4450-91f9-35c1769b8fba tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087044 Nov 20 20:52:59.315882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.318152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:59.326873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1181/2409] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:52:59 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:59.351665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:59.351933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50531602-3abe-4ca2-8aa7-8509a63dedc8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87927f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.357222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.360126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:59.364013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.460612 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50531602-3abe-4ca2-8aa7-8509a63dedc8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.132439 Nov 20 20:52:59.464711 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1182/2410] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:59 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:59.470755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f878b91f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.531159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:52:59.531796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group d4325e6d-dca8-4586-91ca-2bb5480a444e not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:52:59.532344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist Nov 20 20:52:59.532344 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-27ed179b-17c9-4343-ae0e-a66c9bfa20f5'] Nov 20 20:52:59.533497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist Nov 20 20:52:59.533497 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-27ed179b-17c9-4343-ae0e-a66c9bfa20f5'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:52:59.534635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db2eedc8-5e02-4c4f-8f16-944076516c6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e" status: 404 len: 194 microversion: 2.1 time: 0.067461 Nov 20 20:52:59.535386 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1183/2411] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:52:59 2021] GET /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:52:59.554410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:59.555797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:52:59.566104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:59.574158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.578354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:59.580875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lazy-loading 'fault' on Instance uuid 0a604335-3c5c-46dd-879c-5f0d49092a58 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:52:59.588287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.589147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:52:59.593725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:52:59.653749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14079946f53346a3a4373ac0738f5894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9b204d38934eeea9ac2d67611156eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:52:59.662454 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-819787c2-8727-45a5-bf0d-a30f21569c3a tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 200 len: 1256 microversion: 2.1 time: 0.362439 Nov 20 20:52:59.666774 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1229/2412] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:52:59 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 1256 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:59.672713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-316b9d89-822c-4b7c-aab7-611f4d90855b tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-999277689", "id": 367261861, "os-flavor-access:is_public": "False"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:59.674768 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:59.674768 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:52:59.698214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-316b9d89-822c-4b7c-aab7-611f4d90855b tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.029375 Nov 20 20:52:59.699285 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1230/2413] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:52:59 2021] POST /compute/v2.1/flavors => generated 435 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:52:59.710987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-021e46d4-604a-4ff1-9358-dcd700f6cfca tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98c4be50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.711186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f031e2e8-b2e4-48cc-a5a4-ba9522b30791 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.174227 Nov 20 20:52:59.716325 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1184/2414] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:52:59 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:52:59.717809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a45f52e-2ccd-462a-9283-5aae2bc44bc7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87807280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:52:59.917326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a45f52e-2ccd-462a-9283-5aae2bc44bc7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1411 microversion: 2.1 time: 0.203698 Nov 20 20:52:59.919440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1185/2415] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:52:59 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1411 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:52:59.929377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab6c6516-e3c0-4eff-93de-d5a4380d3fdd tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d579c7e9c59a42d1b0fe24b953bafd7c"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:52:59.931869 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:52:59.931869 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:00.223241 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-021e46d4-604a-4ff1-9358-dcd700f6cfca tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f" status: 202 len: 0 microversion: 2.1 time: 0.516901 Nov 20 20:53:00.224365 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1231/2416] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:52:59 2021] DELETE /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:00.232831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98c4b5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.370265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:00.371131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:00.371864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist Nov 20 20:53:00.371864 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-356cf8bf-ced2-453e-9608-b5a117282959'] Nov 20 20:53:00.372537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist Nov 20 20:53:00.372537 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-356cf8bf-ced2-453e-9608-b5a117282959'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:00.373842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-157ab080-a32d-4ee3-a32b-6058d71bfb6d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f" status: 404 len: 194 microversion: 2.1 time: 0.145275 Nov 20 20:53:00.388242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1232/2417] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f => generated 194 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:53:00.397953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.398720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:00.408575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.408911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.414251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.415018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.492620 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ab6c6516-e3c0-4eff-93de-d5a4380d3fdd tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] HTTP exception thrown: Flavor access not found for 37 / d579c7e9c59a42d1b0fe24b953bafd7c combination. Nov 20 20:53:00.493376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab6c6516-e3c0-4eff-93de-d5a4380d3fdd tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Returning 404 to user: Flavor access not found for 37 / d579c7e9c59a42d1b0fe24b953bafd7c combination. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:00.496129 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab6c6516-e3c0-4eff-93de-d5a4380d3fdd tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/367261861/action" status: 404 len: 124 microversion: 2.1 time: 0.575505 Nov 20 20:53:00.499415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1186/2418] 10.222.0.41 () {60 vars in 1196 bytes} [Sat Nov 20 20:52:59 2021] POST /compute/v2.1/flavors/367261861/action => generated 124 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:00.510592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66d843dd-0468-4b56-8835-a7894783c9bd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f878b9040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.764435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:00.779500 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-557a6dad-0a80-44de-992f-8399bb9eee74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1467 microversion: 2.1 time: 0.390040 Nov 20 20:53:00.780182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1233/2419] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:00.805312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ff76592-e078-40f2-a4e2-26f8c5a75b6f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98dcb8b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.812439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66d843dd-0468-4b56-8835-a7894783c9bd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.311680 Nov 20 20:53:00.813023 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1187/2420] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:00.819004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68076ec5-4b89-4d6a-bce2-4e5b15b873d9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.819913 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:00.819913 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:00.841231 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68076ec5-4b89-4d6a-bce2-4e5b15b873d9 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/367261861" status: 202 len: 0 microversion: 2.1 time: 0.026020 Nov 20 20:53:00.842542 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1188/2421] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:53:00 2021] DELETE /compute/v2.1/flavors/367261861 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:00.849033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.849811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] [instance: 0a604335-3c5c-46dd-879c-5f0d49092a58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:00.857044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.857552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.858800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.859384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.876381 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] HTTP exception thrown: Instance 0a604335-3c5c-46dd-879c-5f0d49092a58 could not be found. Nov 20 20:53:00.877394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Returning 404 to user: Instance 0a604335-3c5c-46dd-879c-5f0d49092a58 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:00.878859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed8aeb32-5991-4f5d-b643-fb0b2e6c6442 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58" status: 404 len: 111 microversion: 2.1 time: 0.034866 Nov 20 20:53:00.879956 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1189/2422] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/servers/0a604335-3c5c-46dd-879c-5f0d49092a58 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:00.885130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:00.887267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:00.897443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.898631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.899611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.900213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.974000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af76635a-656c-48e6-a42d-a574834f66c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.092516 Nov 20 20:53:00.978193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1190/2423] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:00 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:00.983199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:00.987022 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:00.987022 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:00.988397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:00.989855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Searching by: {'reservation_id': 'r-b20hj1ey', 'deleted': False, 'project_id': '60778bfeb31b496081c05ccc33a74a1c'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:53:00.997793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:00.998547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:00.999818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:01.000421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:01.184000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:53:01.302401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:01.315309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:01.316400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:01.529457 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e845074-3a53-44ef-8f4c-165ecc75edbf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?reservation_id=r-b20hj1ey" status: 200 len: 2928 microversion: 2.1 time: 0.550867 Nov 20 20:53:01.530906 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1191/2424] 10.222.0.41 () {58 vars in 1196 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/servers/detail?reservation_id=r-b20hj1ey => generated 2928 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:01.555530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e4a96f9-631e-4024-b529-1e48b5384356 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f878193a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-467267317", "description": "tempest-description-635984541"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:01.904691 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e4a96f9-631e-4024-b529-1e48b5384356 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.372475 Nov 20 20:53:01.905871 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1192/2425] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:53:01 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:01.911577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4a57055-fca0-42f2-a76a-9245469ac637 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:01.958981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4a57055-fca0-42f2-a76a-9245469ac637 tempest-FlavorsAccessNegativeTestJSON-398809397 tempest-FlavorsAccessNegativeTestJSON-398809397-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051792 Nov 20 20:53:01.964626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1193/2426] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:01 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:01.974001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bc6eaa5-ebfd-453a-91eb-9ea391facb59 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] Calling method '.version_select at 0x7f3f878da430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:02.016935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bc6eaa5-ebfd-453a-91eb-9ea391facb59 tempest-ServersTestBootFromVolume-1177398021 tempest-ServersTestBootFromVolume-1177398021-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788948485" status: 202 len: 0 microversion: 2.1 time: 0.051099 Nov 20 20:53:02.017495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1194/2427] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:53:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788948485 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:02.038331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a2a535e-4aa9-4c66-b02b-6bbab1a7da19 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87819280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:06.596945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ff76592-e078-40f2-a4e2-26f8c5a75b6f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 5.798723 Nov 20 20:53:06.602828 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1234/2428] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:00 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 5800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:06.608747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa9a5235-c7c3-4371-9b98-fd5c05164a2b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:06.626992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a2a535e-4aa9-4c66-b02b-6bbab1a7da19 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1420 microversion: 2.1 time: 4.608187 Nov 20 20:53:06.628987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1195/2429] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:02 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1420 bytes in 4610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:06.650693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8dfcc411-972e-486e-9000-4a03fa41980c tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f98dfb670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1133960164", "description": "tempest-description-771580775"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:06.656640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_groups [None req-fa9a5235-c7c3-4371-9b98-fd5c05164a2b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Querying cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) for 2 instances {{(pid=140942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 20 20:53:06.663207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa9a5235-c7c3-4371-9b98-fd5c05164a2b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:06.664062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa9a5235-c7c3-4371-9b98-fd5c05164a2b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:06.736922 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa9a5235-c7c3-4371-9b98-fd5c05164a2b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups/8d723fe2-62cd-49cf-a344-895994e71bc0" status: 200 len: 266 microversion: 2.1 time: 0.137704 Nov 20 20:53:06.738080 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1235/2430] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:53:06 2021] GET /compute/v2.1/os-server-groups/8d723fe2-62cd-49cf-a344-895994e71bc0 => generated 266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:06.743879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:06.745450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:06.752904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:06.753969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:06.755131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:06.755807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:06.829546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1469f06-c9c6-4cad-a2f7-248c6d9af717 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.089882 Nov 20 20:53:06.831042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1236/2431] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:06 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:06.839562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-086b717c-fba3-4419-9b6a-8b17baffc973 req-2addb6a9-9b3d-46a6-af71-598805995dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-plugged", "status": "completed", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:06.845103 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:06.845103 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:06.871438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-086b717c-fba3-4419-9b6a-8b17baffc973 req-2addb6a9-9b3d-46a6-af71-598805995dc6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:06.872747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-086b717c-fba3-4419-9b6a-8b17baffc973 req-2addb6a9-9b3d-46a6-af71-598805995dc6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:06.893713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-086b717c-fba3-4419-9b6a-8b17baffc973 req-2addb6a9-9b3d-46a6-af71-598805995dc6 service nova] Creating event network-vif-plugged:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:53:06.900358 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-086b717c-fba3-4419-9b6a-8b17baffc973 req-2addb6a9-9b3d-46a6-af71-598805995dc6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065263 Nov 20 20:53:06.901891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1237/2432] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:06.924755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a09e60d-909e-4809-89a3-5f2d91641d64 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c4bca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:07.050513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a09e60d-909e-4809-89a3-5f2d91641d64 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 200 len: 1420 microversion: 2.1 time: 0.146622 Nov 20 20:53:07.057777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1238/2433] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:06 2021] GET /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:07.067209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:07.067209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:07.077884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:07.080690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:07.082152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:07.082692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:07.127989 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8dfcc411-972e-486e-9000-4a03fa41980c tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.497565 Nov 20 20:53:07.128247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1196/2434] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:53:06 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:07.133244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce6f72ca-c71b-498c-b3b2-4c96a485a92f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f878b9b80>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:07.355926 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c818a376-9e52-4b49-80a6-e1c02b2a864d tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1619 microversion: 2.1 time: 0.302364 Nov 20 20:53:07.358003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1239/2435] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:07 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1619 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:07.380253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:07.381295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:07.398935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:07.404532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:07.406863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:07.409637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:07.600421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f16d4303-1a7f-4ead-b388-7efc593d88cd tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1618 microversion: 2.1 time: 0.224673 Nov 20 20:53:07.618655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1240/2436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:07 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1618 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:07.631207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-930085913", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "b78e4ec9-b593-412e-8e50-3a8f61366198"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:08.770404 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce6f72ca-c71b-498c-b3b2-4c96a485a92f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 204 len: 0 microversion: 2.1 time: 1.640545 Nov 20 20:53:08.772201 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1197/2437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:07 2021] DELETE /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 0 bytes in 1643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:53:08.778869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8df161cc-b1f2-4670-8582-d8d520c57ae8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f879271f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:08.883281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] validate_networks() for [('b78e4ec9-b593-412e-8e50-3a8f61366198', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:08.901785 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8df161cc-b1f2-4670-8582-d8d520c57ae8 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.128227 Nov 20 20:53:08.902392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1198/2438] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:08 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:08.917888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: .version_select at 0x7f3f878da160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1746821235", "policies": ["anti-affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:08.970009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:08.988025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:09.143144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:09.178416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:09.221642 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1709c8a8-a999-4692-ab16-84c62e562b8a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.317430 Nov 20 20:53:09.222185 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1199/2439] 10.222.0.41 () {60 vars in 1173 bytes} [Sat Nov 20 20:53:08 2021] POST /compute/v2.1/os-server-groups => generated 193 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:09.268480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:09.273572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:09.300500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.301015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.302024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.302495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.373070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c057e239-c007-48cb-af1f-71c6d70d11b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.118731 Nov 20 20:53:09.374671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1200/2440] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:09 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:09.383088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:09.384257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:09.405510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.406321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.408060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.408849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.445744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:53:09.589182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4aa1e387-936f-47f6-b61e-7243c4804044 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 204 len: 0 microversion: 2.1 time: 0.212023 Nov 20 20:53:09.592534 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1201/2441] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:53:09 2021] DELETE /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:53:09.737176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:09.738440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:09.738771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:09.739188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:09.739600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:09.757148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.757515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.766333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:09.768016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:09.844778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Getting quotas for project d006f43b28c243da9c910fd530b7958b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:09.890939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Getting quotas for user e25d358e868f40728a6e968216d25f2e and project d006f43b28c243da9c910fd530b7958b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:09.943007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:09.951937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:10.086599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-563c1a8d-8af5-420c-b4c1-88175a273878 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.466656 Nov 20 20:53:10.087757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1241/2442] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:53:10.094620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-645891991", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "898d9a64-5d27-48dd-85ce-7f7dfadfb0c1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:10.191853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb652837-7f4a-4624-81d8-c77ffaf44d50 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-266305960", "ram": 512, "vcpus": 1, "disk": 10, "id": 1708574738, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:10.194406 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:10.194406 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:10.232307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:10.237908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb652837-7f4a-4624-81d8-c77ffaf44d50 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.632101 Nov 20 20:53:10.255073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1202/2443] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:09 2021] POST /compute/v2.1/flavors => generated 415 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:10.267187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1185856818", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7ac3ab90-d288-4bb5-99a9-c81df0147689"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:10.455237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] validate_networks() for [('7ac3ab90-d288-4bb5-99a9-c81df0147689', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:10.817054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:10.817885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:10.818575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:10.819140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:10.819849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:10.844781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:10.847134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:10.850319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:10.851174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:10.887952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:10.894090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:10.909754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 2 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:10.912780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:11.024261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:11.049981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:11.161920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:11.167705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:11.188679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=a3726050-5f51-48dc-941a-2829539906a7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:11.257527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:11.271485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:11.358189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:11.371297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:11.490924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f1497f8-71a6-49d9-8232-50f27a485b53 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.401298 Nov 20 20:53:11.491910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1242/2444] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:10 2021] POST /compute/v2.1/servers => generated 32 bytes in 1403 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 20 20:53:11.497732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-292034c2-5dc7-44d1-89ba-cc2e3096b14c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f863cf0d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:11.589196 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-292034c2-5dc7-44d1-89ba-cc2e3096b14c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.095531 Nov 20 20:53:11.590865 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1243/2445] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:11 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:11.602122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:11.602943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:11.614591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:11.617235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:11.618665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:11.619314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:11.651310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:11.651835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:11.652398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:11.652996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:11.653846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:11.675731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:11.685482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:11.687001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:11.687382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:11.779237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:11.795247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for user 48554aa52ebf468fa74262b1bf8ab300 and project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:11.829853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:11.834665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:11.839017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:11.850316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-719b8ddc-8fce-49bb-8eba-db09505e2951 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1267 microversion: 2.1 time: 0.258141 Nov 20 20:53:11.852766 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1244/2446] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:11 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:11.877967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e1e629b-3ecb-4ae1-8234-b76cd0400a47 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:11.882375 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:11.882375 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:11.962811 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ba73f49-aa55-457f-8e77-c2f41d222718 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703308 Nov 20 20:53:11.970844 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1203/2447] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:53:11.981480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:11.981480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:11.999261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.000467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.001398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.002133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.003441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e1e629b-3ecb-4ae1-8234-b76cd0400a47 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.137769 Nov 20 20:53:12.007412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1245/2448] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:11 2021] POST /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:12.031040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f7ad1c09-6308-477b-8356-0947dde5d255 req-48aef87f-125a-4633-86e5-375e5b7330ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b2f6df-58af-4fe3-a73b-eac474989b6a", "name": "network-vif-unplugged", "status": "completed", "tag": "95a284b7-4c01-4cac-b5d2-4dc06cbf81ba"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:12.037831 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:12.037831 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:12.078414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f7ad1c09-6308-477b-8356-0947dde5d255 req-48aef87f-125a-4633-86e5-375e5b7330ee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.078872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f7ad1c09-6308-477b-8356-0947dde5d255 req-48aef87f-125a-4633-86e5-375e5b7330ee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.140804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f7ad1c09-6308-477b-8356-0947dde5d255 req-48aef87f-125a-4633-86e5-375e5b7330ee service nova] Creating event network-vif-unplugged:95a284b7-4c01-4cac-b5d2-4dc06cbf81ba for instance b3b2f6df-58af-4fe3-a73b-eac474989b6a on nch1-master-1 Nov 20 20:53:12.173164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24c355b7-e646-403b-bfee-e257150db8c4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.199848 Nov 20 20:53:12.173386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f7ad1c09-6308-477b-8356-0947dde5d255 req-48aef87f-125a-4633-86e5-375e5b7330ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161230 Nov 20 20:53:12.174123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1246/2449] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:12.186713 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1204/2450] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:11 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:12.190327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.193503 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:12.193503 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:12.194719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:12.199620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Searching by: {'deleted': False, 'project_id': '60778bfeb31b496081c05ccc33a74a1c'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:53:12.209396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e5c7cbf-3187-4ba1-a2b2-1ef72f373a40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.218541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e5c7cbf-3187-4ba1-a2b2-1ef72f373a40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:12.252705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.253191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.254541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.254981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.322064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5e5c7cbf-3187-4ba1-a2b2-1ef72f373a40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:12.332450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e5c7cbf-3187-4ba1-a2b2-1ef72f373a40 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1208 microversion: 2.1 time: 0.141254 Nov 20 20:53:12.336045 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1205/2451] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1208 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:12.344943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:53:12.409576 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1f7180c-e8d3-43e7-8006-032d0ca02d7a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.227291 Nov 20 20:53:12.412758 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1247/2452] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/servers => generated 1662 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:12.437632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-231d05b8-7009-497f-bcec-8c5d353962c6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.444782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-231d05b8-7009-497f-bcec-8c5d353962c6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:12.761225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-277d62c9-0dc9-4bf7-a9a5-a49b0d9621fe tempest-FlavorsExtraSpecsTestJSON-1351749537 tempest-FlavorsExtraSpecsTestJSON-1351749537-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.782575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-277d62c9-0dc9-4bf7-a9a5-a49b0d9621fe tempest-FlavorsExtraSpecsTestJSON-1351749537 tempest-FlavorsExtraSpecsTestJSON-1351749537-project] 10.222.0.41 "GET /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.444936 Nov 20 20:53:12.784289 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1206/2453] 10.222.0.41 () {58 vars in 1202 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:12.791444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3788ac1d-c8fb-408e-9fe3-c977ec39464f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87872ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.900191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3788ac1d-c8fb-408e-9fe3-c977ec39464f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.114279 Nov 20 20:53:12.901394 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1207/2454] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:12.912299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7b103e8-ae5e-4434-a070-0be34c4d84f1 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:12.919550 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:12.919550 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:12.953888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7b103e8-ae5e-4434-a070-0be34c4d84f1 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051234 Nov 20 20:53:12.955464 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1208/2455] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:12 2021] POST /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:12.966185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-231d05b8-7009-497f-bcec-8c5d353962c6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:12.973112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:12.974078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:12.982376 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-231d05b8-7009-497f-bcec-8c5d353962c6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1218 microversion: 2.1 time: 0.556201 Nov 20 20:53:12.989728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.990698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.992085 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1248/2456] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1218 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:12.993232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:12.995080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:12.997548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d58562b-4afd-4245-8efa-592368b2afd9 tempest-FlavorsExtraSpecsTestJSON-1351749537 tempest-FlavorsExtraSpecsTestJSON-1351749537-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.023782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d58562b-4afd-4245-8efa-592368b2afd9 tempest-FlavorsExtraSpecsTestJSON-1351749537 tempest-FlavorsExtraSpecsTestJSON-1351749537-project] 10.222.0.41 "GET /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030490 Nov 20 20:53:13.030733 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1249/2457] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:13.049883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dfd45f2e-82c2-485f-87e2-39357ee102bd tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:13.051216 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:13.051216 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:13.151369 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dfd45f2e-82c2-485f-87e2-39357ee102bd tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118424 Nov 20 20:53:13.152008 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1250/2458] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:13 2021] POST /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:13.177151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9abb2b40-c2b5-4467-99f9-68aa599b5366 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.198929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:13.200394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9abb2b40-c2b5-4467-99f9-68aa599b5366 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040818 Nov 20 20:53:13.205229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1251/2459] 10.222.0.41 () {58 vars in 1202 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:53:13.223880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:13.224804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:13.229323 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d003191-8712-4d62-8b67-39ab42cbc1f1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1273 microversion: 2.1 time: 0.271838 Nov 20 20:53:13.230599 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1209/2460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:12 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:13.236360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8b471c9-52c3-4781-9c5d-3ff0152854c9 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:13.239045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:13.239779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:13.240826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:13.241440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:13.244792 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:13.244792 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:13.323920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03fe32be-32fe-4fab-b8f1-7779a2831adc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.117539 Nov 20 20:53:13.325109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1252/2461] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:13.329153 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8b471c9-52c3-4781-9c5d-3ff0152854c9 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "PUT /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.095849 Nov 20 20:53:13.331350 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1210/2462] 10.222.0.41 () {60 vars in 1264 bytes} [Sat Nov 20 20:53:13 2021] PUT /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes => generated 22 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:13.341743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9af210d-b03f-41f0-a5e9-47ec5f5b1602 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.352514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.353201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:13.365401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:13.365860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:13.367953 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9af210d-b03f-41f0-a5e9-47ec5f5b1602 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030928 Nov 20 20:53:13.372482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:13.373198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:13.376839 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1211/2463] 10.222.0.41 () {58 vars in 1202 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/flavors/1708574738/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:53:13.389911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c417a7ea-c284-4d9c-bf51-a9cfe9ba4fe4 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.391974 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:13.391974 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:13.462855 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c417a7ea-c284-4d9c-bf51-a9cfe9ba4fe4 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.084710 Nov 20 20:53:13.469093 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1212/2464] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 20:53:13 2021] DELETE /compute/v2.1/flavors/1708574738/os-extra_specs/hw:numa_nodes => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:53:13.474391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c4fdea2a-3b23-41c1-afde-7523c202ccbe tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.534013 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c4fdea2a-3b23-41c1-afde-7523c202ccbe tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1708574738/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.057157 Nov 20 20:53:13.535243 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1213/2465] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 20:53:13 2021] DELETE /compute/v2.1/flavors/1708574738/os-extra_specs/hw:cpu_policy => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 20:53:13.571268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:13.576936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6966f0b2-cdef-4f58-a8f9-6c5faafce24d tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.579487 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42e7d827-aa9c-43d9-b3b5-84e425bcb6bc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1204 microversion: 2.1 time: 0.231481 Nov 20 20:53:13.580075 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1253/2466] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1204 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:13.612943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-804ed532-5a15-42c0-9e3d-a519b27851fc req-9d6e7f96-c706-4ca6-8815-36dc220a06fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b2f6df-58af-4fe3-a73b-eac474989b6a", "name": "network-vif-deleted", "tag": "95a284b7-4c01-4cac-b5d2-4dc06cbf81ba"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:13.614458 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:13.614458 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:13.629196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-804ed532-5a15-42c0-9e3d-a519b27851fc req-9d6e7f96-c706-4ca6-8815-36dc220a06fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:13.630352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-804ed532-5a15-42c0-9e3d-a519b27851fc req-9d6e7f96-c706-4ca6-8815-36dc220a06fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:13.646479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-804ed532-5a15-42c0-9e3d-a519b27851fc req-9d6e7f96-c706-4ca6-8815-36dc220a06fc service nova] Creating event network-vif-deleted:95a284b7-4c01-4cac-b5d2-4dc06cbf81ba for instance b3b2f6df-58af-4fe3-a73b-eac474989b6a on nch1-master-1 Nov 20 20:53:13.651689 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-804ed532-5a15-42c0-9e3d-a519b27851fc req-9d6e7f96-c706-4ca6-8815-36dc220a06fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042284 Nov 20 20:53:13.652117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6966f0b2-cdef-4f58-a8f9-6c5faafce24d tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/1708574738/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.091741 Nov 20 20:53:13.653350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1254/2467] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:53:13.660482 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1214/2468] 10.222.0.41 () {58 vars in 1202 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/flavors/1708574738/os-extra_specs => generated 19 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:13.674232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be93c2a6-2c1b-4a2c-bbaf-a488d718c2c4 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.676978 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:13.676978 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:13.706789 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be93c2a6-2c1b-4a2c-bbaf-a488d718c2c4 tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1708574738" status: 202 len: 0 microversion: 2.1 time: 0.042227 Nov 20 20:53:13.707922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1255/2469] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:53:13 2021] DELETE /compute/v2.1/flavors/1708574738 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:13.715790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cdab75b4-481f-44f1-85d9-6947f69fbc4f tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:13.766106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cdab75b4-481f-44f1-85d9-6947f69fbc4f tempest-FlavorsExtraSpecsTestJSON-1100635679 tempest-FlavorsExtraSpecsTestJSON-1100635679-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053734 Nov 20 20:53:13.771861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1215/2470] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:13.915933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-896f0f83-1f70-47b2-810e-6bf69a74ec2c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98da69d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:14.000178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:14.003744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:14.019418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.020041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.020939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.021494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.055613 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-896f0f83-1f70-47b2-810e-6bf69a74ec2c tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.143817 Nov 20 20:53:14.068455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1256/2471] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:14.229343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:14.247648 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f33331de-5490-4437-8341-5a3c55d9209e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1270 microversion: 2.1 time: 0.251877 Nov 20 20:53:14.250172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:14.250779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1216/2472] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:13 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:14.251327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:14.283078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.291143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.295362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.299345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.337247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:14.338076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:14.350599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.351053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.351846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.352288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.428617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5b2cbcd-b62e-48ee-990e-cb4936c34129 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.095509 Nov 20 20:53:14.430426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1217/2473] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:14 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:14.598920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:14.599587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:14.634477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.638632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.640738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:14.642170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:14.783934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:14.800336 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5eabba7-9cef-4b37-98d6-2824a94e9724 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1266 microversion: 2.1 time: 0.204404 Nov 20 20:53:14.802816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1218/2474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:14 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:14.914437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:14.928086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73468d33-5db7-42d0-b960-9c8d44afe458 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1273 microversion: 2.1 time: 0.682000 Nov 20 20:53:14.932595 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1257/2475] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:14 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1273 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:15.082283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-128c5fa4-7cf7-499c-ad4f-a69e8dc98e7d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87819160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:15.201410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-128c5fa4-7cf7-499c-ad4f-a69e8dc98e7d tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.127678 Nov 20 20:53:15.204851 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1219/2476] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:15 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:15.267234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:15.267857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:15.297809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.299653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.300645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.301381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.435049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:15.440971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:15.441943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:15.448598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09073873-d120-4174-bb3f-117a05113212 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1276 microversion: 2.1 time: 0.185469 Nov 20 20:53:15.460444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1258/2477] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:15 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:15.460917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.460917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.460917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.460917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.552802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34428258-97bf-424d-8c0d-e0b05d8aee55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.114928 Nov 20 20:53:15.558518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1220/2478] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:15 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:15.822632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:15.823964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:15.842980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.843703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.844885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.846918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.956035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:15.957272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:15.981235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.983077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.984331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:15.986973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:15.991737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:16.009050 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd06987a-5f99-4852-b3d4-29564168fed8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1266 microversion: 2.1 time: 0.192136 Nov 20 20:53:16.013901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1259/2479] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:15 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:16.217209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9bb6120-c264-4686-be58-7e90e4bdf47f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f863cdf70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:16.288109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9bb6120-c264-4686-be58-7e90e4bdf47f tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.075125 Nov 20 20:53:16.289300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1260/2480] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:16 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:16.390301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:16.400892 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40b6577f-c7da-460c-99ae-1b127611c4db tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.452942 Nov 20 20:53:16.402165 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1221/2481] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:15 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:16.468084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:16.468686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:16.483830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:16.484478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:16.485481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:16.485916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:16.564692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:16.565988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:16.574221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:16.574756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:16.575551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:16.578676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:16.647031 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-029a13b8-7893-4dcb-8d6c-69b2d3ae5ebe tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.085457 Nov 20 20:53:16.648272 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1222/2482] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:16.834289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:16.850177 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-457396ff-6cf2-4c37-91af-c3f52520a17a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1276 microversion: 2.1 time: 0.378114 Nov 20 20:53:16.857587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1261/2483] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:16 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:17.028792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:17.030243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:17.050351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.051146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.052797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.055247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.231202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:17.241175 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b147478d-4c8d-44dd-b812-c0059aac4934 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1266 microversion: 2.1 time: 0.218133 Nov 20 20:53:17.244751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1223/2484] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:17 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:17.303458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70d8f07a-0a8a-4f80-a357-82e862ef0775 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98da60d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:17.377423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70d8f07a-0a8a-4f80-a357-82e862ef0775 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.077642 Nov 20 20:53:17.383125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1262/2485] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:17 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:17.417819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:17.418488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:17.431825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.432279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.433092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.433525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.660215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:17.661209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:17.669453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.669904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.675767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.677647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.735058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:17.744580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5110430c-b7ff-4f01-8206-0509dcd2ed9d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.330256 Nov 20 20:53:17.745824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1224/2486] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:17 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:17.778423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6dc65344-04c7-4f26-a658-fb105eeb209c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.121221 Nov 20 20:53:17.794825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1263/2487] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:17 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:53:17.867882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:17.868496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:17.895112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.895577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:17.896419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:17.896860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:18.071689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:18.085970 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06729285-0049-4ff4-a96e-6594b6aca36c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1276 microversion: 2.1 time: 0.221617 Nov 20 20:53:18.087125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1225/2488] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:17 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:18.264093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:18.265523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:18.297440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:18.298763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:18.300715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:18.303299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:18.393060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86537187-be1b-4cd6-96b1-6f6cc17a8533 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f878b9ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:18.494366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86537187-be1b-4cd6-96b1-6f6cc17a8533 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.107189 Nov 20 20:53:18.495546 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1226/2489] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:18 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:18.766661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:18.768418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:18.788777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:18.791099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:18.793184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:18.794572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:19.055791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:19.069291 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41e8a01c-8d25-4ab4-884b-932f2e23b52d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.306417 Nov 20 20:53:19.071380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1227/2490] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:18 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:19.077498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:19.080735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:19.091156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:19.092216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:19.093325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:19.094131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:19.167800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63555630-1618-40ca-a3ac-b6a98b72860a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094823 Nov 20 20:53:19.175621 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1228/2491] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:19 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:19.356704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f4e558da-48e6-4f45-bbcb-09cb55c7c425 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-300614215", "ram": 512, "vcpus": 1, "disk": 10, "id": 1961633419, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:19.358781 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:19.358781 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:19.380338 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f4e558da-48e6-4f45-bbcb-09cb55c7c425 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.202463 Nov 20 20:53:19.380949 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1229/2492] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:19 2021] POST /compute/v2.1/flavors => generated 415 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:19.393018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:19.393950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:19.400908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:19.401581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:19.402646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:19.403269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:19.473859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:19.483979 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0163911-d5d9-4f3f-b70b-1fa70019b0c3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1276 microversion: 2.1 time: 0.094727 Nov 20 20:53:19.493964 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1230/2493] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:19 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:19.649538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bdb2dbf-380a-42fa-a7a1-dc24de82e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:19.661121 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5bdb2dbf-380a-42fa-a7a1-dc24de82e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] HTTP exception thrown: Flavor 1961633419 has no extra specs with key hw:cpu_thread_policy. Nov 20 20:53:19.662088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bdb2dbf-380a-42fa-a7a1-dc24de82e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Returning 404 to user: Flavor 1961633419 has no extra specs with key hw:cpu_thread_policy. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:19.663135 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bdb2dbf-380a-42fa-a7a1-dc24de82e9d9 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] 10.222.0.41 "GET /compute/v2.1/flavors/1961633419/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.175982 Nov 20 20:53:19.663935 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1231/2494] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 20:53:19 2021] GET /compute/v2.1/flavors/1961633419/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:19.670635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44344c6e-d68a-4e9c-8188-9a5d16087a96 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f876add30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:19.717458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:19.732674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39f1f83c-a247-49bf-b5ab-13d401408c6c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 1.475131 Nov 20 20:53:19.743301 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44344c6e-d68a-4e9c-8188-9a5d16087a96 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.077815 Nov 20 20:53:19.744063 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1232/2495] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:19 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:19.745120 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1264/2496] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:18 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:19.750120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02ff2f5a-9375-43bf-a59c-32c613fd9003 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:19.751638 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:19.751638 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:19.753045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02ff2f5a-9375-43bf-a59c-32c613fd9003 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c94a1703620d427ea24e8afaec0bdaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678021b4e2844a85811e7a5e1d89f84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:19.753704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02ff2f5a-9375-43bf-a59c-32c613fd9003 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:19.754543 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02ff2f5a-9375-43bf-a59c-32c613fd9003 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] 10.222.0.41 "POST /compute/v2.1/flavors/1961633419/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009411 Nov 20 20:53:19.755614 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1233/2497] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:19 2021] POST /compute/v2.1/flavors/1961633419/os-extra_specs => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:19.819622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03726b35-4d5a-48b2-ae92-7378e9c2dfdb tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:19.826637 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:19.826637 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:19.928571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03726b35-4d5a-48b2-ae92-7378e9c2dfdb tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/1961633419/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118408 Nov 20 20:53:19.933193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1265/2498] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:19 2021] POST /compute/v2.1/flavors/1961633419/os-extra_specs => generated 66 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:19.943107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5542985b-74d5-476e-bf7b-db36ffda5d23 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:19.944509 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:19.944509 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:19.945714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5542985b-74d5-476e-bf7b-db36ffda5d23 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c94a1703620d427ea24e8afaec0bdaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678021b4e2844a85811e7a5e1d89f84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:19.946719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5542985b-74d5-476e-bf7b-db36ffda5d23 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:19.947685 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5542985b-74d5-476e-bf7b-db36ffda5d23 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] 10.222.0.41 "DELETE /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008641 Nov 20 20:53:19.948589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1234/2499] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 20:53:19 2021] DELETE /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes => generated 124 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:19.959592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-968403eb-86d4-4b5f-be0f-3305c396e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.023580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-968403eb-86d4-4b5f-be0f-3305c396e9b6 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors/1961633419/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067095 Nov 20 20:53:20.024578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1266/2500] 10.222.0.41 () {60 vars in 1223 bytes} [Sat Nov 20 20:53:19 2021] POST /compute/v2.1/flavors/1961633419/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:53:20.035797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6816d66e-bc59-4a6e-a8f2-df5b3c5433e6 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.038610 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:20.038610 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:20.040862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6816d66e-bc59-4a6e-a8f2-df5b3c5433e6 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c94a1703620d427ea24e8afaec0bdaa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678021b4e2844a85811e7a5e1d89f84e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:20.042304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6816d66e-bc59-4a6e-a8f2-df5b3c5433e6 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:20.045265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6816d66e-bc59-4a6e-a8f2-df5b3c5433e6 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308 tempest-FlavorsExtraSpecsNegativeTestJSON-94053308-project] 10.222.0.41 "PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014297 Nov 20 20:53:20.053005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1235/2501] 10.222.0.41 () {60 vars in 1264 bytes} [Sat Nov 20 20:53:20 2021] PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:20.061196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61a53758-4ac9-4b7b-8428-fef2f7033254 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.063004 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:20.063004 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:20.079326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-61a53758-4ac9-4b7b-8428-fef2f7033254 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] HTTP exception thrown: Flavor 1961633419 has no extra specs with key hw:cpu_thread_policy. Nov 20 20:53:20.080068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61a53758-4ac9-4b7b-8428-fef2f7033254 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Returning 404 to user: Flavor 1961633419 has no extra specs with key hw:cpu_thread_policy. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:20.081175 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61a53758-4ac9-4b7b-8428-fef2f7033254 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1961633419/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.029580 Nov 20 20:53:20.086375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1267/2502] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:53:20 2021] DELETE /compute/v2.1/flavors/1961633419/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:20.091032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.093268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:20.097354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-184f1fb3-9553-41ad-b652-5aef607b3705 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.120099 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:20.120099 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:20.122365 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-184f1fb3-9553-41ad-b652-5aef607b3705 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 20 20:53:20.122977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-184f1fb3-9553-41ad-b652-5aef607b3705 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:20.124797 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-184f1fb3-9553-41ad-b652-5aef607b3705 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.036567 Nov 20 20:53:20.134044 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1268/2503] 10.222.0.41 () {60 vars in 1264 bytes} [Sat Nov 20 20:53:20 2021] PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:53:20.135882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.136593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.142700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.147244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.161188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aebafcad-a64e-4bca-a520-e8b9305b6aac tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.163885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aebafcad-a64e-4bca-a520-e8b9305b6aac tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:20.187167 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aebafcad-a64e-4bca-a520-e8b9305b6aac tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.028207 Nov 20 20:53:20.187849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1269/2504] 10.222.0.41 () {60 vars in 1264 bytes} [Sat Nov 20 20:53:20 2021] PUT /compute/v2.1/flavors/1961633419/os-extra_specs/hw:numa_nodes => generated 117 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:53:20.203803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.204735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:20.261206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.261678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.264427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.268730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.374402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3ef30c54-5655-44c6-810b-29ad68fb7819 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.182978 Nov 20 20:53:20.375695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1270/2505] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:20 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:20.385503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78036487-fbd3-4f74-b279-bcc0631f0c4f tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.386631 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:20.386631 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:20.436590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78036487-fbd3-4f74-b279-bcc0631f0c4f tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1961633419" status: 202 len: 0 microversion: 2.1 time: 0.059071 Nov 20 20:53:20.438951 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1271/2506] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 20:53:20 2021] DELETE /compute/v2.1/flavors/1961633419 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:20.445421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75f5a3c3-ea23-45e2-969c-f795b62bb36f tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.503320 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75f5a3c3-ea23-45e2-969c-f795b62bb36f tempest-FlavorsExtraSpecsNegativeTestJSON-838506461 tempest-FlavorsExtraSpecsNegativeTestJSON-838506461-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061315 Nov 20 20:53:20.506190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1272/2507] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:20 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:20.522979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-31828a82-2b08-47c8-ba02-6281d6656ca7 req-5e394084-9c49-4754-a6a9-6e030807bd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b84b6d-5fc9-4c6b-944f-85135e5a1c3d", "tag": "b27e869e-b0e4-471a-842c-5c09b72dcda5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:20.524819 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:20.524819 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:20.538811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-31828a82-2b08-47c8-ba02-6281d6656ca7 req-5e394084-9c49-4754-a6a9-6e030807bd20 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.539582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-31828a82-2b08-47c8-ba02-6281d6656ca7 req-5e394084-9c49-4754-a6a9-6e030807bd20 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.566805 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-31828a82-2b08-47c8-ba02-6281d6656ca7 req-5e394084-9c49-4754-a6a9-6e030807bd20 service nova] Creating event network-changed:b27e869e-b0e4-471a-842c-5c09b72dcda5 for instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d on nch1-master-1 Nov 20 20:53:20.581779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-31828a82-2b08-47c8-ba02-6281d6656ca7 req-5e394084-9c49-4754-a6a9-6e030807bd20 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074169 Nov 20 20:53:20.583012 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1273/2508] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:20.588094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.589019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:20.607774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.608439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.609424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.610678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.784004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:20.792867 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6763e71f-a061-44f9-a660-df51973ebc81 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.708325 Nov 20 20:53:20.807102 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1236/2509] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:20 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:20.816432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:20.819498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:20.840195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.840997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:20.843448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:20.844780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:21.373205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:21.383901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:21.387499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffe9dfed-a095-4a15-a467-ad797d3b17f1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.577426 Nov 20 20:53:21.393189 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1237/2510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:20 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:21.399212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3294f145-2022-4a78-9a94-e3ad28a11466 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.814726 Nov 20 20:53:21.407361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4c267e7-c137-4481-a622-2013efaeec42 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f878b91f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:21.409794 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1274/2511] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:20 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:21.414597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:21.415522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:21.445928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:21.450789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:21.451874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:21.452525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:21.485014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4c267e7-c137-4481-a622-2013efaeec42 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1427 microversion: 2.1 time: 0.089813 Nov 20 20:53:21.485969 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1238/2512] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:21 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:21.540835 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf4d8127-59c8-4923-8191-4eb64ae44eae tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.129628 Nov 20 20:53:21.544072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1275/2513] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:21 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:21.816296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:21.817217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:21.826212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:21.827252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:21.828356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:21.829051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:22.110424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:22.118444 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d92de15-e70f-4ae6-a07b-53231025cc82 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.305841 Nov 20 20:53:22.119020 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1239/2514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:21 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:22.410763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:22.416291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:22.416929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:22.418549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:22.430995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:22.437763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:22.440827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:22.442006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:22.442905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:22.443775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:22.444220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:22.450911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:22.900252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:22.910714 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1594c8a8-3c1a-4662-8116-808277577968 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.497966 Nov 20 20:53:22.913647 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1240/2515] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:22 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:22.920645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09c5caa2-3fa2-4558-aba5-e277dfef6578 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f8705e5e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:23.000597 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09c5caa2-3fa2-4558-aba5-e277dfef6578 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1436 microversion: 2.1 time: 0.085343 Nov 20 20:53:23.001667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1241/2516] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:22 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1436 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:23.007469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:23.008509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:23.016382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.017308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.018326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.018926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.071109 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51bc1d51-bc2e-4d79-bde7-7128b2314e81 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.067303 Nov 20 20:53:23.071932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1242/2517] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:23 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:23.078522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3726050-5f51-48dc-941a-2829539906a7", "tag": "d2ec2066-92dd-4bf1-94cf-530a3c89abb1"}, {"name": "network-changed", "server_uuid": "0ffe6a66-af8a-40dc-bb9e-a37fd916c78b", "tag": "c6e0c110-4765-4766-bc45-55c8c3a214d9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:23.080395 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:23.080395 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:23.094982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.094982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.111049 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] Creating event network-changed:d2ec2066-92dd-4bf1-94cf-530a3c89abb1 for instance a3726050-5f51-48dc-941a-2829539906a7 on nch1-master-1 Nov 20 20:53:23.111727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] Creating event network-changed:c6e0c110-4765-4766-bc45-55c8c3a214d9 for instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b on nch1-master-1 Nov 20 20:53:23.117987 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c6cac018-c979-432d-922f-f28d2c2632f4 req-4fdf0866-1387-4634-9cd2-0c70d59bf61c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044083 Nov 20 20:53:23.119169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1243/2518] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:23 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:23.125450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5f6ac82-489c-44bb-8a9b-762103da88c2 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f8705e940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:23.177309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5f6ac82-489c-44bb-8a9b-762103da88c2 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 200 len: 1436 microversion: 2.1 time: 0.056945 Nov 20 20:53:23.178326 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1244/2519] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:23 2021] GET /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 1436 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:23.184019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:23.185815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:23.194091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.194712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.195594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.196421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.461522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:23.470690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95f88127-f509-427f-a04b-319afc07833b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 1.064723 Nov 20 20:53:23.471399 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1276/2520] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:22 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:23.487662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:23.488290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:23.494850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.495300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.496552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.497343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.551654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:23.559971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54e7190e-2476-4c8e-b37d-ae260859608e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.380059 Nov 20 20:53:23.560937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1245/2521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:23 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:23.930273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:23.930875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:23.953657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.954193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:23.955180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:23.955785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:24.221237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:24.229503 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2dadecd8-3811-47ec-9836-ccafe8deffa5 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1465 microversion: 2.1 time: 0.756793 Nov 20 20:53:24.233518 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1277/2522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:23 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1465 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:24.241983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:24.249115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:24.260887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:24.276588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:24.280259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9bd1d01a-2acb-43dc-a787-0f4e75033475 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.353498 Nov 20 20:53:24.280933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:24.282264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1246/2523] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:23 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:24.283674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:24.286370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:24.299164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c629996-e8d6-4490-abc0-259290385a33 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f87046040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:24.385754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed7b4787-e84c-4743-aa39-38a73479e8d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.149663 Nov 20 20:53:24.388345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1278/2524] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:24.488991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:24.490723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:24.501133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:24.502105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:24.503447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:24.504303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.256295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:25.273651 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d82694a-edfc-48ce-b056-ab5f09ec57e2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.788650 Nov 20 20:53:25.276741 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1279/2525] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:24 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:25.288340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:25.291389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:25.314856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.316070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.319471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.321155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.510275 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c629996-e8d6-4490-abc0-259290385a33 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "DELETE /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765" status: 204 len: 0 microversion: 2.1 time: 1.226625 Nov 20 20:53:25.511223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1247/2526] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:24 2021] DELETE /compute/v2.1/images/d0c697db-1396-4ebd-968b-af9a604ff765 => generated 0 bytes in 1228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:53:25.517447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-33fcb14e-cf4f-452b-b9d2-46d2652ba0c5 req-8233ce91-0f5c-4388-a34c-a3584b1a33d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6487b68e-a322-49ab-916e-23d4e8908b45", "tag": "b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:25.522617 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:25.522617 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:25.542399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-33fcb14e-cf4f-452b-b9d2-46d2652ba0c5 req-8233ce91-0f5c-4388-a34c-a3584b1a33d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.544267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-33fcb14e-cf4f-452b-b9d2-46d2652ba0c5 req-8233ce91-0f5c-4388-a34c-a3584b1a33d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.568368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-33fcb14e-cf4f-452b-b9d2-46d2652ba0c5 req-8233ce91-0f5c-4388-a34c-a3584b1a33d9 service nova] Creating event network-changed:b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6 for instance 6487b68e-a322-49ab-916e-23d4e8908b45 on nch2-master-1 Nov 20 20:53:25.580325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-33fcb14e-cf4f-452b-b9d2-46d2652ba0c5 req-8233ce91-0f5c-4388-a34c-a3584b1a33d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067103 Nov 20 20:53:25.585767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1248/2527] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:25.595061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:25.595767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:25.615716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.616359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.619536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.620158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.803172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:25.811924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c40196f4-bca3-4564-ae4b-29d7c3b05eeb tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.532445 Nov 20 20:53:25.813156 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1280/2528] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:25 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:25.818580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9b836a79-f5f3-430c-8d4c-145e1ddfc49e req-34fc6c0c-f485-4014-9576-b405a560bfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-unplugged", "status": "completed", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:25.820965 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:25.820965 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:25.830827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9b836a79-f5f3-430c-8d4c-145e1ddfc49e req-34fc6c0c-f485-4014-9576-b405a560bfe1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.832123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9b836a79-f5f3-430c-8d4c-145e1ddfc49e req-34fc6c0c-f485-4014-9576-b405a560bfe1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.848200 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9b836a79-f5f3-430c-8d4c-145e1ddfc49e req-34fc6c0c-f485-4014-9576-b405a560bfe1 service nova] Creating event network-vif-unplugged:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:53:25.853631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9b836a79-f5f3-430c-8d4c-145e1ddfc49e req-34fc6c0c-f485-4014-9576-b405a560bfe1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038644 Nov 20 20:53:25.855248 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1281/2529] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:25.862450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:25.864392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:25.873567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.874295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.875686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:25.876294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:25.929423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2191a53b-5294-466b-a987-5d4ebf8bfe48 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.072073 Nov 20 20:53:25.931815 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1282/2530] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:25 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:25.943393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24331330-cb39-4246-a121-7f14f4c108ce tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '.version_select at 0x7f3f98df1790>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:25.988428 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-24331330-cb39-4246-a121-7f14f4c108ce tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] HTTP exception thrown: Image not found. Nov 20 20:53:25.989039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24331330-cb39-4246-a121-7f14f4c108ce tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:25.989920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-24331330-cb39-4246-a121-7f14f4c108ce tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "DELETE /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503" status: 404 len: 62 microversion: 2.1 time: 0.056371 Nov 20 20:53:25.993849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1283/2531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:25 2021] DELETE /compute/v2.1/images/87e7b883-4dc3-4eea-bade-bb4a4e944503 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:53:25.999975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.000601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:26.017827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.018331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.019399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.019842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.067937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:53:26.133898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:26.143520 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-585dd7e0-87c4-4717-b1ae-c9d3779acf6a tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.555632 Nov 20 20:53:26.159091 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1249/2532] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:25 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:26.260626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35ae1171-112f-4708-93ea-f3c275fe0428 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 204 len: 0 microversion: 2.1 time: 0.264491 Nov 20 20:53:26.262455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1284/2533] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:53:25 2021] DELETE /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:53:26.272872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.275158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:26.286606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.287260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.288627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.289231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.425639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Calling method '.version_select at 0x7f3f87a3f820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.426707 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:26.426707 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:26.428500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.429544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.455601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.456310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.481077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.481761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.491968 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e03a555-52f5-4a94-93a9-3e6fe8faa36f tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.295314 Nov 20 20:53:26.493258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1250/2534] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:53:26.502073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.503604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:26.518195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.520128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.521163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.521779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.726823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:26.743827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2b6932d3-9800-450f-92f6-0529d775db6a tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1471 microversion: 2.1 time: 0.476272 Nov 20 20:53:26.757561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1285/2535] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1471 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:26.782506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Calling method '.version_select at 0x7f3f98c3d310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.784923 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:26.784923 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:26.787669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.788383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.818981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.820468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.869670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:26.879582 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37c1ab08-74d7-4ada-a135-c6e7c253fef0 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.384997 Nov 20 20:53:26.880432 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1251/2536] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:26.882161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.882742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.889677 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a38fde11-93bf-4375-b73e-cc83a47547ca tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.130352 Nov 20 20:53:26.890463 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1286/2537] 10.222.0.41 () {58 vars in 1211 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 591 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:26.891893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.892509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:26.900508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.900959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.901758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.902265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.904759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Calling method '.version_select at 0x7f3f98df14c0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:26.906525 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:26.906525 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:26.910130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.910735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.934661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.935288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.959399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.959974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.967264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20bf0547-e5a0-482d-84b9-305318f3f31c tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067557 Nov 20 20:53:26.968326 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1287/2538] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:53:26.975943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:26.977212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:26.990798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.991431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:26.992252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:26.992692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.059136 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6df7857-5fac-40fe-90bb-7a32778c2e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.088882 Nov 20 20:53:27.060545 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1288/2539] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:26 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:27.072398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Calling method '.version_select at 0x7f3f98dbf5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:27.073486 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:27.073486 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:27.076577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.077231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.116862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.124471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.135417 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13a7f33d-6404-406e-a3c2-2779f09fe7bb tempest-HypervisorAdminUnderV252Test-771583160 tempest-HypervisorAdminUnderV252Test-771583160-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.073033 Nov 20 20:53:27.143658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1289/2540] 10.222.0.41 () {58 vars in 1208 bytes} [Sat Nov 20 20:53:27 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:27.166283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:27.167156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:27.175890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.178553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.181247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.182091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.234331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:27.242312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e8ce421-88ba-4f06-98a2-be434db41bd4 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.360426 Nov 20 20:53:27.242897 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1252/2541] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:26 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:27.488933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:27.499966 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c79cbca-effa-4348-ab04-4ed5aec76e30 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.337529 Nov 20 20:53:27.508033 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1290/2542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:27 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:27.728584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-945085608", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7c0e623a-f529-4e97-805b-d4b7151232ec"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:27.777443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:27.778759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:27.789853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.791238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] validate_networks() for [('7c0e623a-f529-4e97-805b-d4b7151232ec', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:27.791799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.793313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:27.794266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:27.997795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:28.006723 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a3062b3-da5a-49a0-915c-508f2e8de311 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1471 microversion: 2.1 time: 0.235766 Nov 20 20:53:28.008373 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1291/2543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:27 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:28.022852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:28.024592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:28.033662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.034450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.036096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.036705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.229271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:28.240448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-366ab7a3-773e-413f-a3d5-3013ff2a031c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.230374 Nov 20 20:53:28.241038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1292/2544] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:28 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:28.247247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:28.248228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:28.255762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.256324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.257193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.257615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.316121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72c45858-ce5e-4d87-b04d-08ca542ba9d5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.072636 Nov 20 20:53:28.317890 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1293/2545] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:28 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:28.325376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:28.326410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:28.329945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:28.330517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:28.331144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:28.331658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:28.332172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:28.336474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.337103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.338310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.338926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.343364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.343889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.344790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.345282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.364121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Getting quotas for project 59c483cdab9f4467a9c5bdd3b6c8357e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:28.369748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Getting quotas for user 01a808360bed4a0fb23cfab904c97a85 and project 59c483cdab9f4467a9c5bdd3b6c8357e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:28.382900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:28.385618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:28.452925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a7291d2-559f-4657-b4a3-57ca29cab8ae tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.875315 Nov 20 20:53:28.462110 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1253/2546] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:53:28.467833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d0f47c2-5124-4909-9b3e-5a81db7a42cd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:28.468721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d0f47c2-5124-4909-9b3e-5a81db7a42cd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:28.533559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4d0f47c2-5124-4909-9b3e-5a81db7a42cd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:28.544571 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d0f47c2-5124-4909-9b3e-5a81db7a42cd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1222 microversion: 2.1 time: 0.080754 Nov 20 20:53:28.545474 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1254/2547] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:28 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:28.550505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:28.551287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:28.558110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.558927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.560038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.560671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.594139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:28.605199 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e9bdeb8-82f9-46c8-a29a-9e8928750448 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.283460 Nov 20 20:53:28.606656 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1294/2548] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:28 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:28.827781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:28.838037 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb535e8c-d25b-4ba0-8590-4fce123e269f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.291201 Nov 20 20:53:28.841096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1255/2549] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:28 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:28.893357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-755876d9-4c26-4db8-af0e-17d0d384f76d req-3643efdc-1a94-4cc1-a54b-889279f672e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b84b6d-5fc9-4c6b-944f-85135e5a1c3d", "name": "network-vif-plugged", "status": "completed", "tag": "b27e869e-b0e4-471a-842c-5c09b72dcda5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:28.895427 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:28.895427 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:28.918721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-755876d9-4c26-4db8-af0e-17d0d384f76d req-3643efdc-1a94-4cc1-a54b-889279f672e7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:28.919900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-755876d9-4c26-4db8-af0e-17d0d384f76d req-3643efdc-1a94-4cc1-a54b-889279f672e7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:28.953469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-755876d9-4c26-4db8-af0e-17d0d384f76d req-3643efdc-1a94-4cc1-a54b-889279f672e7 service nova] Creating event network-vif-plugged:b27e869e-b0e4-471a-842c-5c09b72dcda5 for instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d on nch1-master-1 Nov 20 20:53:28.963154 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-755876d9-4c26-4db8-af0e-17d0d384f76d req-3643efdc-1a94-4cc1-a54b-889279f672e7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073740 Nov 20 20:53:28.966264 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1295/2550] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:29.024961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:29.025841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.035517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.039475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.040765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.041558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.261084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:29.262611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.288019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.289111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.290588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.294320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.407188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:29.418559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3aaa1d6-7c65-4a2b-94c5-0a3570c095ac tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1471 microversion: 2.1 time: 0.396800 Nov 20 20:53:29.419141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1256/2551] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:29 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:29.424877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:29.426547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.433461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.436543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.437618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.438286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.523685 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-362c774f-d0b1-4c2e-bf25-6a0809fc9ead tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.102002 Nov 20 20:53:29.525217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1257/2552] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:29 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:29.564453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:29.565154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.588711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.589170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.590639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.600518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.665842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:29.676787 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4c02d39-619b-4e97-9861-4b08b676c787 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.419669 Nov 20 20:53:29.688648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1296/2553] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:29 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:29.694810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:29.696229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.702898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.703582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.704560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.705223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.761005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:29.769943 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54e2c563-ab17-4eea-bd6b-b3a2b6b997da tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1218 microversion: 2.1 time: 0.212817 Nov 20 20:53:29.784134 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1258/2554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:29 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:29.791622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0e066f4f-99da-4f0a-9a70-e3e5935d9739 req-33fc0c52-6aa6-45d5-b850-9ba4a689be5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5d2876-ea4f-4e03-a581-1d45371ac7ec", "name": "network-vif-deleted", "tag": "26b2f2b5-9423-4dba-bae3-4bdfc4373120"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:29.795145 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:29.795145 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:29.809473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0e066f4f-99da-4f0a-9a70-e3e5935d9739 req-33fc0c52-6aa6-45d5-b850-9ba4a689be5d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.810232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0e066f4f-99da-4f0a-9a70-e3e5935d9739 req-33fc0c52-6aa6-45d5-b850-9ba4a689be5d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.832177 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0e066f4f-99da-4f0a-9a70-e3e5935d9739 req-33fc0c52-6aa6-45d5-b850-9ba4a689be5d service nova] Creating event network-vif-deleted:26b2f2b5-9423-4dba-bae3-4bdfc4373120 for instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec on nch2-master-1 Nov 20 20:53:29.844675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0e066f4f-99da-4f0a-9a70-e3e5935d9739 req-33fc0c52-6aa6-45d5-b850-9ba4a689be5d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058877 Nov 20 20:53:29.846793 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1259/2555] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:29.858753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:29.868122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:29.880761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.884361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.890393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:29.892992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:29.958097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:29.969465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9c26730-a23a-421e-ab93-dc70db3d37d2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1315 microversion: 2.1 time: 0.279051 Nov 20 20:53:29.973070 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1297/2556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:29 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:30.113091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:30.137558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a140fac9-3491-42a3-a8c1-853739b15bb4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.280475 Nov 20 20:53:30.143189 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1260/2557] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:29 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:30.443957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:30.444673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:30.458271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.462691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.465984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.469841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.536367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:30.538119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:30.561127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.573112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.574479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.574626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.575722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lazy-loading 'fault' on Instance uuid 2a5d2876-ea4f-4e03-a581-1d45371ac7ec {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:53:30.578132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.578760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.632413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f33044b-45b7-4067-bc2c-d794b9d8673a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.099322 Nov 20 20:53:30.634131 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1261/2558] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:30 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:53:30.642814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee1e5b42cae4b57a2b191ff14f10b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d37f61bf9c4afcb21e044f0d2da2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:30.651536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13ee27c9-ec22-4926-8492-e94346ecd723 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 200 len: 1306 microversion: 2.1 time: 0.217766 Nov 20 20:53:30.654096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1298/2559] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:30 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 1306 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:30.695150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:30.696113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:30.704075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.704531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.705562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.706273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.789369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:30.790463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:30.802433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.804879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.806780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.811258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.903480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:30.912330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-737a8627-f1c6-493f-8be0-bbedb8c04da9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.221398 Nov 20 20:53:30.922653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:30.922841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1262/2560] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:30 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:30.929944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d143803-2e3c-48b5-947a-1d02a461d65b tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1280 microversion: 2.1 time: 0.144367 Nov 20 20:53:30.932488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1299/2561] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:30 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:30.989758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:30.990429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:30.998559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:30.999006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:30.999793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.000223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.157038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:31.157667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:31.178543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.180267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.181520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.183372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.216417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:31.227659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19c4772b-2446-4ca1-8665-c8dbc132a781 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1502 microversion: 2.1 time: 0.241680 Nov 20 20:53:31.230823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1263/2562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:30 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:31.254869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-467267317"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:31.255611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:31.270417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.271215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.272298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.273706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.464278 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.security_group_api [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Adding security group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 to port b27e869e-b0e4-471a-842c-5c09b72dcda5 Nov 20 20:53:31.540272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:31.552281 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce0ec4e4-c2f6-464a-a279-c31d6cc6904c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.400906 Nov 20 20:53:31.553510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1300/2563] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:31 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:31.558547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-97db9c6e-d629-4fa3-978f-3f01df0204e1 req-a795b70d-5698-462b-a6bf-a2fedb7d6540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6487b68e-a322-49ab-916e-23d4e8908b45", "name": "network-vif-plugged", "status": "completed", "tag": "b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:31.564237 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:31.564237 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:31.580025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-97db9c6e-d629-4fa3-978f-3f01df0204e1 req-a795b70d-5698-462b-a6bf-a2fedb7d6540 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.580570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-97db9c6e-d629-4fa3-978f-3f01df0204e1 req-a795b70d-5698-462b-a6bf-a2fedb7d6540 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.593888 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-97db9c6e-d629-4fa3-978f-3f01df0204e1 req-a795b70d-5698-462b-a6bf-a2fedb7d6540 service nova] Creating event network-vif-plugged:b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6 for instance 6487b68e-a322-49ab-916e-23d4e8908b45 on nch2-master-1 Nov 20 20:53:31.600257 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-97db9c6e-d629-4fa3-978f-3f01df0204e1 req-a795b70d-5698-462b-a6bf-a2fedb7d6540 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045105 Nov 20 20:53:31.602712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1301/2564] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:31.664686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:31.670942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:31.705652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.707960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.712453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.713491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.847334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02a94826-6aaa-4e6d-a4b6-44fe75708e2c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.205907 Nov 20 20:53:31.849561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1302/2565] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:31 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:53:31.858575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:31.865525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] [instance: 2a5d2876-ea4f-4e03-a581-1d45371ac7ec] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:31.893676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.896121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.896962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:31.897405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:31.946345 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] HTTP exception thrown: Instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec could not be found. Nov 20 20:53:31.946972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] Returning 404 to user: Instance 2a5d2876-ea4f-4e03-a581-1d45371ac7ec could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:31.950471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c9bc4d6-18ce-4e82-9b5c-9a17c6badfc6 tempest-ImagesOneServerTestJSON-113813355 tempest-ImagesOneServerTestJSON-113813355-project] 10.222.0.41 "GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec" status: 404 len: 111 microversion: 2.1 time: 0.098937 Nov 20 20:53:31.952920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1303/2566] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:31 2021] GET /compute/v2.1/servers/2a5d2876-ea4f-4e03-a581-1d45371ac7ec => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:32.220794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-128a0e64-fcdd-4666-a8e3-13e40712505e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action" status: 202 len: 0 microversion: 2.1 time: 0.976383 Nov 20 20:53:32.222162 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1264/2567] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:31 2021] POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:32.233179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:32.234319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:32.242770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.243637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.244962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.245727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.262148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Calling method '.version_select at 0x7f3f98d45700>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:32.263452 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:32.263452 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:32.265154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.265636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.298466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.299567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.313032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.313912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.324157 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-509fd36d-1450-430a-8007-342c6c3a8d2d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.369472 Nov 20 20:53:32.326497 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1304/2568] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:31 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:32.333619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:32.334696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:32.343710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.344616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.345663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.346317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.501958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:32.511884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38ffb827-b93b-4bd4-a7c8-20b24dbe1b26 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.284236 Nov 20 20:53:32.516642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1265/2569] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:32 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:32.542338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d7f2964-d92c-437c-b80b-e584156dab5f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f87a85a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:32.696832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-5d7f2964-d92c-437c-b80b-e584156dab5f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 in use.", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:32.697721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5d7f2964-d92c-437c-b80b-e584156dab5f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security Group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 in use. Nov 20 20:53:32.697721 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-0dac06d3-ea5d-4fb9-8c73-39e750f69458'] Nov 20 20:53:32.698515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d7f2964-d92c-437c-b80b-e584156dab5f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 400 to user: Security Group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 in use. Nov 20 20:53:32.698515 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-0dac06d3-ea5d-4fb9-8c73-39e750f69458'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:32.699646 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d7f2964-d92c-437c-b80b-e584156dab5f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71" status: 400 len: 185 microversion: 2.1 time: 0.180459 Nov 20 20:53:32.700950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1266/2570] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:32 2021] DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71 => generated 185 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:53:32.707907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-18360e26-7f7f-4464-a1b9-822996cdd24b req-8396b2a6-8f99-45ec-bcee-3848d88d1e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b84b6d-5fc9-4c6b-944f-85135e5a1c3d", "tag": "b27e869e-b0e4-471a-842c-5c09b72dcda5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:32.714339 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:32.714339 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:32.736981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-18360e26-7f7f-4464-a1b9-822996cdd24b req-8396b2a6-8f99-45ec-bcee-3848d88d1e32 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.738709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-18360e26-7f7f-4464-a1b9-822996cdd24b req-8396b2a6-8f99-45ec-bcee-3848d88d1e32 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.755458 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-18360e26-7f7f-4464-a1b9-822996cdd24b req-8396b2a6-8f99-45ec-bcee-3848d88d1e32 service nova] Creating event network-changed:b27e869e-b0e4-471a-842c-5c09b72dcda5 for instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d on nch1-master-1 Nov 20 20:53:32.764924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-18360e26-7f7f-4464-a1b9-822996cdd24b req-8396b2a6-8f99-45ec-bcee-3848d88d1e32 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062423 Nov 20 20:53:32.765583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1267/2571] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:32.882856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:32.893301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d9f54ad-8598-47ce-81f4-69554f10ea04 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.565345 Nov 20 20:53:32.899347 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1305/2572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:32 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:32.906292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:32.910539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:32.940094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.942172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:32.948404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:32.949726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.091626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ea6096d-7a29-4ac0-ab26-7295ffc9ce32 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Calling method '.version_select at 0x7f3f87ac43a0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:33.094935 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:33.094935 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:33.096748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ea6096d-7a29-4ac0-ab26-7295ffc9ce32 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd55c3122392048479bcb76fa5abce4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fd88702e204a63bf76331f666e6038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:33.102508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ea6096d-7a29-4ac0-ab26-7295ffc9ce32 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:33.107019 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ea6096d-7a29-4ac0-ab26-7295ffc9ce32 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.338137 Nov 20 20:53:33.108948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1268/2573] 10.222.0.41 () {58 vars in 1208 bytes} [Sat Nov 20 20:53:32 2021] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 342 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:33.126597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:33.128888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:33.149143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.151302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.155056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.156959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.375423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9f74b62-59de-4f6f-a32f-e578951723a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action" status: 202 len: 0 microversion: 2.1 time: 0.262913 Nov 20 20:53:33.377588 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1269/2574] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:33 2021] POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:33.415363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:33.421520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:33.441647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.443494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.445748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.446475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.499711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:33.508379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ead51496-c6e1-429d-b1ef-8c704deff137 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1318 microversion: 2.1 time: 0.607430 Nov 20 20:53:33.510589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7deb2cd1-8e34-46e6-b079-42828f95ca7b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.118922 Nov 20 20:53:33.516777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1270/2575] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:33 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:33.519806 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1306/2576] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:32 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:33.523800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Calling method '.version_select at 0x7f3f8705e5e0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:33.524639 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:33.524639 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:33.531415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.531936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.542514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:33.543921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:33.550420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.551154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.552234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.552912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.559265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 20 20:53:33.560044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:33.568726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81e3d175-096d-4a53-bb79-169004b81af7 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.050658 Nov 20 20:53:33.575183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1271/2577] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 20:53:33 2021] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:33.580651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:33.581610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:33.615881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.619629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.622462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.623176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.836296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:33.844819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c4c36dc4-8508-4d27-9ca2-0cdd055a2d13 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.268066 Nov 20 20:53:33.846932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1272/2578] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:33 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:33.852767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Calling method '.version_select at 0x7f3f87017d30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:33.853552 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:33.853552 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:33.874325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.874848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.906253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.906697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.933551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.934107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:33.950429 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dacb4972-e731-4a13-8e1e-ce0e60cd797d tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.101369 Nov 20 20:53:33.951328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1273/2579] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:53:33 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:33.969072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe6a66-af8a-40dc-bb9e-a37fd916c78b", "name": "network-vif-plugged", "status": "completed", "tag": "c6e0c110-4765-4766-bc45-55c8c3a214d9"}, {"server_uuid": "a3726050-5f51-48dc-941a-2829539906a7", "name": "network-vif-plugged", "status": "completed", "tag": "d2ec2066-92dd-4bf1-94cf-530a3c89abb1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:33.972076 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:33.972076 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:33.983722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:33.984794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.001315 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] Creating event network-vif-plugged:c6e0c110-4765-4766-bc45-55c8c3a214d9 for instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b on nch1-master-1 Nov 20 20:53:34.002239 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] Creating event network-vif-plugged:d2ec2066-92dd-4bf1-94cf-530a3c89abb1 for instance a3726050-5f51-48dc-941a-2829539906a7 on nch1-master-1 Nov 20 20:53:34.011591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3f9cff92-b71a-42cf-96cb-6330528006ab req-7bea7dde-05ad-4672-adb9-c822803cc585 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051413 Nov 20 20:53:34.013314 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1274/2580] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:34.020369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.021291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:34.051216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.054301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.055257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.057001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.114998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:34.122757 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45933f8c-45f1-4519-a95d-223616bd3858 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1572 microversion: 2.1 time: 0.583837 Nov 20 20:53:34.123417 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1307/2581] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:33 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1572 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:34.130868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a7a59d3-79ad-4b22-a14d-2b0ddb40e793 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Calling method '.version_select at 0x7f3f98c3d310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.131961 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:34.131961 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:34.133647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a7a59d3-79ad-4b22-a14d-2b0ddb40e793 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd55c3122392048479bcb76fa5abce4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fd88702e204a63bf76331f666e6038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:34.134721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a7a59d3-79ad-4b22-a14d-2b0ddb40e793 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:34.135843 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a7a59d3-79ad-4b22-a14d-2b0ddb40e793 tempest-HypervisorAdminNegativeUnderV252Test-904556759 tempest-HypervisorAdminNegativeUnderV252Test-904556759-project] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011273 Nov 20 20:53:34.137580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1308/2582] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:34.153096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Calling method '.version_select at 0x7f3f98e09af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.159569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.160056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.186550 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] HTTP exception thrown: No hypervisor matching 'ad104364-808c-4eac-a810-1afe82d1e237' could be found. Nov 20 20:53:34.187159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] Returning 404 to user: No hypervisor matching 'ad104364-808c-4eac-a810-1afe82d1e237' could be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:34.188000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fdb80161-04ff-495a-acd7-23e61911faf9 tempest-HypervisorAdminNegativeUnderV252Test-1691923932 tempest-HypervisorAdminNegativeUnderV252Test-1691923932-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors/ad104364-808c-4eac-a810-1afe82d1e237/servers" status: 404 len: 123 microversion: 2.1 time: 0.045437 Nov 20 20:53:34.189810 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1309/2583] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/os-hypervisors/ad104364-808c-4eac-a810-1afe82d1e237/servers => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:34.201853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-dbf1e5ac-657a-4d19-9ae8-2aa94269f6c0 req-29d4460e-eb59-4168-8587-0648bc095c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:34.204081 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:34.204081 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:34.214134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dbf1e5ac-657a-4d19-9ae8-2aa94269f6c0 req-29d4460e-eb59-4168-8587-0648bc095c77 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.217777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dbf1e5ac-657a-4d19-9ae8-2aa94269f6c0 req-29d4460e-eb59-4168-8587-0648bc095c77 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.231587 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-dbf1e5ac-657a-4d19-9ae8-2aa94269f6c0 req-29d4460e-eb59-4168-8587-0648bc095c77 service nova] Creating event network-changed:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:53:34.240101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-dbf1e5ac-657a-4d19-9ae8-2aa94269f6c0 req-29d4460e-eb59-4168-8587-0648bc095c77 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047631 Nov 20 20:53:34.241279 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1310/2584] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:34.276335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:34.285847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99e44f8f-eac7-48b3-957a-7ffec19eecdd tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.270934 Nov 20 20:53:34.286863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1275/2585] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:34.525360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:34.526405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:34.541541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.543356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:34.550323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.550787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.553372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.553827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.554553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.554994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.555784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.556210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.630476 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c86d3221-b158-4d8f-a4e2-4678b085125e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.109508 Nov 20 20:53:34.631158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1311/2586] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:34.815716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:34.824340 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0e09752-c7a1-42f3-8989-22957782db3f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1468 microversion: 2.1 time: 0.288660 Nov 20 20:53:34.825292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1276/2587] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1468 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:34.842268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.842978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:34.850187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.850880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.851687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.852258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.868963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:34.870136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:34.879009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.879636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:34.882019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:34.883856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.042439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:35.049831 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db084b1a-c347-4b2a-9e98-77e49a3c9a06 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1308 microversion: 2.1 time: 0.188030 Nov 20 20:53:35.050449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1277/2588] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:35.140672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:35.141390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:35.147686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.148209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.149062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.149721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.296137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:35.306073 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ca974ce-6bef-4f71-aee5-cf38a17ab8ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1572 microversion: 2.1 time: 0.170213 Nov 20 20:53:35.306672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1278/2589] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:35 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:35.312566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:35.313312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:35.319711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.320503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.321774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.322503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.387067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:35.397925 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6b9b680-c48d-4772-9d33-6fe5d618e2b3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 200 len: 1318 microversion: 2.1 time: 0.560242 Nov 20 20:53:35.398891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1312/2590] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:34 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:35.701404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:35.702360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:35.710642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.711613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.712902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:35.713475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:35.756837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:35.778274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e4cbc48-d066-4e59-9acb-19121766f1f2 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.469835 Nov 20 20:53:35.781572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1279/2591] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:35 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:35.785375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bac8ec2e-97c0-45c4-a12d-4cc87cb023d2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.087972 Nov 20 20:53:35.786722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1313/2592] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:35 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:53:36.068588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:36.069206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:36.086203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.086658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.087483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.087931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.326553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:36.327404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:36.348166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.350491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.351858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.354159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.445199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:36.453236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-951b8e45-069d-4dfb-bc3c-917caac6d48e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1486 microversion: 2.1 time: 0.389665 Nov 20 20:53:36.466584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1280/2593] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:36 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1486 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:36.473547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:36.474558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:36.481242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.482303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.483329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.484001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.779651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:36.791263 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6da21aba-74e2-4e21-806f-929d38959bde tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1572 microversion: 2.1 time: 0.470486 Nov 20 20:53:36.792278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1314/2594] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:36 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1572 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:36.804666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:36.805573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:36.827896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.829011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.831792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.837202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.873167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:36.896488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2186c9ad-fcca-43e6-846b-4c50aa9d0edd tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 200 len: 1468 microversion: 2.1 time: 0.428075 Nov 20 20:53:36.896758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1281/2595] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:36 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 1468 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:36.903314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:36.904157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:36.906669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lazy-loading 'flavor' on Instance uuid 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:53:36.915060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.922345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:36.923711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:36.924416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.024733 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e1153c6-9204-4971-91a8-7fdbc9fb43ea tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b/action" status: 202 len: 0 microversion: 2.1 time: 0.228955 Nov 20 20:53:37.028346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1315/2596] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:36 2021] POST /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:37.044367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:37.046192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:37.055625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.057762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.059457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.060194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.127110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35ea7499-bf26-49f7-a0ce-79c2e66c432e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.099742 Nov 20 20:53:37.127950 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1316/2597] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:37 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:37.137035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.140536 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:37.140536 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:37.141547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:37.142418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Searching by: {'reservation_id': 'r-yt0i1scn', 'deleted': False, 'project_id': '60778bfeb31b496081c05ccc33a74a1c'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:53:37.148745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.149202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.150217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.150501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.251332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:53:37.264254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:37.276112 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbe28e53-2a61-4825-b4b7-969c9aea3327 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.377678 Nov 20 20:53:37.277022 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1282/2598] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:36 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:37.299118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.301466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:37.332313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.332925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.333783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.338322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.368145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:37.376712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.377176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.548279 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2af1c12-5ae1-4bbf-935f-2c5d11e239bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?reservation_id=r-yt0i1scn" status: 200 len: 2929 microversion: 2.1 time: 0.419229 Nov 20 20:53:37.548900 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1317/2599] 10.222.0.41 () {58 vars in 1196 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/servers/detail?reservation_id=r-yt0i1scn => generated 2929 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:37.567527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89a8802d-346c-4580-a447-3f52e9685052 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.584909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_groups [None req-89a8802d-346c-4580-a447-3f52e9685052 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Querying cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) for 2 instances {{(pid=140942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 20 20:53:37.585784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89a8802d-346c-4580-a447-3f52e9685052 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.586269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89a8802d-346c-4580-a447-3f52e9685052 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.609362 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89a8802d-346c-4580-a447-3f52e9685052 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups/898d9a64-5d27-48dd-85ce-7f7dfadfb0c1" status: 200 len: 271 microversion: 2.1 time: 0.045033 Nov 20 20:53:37.610565 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1318/2600] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/os-server-groups/898d9a64-5d27-48dd-85ce-7f7dfadfb0c1 => generated 271 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:53:37.622733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.623467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:37.641266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.641638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.642507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.643555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.673073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:37.682099 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b594954e-7f45-4105-9233-f5be2ed3be83 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1494 microversion: 2.1 time: 0.390382 Nov 20 20:53:37.685916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1283/2601] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:37.810906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.811758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:37.820572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.821188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.823170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.825142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.910579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b952e7c-4339-495b-93f0-bb23f951ca34 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1619 microversion: 2.1 time: 0.293152 Nov 20 20:53:37.912224 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1319/2602] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1619 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:37.931873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:37.932496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:37.944905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.945639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:37.946919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:37.947541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:38.154268 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e267996-e897-44e9-82d2-d74e36e0f3b7 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 200 len: 1619 microversion: 2.1 time: 0.226336 Nov 20 20:53:38.158525 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1320/2603] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 1619 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:38.195870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:38.198453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:38.215090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:38.215578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:38.230964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:38.231637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:38.269581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:38.282183 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dca69e8-e06f-482d-81ab-24ba0a718441 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1570 microversion: 2.1 time: 0.477133 Nov 20 20:53:38.295417 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1284/2604] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:37 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1570 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:38.301918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-213092299", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "d0202d45-4861-4548-b517-c5a02af49a0d"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:38.363295 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73ba2dcb-e6b6-4368-b584-0d37fe731e3c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.201904 Nov 20 20:53:38.367819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1321/2605] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:38 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:38.372468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:38.384792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1133960164"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:38.385063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:38.399539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:38.399990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:38.400791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:38.405484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:38.785132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.network.security_group_api [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Adding security group 58f803d7-6354-4590-bfe1-d1be79906a5e to port b27e869e-b0e4-471a-842c-5c09b72dcda5 Nov 20 20:53:39.113831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:39.114604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:39.115400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:39.116015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:39.116620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:39.141600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.142370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.144542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.145636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.191693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:39.205265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:39.236635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:39.243240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:39.358313 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbd4a3c3-16c3-4088-8c95-c69ad9748910 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061498 Nov 20 20:53:39.367677 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1285/2606] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:53:39.383023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:39.397297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:39.417349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.419787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.421892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.423014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.744978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e6678f1-77bf-4344-bdce-e0a65ea75cba tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action" status: 202 len: 0 microversion: 2.1 time: 1.379806 Nov 20 20:53:39.746819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1322/2607] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:38 2021] POST /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d/action => generated 0 bytes in 1382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:39.753079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:39.754181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:39.777466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.778877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.782998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:39.785018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:39.985764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:39.994753 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab34156a-fa28-4ad0-926a-82e6faeb3447 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.625568 Nov 20 20:53:39.995342 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1286/2608] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:39 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:40.011245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:40.012234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:40.038512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.038982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.039811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.043214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.114848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b68b4e09-d285-42ae-b37e-e2dac57206f1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.117466 Nov 20 20:53:40.117169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1287/2609] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:40.134000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8061848-b0ba-46aa-b7a4-ecdccd4a1260 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:40.138474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8061848-b0ba-46aa-b7a4-ecdccd4a1260 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:40.270488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:40.284651 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02c12685-96f4-41ae-9738-70fe931ca85c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 200 len: 1477 microversion: 2.1 time: 0.532932 Nov 20 20:53:40.285532 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1323/2610] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:39 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:40.292220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad9254e7-72b5-43b4-905e-e2482f36e57d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98c3d550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:40.308843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e8061848-b0ba-46aa-b7a4-ecdccd4a1260 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:40.318680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8061848-b0ba-46aa-b7a4-ecdccd4a1260 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1216 microversion: 2.1 time: 0.198116 Nov 20 20:53:40.319106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1288/2611] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:40 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1216 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:40.351862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-137a1693-dbd5-40c9-af6b-510f6c9878aa req-733fe749-1c34-41a6-a1c1-79897c18cf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b84b6d-5fc9-4c6b-944f-85135e5a1c3d", "tag": "b27e869e-b0e4-471a-842c-5c09b72dcda5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:40.353577 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:40.353577 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:40.364625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-137a1693-dbd5-40c9-af6b-510f6c9878aa req-733fe749-1c34-41a6-a1c1-79897c18cf3e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.370863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-137a1693-dbd5-40c9-af6b-510f6c9878aa req-733fe749-1c34-41a6-a1c1-79897c18cf3e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.401430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-137a1693-dbd5-40c9-af6b-510f6c9878aa req-733fe749-1c34-41a6-a1c1-79897c18cf3e service nova] Creating event network-changed:b27e869e-b0e4-471a-842c-5c09b72dcda5 for instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d on nch1-master-1 Nov 20 20:53:40.423210 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-137a1693-dbd5-40c9-af6b-510f6c9878aa req-733fe749-1c34-41a6-a1c1-79897c18cf3e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102324 Nov 20 20:53:40.423869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1289/2612] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:40.438559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1517753407"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:40.439752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:40.486962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.489418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.494042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.496434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.676189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-ad9254e7-72b5-43b4-905e-e2482f36e57d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 58f803d7-6354-4590-bfe1-d1be79906a5e in use.", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:40.677260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ad9254e7-72b5-43b4-905e-e2482f36e57d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security Group 58f803d7-6354-4590-bfe1-d1be79906a5e in use. Nov 20 20:53:40.677260 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-8356cd81-1baa-4f38-a2ed-0754f8572ece'] Nov 20 20:53:40.678485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad9254e7-72b5-43b4-905e-e2482f36e57d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 400 to user: Security Group 58f803d7-6354-4590-bfe1-d1be79906a5e in use. Nov 20 20:53:40.678485 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-8356cd81-1baa-4f38-a2ed-0754f8572ece'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:40.679976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad9254e7-72b5-43b4-905e-e2482f36e57d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e" status: 400 len: 185 microversion: 2.1 time: 0.391255 Nov 20 20:53:40.681124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1324/2613] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:40 2021] DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e => generated 185 bytes in 393 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:53:40.689327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:40.690390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:40.705025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.708816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.709680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.710159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:40.767793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:53:40.968504 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0dfaf52-17ae-4568-b77a-d95dacf6649e tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 204 len: 0 microversion: 2.1 time: 0.283102 Nov 20 20:53:40.972091 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1325/2614] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:53:40 2021] DELETE /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:53:40.985567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:40.986451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:40.997099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:40.998364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.000009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.001058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.099584 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d0393aa-ad4d-490d-8c1e-52448c03e24f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b/action" status: 202 len: 0 microversion: 2.1 time: 0.674218 Nov 20 20:53:41.126850 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1290/2615] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:40 2021] POST /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:53:41.137212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:41.138416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:41.161754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.162241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.163097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.163467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.610965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:41.618944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c26f30f-d120-416a-a856-5a8eb47cf84a tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1645 microversion: 2.1 time: 0.642633 Nov 20 20:53:41.622727 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1326/2616] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:40 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1645 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:41.627732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:41.635841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:41.649362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.650266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.651300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.652040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.671793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:41.680916 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0550279a-1e6b-4534-9198-2c674ae4d762 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.548122 Nov 20 20:53:41.685013 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1291/2617] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:41 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:41.696756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0223b06-13b8-4dc2-8999-536a5d031f7f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8703bf70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:41.740364 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-576be226-8b42-49f6-a2e4-19f5c81ffb26 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.115992 Nov 20 20:53:41.741046 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1327/2618] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:41.749954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:41.750719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:41.767327 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0223b06-13b8-4dc2-8999-536a5d031f7f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.081007 Nov 20 20:53:41.768505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.769857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.770697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:41.771219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:41.772963 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1292/2619] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:41 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:41.921852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:41.933836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed8ce96b-3810-4dfc-8bfd-2e75ca4f1626 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1274 microversion: 2.1 time: 0.191068 Nov 20 20:53:41.934450 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1328/2620] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:41 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:42.642296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:42.642912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:42.657575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:42.657575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:42.658312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:42.658773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:42.699896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:42.700906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:42.709327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:42.722867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:42.723977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:42.724607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:43.085006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:43.095965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5fb2af16-833f-490c-b817-ebe66b6e1235 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1645 microversion: 2.1 time: 0.457630 Nov 20 20:53:43.099496 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1293/2621] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:42 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1645 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:43.120045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:43.122453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:43.145258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:43.146006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:43.149609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:43.150345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:43.238042 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27cbdcca-cce8-4871-9b73-a3ea2b7b8e55 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.135556 Nov 20 20:53:43.239368 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1294/2622] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:43 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:43.257146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87e5ebea-a183-4649-b765-b4d28484a82e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8703b550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:43.349287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87e5ebea-a183-4649-b765-b4d28484a82e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.109264 Nov 20 20:53:43.349878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1295/2623] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:43 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:43.365402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:43.375457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:43.395269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:43.398152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:43.402689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:43.403237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:43.739244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:43.751903 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5837a727-e276-44d1-99b3-7ca8ac504fae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.398370 Nov 20 20:53:43.752780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1296/2624] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:43 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:43.912203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:43.921717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd6565ec-a0d8-495d-9581-70dd25f8d882 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 1.225868 Nov 20 20:53:43.928768 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1329/2625] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:42 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:44.045040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'create', calling method: .version_select at 0x7f3f8703b790>, body: {"keypair": {"name": "tempest-keypair-1934884332"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:44.070333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:44.076942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for user ffd18846beb2426998ae8a8188fdb333 and project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:44.116648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:44.117764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:44.125340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.126823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.129204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.130082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.229330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:44.248102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for user ffd18846beb2426998ae8a8188fdb333 and project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:44.275401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f4936da-5e7a-437f-a836-f6314a505f17 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.438110 Nov 20 20:53:44.287293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1297/2626] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:53:43 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:44.293739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:44.300433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:44.316550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.317296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.322119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.322973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.398199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07da400b-112b-49a1-970e-618482cc5f86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.108334 Nov 20 20:53:44.402368 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1298/2627] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:44 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:44.413001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3fcd4d3-f4d8-4043-895a-24abbfd44749 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f878b9dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:44.504745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3fcd4d3-f4d8-4043-895a-24abbfd44749 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.100514 Nov 20 20:53:44.505755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1299/2628] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:44 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:44.771452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:44.772736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:44.796560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.803492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.804584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:44.805322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:44.994251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:45.007001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f4713c1-bd9c-4044-92cb-930d22934081 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1645 microversion: 2.1 time: 0.891052 Nov 20 20:53:45.009919 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1330/2629] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:44 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1645 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:45.024788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:45.028325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:45.043889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:45.044830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:45.045873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:45.046521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:45.747809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:45.757536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14e5132b-43b0-4b47-9459-cf3db7db5779 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.743049 Nov 20 20:53:45.765598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1331/2630] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:45 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:45.789947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:45.791947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:45.813175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:45.813784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:45.815022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:45.815604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:45.876290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:45.887730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c11db4f-6b60-4ee2-b4ed-f3c935d16370 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 1.122433 Nov 20 20:53:45.888313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1300/2631] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:44 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:45.904570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b88cac4-8c7a-4a6f-90af-1089ee01fe99 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.136994 Nov 20 20:53:45.907065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24c49458-23ae-42ed-961a-195f98c91ab3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f878179d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:45.911811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1332/2632] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:45 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:45.923739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d7f807e3-df36-4bce-80e9-f4955957576a req-119ea377-42da-4451-b496-c37343b651ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b84b6d-5fc9-4c6b-944f-85135e5a1c3d", "name": "network-vif-deleted", "tag": "b27e869e-b0e4-471a-842c-5c09b72dcda5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:45.933495 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:45.933495 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:45.948856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d7f807e3-df36-4bce-80e9-f4955957576a req-119ea377-42da-4451-b496-c37343b651ef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:45.949826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d7f807e3-df36-4bce-80e9-f4955957576a req-119ea377-42da-4451-b496-c37343b651ef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:45.994690 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24c49458-23ae-42ed-961a-195f98c91ab3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.104939 Nov 20 20:53:45.996987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1301/2633] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:45 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:46.004308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d7f807e3-df36-4bce-80e9-f4955957576a req-119ea377-42da-4451-b496-c37343b651ef service nova] Creating event network-vif-deleted:b27e869e-b0e4-471a-842c-5c09b72dcda5 for instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d on nch1-master-1 Nov 20 20:53:46.025529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d7f807e3-df36-4bce-80e9-f4955957576a req-119ea377-42da-4451-b496-c37343b651ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111948 Nov 20 20:53:46.031985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:46.032914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:46.033500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1333/2634] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:46.251775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4b3cde8a-35be-492c-9f9a-f58ea39dc6a8 req-17a3ba43-16e3-481e-800a-19cf6e29d40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "name": "network-vif-plugged", "status": "completed", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:46.253766 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:46.253766 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:46.274080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4b3cde8a-35be-492c-9f9a-f58ea39dc6a8 req-17a3ba43-16e3-481e-800a-19cf6e29d40d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.285571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4b3cde8a-35be-492c-9f9a-f58ea39dc6a8 req-17a3ba43-16e3-481e-800a-19cf6e29d40d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.383492 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4b3cde8a-35be-492c-9f9a-f58ea39dc6a8 req-17a3ba43-16e3-481e-800a-19cf6e29d40d service nova] Creating event network-vif-plugged:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:53:46.413834 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4b3cde8a-35be-492c-9f9a-f58ea39dc6a8 req-17a3ba43-16e3-481e-800a-19cf6e29d40d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161215 Nov 20 20:53:46.417862 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1334/2635] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:46.563066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.563749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.564726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.566495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.653984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.655053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.655521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lazy-loading 'fault' on Instance uuid 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:53:46.783349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:46.784565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:46.796951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.799617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.804132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.804837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.905667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:46.921010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6996bc2a-80cf-4a1e-b584-f9ebfd089cdd tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 200 len: 1305 microversion: 2.1 time: 0.897405 Nov 20 20:53:46.921595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1302/2636] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:46 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 1305 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:46.941517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:46.946810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:46.970261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.970654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:46.973486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:46.978083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:47.305778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:47.317221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-192b08ed-2884-4eff-9551-016255c4c422 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 0.539263 Nov 20 20:53:47.324966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1335/2637] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:46 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:47.330572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:47.340628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:47.352949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:47.353954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:47.355165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:47.356043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:47.443813 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f74d675a-9b4c-4fda-b077-68bf0a0b178d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.117093 Nov 20 20:53:47.450801 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1336/2638] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:47 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:47.456625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-645cd069-95b0-4f41-a570-e48a9e8882bf tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693dee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:47.558521 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-645cd069-95b0-4f41-a570-e48a9e8882bf tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.106027 Nov 20 20:53:47.559436 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1337/2639] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:47 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:47.568088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:47.579801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6a240c6-f42e-4109-afd3-7919d3716979 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.652074 Nov 20 20:53:47.582946 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1303/2640] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:46 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:47.939288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:47.940205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:47.951867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:47.953049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:47.954278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:47.955134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:48.027594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. Nov 20 20:53:48.030629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:48.031831 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30d96708-f04e-49db-92ae-e7c487da61a2 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 404 len: 111 microversion: 2.1 time: 0.097071 Nov 20 20:53:48.034910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1338/2641] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:47 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:48.044658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c563e205-30cd-4747-ab22-d3df3a165353 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f87058820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:48.082894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f7baccd2-00f4-4c9c-b7d8-f5e2c0e56243 req-3ff37bb7-b514-41fb-b3b2-0fe6c2367455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b25af4d5-11da-4354-91b9-89a2490dea39", "tag": "48e83d26-e36f-40f3-b0cf-f124edaa6b06"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:48.086469 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:48.086469 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:48.102452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f7baccd2-00f4-4c9c-b7d8-f5e2c0e56243 req-3ff37bb7-b514-41fb-b3b2-0fe6c2367455 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:48.106883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f7baccd2-00f4-4c9c-b7d8-f5e2c0e56243 req-3ff37bb7-b514-41fb-b3b2-0fe6c2367455 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:48.134937 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f7baccd2-00f4-4c9c-b7d8-f5e2c0e56243 req-3ff37bb7-b514-41fb-b3b2-0fe6c2367455 service nova] Creating event network-changed:48e83d26-e36f-40f3-b0cf-f124edaa6b06 for instance b25af4d5-11da-4354-91b9-89a2490dea39 on nch2-master-1 Nov 20 20:53:48.147891 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f7baccd2-00f4-4c9c-b7d8-f5e2c0e56243 req-3ff37bb7-b514-41fb-b3b2-0fe6c2367455 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070537 Nov 20 20:53:48.150114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1339/2642] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:48.351739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:48.353363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:48.383697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:48.389657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:48.393076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:48.393539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.346765 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c563e205-30cd-4747-ab22-d3df3a165353 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71" status: 202 len: 0 microversion: 2.1 time: 1.307453 Nov 20 20:53:49.347894 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1304/2643] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:48 2021] DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71 => generated 0 bytes in 1309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:49.353051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:49.354381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:49.368752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:49.369422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.370719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:49.375782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.477440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e4725be-afe7-469f-bbbc-52e48cebe6ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.127981 Nov 20 20:53:49.478392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1305/2644] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:49 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:49.487690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a92061b-7256-41b9-b046-cedb10b1ee48 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86fe6e50>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:49.649703 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a92061b-7256-41b9-b046-cedb10b1ee48 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.169944 Nov 20 20:53:49.650961 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1306/2645] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:49 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:49.673613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:49.674990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:49.683047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:49.691652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.694000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:49.694000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.748667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:49.764310 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f4d7bd1f-b037-4b4e-ac8d-706c8b4896fc tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1322 microversion: 2.1 time: 1.420938 Nov 20 20:53:49.767305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1340/2646] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:48 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1322 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:49.790197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cb58bbc3-6457-46e3-bc5d-5e73951edd63 req-585e223c-94e0-48ff-9450-0adfdf53113f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe6a66-af8a-40dc-bb9e-a37fd916c78b", "name": "network-vif-plugged", "status": "completed", "tag": "c6e0c110-4765-4766-bc45-55c8c3a214d9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:49.801706 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:49.801706 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:49.831087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cb58bbc3-6457-46e3-bc5d-5e73951edd63 req-585e223c-94e0-48ff-9450-0adfdf53113f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:49.837860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cb58bbc3-6457-46e3-bc5d-5e73951edd63 req-585e223c-94e0-48ff-9450-0adfdf53113f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:49.883041 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cb58bbc3-6457-46e3-bc5d-5e73951edd63 req-585e223c-94e0-48ff-9450-0adfdf53113f service nova] Creating event network-vif-plugged:c6e0c110-4765-4766-bc45-55c8c3a214d9 for instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b on nch1-master-1 Nov 20 20:53:49.905750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cb58bbc3-6457-46e3-bc5d-5e73951edd63 req-585e223c-94e0-48ff-9450-0adfdf53113f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131945 Nov 20 20:53:49.910376 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1341/2647] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:49.940552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0534d7c7-e105-4c43-8423-bdbaa6b33ada tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98e669d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:50.396404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:50.409012 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dc1a08c-8f3d-4d06-92e5-25bc9f531d85 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.753505 Nov 20 20:53:50.421639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1307/2648] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:49 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:50.490436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:50.491849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:50.501123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:50.515458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:50.516712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:50.517420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:50.600574 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86062b58-ac00-4056-9ca6-cac468919606 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.113667 Nov 20 20:53:50.603162 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1308/2649] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:53:50.669648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5297725d-98da-4240-93b8-e1251aa7674b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98dea820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:50.753400 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5297725d-98da-4240-93b8-e1251aa7674b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.091188 Nov 20 20:53:50.754934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1309/2650] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:50 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:50.787306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:50.788695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:50.799616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:50.800052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:50.800892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:50.801304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:51.279613 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0534d7c7-e105-4c43-8423-bdbaa6b33ada tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e" status: 202 len: 0 microversion: 2.1 time: 1.367555 Nov 20 20:53:51.280539 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1342/2651] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:49 2021] DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e => generated 0 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:51.286716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-457665655", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a5652dae-c97d-4dac-8379-2f9cbb8facac"}], "security_groups": [{"name": "tempest-securitygroup--1018702445"}], "key_name": "tempest-keypair-1934884332", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:51.561318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:51.573187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ff1ac39-0292-46a6-a6bf-e06b147a52fa tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1518 microversion: 2.1 time: 0.789156 Nov 20 20:53:51.576862 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1310/2652] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:50 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1518 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:51.595729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-124b18fd-60a3-4ea6-99db-4bf4156201a1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'create', calling method: .version_select at 0x7f3f87927430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-487671526", "description": "tempest-description-1588147845"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:51.759741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] validate_networks() for [('a5652dae-c97d-4dac-8379-2f9cbb8facac', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:53:52.062655 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-124b18fd-60a3-4ea6-99db-4bf4156201a1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.483687 Nov 20 20:53:52.063960 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1311/2653] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:53:51 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:52.068575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:52.069668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:52.090664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.092616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.095872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.096679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.661526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:52.686360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:52.696140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for user ffd18846beb2426998ae8a8188fdb333 and project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:52.705751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1fd277a5-38f1-451c-b7bf-1bf2d92bc77d tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.640378 Nov 20 20:53:52.706386 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1312/2654] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:52 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:52.727434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:52.728867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:52.731399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:53:52.732795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:53:52.734846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:53:52.736162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:53:52.736843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:53:52.758647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.759531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.760501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.762112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.765412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.767650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.777984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:52.779399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:52.828946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:53:52.838592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lazy-loading 'flavor' on Instance uuid 3d6be238-5664-44e6-b4f8-2b26652e0cb1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:53:52.840360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Getting quotas for user ffd18846beb2426998ae8a8188fdb333 and project f7d1c3af3ff54b5eb9d1972c3dd28026. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:53:52.871361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:53:52.879464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:53:53.004042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d3dcf4f-e042-4e8b-8bc7-d8bdc671971f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.722097 Nov 20 20:53:53.009180 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1343/2655] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:53:51 2021] POST /compute/v2.1/servers => generated 407 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:53:53.019760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:53.024436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:53.048861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:53.051075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:53.052728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:53.053430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:53.131955 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a6b08de5-3a79-4725-bbbc-3ae261002d3d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.120803 Nov 20 20:53:53.143983 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1344/2656] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:53 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:53.156013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f57ee15c-39d6-4c2f-80d5-4c37071f2397 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98e71af0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:53.163172 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-de354338-517e-489c-83be-a235b6c947ba tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action" status: 200 len: 32 microversion: 2.1 time: 0.453552 Nov 20 20:53:53.163769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1313/2657] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:53:52 2021] POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:53:53.211109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-734644bb-ab47-49a2-8d0b-96aff6c64854 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Action: 'update', calling method: .version_select at 0x7f3f87927af0>, body: {"security_group": {"name": "tempest-sg-hth-794910502", "description": "tempest-description-hth-1745763894"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:53.285866 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f57ee15c-39d6-4c2f-80d5-4c37071f2397 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.134551 Nov 20 20:53:53.297369 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1345/2658] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:53 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:53.321244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5eb57cdf-7419-45ba-9020-f5287b1d4e89 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:53.322341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5eb57cdf-7419-45ba-9020-f5287b1d4e89 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:53.531297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5eb57cdf-7419-45ba-9020-f5287b1d4e89 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:53.541692 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5eb57cdf-7419-45ba-9020-f5287b1d4e89 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1269 microversion: 2.1 time: 0.240007 Nov 20 20:53:53.567336 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1346/2659] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:53 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1269 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:53.575279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:53.576293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:53.585035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:53.585821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:53.587044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:53.588118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:54.051469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:54.060838 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-963bb3f5-1e37-4126-8186-e24760217f4c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.491971 Nov 20 20:53:54.072238 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1347/2660] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:53 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:54.096033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:54.098849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:54.127108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:54.137514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:54.138723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:54.146471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:54.778075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:54.796981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0950185a-5b30-4e6b-98ba-910ed57bfa2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.723415 Nov 20 20:53:54.827039 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1348/2661] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:54 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:54.840361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:54.841487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:54.855809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:54.856503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:54.859183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:54.860070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:54.947383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd5c8321-4553-479e-b09c-75b26e60dc7e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.116388 Nov 20 20:53:54.949902 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1349/2662] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:54.955751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e957035a-47db-4441-a3b9-182cf3930db5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98e88700>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:55.006208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-734644bb-ab47-49a2-8d0b-96aff6c64854 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "PUT /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903" status: 200 len: 217 microversion: 2.1 time: 1.832134 Nov 20 20:53:55.008285 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1314/2663] 10.222.0.41 () {60 vars in 1289 bytes} [Sat Nov 20 20:53:53 2021] PUT /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903 => generated 217 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:55.013933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:55.015340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:55.050023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:55.053436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:55.064465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:55.065186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:55.113142 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e957035a-47db-4441-a3b9-182cf3930db5 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.161591 Nov 20 20:53:55.117761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1350/2664] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:54 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:55.138554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d08d9629-6f5a-47c4-9860-78e1b7f33997 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98e1a940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:55.444269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:55.461575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c719dac-6cf0-4c44-8f1a-14c9b1ff299d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1321 microversion: 2.1 time: 0.451828 Nov 20 20:53:55.466247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1315/2665] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:55 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:55.490316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:55.491202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:55.505709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:55.508555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:55.517007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:55.519899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.165608 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d08d9629-6f5a-47c4-9860-78e1b7f33997 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903" status: 200 len: 217 microversion: 2.1 time: 1.046349 Nov 20 20:53:56.176947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1351/2666] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:53:55 2021] GET /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903 => generated 217 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:56.201104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a09bc066-ba7b-4d87-9c9d-63f1511dfa18 req-a6993ce4-d71d-4a4b-829d-127f6b0f2160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b25af4d5-11da-4354-91b9-89a2490dea39", "name": "network-vif-plugged", "status": "completed", "tag": "48e83d26-e36f-40f3-b0cf-f124edaa6b06"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:56.212684 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:56.212684 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:53:56.227912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a09bc066-ba7b-4d87-9c9d-63f1511dfa18 req-a6993ce4-d71d-4a4b-829d-127f6b0f2160 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:56.228741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a09bc066-ba7b-4d87-9c9d-63f1511dfa18 req-a6993ce4-d71d-4a4b-829d-127f6b0f2160 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.256013 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a09bc066-ba7b-4d87-9c9d-63f1511dfa18 req-a6993ce4-d71d-4a4b-829d-127f6b0f2160 service nova] Creating event network-vif-plugged:48e83d26-e36f-40f3-b0cf-f124edaa6b06 for instance b25af4d5-11da-4354-91b9-89a2490dea39 on nch2-master-1 Nov 20 20:53:56.289591 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a09bc066-ba7b-4d87-9c9d-63f1511dfa18 req-a6993ce4-d71d-4a4b-829d-127f6b0f2160 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109895 Nov 20 20:53:56.300062 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1352/2667] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:53:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:53:56.339124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:56.343158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:56.376964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:56.379269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.381703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:56.384596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.612421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:56.629710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43ca5692-68b7-4ad5-810e-b0fea61a760f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 1.160301 Nov 20 20:53:56.644797 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1316/2668] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:55 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:56.688856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:56.690130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:56.703202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:56.704551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.705953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:56.706671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:56.790023 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94db8063-ca91-4e04-a4ca-4bf2f0e69a4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.143747 Nov 20 20:53:56.798619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1317/2669] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:56 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:56.809065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06ebd006-aaf2-49ac-867d-f7d18c316634 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87927af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:56.911623 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06ebd006-aaf2-49ac-867d-f7d18c316634 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.109008 Nov 20 20:53:56.919687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1318/2670] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:56 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:56.947000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9640eacc-4420-4e4f-854b-2af95acbb828 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f879270d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:57.074969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:57.100220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e792b96f-1a0c-41c7-8e83-c47e51540e64 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.797544 Nov 20 20:53:57.107400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1353/2671] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:56 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:57.117349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:57.122491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:57.140586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:57.141509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:57.143243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:57.144275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:57.324428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:57.341472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67e49b6c-eda5-4add-ba39-4bcb9066bb3e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1327 microversion: 2.1 time: 0.232563 Nov 20 20:53:57.345745 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1354/2672] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:57 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1327 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:57.649144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:57.649677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:57.664819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:57.670572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:57.673204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:57.675065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.000352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:58.014782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6540c420-592a-460d-8579-c9c0fb661714 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.370102 Nov 20 20:53:58.015402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1355/2673] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:57 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:53:58.034130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:58.036749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:58.059257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.061024 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9640eacc-4420-4e4f-854b-2af95acbb828 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903" status: 202 len: 0 microversion: 2.1 time: 1.138811 Nov 20 20:53:58.061856 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1319/2674] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:56 2021] DELETE /compute/v2.1/os-security-groups/34f84f6b-9daf-45a7-9f16-ecb100bf7903 => generated 0 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:58.062193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.064917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.068951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da3454ac-d710-4e0f-8d82-e2c2b30afdf4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87b36310>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.071084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.165970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f26b7f8-9b00-4c6c-8164-0b26a6587ed8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.145073 Nov 20 20:53:58.170872 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1356/2675] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:58.189563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.191123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:58.209933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.210638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.211941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.212598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.212735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da3454ac-d710-4e0f-8d82-e2c2b30afdf4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.147382 Nov 20 20:53:58.218335 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1320/2676] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:58 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:58.252760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.254967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:58.266790 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. Nov 20 20:53:58.271467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:58.273662 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f3adab8-c489-4e3a-a9c8-b393d01e36c1 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 404 len: 111 microversion: 2.1 time: 0.099378 Nov 20 20:53:58.280444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1357/2677] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:53:58 2021] DELETE /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:58.282231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.284309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.287929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.290922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.292488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:58.295238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.309542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.310432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.311572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.312358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.331644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. Nov 20 20:53:58.333100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Instance 15b84b6d-5fc9-4c6b-944f-85135e5a1c3d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:58.334262 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a28a730b-0a27-47ac-b6d0-58bca5f7f64f tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d" status: 404 len: 111 microversion: 2.1 time: 0.051180 Nov 20 20:53:58.338496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1358/2678] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:58 2021] GET /compute/v2.1/servers/15b84b6d-5fc9-4c6b-944f-85135e5a1c3d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:58.344490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98e091f0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.430943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58f803d7-6354-4590-bfe1-d1be79906a5e does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:58.431554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 58f803d7-6354-4590-bfe1-d1be79906a5e not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:58.432083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 58f803d7-6354-4590-bfe1-d1be79906a5e does not exist Nov 20 20:53:58.432083 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-69f50a86-3f73-47ec-8584-19079b998ae3'] Nov 20 20:53:58.434010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 58f803d7-6354-4590-bfe1-d1be79906a5e does not exist Nov 20 20:53:58.434010 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-69f50a86-3f73-47ec-8584-19079b998ae3'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:58.435618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4121621a-ed17-41e4-aea3-2f854d5aa510 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e" status: 404 len: 194 microversion: 2.1 time: 0.095059 Nov 20 20:53:58.436869 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1359/2679] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:58 2021] DELETE /compute/v2.1/os-security-groups/58f803d7-6354-4590-bfe1-d1be79906a5e => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:58.446018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:58.448321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:58.477130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.483104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:58.484159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:58.485312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.064985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:59.084833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b18ab803-5632-470d-8f36-040403a5d7ab tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.646677 Nov 20 20:53:59.089657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1360/2680] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:58 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:59.099811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:59.124827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a06abcee-7d88-4e2e-93a9-ca233f3f0427 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1316 microversion: 2.1 time: 0.902721 Nov 20 20:53:59.125463 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1321/2681] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:58 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1316 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:59.126149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f8693d0d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.188161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:59.188828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:59.189364 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 does not exist Nov 20 20:53:59.189364 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-ec3db168-87da-433a-a060-b039c0ba906e'] Nov 20 20:53:59.189967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 2654fcf0-5f35-4447-9e94-f74f66e7dc71 does not exist Nov 20 20:53:59.189967 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-ec3db168-87da-433a-a060-b039c0ba906e'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:59.190986 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bcce7e70-8ee6-4d85-a7a7-6e9177a2e09b tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71" status: 404 len: 194 microversion: 2.1 time: 0.085014 Nov 20 20:53:59.192118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1361/2682] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:59 2021] DELETE /compute/v2.1/os-security-groups/2654fcf0-5f35-4447-9e94-f74f66e7dc71 => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:59.209141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.210077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:59.241538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.251188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.252698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.253363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.388415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87046790>, body: {"quota_set": {"ram": "5120"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:59.390471 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:53:59.390471 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:53:59.474081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.474534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.476017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.476465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.545463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43ccea44-359a-4a4b-9778-c1cc469bb9c4 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b" status: 200 len: 240 microversion: 2.36 time: 0.406714 Nov 20 20:53:59.546758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1322/2683] 10.222.0.41 () {62 vars in 1302 bytes} [Sat Nov 20 20:53:59 2021] PUT /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b => generated 240 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:53:59.559233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:53:59.560387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:53:59.568175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.569075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.571239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.572170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.636351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7debf49-ae48-4324-b86e-4799e3cc1dc9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.080815 Nov 20 20:53:59.639391 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1323/2684] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:53:59 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:53:59.647326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98dfbdc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.664024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:53:59.675745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3679558c-4579-4bca-b17b-297b9969c1f4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.482388 Nov 20 20:53:59.693486 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1362/2685] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:53:59 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:59.703194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69972e9b-3ba0-41cc-a41e-468624dbb7f3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693d670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.712854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:59.713442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:59.715320 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist Nov 20 20:53:59.715320 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-0d64a72c-024f-497d-aa0e-bafb405eb09a'] Nov 20 20:53:59.715935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 5769c47c-1b18-40e4-9ffe-c3a3b92abd2f does not exist Nov 20 20:53:59.715935 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-0d64a72c-024f-497d-aa0e-bafb405eb09a'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:59.717720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9935c454-0695-4ac9-b63b-81774014d833 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f" status: 404 len: 194 microversion: 2.1 time: 0.076038 Nov 20 20:53:59.718814 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1324/2686] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:59 2021] DELETE /compute/v2.1/os-security-groups/5769c47c-1b18-40e4-9ffe-c3a3b92abd2f => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:59.743723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Calling method '.version_select at 0x7f3f87930dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.810824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69972e9b-3ba0-41cc-a41e-468624dbb7f3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.111065 Nov 20 20:53:59.812784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1363/2687] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:53:59 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:53:59.825632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f863cf5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.876357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.878109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.880650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:53:59.882819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:53:59.885048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:59.885694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group d4325e6d-dca8-4586-91ca-2bb5480a444e not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:59.886572 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist Nov 20 20:53:59.886572 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-c0ef5a50-ecf7-4a87-8d32-ac2ca6793949'] Nov 20 20:53:59.887255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group d4325e6d-dca8-4586-91ca-2bb5480a444e does not exist Nov 20 20:53:59.887255 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-c0ef5a50-ecf7-4a87-8d32-ac2ca6793949'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:59.888549 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d394ffeb-a571-4ebd-9691-5b52c43137df tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e" status: 404 len: 194 microversion: 2.1 time: 0.074418 Nov 20 20:53:59.889299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1364/2688] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:59 2021] DELETE /compute/v2.1/os-security-groups/d4325e6d-dca8-4586-91ca-2bb5480a444e => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:53:59.899716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f98e88820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:53:59.933818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f9956db-b73c-4c0c-9732-fd2bb1613d0d tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b/detail" status: 200 len: 672 microversion: 2.36 time: 0.213840 Nov 20 20:53:59.940310 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1325/2689] 10.222.0.41 () {60 vars in 1303 bytes} [Sat Nov 20 20:53:59 2021] GET /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b/detail => generated 672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:53:59.957288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:53:59.957878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:53:59.958600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist Nov 20 20:53:59.958600 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-ada674c5-61b0-4af6-a8d4-a0a0e3261df1'] Nov 20 20:53:59.960618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group 109149d1-93b5-47ea-ae9b-e3b0c367c6c5 does not exist Nov 20 20:53:59.960618 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-ada674c5-61b0-4af6-a8d4-a0a0e3261df1'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:53:59.962241 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc9264ab-2fc0-4546-96b0-be0546c00595 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5" status: 404 len: 194 microversion: 2.1 time: 0.068176 Nov 20 20:53:59.965293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1365/2690] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:59 2021] DELETE /compute/v2.1/os-security-groups/109149d1-93b5-47ea-ae9b-e3b0c367c6c5 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:53:59.973916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f86fe6430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:00.024784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:00.025378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Neutron security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:54:00.027876 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist Nov 20 20:54:00.027876 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-13f7a3c7-9076-4f73-9f5f-43bc99e7d66b'] Nov 20 20:54:00.028884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Security group fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 does not exist Nov 20 20:54:00.028884 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-13f7a3c7-9076-4f73-9f5f-43bc99e7d66b'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:00.030006 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea20e4f2-22da-497f-a705-26fd5cbf42ac tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250" status: 404 len: 194 microversion: 2.1 time: 0.060354 Nov 20 20:54:00.031181 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1326/2691] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:53:59 2021] DELETE /compute/v2.1/os-security-groups/fb7aef3c-b6d5-4dad-bdfa-c9dcef874250 => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:00.051212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:00.058787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:00.069394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.071905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.073401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.076152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.111393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:00.112975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:00.129892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.135202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.136690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.138893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.140594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:00.333429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fefa5046-8468-40d9-8ef2-0c999a196972 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 204 len: 0 microversion: 2.1 time: 0.291414 Nov 20 20:54:00.334496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1366/2692] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:00 2021] DELETE /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:00.341666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:00.348696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:00.363711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.364085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.364909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:00.365424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:00.781801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:00.792909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c968845-8819-4b92-89fe-c8ffdeec540b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1466 microversion: 2.1 time: 0.454082 Nov 20 20:54:00.793611 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1367/2693] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:00 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1466 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:00.818424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Action: 'update', calling method: .version_select at 0x7f3f98c4be50>, body: {"quota_set": {"ram": "2048"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:00.822622 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:00.822622 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:01.065946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.067292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.069608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.070346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.158677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.159449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.160491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.161110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.179139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:01.192153 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1951fdd-d519-457a-bb76-d5f96d4bb778 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 1.088331 Nov 20 20:54:01.196244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1327/2694] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:00 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:01.206772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:01.207891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:01.218164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.218667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.220333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.221442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.300206 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69581095-d8e6-4dbf-afdd-de22eb3f2655 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b?user_id=c3abb02c15494bacbc78f6bf6f6bde63" status: 200 len: 240 microversion: 2.36 time: 0.495226 Nov 20 20:54:01.307563 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1368/2695] 10.222.0.41 () {62 vars in 1383 bytes} [Sat Nov 20 20:54:00 2021] PUT /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b?user_id=c3abb02c15494bacbc78f6bf6f6bde63 => generated 240 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:01.315575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4c244169-faf2-4cfa-9ca8-a7f65d280ad9 req-0f3af734-19f2-45e9-aaa6-2ee57cff6a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649c047e-3541-4d30-a07c-dc2788902dfd", "tag": "65288fa2-856b-4bcd-b79e-358cb9d13ee1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:01.317668 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:01.317668 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:01.329968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4c244169-faf2-4cfa-9ca8-a7f65d280ad9 req-0f3af734-19f2-45e9-aaa6-2ee57cff6a4b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.330997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4c244169-faf2-4cfa-9ca8-a7f65d280ad9 req-0f3af734-19f2-45e9-aaa6-2ee57cff6a4b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.348861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4c244169-faf2-4cfa-9ca8-a7f65d280ad9 req-0f3af734-19f2-45e9-aaa6-2ee57cff6a4b service nova] Creating event network-changed:65288fa2-856b-4bcd-b79e-358cb9d13ee1 for instance 649c047e-3541-4d30-a07c-dc2788902dfd on nch2-master-1 Nov 20 20:54:01.356126 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4c244169-faf2-4cfa-9ca8-a7f65d280ad9 req-0f3af734-19f2-45e9-aaa6-2ee57cff6a4b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044824 Nov 20 20:54:01.356924 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1369/2696] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:01.364028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:01.365493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:01.395320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.396292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.397573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.398329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.452187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6ac329a-83ac-4cc7-be85-1239b357b9a5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.093610 Nov 20 20:54:01.457060 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1370/2697] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:01 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:01.463212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:01.465698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:01.476507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.477366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.478805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.480179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.680994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:01.696235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6e766b5-2b36-4a37-9bfb-5da6708a6711 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1647 microversion: 2.1 time: 0.497932 Nov 20 20:54:01.697098 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1328/2698] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:01 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1647 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:01.705143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:01.706156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:01.713333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.714683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.715959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:01.716594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:01.787436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:01.799328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43fcd8e9-02cd-49cb-9e7a-09ab486523b7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.340680 Nov 20 20:54:01.810451 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1371/2699] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:01 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:01.810451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c8aa949-6a29-4e4e-bc24-fd9231a7847e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87276430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:01.865477 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c8aa949-6a29-4e4e-bc24-fd9231a7847e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.063967 Nov 20 20:54:01.866377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1372/2700] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:01 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:01.871686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9cb31bfa-7fda-4e7b-83da-f4cf853db421 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] Calling method '.version_select at 0x7f3f98e6f670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:01.972133 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9cb31bfa-7fda-4e7b-83da-f4cf853db421 tempest-QuotasAdminTestV236-1614996833 tempest-QuotasAdminTestV236-1614996833-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b?user_id=c3abb02c15494bacbc78f6bf6f6bde63" status: 200 len: 282 microversion: 2.36 time: 0.104692 Nov 20 20:54:01.972910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1373/2701] 10.222.0.41 () {60 vars in 1363 bytes} [Sat Nov 20 20:54:01 2021] GET /compute/v2.1/os-quota-sets/41926ac5910542b19e35bd39a92f4d9b?user_id=c3abb02c15494bacbc78f6bf6f6bde63 => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:02.129945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6df818cb-bca1-439c-a5d5-2a5a654ad0f8 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1617 microversion: 2.1 time: 0.431220 Nov 20 20:54:02.138717 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1329/2702] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:01 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1617 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:02.211002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:02.211898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:02.224568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.226995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.228673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.229196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.301091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1792714661", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["d0202d45-4861-4548-b517-c5a02af49a0d"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:02.406984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:54:02.438640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:02.460081 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b6ed6fb-9a56-47e1-8e0b-d7ffd31cb049 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.252213 Nov 20 20:54:02.470948 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1374/2703] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:02 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:02.470948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:02.470948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:02.482222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.482885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.483543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.483992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.564481 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e99a9bd-e921-4fc1-af6b-55d2b291621c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.100452 Nov 20 20:54:02.568532 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1375/2704] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:02 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:02.718021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:02.718753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:02.726504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.726737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.727434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.728407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.965325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:02.973702 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43898333-50d3-4e2c-b5a1-e9ee6a3eb1a9 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1647 microversion: 2.1 time: 0.264045 Nov 20 20:54:02.974511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1376/2705] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:02 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1647 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:02.978928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:02.979572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:02.988441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.989317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:02.990314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:02.990869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.120039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:54:03.120457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:54:03.120915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:54:03.121508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:54:03.122114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:54:03.138531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.139300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.140302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.140915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.165731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:03.179027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1e88522-83af-473d-bdb3-5454150b359a tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.203530 Nov 20 20:54:03.180365 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1377/2706] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:02 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:03.181661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:03.185289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf9ad5b2-d679-4bd0-85fb-b5438e0ae9e6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f863a7820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:03.192781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:03.222653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:54:03.229076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:54:03.260273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf9ad5b2-d679-4bd0-85fb-b5438e0ae9e6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.078613 Nov 20 20:54:03.263719 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1378/2707] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:03 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:03.285146 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f0e763e-65d1-43de-b371-abadb58e3dda tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987531 Nov 20 20:54:03.292594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1330/2708] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:54:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:54:03.297489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-703290c9-97c8-4fdc-8ff1-e61fd2c1b213 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:03.298272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-703290c9-97c8-4fdc-8ff1-e61fd2c1b213 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:03.453052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-703290c9-97c8-4fdc-8ff1-e61fd2c1b213 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:03.461580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-703290c9-97c8-4fdc-8ff1-e61fd2c1b213 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1217 microversion: 2.1 time: 0.168181 Nov 20 20:54:03.479104 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1379/2709] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:03 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:03.486966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:03.488211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:03.496078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.496827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.497810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.498940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.582892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:03.584143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:03.596696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.597164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.598006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.598479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.699825 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cbb66760-b7ba-403d-b37f-5b004209c207 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.126919 Nov 20 20:54:03.701151 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1380/2710] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:03 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:03.782527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-11fd0c3d-6a0e-40e5-a928-9d3d7b2bb5f2 req-cf71eab7-756d-4017-a745-45d940d60068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa040e2b-b12a-4df9-b751-18927bb85bbc", "name": "network-vif-deleted", "tag": "f45eebd5-aed0-4beb-a5fe-f44aba552d89"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:03.784549 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:03.784549 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:03.803167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-11fd0c3d-6a0e-40e5-a928-9d3d7b2bb5f2 req-cf71eab7-756d-4017-a745-45d940d60068 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:03.804012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-11fd0c3d-6a0e-40e5-a928-9d3d7b2bb5f2 req-cf71eab7-756d-4017-a745-45d940d60068 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:03.836910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-11fd0c3d-6a0e-40e5-a928-9d3d7b2bb5f2 req-cf71eab7-756d-4017-a745-45d940d60068 service nova] Creating event network-vif-deleted:f45eebd5-aed0-4beb-a5fe-f44aba552d89 for instance fa040e2b-b12a-4df9-b751-18927bb85bbc on nch2-master-1 Nov 20 20:54:03.845446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-11fd0c3d-6a0e-40e5-a928-9d3d7b2bb5f2 req-cf71eab7-756d-4017-a745-45d940d60068 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068900 Nov 20 20:54:03.850605 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1381/2711] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:54:03.912117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:03.931541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e2a6b04-fbb4-4ff2-bcbe-dd57d05cc012 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.447809 Nov 20 20:54:03.935754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1331/2712] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:03 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:03.992451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:03.995006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:04.007417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.009329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.014181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.015236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.103684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.104233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.105322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lazy-loading 'fault' on Instance uuid fa040e2b-b12a-4df9-b751-18927bb85bbc {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:54:04.192025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e25d358e868f40728a6e968216d25f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd006f43b28c243da9c910fd530b7958b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:04.201270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:04.202498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:04.204312 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-faa28498-324e-4681-94f1-8547ac92a938 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 200 len: 1306 microversion: 2.1 time: 0.217573 Nov 20 20:54:04.204911 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1382/2713] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:03 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:04.211115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.211808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.212776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.213469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.279514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02f3b33d-e5bf-4d55-bfc8-3a5a2a2a18cc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f869e5d30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:04.364724 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02f3b33d-e5bf-4d55-bfc8-3a5a2a2a18cc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.090529 Nov 20 20:54:04.378525 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1383/2714] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:04 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:04.487165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:04.488119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:04.496772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.498030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.498980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.499695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.610767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:04.617368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:04.628422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc38d4b2-9fe5-436e-a962-596b392b2ebb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1269 microversion: 2.1 time: 0.143347 Nov 20 20:54:04.638383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1384/2715] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:04 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:04.638628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6d936e1-1b89-4ae4-986b-c03bb4bffce7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.436927 Nov 20 20:54:04.638628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1332/2716] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:04 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:04.712253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:04.714443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:04.727189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.728225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.732285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.732964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.848999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29b5139a-7cdf-47fd-bb1b-236ed85b6922 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.139906 Nov 20 20:54:04.853318 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1385/2717] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:04 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:04.952763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:04.953377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:04.972838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.973470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:04.974486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:04.975169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.223696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:05.225011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] [instance: fa040e2b-b12a-4df9-b751-18927bb85bbc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:05.244661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.246011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.247116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.247735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.272346 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] HTTP exception thrown: Instance fa040e2b-b12a-4df9-b751-18927bb85bbc could not be found. Nov 20 20:54:05.272961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Returning 404 to user: Instance fa040e2b-b12a-4df9-b751-18927bb85bbc could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:05.273871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b4301e7c-2bc3-40f3-beb4-56e5de7f6908 tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc" status: 404 len: 111 microversion: 2.1 time: 0.054178 Nov 20 20:54:05.289510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1386/2718] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:05 2021] GET /compute/v2.1/servers/fa040e2b-b12a-4df9-b751-18927bb85bbc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:05.295018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f3ed18f-ea90-46f6-9ed9-dfec0a02e5ca tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f869e5940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:05.681729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f3ed18f-ea90-46f6-9ed9-dfec0a02e5ca tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/28c6b215-a994-40c5-acb3-309dabf90d76" status: 202 len: 0 microversion: 2.1 time: 0.390372 Nov 20 20:54:05.683666 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1387/2719] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:54:05 2021] DELETE /compute/v2.1/os-security-groups/28c6b215-a994-40c5-acb3-309dabf90d76 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:05.690131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9312af9-99cb-4fa6-8cd9-55ab0814da9c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693d5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:05.790720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9312af9-99cb-4fa6-8cd9-55ab0814da9c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.105603 Nov 20 20:54:05.798692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1388/2720] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:05 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:05.806082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:05.807009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:05.814898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.815663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.816843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.817468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.921343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:05.930101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f86cef3-da18-4551-bcd3-a51c43f92ce1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1275 microversion: 2.1 time: 0.129857 Nov 20 20:54:05.932577 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1389/2721] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:05 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:05.944852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:05.945682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:05.970086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.970541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:05.974040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:05.974534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:06.166025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:06.180358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b800c6a-b536-42fc-b657-3e97219bae05 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 1.232058 Nov 20 20:54:06.181518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1333/2722] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:04 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:06.186923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b6da6b9-df24-4650-bd57-10abcfad4b1d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] Calling method '.version_select at 0x7f3f87076af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:06.257988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:06.272024 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d900fa31-d613-4ff4-a972-81e58097fa81 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.337496 Nov 20 20:54:06.273226 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1390/2723] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:05 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:06.278999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:06.280249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:06.287527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:06.288292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:06.289973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:06.290626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:06.368014 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4317570-6a22-4e73-b124-5a79658d1a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.090540 Nov 20 20:54:06.371397 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1391/2724] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:06 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:06.786554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b6da6b9-df24-4650-bd57-10abcfad4b1d tempest-SecurityGroupsTestJSON-1293195175 tempest-SecurityGroupsTestJSON-1293195175-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/60965fec-030a-46ba-96d7-c86fbee2f90f" status: 202 len: 0 microversion: 2.1 time: 0.603721 Nov 20 20:54:06.787135 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1334/2725] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:54:06 2021] DELETE /compute/v2.1/os-security-groups/60965fec-030a-46ba-96d7-c86fbee2f90f => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:06.804530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c6da669-a300-4aec-917e-6c172d641a3e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86918160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:06.919559 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c6da669-a300-4aec-917e-6c172d641a3e tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.118992 Nov 20 20:54:06.920685 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1392/2726] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:06 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:06.949840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:06.950487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:06.957153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:06.960695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:06.963001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:06.964313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.065487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:07.079584 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be503f71-8fdd-4bb9-9521-ae9770360997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1275 microversion: 2.1 time: 0.135080 Nov 20 20:54:07.081630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1335/2727] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:06 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:07.197794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:07.200390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:07.218072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.218540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.219347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.219790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.292255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:07.296006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:07.331305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.331977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.332976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.333583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.780357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:07.787720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc497f4a-40e9-4858-9396-c062174ae8c5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.500814 Nov 20 20:54:07.788290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1336/2728] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:07 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:07.793414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:07.804139 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa08ff0e-6406-4003-9389-e9bccb442894 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.610701 Nov 20 20:54:07.804946 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1393/2729] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:07 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:07.836131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:07.837359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:07.858334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.858782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.871897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:07.872905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:07.999698 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a7e8b1e-b7e7-4758-9c41-e692f417f714 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.182945 Nov 20 20:54:08.000791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1394/2730] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:07 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:08.005849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-04bdfa87-5862-4137-bded-6e67c17646da tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98e243a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.112396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-04bdfa87-5862-4137-bded-6e67c17646da tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1438 microversion: 2.1 time: 0.110130 Nov 20 20:54:08.113369 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1395/2731] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:08.135948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.136717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:08.160443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.160899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.161908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.163077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.190675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Action: 'update', calling method: .version_select at 0x7f3f98dfb5e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:08.193890 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.193890 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.195799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.196450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.212155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.212923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.230825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] HTTP exception thrown: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. Nov 20 20:54:08.236001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Returning 404 to user: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:08.237392 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1fb961f9-83f1-4bf3-ba0c-645b2cd372c0 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65" status: 404 len: 110 microversion: 2.53 time: 0.448170 Nov 20 20:54:08.238328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1337/2732] 10.222.0.41 () {62 vars in 1308 bytes} [Sat Nov 20 20:54:07 2021] PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65 => generated 110 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:54:08.247135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Action: 'update', calling method: .version_select at 0x7f3f87076ca0>, body: {"status": "disabled"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:08.252417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.252800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.269819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.270306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.284508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] HTTP exception thrown: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. Nov 20 20:54:08.285629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Returning 404 to user: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:08.289204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e7a6b3e-1764-4fa7-9298-c6cf1a6e6b21 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65" status: 404 len: 110 microversion: 2.53 time: 0.045780 Nov 20 20:54:08.291703 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1338/2733] 10.222.0.41 () {62 vars in 1308 bytes} [Sat Nov 20 20:54:08 2021] PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:54:08.302844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Action: 'update', calling method: .version_select at 0x7f3f98dfb670>, body: {"status": "enabled"} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:08.309767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.310386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.326428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.329871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.340599 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] HTTP exception thrown: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. Nov 20 20:54:08.344259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Returning 404 to user: Service 69a2f475-8aba-4b35-b6af-653595cf5a65 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:08.345330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d4c6147-6772-4bc2-a3f3-ac999254fc56 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65" status: 404 len: 110 microversion: 2.53 time: 0.049252 Nov 20 20:54:08.346449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1339/2734] 10.222.0.41 () {62 vars in 1308 bytes} [Sat Nov 20 20:54:08 2021] PUT /compute/v2.1/os-services/69a2f475-8aba-4b35-b6af-653595cf5a65 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:54:08.355268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.365679 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.365679 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.372619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.374289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.377416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.379948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.454923 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4398193f-174a-4d17-a3ba-172966ed7906 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.103599 Nov 20 20:54:08.462721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1340/2735] 10.222.0.41 () {60 vars in 1177 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:54:08.473886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.475565 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.475565 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.477509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.482157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.483327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.484030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.555523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7ec1327-f278-42f2-aa5a-351706aaa6a1 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.084563 Nov 20 20:54:08.563033 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1341/2736] 10.222.0.41 () {60 vars in 1210 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 20:54:08.575517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.580750 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.580750 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.583272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.584570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.585639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.586355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.627274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0fc4d76e-05a5-47f0-8d9b-8962520d507d tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.058636 Nov 20 20:54:08.628262 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1342/2737] 10.222.0.41 () {60 vars in 1177 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:54:08.650788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.652471 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.652471 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.654610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.655653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.657240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.657962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.694835 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cac8e4e5-62ff-4ed5-bfba-ef7d1d3d56af tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.047734 Nov 20 20:54:08.704997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1343/2738] 10.222.0.41 () {60 vars in 1236 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:08.712568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.731230 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.731230 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.736555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.737622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.740255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.740989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.777612 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-865b5889-76fb-4768-93bb-4e08fe6a7281 tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.070808 Nov 20 20:54:08.778815 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1344/2739] 10.222.0.41 () {60 vars in 1177 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:54:08.791382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.793350 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:08.793350 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:08.795450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.798863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.800420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.801226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.852207 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d3da7fe-82ce-4b67-9b9f-0cdf4e09f6bf tempest-ServicesAdminNegativeV253TestJSON-485888764 tempest-ServicesAdminNegativeV253TestJSON-485888764-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.065042 Nov 20 20:54:08.858801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1345/2740] 10.222.0.41 () {60 vars in 1238 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:08.860504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:08.861128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:08.876090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.876547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:08.877375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:08.887444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.211382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:09.221569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:09.227325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94279622-cc77-43fa-ac0e-9271dab45d5c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 1.112386 Nov 20 20:54:09.228215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1396/2741] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:09.234627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:09.235582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:09.242939 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be0de3db-0b07-453f-85a0-4607300de1e5 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.387757 Nov 20 20:54:09.243828 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1346/2742] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:08 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:09.253907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e0ef638b-bd34-490e-8243-208d88f797cf req-2bf6cf09-3809-47d4-bafb-91fb7433bf27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fbe1bea-a4aa-4b72-87dd-856345ef5791", "tag": "418f2718-5a55-4ccb-996a-11201d6702b2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:09.255551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.256297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.257361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.258073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.259405 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:09.259405 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:09.270329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e0ef638b-bd34-490e-8243-208d88f797cf req-2bf6cf09-3809-47d4-bafb-91fb7433bf27 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.273348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e0ef638b-bd34-490e-8243-208d88f797cf req-2bf6cf09-3809-47d4-bafb-91fb7433bf27 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.304110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e0ef638b-bd34-490e-8243-208d88f797cf req-2bf6cf09-3809-47d4-bafb-91fb7433bf27 service nova] Creating event network-changed:418f2718-5a55-4ccb-996a-11201d6702b2 for instance 3fbe1bea-a4aa-4b72-87dd-856345ef5791 on nch2-master-1 Nov 20 20:54:09.318008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e0ef638b-bd34-490e-8243-208d88f797cf req-2bf6cf09-3809-47d4-bafb-91fb7433bf27 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072066 Nov 20 20:54:09.329658 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1347/2743] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:09.617268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49bf45ac-988b-4c90-9755-288fc0f72b8b tempest-ServicesAdminNegativeV253TestJSON-1990261402 tempest-ServicesAdminNegativeV253TestJSON-1990261402-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:09.619217 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:09.619217 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:09.621433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49bf45ac-988b-4c90-9755-288fc0f72b8b tempest-ServicesAdminNegativeV253TestJSON-1990261402 tempest-ServicesAdminNegativeV253TestJSON-1990261402-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ef141a7ecb464afda1709d6408c2b987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70701828fdff40fa9495753244731dd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:09.622843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49bf45ac-988b-4c90-9755-288fc0f72b8b tempest-ServicesAdminNegativeV253TestJSON-1990261402 tempest-ServicesAdminNegativeV253TestJSON-1990261402-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:09.623606 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49bf45ac-988b-4c90-9755-288fc0f72b8b tempest-ServicesAdminNegativeV253TestJSON-1990261402 tempest-ServicesAdminNegativeV253TestJSON-1990261402-project] 10.222.0.41 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.292681 Nov 20 20:54:09.628002 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1348/2744] 10.222.0.41 () {60 vars in 1177 bytes} [Sat Nov 20 20:54:09 2021] GET /compute/v2.1/os-services => generated 112 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:54:09.629765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:09.636900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:09.645074 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53b7d727-eb95-4d60-98de-aed3107a1651 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.415295 Nov 20 20:54:09.645555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:09.657542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1397/2745] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:09 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:09.668764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb24c09b-f42e-4307-b932-85300d0a5b0c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c3d550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:09.674780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.679436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.680370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.680825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.756929 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb24c09b-f42e-4307-b932-85300d0a5b0c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1447 microversion: 2.1 time: 0.106282 Nov 20 20:54:09.757517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1398/2746] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:09 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:09.764161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9f2c6730-089c-4db5-878d-02eb3f08f013 req-a67281ef-70dd-4f88-9a7d-e18e60685e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649c047e-3541-4d30-a07c-dc2788902dfd", "name": "network-vif-plugged", "status": "completed", "tag": "65288fa2-856b-4bcd-b79e-358cb9d13ee1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:09.773986 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c48c7e96-067f-42fb-ab1a-ea9525c52dcd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.148187 Nov 20 20:54:09.774601 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1349/2747] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:09 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:09.777225 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:09.777225 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:09.791144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9f2c6730-089c-4db5-878d-02eb3f08f013 req-a67281ef-70dd-4f88-9a7d-e18e60685e74 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:09.792345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9f2c6730-089c-4db5-878d-02eb3f08f013 req-a67281ef-70dd-4f88-9a7d-e18e60685e74 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:09.793741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0cd37cf-dbd7-4865-a831-88e0a982bbae tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87930550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:09.846705 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9f2c6730-089c-4db5-878d-02eb3f08f013 req-a67281ef-70dd-4f88-9a7d-e18e60685e74 service nova] Creating event network-vif-plugged:65288fa2-856b-4bcd-b79e-358cb9d13ee1 for instance 649c047e-3541-4d30-a07c-dc2788902dfd on nch2-master-1 Nov 20 20:54:09.863016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9f2c6730-089c-4db5-878d-02eb3f08f013 req-a67281ef-70dd-4f88-9a7d-e18e60685e74 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100816 Nov 20 20:54:09.863824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1399/2748] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:09.890588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0cd37cf-dbd7-4865-a831-88e0a982bbae tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 200 len: 1447 microversion: 2.1 time: 0.106624 Nov 20 20:54:09.891453 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1350/2749] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:09 2021] GET /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:09.905015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-650f2994-174f-4354-bce3-8993e5c3158b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f98c3d550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:10.245635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:10.246958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:10.253480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.254300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.255711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.256456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.503270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:10.515532 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56f45555-37bc-4fca-b4f0-508bfdaddd87 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.270836 Nov 20 20:54:10.516153 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1351/2750] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:10 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:10.523947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:10.524602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:10.537980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.538685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.540005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.540841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.819538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-650f2994-174f-4354-bce3-8993e5c3158b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 204 len: 0 microversion: 2.1 time: 0.919219 Nov 20 20:54:10.821461 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1400/2751] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:09 2021] DELETE /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 0 bytes in 921 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:10.828827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:10.830008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:10.847781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.848490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.849853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.851029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.960773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:10.971492 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63960b40-f7bc-4e57-9142-4c62208cfd43 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.453728 Nov 20 20:54:10.972753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1352/2752] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:10 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:10.988478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:10.989459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:10.997986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:10.998466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:10.999840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:11.000466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:11.049806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1af73a8b-6ed3-49e2-aa2b-e01dedf5152c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.075431 Nov 20 20:54:11.051173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1353/2753] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:10 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:11.056674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:11.064208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:11.071361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:11.072088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:11.072991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:11.073605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:11.101394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:11.238900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a3fe30d-d38d-4298-a2da-e75cdde2acc1 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 204 len: 0 microversion: 2.1 time: 0.185674 Nov 20 20:54:11.239627 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1354/2754] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:11 2021] DELETE /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:11.308931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:11.318005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e30ff36-f920-49c2-bcee-6d789dc69503 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1395 microversion: 2.1 time: 0.495264 Nov 20 20:54:11.327935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1401/2755] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:10 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:11.438934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-566460459", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7ac3ab90-d288-4bb5-99a9-c81df0147689"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:11.514752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] validate_networks() for [('7ac3ab90-d288-4bb5-99a9-c81df0147689', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:54:11.533719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:11.534382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:11.545326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:11.546301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:11.547299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:11.547921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:11.946548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:11.957809 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bbf90242-0fe3-4ac0-927f-dad85f1325e9 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.425796 Nov 20 20:54:11.958503 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1402/2756] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:11 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:11.989415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:11.990061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:11.999745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.000209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.001627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.002104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.361902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:54:12.362424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:54:12.362977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:54:12.363458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:54:12.363967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:54:12.374084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.374599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.375507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.376019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.397161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:12.403683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Getting quotas for user 48554aa52ebf468fa74262b1bf8ab300 and project 44e20e99a6534d5d95e9d012160657a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:12.417922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:54:12.423223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:54:12.468644 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-baefbfbc-3320-4c3c-86fe-048e7c64292d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035741 Nov 20 20:54:12.469834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1355/2757] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:54:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:54:12.474322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:12.475330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:12.481612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.482363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.483351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.483982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.499972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:12.515058 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a305e552-ba85-48b5-9291-4a38a4fadbc4 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.528442 Nov 20 20:54:12.518036 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1403/2758] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:11 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:12.523088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:12.524281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:12.535927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.536640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.538025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.538167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.553769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6489151f-9240-49c8-b375-468ce94bcbeb tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.082612 Nov 20 20:54:12.555507 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1356/2759] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:12 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:12.560944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f189fef5-12ee-435a-bf8f-89144b9b0363 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:12.561636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f189fef5-12ee-435a-bf8f-89144b9b0363 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:12.619909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f189fef5-12ee-435a-bf8f-89144b9b0363 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:12.628044 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f189fef5-12ee-435a-bf8f-89144b9b0363 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1207 microversion: 2.1 time: 0.071145 Nov 20 20:54:12.631290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1357/2760] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:12 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1207 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:12.975592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:12.976465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:12.992612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.993355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:12.994358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:12.994997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.199191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:13.208054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44205524-03fe-4072-90b4-7dc3d00ff98d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1575 microversion: 2.1 time: 0.689849 Nov 20 20:54:13.210873 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1404/2761] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:12 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1575 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:13.228942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:13.229449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:13.242454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.242912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.243916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.244530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.287216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:13.301600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f9fd8982-a888-44c2-adb2-5e8436e9b997 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.329062 Nov 20 20:54:13.314403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1358/2762] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:12 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:13.424621 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-915aa430-300f-4b59-9298-eea2d00219a5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199067 Nov 20 20:54:13.425761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1405/2763] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:54:13 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:13.544355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:13.546408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:13.564751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.565357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.566062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.566508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.567404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:13.568484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:13.580846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.582953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.584622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.600845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.712282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b33bc978-ea9d-457b-8a9c-09a5d6f6bd63 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.149092 Nov 20 20:54:13.718752 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1406/2764] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:13.728329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:13.730661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:13.763347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.763872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.765084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:13.765880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:13.927949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:13.936967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:13.938475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f819813-d606-4dfa-a3c2-4e35bbd9772c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1259 microversion: 2.1 time: 0.217856 Nov 20 20:54:13.939286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1407/2765] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:13 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:13.949236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22007c70-5435-4d33-ad37-e531454794fe tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1524 microversion: 2.1 time: 0.417453 Nov 20 20:54:13.957307 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1359/2766] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:13 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1524 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:14.327294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:14.332396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:14.349056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.350732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.351820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.352627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.730510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:14.731596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:14.745607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.746557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.747866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.750751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.825211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a91e1e3d-1595-48c1-9660-288ed0cdb6d3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.097526 Nov 20 20:54:14.835391 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1360/2767] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:14 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:14.889018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2f9c8a72-8fec-4b3a-a003-f890308589fd req-90b6ce73-3bf6-45f6-a161-31ce9ecc62bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe6a66-af8a-40dc-bb9e-a37fd916c78b", "name": "network-vif-unplugged", "status": "completed", "tag": "c6e0c110-4765-4766-bc45-55c8c3a214d9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:14.892442 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:14.892442 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:14.916136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f9c8a72-8fec-4b3a-a003-f890308589fd req-90b6ce73-3bf6-45f6-a161-31ce9ecc62bd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.917425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f9c8a72-8fec-4b3a-a003-f890308589fd req-90b6ce73-3bf6-45f6-a161-31ce9ecc62bd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.934991 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2f9c8a72-8fec-4b3a-a003-f890308589fd req-90b6ce73-3bf6-45f6-a161-31ce9ecc62bd service nova] Creating event network-vif-unplugged:c6e0c110-4765-4766-bc45-55c8c3a214d9 for instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b on nch1-master-1 Nov 20 20:54:14.941093 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2f9c8a72-8fec-4b3a-a003-f890308589fd req-90b6ce73-3bf6-45f6-a161-31ce9ecc62bd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056651 Nov 20 20:54:14.942746 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1361/2768] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:14 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:54:14.959547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:14.960603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:14.972694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.973681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:14.976109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:14.977000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:15.047211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:15.062265 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7d42009-91cf-45ec-bec7-8b6d9e477e1e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.740407 Nov 20 20:54:15.063705 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1408/2769] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:14 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:15.070399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:15.071569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:15.078399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:15.079140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:15.080301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:15.080963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:15.099125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:15.115180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dc0376f8-f6c6-4df1-ad31-18a46a7d73c9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1265 microversion: 2.1 time: 0.163444 Nov 20 20:54:15.127674 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1362/2770] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:14 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:15.618430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:15.632578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4107edfc-c227-48e8-b607-da4c03bc1ebb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1504 microversion: 2.1 time: 0.565864 Nov 20 20:54:15.633926 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1409/2771] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:15 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1504 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:15.650762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-106ed66a-b62d-41ee-b853-edc348a1898c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'create', calling method: .version_select at 0x7f3f878da430>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874340503", "description": "tempest-description-1999313630"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:15.842851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:15.844167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:15.851709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:15.856521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:15.857661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:15.858305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:15.932619 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-769e7f4a-772e-4a13-8677-99af3fd12267 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.093545 Nov 20 20:54:15.934249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1410/2772] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:15 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:16.081417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:16.082039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:16.090332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.091043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.091856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.092304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.566873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:16.576507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f32b8349-0d38-40e6-83d4-730277e5df1c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.500047 Nov 20 20:54:16.577108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1411/2773] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:16 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:16.585080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:16.589112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:16.607848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.608583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.609848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.610520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.736370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:16.746479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-15b38c7a-7caa-4883-8b3a-3de80153d955 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1265 microversion: 2.1 time: 0.164818 Nov 20 20:54:16.748162 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1412/2774] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:16 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:16.757945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-106ed66a-b62d-41ee-b853-edc348a1898c tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.105456 Nov 20 20:54:16.757945 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1363/2775] 10.222.0.41 () {60 vars in 1179 bytes} [Sat Nov 20 20:54:15 2021] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:54:16.758966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a5d19bcf-d190-4d35-8d0f-0c7c12ef4407 req-f7467040-6f95-45ae-909a-b00c9b583165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffe6a66-af8a-40dc-bb9e-a37fd916c78b", "name": "network-vif-deleted", "tag": "c6e0c110-4765-4766-bc45-55c8c3a214d9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:16.762294 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:16.762294 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:16.765821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:16.767081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:16.774191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.775058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.776149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.776886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.783536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a5d19bcf-d190-4d35-8d0f-0c7c12ef4407 req-f7467040-6f95-45ae-909a-b00c9b583165 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.787846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a5d19bcf-d190-4d35-8d0f-0c7c12ef4407 req-f7467040-6f95-45ae-909a-b00c9b583165 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.820042 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a5d19bcf-d190-4d35-8d0f-0c7c12ef4407 req-f7467040-6f95-45ae-909a-b00c9b583165 service nova] Creating event network-vif-deleted:c6e0c110-4765-4766-bc45-55c8c3a214d9 for instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b on nch1-master-1 Nov 20 20:54:16.827806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a5d19bcf-d190-4d35-8d0f-0c7c12ef4407 req-f7467040-6f95-45ae-909a-b00c9b583165 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072946 Nov 20 20:54:16.829671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1364/2776] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:16.836565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874340503"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:16.838747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:16.845107 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-597ec8fc-50ab-4f4d-a0c1-845debc92bd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.084410 Nov 20 20:54:16.845754 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1413/2777] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:16 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:16.850286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.851037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.852724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.853425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.945689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:16.946959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:16.967060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.967621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:16.968758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:16.968979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:17.047373 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bff72fe1-4840-4b9e-9cf3-59dace9af93b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.105281 Nov 20 20:54:17.050043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1414/2778] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:17.392385 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.security_group_api [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Adding security group 67b9a182-8e87-42e1-b866-5fa94524ce17 to port f1bd4c4a-0fa6-457c-a111-718b20fa5663 Nov 20 20:54:17.594339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:17.595045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:17.610367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:17.610825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:17.615497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:17.616230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.132897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:18.160545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ffde4e3-8642-45d5-b537-21adde4b65b8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.570166 Nov 20 20:54:18.162355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1415/2779] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:17 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:18.175991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:18.177199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:18.197565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.198405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.199568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.200256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.466638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69856b1b-97a2-4348-8372-71ef058b25c7 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action" status: 202 len: 0 microversion: 2.1 time: 1.635432 Nov 20 20:54:18.471898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1365/2780] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:16 2021] POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action => generated 0 bytes in 1641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:18.477155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:18.479304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:18.493685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.494179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.495178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.495845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.552845 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffb9e4a2-d8e3-492c-ac80-6a3011ff0b10 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.079338 Nov 20 20:54:18.553631 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1366/2781] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:18 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:18.563489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5278bb79-907b-40b8-8ef9-9bdd9f834568 req-15bc1afe-1af8-4b7f-ab38-253059885c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbe1bea-a4aa-4b72-87dd-856345ef5791", "name": "network-vif-plugged", "status": "completed", "tag": "418f2718-5a55-4ccb-996a-11201d6702b2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:18.564995 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:18.564995 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:18.574230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5278bb79-907b-40b8-8ef9-9bdd9f834568 req-15bc1afe-1af8-4b7f-ab38-253059885c2f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.574680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5278bb79-907b-40b8-8ef9-9bdd9f834568 req-15bc1afe-1af8-4b7f-ab38-253059885c2f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.588334 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5278bb79-907b-40b8-8ef9-9bdd9f834568 req-15bc1afe-1af8-4b7f-ab38-253059885c2f service nova] Creating event network-vif-plugged:418f2718-5a55-4ccb-996a-11201d6702b2 for instance 3fbe1bea-a4aa-4b72-87dd-856345ef5791 on nch2-master-1 Nov 20 20:54:18.595275 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5278bb79-907b-40b8-8ef9-9bdd9f834568 req-15bc1afe-1af8-4b7f-ab38-253059885c2f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037206 Nov 20 20:54:18.596071 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1367/2782] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:18.610566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:18.612214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:18.629675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.630748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.632619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.633457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.701237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-531258c4-7622-43f3-abff-19fe59b67d84 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.099809 Nov 20 20:54:18.703064 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1368/2783] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:18 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:18.709767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1874340503"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:18.716062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:18.725577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.726315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.728697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.731152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:18.912576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:18.928930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9296deb-ec4c-4727-83db-55e0effc447b tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.759846 Nov 20 20:54:18.933455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1416/2784] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:18 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:18.944759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-143d5f33-b36f-4268-b7c7-656652f38b39 req-7299d253-5a81-410c-ad10-54dcfaa3859a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:18.950969 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:18.950969 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:18.974162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-143d5f33-b36f-4268-b7c7-656652f38b39 req-7299d253-5a81-410c-ad10-54dcfaa3859a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:18.983888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-143d5f33-b36f-4268-b7c7-656652f38b39 req-7299d253-5a81-410c-ad10-54dcfaa3859a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:19.050356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-143d5f33-b36f-4268-b7c7-656652f38b39 req-7299d253-5a81-410c-ad10-54dcfaa3859a service nova] Creating event network-changed:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:54:19.063433 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-143d5f33-b36f-4268-b7c7-656652f38b39 req-7299d253-5a81-410c-ad10-54dcfaa3859a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126840 Nov 20 20:54:19.067045 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1417/2785] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:19.093771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a0ba5381-86e7-4eb7-be21-4af0e8103ca7 req-f81f9bbb-fc59-48b1-97b2-6a3edc460bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649c047e-3541-4d30-a07c-dc2788902dfd", "tag": "65288fa2-856b-4bcd-b79e-358cb9d13ee1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:19.098217 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.security_group_api [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Removing security group 67b9a182-8e87-42e1-b866-5fa94524ce17 from port f1bd4c4a-0fa6-457c-a111-718b20fa5663 Nov 20 20:54:19.099645 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:19.099645 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:19.144131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0ba5381-86e7-4eb7-be21-4af0e8103ca7 req-f81f9bbb-fc59-48b1-97b2-6a3edc460bdf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:19.144784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0ba5381-86e7-4eb7-be21-4af0e8103ca7 req-f81f9bbb-fc59-48b1-97b2-6a3edc460bdf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:19.175495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a0ba5381-86e7-4eb7-be21-4af0e8103ca7 req-f81f9bbb-fc59-48b1-97b2-6a3edc460bdf service nova] Creating event network-changed:65288fa2-856b-4bcd-b79e-358cb9d13ee1 for instance 649c047e-3541-4d30-a07c-dc2788902dfd on nch2-master-1 Nov 20 20:54:19.181249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a0ba5381-86e7-4eb7-be21-4af0e8103ca7 req-f81f9bbb-fc59-48b1-97b2-6a3edc460bdf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111771 Nov 20 20:54:19.182236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1418/2786] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:19.192065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:19.193272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:19.205241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:19.208104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:19.209362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:19.209984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:19.944365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:19.952841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ef13f93-bfd2-4b4d-bc6d-30df18f56f74 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1317 microversion: 2.1 time: 0.769094 Nov 20 20:54:19.954241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1419/2787] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:19 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:19.969512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:19.971118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:19.978019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:19.978502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:19.980247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:19.980695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:20.067030 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00d96cce-b312-4b6b-b62f-ad82af144303 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.104826 Nov 20 20:54:20.068350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1420/2788] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:19 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:20.078405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:20.079648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:20.088230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:20.090251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:20.091398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:20.092047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:20.179509 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d249eff-ecc2-43a3-9240-2185177f62c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.109393 Nov 20 20:54:20.185466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1421/2789] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:20 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:20.194655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:20.195658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:20.204330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:20.205059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:20.206115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:20.206895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.036065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:21.036233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-209bdd8a-d74e-4a5f-89a8-2ff9a91db804 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action" status: 202 len: 0 microversion: 2.1 time: 2.331362 Nov 20 20:54:21.045533 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1369/2790] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:18 2021] POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action => generated 0 bytes in 2341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:21.050567 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c1e4639-1e49-486e-8852-b8ba7be2fe11 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.862919 Nov 20 20:54:21.051163 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1422/2791] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:20 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:21.051325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:21.063099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:21.065989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd17e7fa-e3cc-49e8-b50c-44c8b17cbecb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'create', calling method: .version_select at 0x7f3f86fd5ca0>, body: {"pool": null} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:21.086223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.086684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.087491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.087927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.847784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:21.867561 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7fd1940-bb13-477d-aee5-57dfcf3c4c37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1467 microversion: 2.1 time: 0.820832 Nov 20 20:54:21.870665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1370/2792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:21 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1467 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:21.884903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:21.886403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:21.901661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.902610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.903632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.904256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.955850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f542f050-6660-474d-a515-4c80de6d8347 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.076861 Nov 20 20:54:21.956550 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1371/2793] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:21 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:21.972339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:21.975542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:21.990264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.990861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:21.991554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:21.991932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.042971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-140e1590-0b89-49a7-9436-93cd607574a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.082086 Nov 20 20:54:22.047784 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1372/2794] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:21 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:22.054686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-54d2195f-1327-47f4-af3e-eb1c6cba1d90 req-151ad4f1-3e8c-47cd-bb66-d09adf681190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:22.056427 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:22.056427 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:22.069275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-54d2195f-1327-47f4-af3e-eb1c6cba1d90 req-151ad4f1-3e8c-47cd-bb66-d09adf681190 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.069779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-54d2195f-1327-47f4-af3e-eb1c6cba1d90 req-151ad4f1-3e8c-47cd-bb66-d09adf681190 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.083478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-54d2195f-1327-47f4-af3e-eb1c6cba1d90 req-151ad4f1-3e8c-47cd-bb66-d09adf681190 service nova] Creating event network-changed:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:54:22.090717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-54d2195f-1327-47f4-af3e-eb1c6cba1d90 req-151ad4f1-3e8c-47cd-bb66-d09adf681190 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044601 Nov 20 20:54:22.091703 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1373/2795] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:22.099646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0a874f8f-5878-4250-94ed-7e24a0ff8cb4 req-ca38d617-4a01-4aa7-87f1-65808fe9f49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b7cefa-0cde-4503-a8c6-102e37a1b57d", "tag": "750b5bfe-3b8d-4aec-8be2-266f1f451b32"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:22.101526 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:22.101526 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:22.132690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0a874f8f-5878-4250-94ed-7e24a0ff8cb4 req-ca38d617-4a01-4aa7-87f1-65808fe9f49a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.133158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0a874f8f-5878-4250-94ed-7e24a0ff8cb4 req-ca38d617-4a01-4aa7-87f1-65808fe9f49a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.147179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0a874f8f-5878-4250-94ed-7e24a0ff8cb4 req-ca38d617-4a01-4aa7-87f1-65808fe9f49a service nova] Creating event network-changed:750b5bfe-3b8d-4aec-8be2-266f1f451b32 for instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d on nch1-master-1 Nov 20 20:54:22.152633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0a874f8f-5878-4250-94ed-7e24a0ff8cb4 req-ca38d617-4a01-4aa7-87f1-65808fe9f49a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059527 Nov 20 20:54:22.153861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1374/2796] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:22.163947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:22.165318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:22.177351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.182943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.184112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.186074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.513330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1805bf43-54c4-42e2-a423-f36dbd2c0b50 tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1618 microversion: 2.1 time: 0.358334 Nov 20 20:54:22.530607 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1375/2797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:22 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1618 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:22.538366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:22.540093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:22.548041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.549052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.550131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:22.551143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:22.798866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:22.809139 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ec0cb67-afea-48a5-a9d6-6f09e5809bfb tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.277062 Nov 20 20:54:22.809859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1376/2798] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:22 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:22.961510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'create', calling method: .version_select at 0x7f3f87a855e0>, body: {"keypair": {"name": "tempest-keypair-1481134419"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:22.977518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for project 170ca59a5b074770be63f18691e7aa40. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:22.983389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for user 676538dfd9cc42d6bbbae90e6f4c09ba and project 170ca59a5b074770be63f18691e7aa40. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:23.492550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for project 170ca59a5b074770be63f18691e7aa40. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:23.499199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for user 676538dfd9cc42d6bbbae90e6f4c09ba and project 170ca59a5b074770be63f18691e7aa40. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:23.514984 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-327b3f31-3288-4d56-983d-e621111f41d8 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.704227 Nov 20 20:54:23.515832 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1377/2799] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:54:22 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:23.520853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1165896368", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d0202d45-4861-4548-b517-c5a02af49a0d"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:23.574525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:54:23.955509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:54:23.955954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:54:23.956688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:54:23.957144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:54:23.957564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:54:23.974814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:23.975270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:23.976101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:23.976540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.008445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:24.018778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Getting quotas for user bef88327b9f44c12a76983196b9a3ee8 and project 60778bfeb31b496081c05ccc33a74a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:24.038998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:54:24.041382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:54:24.110654 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d14c12a1-b33e-49d6-9078-18d14ee76b14 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593124 Nov 20 20:54:24.112389 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1378/2800] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:54:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:54:24.117079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:24.119096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:24.127106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.128081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.129453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.130175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.216193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac8265a1-29ab-4b84-aa2f-bed27d45f4a7 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.102308 Nov 20 20:54:24.216957 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1379/2801] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:24 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:24.227534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:24.235380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:24.252305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.253147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.255034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.256838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.321308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5fdb09bf-5ccb-42d7-aae2-2ed88b4ac680 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.102273 Nov 20 20:54:24.323852 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1380/2802] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:24.339870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:24.340680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:24.351192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.351714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.352446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:24.354703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:24.864941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:24.875114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0922288b-5d96-4ea2-bd5b-2bb212989352 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.549586 Nov 20 20:54:24.889500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1381/2803] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:24 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:24.895594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a107c53-922a-460e-8ee7-e77a05ff1b37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:24.896528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a107c53-922a-460e-8ee7-e77a05ff1b37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:25.407720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a107c53-922a-460e-8ee7-e77a05ff1b37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:25.444757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a107c53-922a-460e-8ee7-e77a05ff1b37 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1217 microversion: 2.1 time: 0.553446 Nov 20 20:54:25.456317 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1382/2804] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:24 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1217 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:25.462456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:25.463895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:25.474630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.484669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:25.486948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.487582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:25.563426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf7f771a-d2ab-497a-bd85-b169c8ed1a26 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 14 microversion: 2.1 time: 0.105299 Nov 20 20:54:25.566475 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1383/2805] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:25 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:25.580865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:25.582250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:25.592688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.593402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:25.594451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.600618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:25.693136 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dc6e4674-1e31-412a-a19b-704278b3fe76 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.127529 Nov 20 20:54:25.698459 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1384/2806] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:25 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:25.895185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:25.902740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:25.919015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.920010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:25.923014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:25.923719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.465146 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd17e7fa-e3cc-49e8-b50c-44c8b17cbecb tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.410846 Nov 20 20:54:26.466448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1423/2807] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:54:21 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:26.471796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:26.472670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:26.489980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.496420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.497593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.499804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.652109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:26.672476 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d700f577-1e5f-42af-9fd4-080327545617 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1275 microversion: 2.1 time: 0.202004 Nov 20 20:54:26.673759 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1424/2808] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:26 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1275 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:26.698586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.215"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:26.700031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:26.721642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.722658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.725419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.727097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.775964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Acquired lock "refresh_cache-3d6be238-5664-44e6-b4f8-2b26652e0cb1" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:54:26.779374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:26.787000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd5f77a8-ee7e-4a0d-aac4-7733f4f6f687 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.896238 Nov 20 20:54:26.787582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1385/2809] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:25 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:26.805363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:26.807294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:26.826681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.828861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.835825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.836567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.940111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c6e19b3-0285-4be6-b09a-d217273fcbae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 16398 microversion: 2.1 time: 0.149830 Nov 20 20:54:26.942216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1386/2810] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:26 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 16398 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:26.948615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:26.949972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:26.957056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.961612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:26.964249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:26.965074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:27.024909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24b10e8e-3902-4cd8-904e-05e741983a04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.080543 Nov 20 20:54:27.027393 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1387/2811] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:26 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:27.036025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a165c015-6336-4887-8830-b87d73789cc0"}], "security_groups": [{"name": "tempest-securitygroup--32992882"}], "key_name": "tempest-keypair-1481134419", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:27.239632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] validate_networks() for [('a165c015-6336-4887-8830-b87d73789cc0', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:54:27.989585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:54:27.990260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:54:27.990559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:54:27.990969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:54:27.991581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:54:28.007188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.008169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:28.012145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.013585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:28.056505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for project 170ca59a5b074770be63f18691e7aa40. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:28.077224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Getting quotas for user 676538dfd9cc42d6bbbae90e6f4c09ba and project 170ca59a5b074770be63f18691e7aa40. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:28.113880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:54:28.118308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:54:28.208232 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-619c38ae-6bad-4bc7-8872-9f532fb1d9a3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.178144 Nov 20 20:54:28.209891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1388/2812] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:54:27 2021] POST /compute/v2.1/servers => generated 407 bytes in 1182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:54:28.215187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:28.216808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:28.235680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.237173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:28.238567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.240359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:28.627322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:28.640911 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0293f2a-0cf5-40e1-862e-41102518639e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 0.429419 Nov 20 20:54:28.652916 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1389/2813] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:28 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:28.658727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:28.659338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:28.678252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.678711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:28.679513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:28.679947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.036493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:29.059322 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47747bdf-7335-47c2-8b23-2e5a789c1c5d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.404828 Nov 20 20:54:29.059921 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1390/2814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:28 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:29.064313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:29.065287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:29.083249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.083952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.084953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.086335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.189001 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-435e4d1e-138a-463c-a882-710caa88384c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 16398 microversion: 2.1 time: 0.127594 Nov 20 20:54:29.192982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1391/2815] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:29 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 16398 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:29.215069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:29.216287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:29.232656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.233118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.233929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.237555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.317509 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dae85913-589a-48e8-843d-f6562671be12 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.123052 Nov 20 20:54:29.318208 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1392/2816] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:29 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:29.325712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:29.326393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:29.364109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.364566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.365746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:29.366583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:29.496910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:29.506472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a67cad05-1582-4739-94f8-e7f1767cdb4d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1278 microversion: 2.1 time: 0.187069 Nov 20 20:54:29.507398 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1393/2817] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:29 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:29.601762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-084f9892-ab63-450c-a88c-78d24c79fda7 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Action: 'create', calling method: .version_select at 0x7f3f878e4820>, body: {"pool": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:30.210089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:54:31.735025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-084f9892-ab63-450c-a88c-78d24c79fda7 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.223435 Nov 20 20:54:31.735644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1394/2818] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:54:29 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:31.741539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:31.742890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:31.749748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:31.750235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:31.751026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:31.751459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.054599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:32.066715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b00ab9ff-7427-46e1-9fd5-f02d3b470a45 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 0.329861 Nov 20 20:54:32.067606 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1395/2819] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:31 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:32.075933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6261378b-0965-4319-9ac2-4b4f7fc3bb1c req-560ba96b-de58-435f-9f4d-b4cb1937bbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b7cefa-0cde-4503-a8c6-102e37a1b57d", "name": "network-vif-plugged", "status": "completed", "tag": "750b5bfe-3b8d-4aec-8be2-266f1f451b32"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:32.079914 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:32.079914 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:32.101518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6261378b-0965-4319-9ac2-4b4f7fc3bb1c req-560ba96b-de58-435f-9f4d-b4cb1937bbf2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.101960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6261378b-0965-4319-9ac2-4b4f7fc3bb1c req-560ba96b-de58-435f-9f4d-b4cb1937bbf2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.130573 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6261378b-0965-4319-9ac2-4b4f7fc3bb1c req-560ba96b-de58-435f-9f4d-b4cb1937bbf2 service nova] Creating event network-vif-plugged:750b5bfe-3b8d-4aec-8be2-266f1f451b32 for instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d on nch1-master-1 Nov 20 20:54:32.146493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6261378b-0965-4319-9ac2-4b4f7fc3bb1c req-560ba96b-de58-435f-9f4d-b4cb1937bbf2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074971 Nov 20 20:54:32.152324 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1396/2820] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:32.159010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:32.160206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:32.179557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.180429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.181590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.182507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.294151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Updating instance_info_cache with network_info: [{"id": "f1bd4c4a-0fa6-457c-a111-718b20fa5663", "address": "fa:16:3e:fe:9b:30", "network": {"id": "7c0e623a-f529-4e97-805b-d4b7151232ec", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1059511039-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "59c483cdab9f4467a9c5bdd3b6c8357e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf1bd4c4a-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:54:32.329576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Releasing lock "refresh_cache-3d6be238-5664-44e6-b4f8-2b26652e0cb1" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:54:32.331258 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d841963e-3967-40e9-b518-15a859e8912e tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action" status: 202 len: 0 microversion: 2.1 time: 5.655132 Nov 20 20:54:32.336452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1425/2821] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:26 2021] POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action => generated 0 bytes in 5662 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:54:32.343504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:32.345322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:32.354451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.355328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.357786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.360991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.435683 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60b8a2c8-3d09-4f46-bcd3-f67564d99b63 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.096820 Nov 20 20:54:32.441015 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1426/2822] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:32 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:32.446767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ff4b5a0a-dfe6-491c-b12d-bdb20df92cdb req-53272227-7562-4a8f-8d87-e8209ba1ef05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:32.449494 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:32.449494 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:32.459119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ff4b5a0a-dfe6-491c-b12d-bdb20df92cdb req-53272227-7562-4a8f-8d87-e8209ba1ef05 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.459964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ff4b5a0a-dfe6-491c-b12d-bdb20df92cdb req-53272227-7562-4a8f-8d87-e8209ba1ef05 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.474449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:32.475946 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ff4b5a0a-dfe6-491c-b12d-bdb20df92cdb req-53272227-7562-4a8f-8d87-e8209ba1ef05 service nova] Creating event network-changed:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:54:32.482349 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ff4b5a0a-dfe6-491c-b12d-bdb20df92cdb req-53272227-7562-4a8f-8d87-e8209ba1ef05 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039436 Nov 20 20:54:32.483873 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1427/2823] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:32.485834 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9153d88-6ff7-4700-9e83-fe4119f527f4 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1307 microversion: 2.1 time: 0.330565 Nov 20 20:54:32.486751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1397/2824] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:32 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:32.497080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:32.501255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:32.519484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.519932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.520740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.521179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.525418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:32.527208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:32.539600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.540305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.541735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:32.542520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:32.638173 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f91ae02d-4899-4c7c-8c1f-682f3df50499 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.152268 Nov 20 20:54:32.639170 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1428/2825] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:32 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:32.645594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e48857d3-7f57-4a5e-932b-09e45dfe1d93 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f87259310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:32.828710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:32.836626 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2245dd8-8154-46a3-9e80-ba834fa1fc06 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.345231 Nov 20 20:54:32.837268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1398/2826] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:32 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:32.844855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.215"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:33.117537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:33.124594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:33.125532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:33.126961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:33.127645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:33.133629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e48857d3-7f57-4a5e-932b-09e45dfe1d93 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips/1442752c-9e47-46ec-b25a-c58ad1012993" status: 200 len: 142 microversion: 2.1 time: 0.492475 Nov 20 20:54:33.134572 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1429/2827] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:54:32 2021] GET /compute/v2.1/os-floating-ips/1442752c-9e47-46ec-b25a-c58ad1012993 => generated 142 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:33.139226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:33.140186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:33.155675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:33.156202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:33.157080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:33.159047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:33.533726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Acquired lock "refresh_cache-3d6be238-5664-44e6-b4f8-2b26652e0cb1" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:54:34.151158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:34.165102 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e6edf23b-a7c1-4931-8fa6-6c28eba4d379 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 1.029168 Nov 20 20:54:34.169946 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1430/2828] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:33 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:34.175647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef6d5459-1497-4b68-9bea-6e6a2c93f650 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f8693d3a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:34.658436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef6d5459-1497-4b68-9bea-6e6a2c93f650 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.487137 Nov 20 20:54:34.659384 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1431/2829] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:54:34 2021] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:34.667474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:34.670074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:34.679343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:34.680079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:34.681726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:34.682502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:34.764193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c87d3b83-109d-402a-832c-c836201c438f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.102823 Nov 20 20:54:34.765401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1432/2830] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:34 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:34.784949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:34.784949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:34.792165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:34.792756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:34.793734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:34.794453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.121216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:35.129883 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a106e56b-71ed-42ea-bb23-2b87e5ddd5b6 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1486 microversion: 2.1 time: 0.360369 Nov 20 20:54:35.135821 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1433/2831] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:34 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1486 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:35.137018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:35.137972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:35.147172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:35.147634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.148442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:35.148888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.208403 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d6204fc3-2fd1-45a3-aa93-122bd1b58c9f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.076044 Nov 20 20:54:35.209620 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1434/2832] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:35 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:35.215336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:35.216072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:35.223239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:35.223696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.224501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:35.224942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.274347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Building network info cache for instance {{(pid=140941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:54:35.558241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:35.566162 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a31a69ce-5979-4971-87ec-bf3ce429fa9f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.355118 Nov 20 20:54:35.566772 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1435/2833] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:35 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:35.581287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6744f184-6d59-4378-a67b-bea7e4d1782a req-32c817c6-88de-4d86-8c83-e1f65eab523c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d035c3-0fd0-4d00-bff1-2eb652dcc037", "tag": "d70779e8-408f-4a77-b101-71a029e143c9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:35.588995 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:35.588995 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:35.608725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6744f184-6d59-4378-a67b-bea7e4d1782a req-32c817c6-88de-4d86-8c83-e1f65eab523c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:35.609827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6744f184-6d59-4378-a67b-bea7e4d1782a req-32c817c6-88de-4d86-8c83-e1f65eab523c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:35.624922 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6744f184-6d59-4378-a67b-bea7e4d1782a req-32c817c6-88de-4d86-8c83-e1f65eab523c service nova] Creating event network-changed:d70779e8-408f-4a77-b101-71a029e143c9 for instance d3d035c3-0fd0-4d00-bff1-2eb652dcc037 on nch1-master-1 Nov 20 20:54:35.630857 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6744f184-6d59-4378-a67b-bea7e4d1782a req-32c817c6-88de-4d86-8c83-e1f65eab523c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052998 Nov 20 20:54:35.631673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1436/2834] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:35.645785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-864c72c8-16ee-4532-8959-d7dd49a7ac19 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f873605e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:36.381996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Updating instance_info_cache with network_info: [{"id": "f1bd4c4a-0fa6-457c-a111-718b20fa5663", "address": "fa:16:3e:fe:9b:30", "network": {"id": "7c0e623a-f529-4e97-805b-d4b7151232ec", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1059511039-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "59c483cdab9f4467a9c5bdd3b6c8357e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapf1bd4c4a-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:54:36.419996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Releasing lock "refresh_cache-3d6be238-5664-44e6-b4f8-2b26652e0cb1" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:54:36.421696 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0010315-c546-45d3-b307-2f2cd8246965 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action" status: 202 len: 0 microversion: 2.1 time: 3.583579 Nov 20 20:54:36.423084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1399/2835] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:32 2021] POST /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1/action => generated 0 bytes in 3585 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:54:36.429335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-47038217"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:36.432717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:36.441993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:36.443257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:36.444413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:36.445449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:36.862413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09035ea4-528e-4737-823a-eeb60f4414d3 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "POST /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d/action" status: 202 len: 0 microversion: 2.1 time: 0.436642 Nov 20 20:54:36.864563 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1400/2836] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:36 2021] POST /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 20:54:36.886450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:36.890295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:36.905643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:36.906736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:36.908919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:36.909521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.132754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-864c72c8-16ee-4532-8959-d7dd49a7ac19 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/1442752c-9e47-46ec-b25a-c58ad1012993" status: 202 len: 0 microversion: 2.1 time: 1.492045 Nov 20 20:54:37.133352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1437/2837] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:54:35 2021] DELETE /compute/v2.1/os-floating-ips/1442752c-9e47-46ec-b25a-c58ad1012993 => generated 0 bytes in 1501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:37.143747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7b92e348-c664-4bb1-9594-ffc162414f8e req-feb80f1d-ea30-42f0-9179-fae68d5a1eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:37.147806 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:37.147806 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:37.163456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7b92e348-c664-4bb1-9594-ffc162414f8e req-feb80f1d-ea30-42f0-9179-fae68d5a1eb4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.163918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7b92e348-c664-4bb1-9594-ffc162414f8e req-feb80f1d-ea30-42f0-9179-fae68d5a1eb4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.177842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7b92e348-c664-4bb1-9594-ffc162414f8e req-feb80f1d-ea30-42f0-9179-fae68d5a1eb4 service nova] Creating event network-changed:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:54:37.183063 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7b92e348-c664-4bb1-9594-ffc162414f8e req-feb80f1d-ea30-42f0-9179-fae68d5a1eb4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048555 Nov 20 20:54:37.184731 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1438/2838] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:37.190533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:37.192001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:37.202504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.203286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.205313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.205781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.226237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:37.233698 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a274ba23-192e-4a0e-84d3-b1f5f34f83b2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 0.358524 Nov 20 20:54:37.243055 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1401/2839] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:36 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:37.249224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:37.250736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:37.264797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.265236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.266270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.266872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.285497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6cb84284-39c8-4156-969d-09d3bc8a2ca4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.098450 Nov 20 20:54:37.287570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1439/2840] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:37 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:37.305079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c48f7ad-d704-4093-bbc0-b9bfda88bcee tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '.version_select at 0x7f3f86fd5430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:37.323495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79b3eccc-1b79-4843-b22b-4253a8dc2a6d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.077678 Nov 20 20:54:37.325018 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1402/2841] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:37 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:37.342811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:37.343542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:37.353465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.354750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.355808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:37.356471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:37.584450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:37.593849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e27af27-3266-4f9d-8423-f8c885484d63 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.267303 Nov 20 20:54:37.594897 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1403/2842] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:37 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:37.605209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ddc2a48-d3d2-450c-8e06-02ca5e809610 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f878e4d30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:37.660096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ddc2a48-d3d2-450c-8e06-02ca5e809610 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1" status: 200 len: 1410 microversion: 2.1 time: 0.060571 Nov 20 20:54:37.660843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1404/2843] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:37 2021] GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1 => generated 1410 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:37.665827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2b84a63-0242-4d45-851b-4d3011158ccc tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Action: 'create', calling method: .version_select at 0x7f3f87a3ff70>, body: {"pool": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:38.852860 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2b84a63-0242-4d45-851b-4d3011158ccc tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.190858 Nov 20 20:54:38.858748 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1405/2844] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:54:37 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:38.873564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b71797a9-a945-4c1e-9693-2bc94574ce23 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8702e8b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:38.928220 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b71797a9-a945-4c1e-9693-2bc94574ce23 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1" status: 200 len: 1410 microversion: 2.1 time: 0.072308 Nov 20 20:54:38.933473 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1406/2845] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:38 2021] GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1 => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:38.940305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-68e5331a-1547-45e9-86f1-10f880cfa8a0 req-451248e2-f69c-492c-8e6f-cdc8ea146143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "797fe36e-be61-49c1-a438-56124738f92d", "tag": "8732f318-293e-426d-9e8f-6b1fe937a69e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:38.942910 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:38.942910 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:38.953789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68e5331a-1547-45e9-86f1-10f880cfa8a0 req-451248e2-f69c-492c-8e6f-cdc8ea146143 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:38.954445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68e5331a-1547-45e9-86f1-10f880cfa8a0 req-451248e2-f69c-492c-8e6f-cdc8ea146143 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:38.966480 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-68e5331a-1547-45e9-86f1-10f880cfa8a0 req-451248e2-f69c-492c-8e6f-cdc8ea146143 service nova] Creating event network-changed:8732f318-293e-426d-9e8f-6b1fe937a69e for instance 797fe36e-be61-49c1-a438-56124738f92d on nch1-master-1 Nov 20 20:54:38.972480 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-68e5331a-1547-45e9-86f1-10f880cfa8a0 req-451248e2-f69c-492c-8e6f-cdc8ea146143 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036558 Nov 20 20:54:38.973450 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1407/2846] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:38.979010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:38.979798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:38.992356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:38.994653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:38.996245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:38.996752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.138588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:39.146358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ad1e4e9-50b1-45b6-8f64-cd28cee1c18f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 0.171731 Nov 20 20:54:39.146932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1408/2847] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:38 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:39.152122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:39.153067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:39.158764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.159195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.159974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.160403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.203466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52c72ab1-0ec5-417c-8fe7-90289db925bf tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.055241 Nov 20 20:54:39.207111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1409/2848] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:39 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:39.209179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:39.210211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:39.217556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.218006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.218815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.219246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.261621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0429444-00db-4994-aaf0-9c3cebbb02cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.056066 Nov 20 20:54:39.262555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1410/2849] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:39.267240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:39.267946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:39.275014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.276234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.277011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.277444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.434329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:39.444242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d42104e9-56fb-4b44-a37f-e4ee0f8f50eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.180686 Nov 20 20:54:39.445174 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1411/2850] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:39 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:39.455177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f152e6ed-4f68-4561-bd68-34be2267c6de tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f87cd81f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:39.616451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c48f7ad-d704-4093-bbc0-b9bfda88bcee tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/0b077b54-4613-42da-bf3c-577d4d930c2a" status: 202 len: 0 microversion: 2.1 time: 2.327458 Nov 20 20:54:39.617721 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1440/2851] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:54:37 2021] DELETE /compute/v2.1/os-floating-ips/0b077b54-4613-42da-bf3c-577d4d930c2a => generated 0 bytes in 2330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:39.622740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c5237424-ac7c-4bee-ae68-a685c34e97fc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8693de50>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:39.757398 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c5237424-ac7c-4bee-ae68-a685c34e97fc tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1" status: 204 len: 0 microversion: 2.1 time: 0.138199 Nov 20 20:54:39.757997 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1441/2852] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:39 2021] DELETE /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:39.766701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4acdf601-292f-4fcc-99a4-9c2e32f0651c req-813d49af-703b-4ef3-8521-8fe5096f637e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d035c3-0fd0-4d00-bff1-2eb652dcc037", "name": "network-vif-plugged", "status": "completed", "tag": "d70779e8-408f-4a77-b101-71a029e143c9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:39.769134 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:39.769134 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:39.778397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4acdf601-292f-4fcc-99a4-9c2e32f0651c req-813d49af-703b-4ef3-8521-8fe5096f637e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:39.779348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4acdf601-292f-4fcc-99a4-9c2e32f0651c req-813d49af-703b-4ef3-8521-8fe5096f637e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:39.790472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4acdf601-292f-4fcc-99a4-9c2e32f0651c req-813d49af-703b-4ef3-8521-8fe5096f637e service nova] Creating event network-vif-plugged:d70779e8-408f-4a77-b101-71a029e143c9 for instance d3d035c3-0fd0-4d00-bff1-2eb652dcc037 on nch1-master-1 Nov 20 20:54:39.797440 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4acdf601-292f-4fcc-99a4-9c2e32f0651c req-813d49af-703b-4ef3-8521-8fe5096f637e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Nov 20 20:54:39.801011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1442/2853] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:39.806985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f12a28f-f8e8-4975-8e68-ceec3b4958c1 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '.version_select at 0x7f3f872168b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.221900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f12a28f-f8e8-4975-8e68-ceec3b4958c1 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/67b9a182-8e87-42e1-b866-5fa94524ce17" status: 202 len: 0 microversion: 2.1 time: 0.419606 Nov 20 20:54:40.222596 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1443/2854] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:54:39 2021] DELETE /compute/v2.1/os-security-groups/67b9a182-8e87-42e1-b866-5fa94524ce17 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:40.232347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61b4145a-9a76-4c96-9762-dc025e47379c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f870e7f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.272061 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-61b4145a-9a76-4c96-9762-dc025e47379c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Image not found. Nov 20 20:54:40.272668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61b4145a-9a76-4c96-9762-dc025e47379c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:40.273695 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61b4145a-9a76-4c96-9762-dc025e47379c tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1" status: 404 len: 62 microversion: 2.1 time: 0.046053 Nov 20 20:54:40.274322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1444/2855] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:40 2021] GET /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:40.279436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.280155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.287688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.288134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.288927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.289361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.444132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:40.452717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe20c774-0d80-433c-97dd-a847fd1c0876 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1317 microversion: 2.1 time: 0.177423 Nov 20 20:54:40.453309 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1445/2856] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:40 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:40.458205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:40.459170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.466039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.466431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.467225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.467665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.508596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa3ecf81-e2a5-4777-9c4f-ab7a76fb28cb tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.054027 Nov 20 20:54:40.512966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1446/2857] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:40 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:40.514863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.515445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.522798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.523233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.524087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.524760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.552087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:40.633101 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72625601-f979-4972-a6d8-64e0cfd37a24 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 204 len: 0 microversion: 2.1 time: 0.121713 Nov 20 20:54:40.633845 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1447/2858] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:40 2021] DELETE /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:40.643987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:40.644982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.651503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.651925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.653335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.653335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.706933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc96d7f7-b129-4ee7-8540-382d0c5c05a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.067010 Nov 20 20:54:40.708492 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1448/2859] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:40 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:40.714845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.715921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.724246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.724869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.726386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.726934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.844176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f152e6ed-4f68-4561-bd68-34be2267c6de tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d" status: 202 len: 0 microversion: 2.1 time: 1.392407 Nov 20 20:54:40.845311 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1412/2860] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:54:39 2021] DELETE /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d => generated 0 bytes in 1400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:40.850863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:40.851491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:40.859980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.860435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:40.861426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:40.862159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.014751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:41.023893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ef093ac-bd32-48fa-8c91-63bd7ffa1941 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.177100 Nov 20 20:54:41.024880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1413/2861] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:40 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:41.029804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.030518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.036624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.037150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.038021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.038565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.208271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:41.223407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f95d74a0-ba9b-4860-9317-4e28aec66079 tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1510 microversion: 2.1 time: 0.196909 Nov 20 20:54:41.224769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1414/2862] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:41 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:41.231983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96555a7a-798b-40b6-a014-c6998ba1cede tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f87a3fe50>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.283131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-96555a7a-798b-40b6-a014-c6998ba1cede tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d could not be found", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:41.284772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-96555a7a-798b-40b6-a014-c6998ba1cede tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] HTTP exception thrown: Floating IP not found for ID cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d Nov 20 20:54:41.285645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96555a7a-798b-40b6-a014-c6998ba1cede tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Returning 404 to user: Floating IP not found for ID cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:41.286677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96555a7a-798b-40b6-a014-c6998ba1cede tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d" status: 404 len: 111 microversion: 2.1 time: 0.060811 Nov 20 20:54:41.287731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1415/2863] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:54:41 2021] GET /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:41.296921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f3d5bc4-5ce6-4daa-9438-031d9bb57259 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Calling method '.version_select at 0x7f3f879dc8b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.332203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:41.342304 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a81e10c0-9dd3-4564-b72d-579007ea0e54 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1486 microversion: 2.1 time: 0.632022 Nov 20 20:54:41.355740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-9f3d5bc4-5ce6-4daa-9438-031d9bb57259 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d could not be found", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:41.356215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1449/2864] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:40 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1486 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:41.356361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9f3d5bc4-5ce6-4daa-9438-031d9bb57259 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] HTTP exception thrown: Floating IP not found for ID cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d Nov 20 20:54:41.357350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f3d5bc4-5ce6-4daa-9438-031d9bb57259 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] Returning 404 to user: Floating IP not found for ID cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:41.358347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f3d5bc4-5ce6-4daa-9438-031d9bb57259 tempest-FloatingIPsTestJSON-2056588219 tempest-FloatingIPsTestJSON-2056588219-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d" status: 404 len: 111 microversion: 2.1 time: 0.065771 Nov 20 20:54:41.361522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.362257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.375299 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1416/2865] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:54:41 2021] DELETE /compute/v2.1/os-floating-ips/cd96d7fb-42f6-4f0e-9b10-5968b9f38b6d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:41.391685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.392534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.393763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.394894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.440144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:41.471997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.472900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.486408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.486882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.491375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.491840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.565199 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c86bddd5-1643-42f4-a766-0d21cacdf346 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 204 len: 0 microversion: 2.1 time: 0.206755 Nov 20 20:54:41.566559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1450/2866] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:41 2021] DELETE /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:41.579910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:41.581064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.600554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.601140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.602041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.602701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.659976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b2c22c2-e838-49b6-8cd3-272bf7048228 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.085946 Nov 20 20:54:41.663967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1451/2867] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:41 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:41.669942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25d8453d-8a7f-4c84-a319-94eb606d0b9d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86f36670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.709859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-25d8453d-8a7f-4c84-a319-94eb606d0b9d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Image not found. Nov 20 20:54:41.710558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25d8453d-8a7f-4c84-a319-94eb606d0b9d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:41.711443 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25d8453d-8a7f-4c84-a319-94eb606d0b9d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1" status: 404 len: 62 microversion: 2.1 time: 0.049376 Nov 20 20:54:41.712209 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1452/2868] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:41 2021] DELETE /compute/v2.1/images/2350c5d8-04c7-43c2-b8e5-edb5d54f0cb1 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:41.725353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:41.726708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.734148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.735003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.736244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.736987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.798815 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97df9220-2f1b-457c-bd9c-577876f4c5a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.079566 Nov 20 20:54:41.799955 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1453/2869] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:41.806408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.807077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.815217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.819096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.820181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.821032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.850644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:41.860507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:41.872694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9040e2a8-a450-463c-886f-edabedc97af4 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1467 microversion: 2.1 time: 0.403649 Nov 20 20:54:41.873297 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1417/2870] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:41 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1467 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:41.896006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.897847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.907383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.908502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.911278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.912088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.930718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Instance is already in deleting state, ignoring this request Nov 20 20:54:41.931737 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8d903cb-843e-44a7-b075-43d1ec37b478 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 204 len: 0 microversion: 2.1 time: 0.130410 Nov 20 20:54:41.932886 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1454/2871] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:41 2021] DELETE /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:41.947846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:41.951319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:41.961218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.961975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:41.963774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:41.964654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.129150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:42.140379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4ce4ece-5681-42d6-94c8-fc1f6b685627 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1492 microversion: 2.1 time: 0.201715 Nov 20 20:54:42.141002 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1455/2872] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:41 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1492 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:42.149713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:42.151127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.157257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.157736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.158593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.159061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.261341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26365d58-b4b4-4eb6-befe-e27bd277415e tempest-ServersOnMultiNodesTest-854822447 tempest-ServersOnMultiNodesTest-854822447-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1618 microversion: 2.1 time: 0.375459 Nov 20 20:54:42.262118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1418/2873] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:41 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1618 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:42.266984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:42.267893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.274395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.274836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.276337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.277034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.318778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:42.327246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1d8f09c-0e49-4bb2-b2b0-3ebc30af4d98 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.185109 Nov 20 20:54:42.327886 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1456/2874] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:42 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:42.332339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:42.332842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.339248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.339702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.340492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.340932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.366506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:42.449994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97b5d92c-2dd8-44af-9594-0728d3d74e2e tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 204 len: 0 microversion: 2.1 time: 0.120809 Nov 20 20:54:42.453516 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1457/2875] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:42 2021] DELETE /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:42.470988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:42.470988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.476874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.477395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.478620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.479376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.622265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:42.627510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:42.632171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca2a3534-9d35-4d6c-805a-4f26d114e0be tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1510 microversion: 2.1 time: 0.368765 Nov 20 20:54:42.632919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1419/2876] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:42 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:42.635958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be7e95d3-acb5-4549-a675-ad9b660b79a6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1473 microversion: 2.1 time: 0.180214 Nov 20 20:54:42.637092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1458/2877] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:42 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:42.674495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:42.675448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.681949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.682443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.683245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.683676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.723717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9f9caf4-70b1-4f1d-ae4c-c0f6de2c7352 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.053180 Nov 20 20:54:42.727410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1420/2878] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:42 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:42.811284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:42.812565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:42.819276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.819814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.820773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.821250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.889861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bbdcf9f-e247-4e0b-9321-c55f693fccba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.082182 Nov 20 20:54:42.890929 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1459/2879] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:42 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:42.958687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a07d3648-ddb3-47c4-ba8b-bde6aab69927 req-30b68146-579a-4029-a8a7-08ef9d754f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b7cefa-0cde-4503-a8c6-102e37a1b57d", "name": "network-vif-plugged", "status": "completed", "tag": "750b5bfe-3b8d-4aec-8be2-266f1f451b32"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:42.960226 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:42.960226 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:42.970872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a07d3648-ddb3-47c4-ba8b-bde6aab69927 req-30b68146-579a-4029-a8a7-08ef9d754f1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:42.971338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a07d3648-ddb3-47c4-ba8b-bde6aab69927 req-30b68146-579a-4029-a8a7-08ef9d754f1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:42.984774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a07d3648-ddb3-47c4-ba8b-bde6aab69927 req-30b68146-579a-4029-a8a7-08ef9d754f1a service nova] Creating event network-vif-plugged:750b5bfe-3b8d-4aec-8be2-266f1f451b32 for instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d on nch1-master-1 Nov 20 20:54:42.990208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a07d3648-ddb3-47c4-ba8b-bde6aab69927 req-30b68146-579a-4029-a8a7-08ef9d754f1a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 Nov 20 20:54:42.991779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1421/2880] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:43.158322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:43.159115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:43.168103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.169466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.171070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.171805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.345525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:43.346243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:43.354616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.355360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.356158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.356759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.390780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:43.409389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2908ea81-82b7-4f81-b7a1-e19176e93181 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1492 microversion: 2.1 time: 0.255252 Nov 20 20:54:43.419883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1460/2881] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:43 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1492 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:43.600015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:43.609616 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f09275d-a823-4fe6-a84b-71bfe07eb8b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.268660 Nov 20 20:54:43.610799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1422/2882] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:43 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:43.655448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:43.656956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:43.658503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:43.659397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:43.675256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.676543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.677065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.677732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.680129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.680683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.681976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:43.682808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:43.984636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:43.995455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4decd176-2d1f-490c-bc4d-e86a7cd34bf6 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1473 microversion: 2.1 time: 0.345579 Nov 20 20:54:43.996077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1423/2883] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:43 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1473 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:44.002122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:44.003310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:44.031999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.032491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.033512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.033955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.064508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a808360bed4a0fb23cfab904c97a85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c483cdab9f4467a9c5bdd3b6c8357e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:44.075329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1c44eae-7745-45ff-9136-ce1a36f51f2f tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 200 len: 1510 microversion: 2.1 time: 0.429183 Nov 20 20:54:44.085481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1461/2884] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:43 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 1510 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:44.091429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:44.091670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7692a2f5-89eb-491e-829b-b90352bf4e81 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.093048 Nov 20 20:54:44.092826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:44.093577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1424/2885] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:43 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:44.100026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.100844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.101852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.102545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.155337 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50a12d90-9e78-4319-a8cd-fd3b4ce7a81a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.067101 Nov 20 20:54:44.156152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1462/2886] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:44 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:44.427675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:44.428418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:44.443819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.445499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.446532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.447314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.553343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cf6f01f3-661b-4728-9003-f497f13cc52e req-0389a2a4-c280-4d3e-a183-0c74817ac97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6be238-5664-44e6-b4f8-2b26652e0cb1", "name": "network-vif-deleted", "tag": "f1bd4c4a-0fa6-457c-a111-718b20fa5663"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:44.555495 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:44.555495 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:44.573487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf6f01f3-661b-4728-9003-f497f13cc52e req-0389a2a4-c280-4d3e-a183-0c74817ac97f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.574329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf6f01f3-661b-4728-9003-f497f13cc52e req-0389a2a4-c280-4d3e-a183-0c74817ac97f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.595676 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cf6f01f3-661b-4728-9003-f497f13cc52e req-0389a2a4-c280-4d3e-a183-0c74817ac97f service nova] Creating event network-vif-deleted:f1bd4c4a-0fa6-457c-a111-718b20fa5663 for instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 on nch1-master-1 Nov 20 20:54:44.603718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cf6f01f3-661b-4728-9003-f497f13cc52e req-0389a2a4-c280-4d3e-a183-0c74817ac97f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069277 Nov 20 20:54:44.605207 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1463/2887] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:54:44.627988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:44.628757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:44.637388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.637948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:44.639027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:44.639548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.286630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48554aa52ebf468fa74262b1bf8ab300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e20e99a6534d5d95e9d012160657a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:45.299128 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f0d9243-3da2-438c-882e-db2afb66f5d9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 200 len: 1492 microversion: 2.1 time: 0.875617 Nov 20 20:54:45.300553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1425/2888] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:44 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 1492 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:45.310096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:45.310096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:45.313042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:45.318163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.318632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.319457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.319904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.323726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33d82bf8-64bd-4926-b178-838da6aed530 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.698384 Nov 20 20:54:45.324869 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1464/2889] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:44 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:45.336095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:45.336751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] [instance: 3d6be238-5664-44e6-b4f8-2b26652e0cb1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:45.346433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.346901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.347844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.348335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.369770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] HTTP exception thrown: Instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 could not be found. Nov 20 20:54:45.370755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] Returning 404 to user: Instance 3d6be238-5664-44e6-b4f8-2b26652e0cb1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:45.372746 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d00951a4-a61d-4942-bab8-c27be0b5e6ac tempest-ServerRescueTestJSONUnderV235-2100032891 tempest-ServerRescueTestJSONUnderV235-2100032891-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1" status: 404 len: 111 microversion: 2.1 time: 0.046016 Nov 20 20:54:45.374728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1465/2890] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:45 2021] GET /compute/v2.1/servers/3d6be238-5664-44e6-b4f8-2b26652e0cb1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:45.386021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:45.387384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:45.396665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.397524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.399383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.400720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.451951 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2b33bbc3-bfd2-4acc-8fde-e9d990babcbc tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.075564 Nov 20 20:54:45.452794 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1466/2891] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:45 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:45.459985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-929555e3-2726-4e4b-bd6d-def6f650befe req-f6d0e966-052c-4d99-a5da-ca278a111f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797fe36e-be61-49c1-a438-56124738f92d", "name": "network-vif-plugged", "status": "completed", "tag": "8732f318-293e-426d-9e8f-6b1fe937a69e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:45.462148 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:45.462148 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:45.484096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:45.500673 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85968d08-26a6-42b3-a2c5-eeed191fa1ae tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1431 microversion: 2.1 time: 0.198883 Nov 20 20:54:45.502913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-929555e3-2726-4e4b-bd6d-def6f650befe req-f6d0e966-052c-4d99-a5da-ca278a111f78 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.504352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1426/2892] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:45 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1431 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:45.505603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-929555e3-2726-4e4b-bd6d-def6f650befe req-f6d0e966-052c-4d99-a5da-ca278a111f78 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.518409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:45.519590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:45.541908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.542630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.545994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:45.547260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:45.597436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-929555e3-2726-4e4b-bd6d-def6f650befe req-f6d0e966-052c-4d99-a5da-ca278a111f78 service nova] Creating event network-vif-plugged:8732f318-293e-426d-9e8f-6b1fe937a69e for instance 797fe36e-be61-49c1-a438-56124738f92d on nch1-master-1 Nov 20 20:54:45.620916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-929555e3-2726-4e4b-bd6d-def6f650befe req-f6d0e966-052c-4d99-a5da-ca278a111f78 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161907 Nov 20 20:54:45.622885 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1467/2893] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:45.658308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ee0ed5a9-8063-4add-89f6-ef123995ef67 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.149855 Nov 20 20:54:45.660406 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1427/2894] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:45 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:46.320915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.321737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 51b7cefa-0cde-4503-a8c6-102e37a1b57d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.341521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.343909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.348582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.351547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.354763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.355284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.374830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.375731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.378618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.381622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.411685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d could not be found. Nov 20 20:54:46.420822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:46.421707 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7db8585b-0b01-484d-ac61-ac28bab8aa1d tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d" status: 404 len: 111 microversion: 2.1 time: 0.107652 Nov 20 20:54:46.428137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1468/2895] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] GET /compute/v2.1/servers/51b7cefa-0cde-4503-a8c6-102e37a1b57d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:46.437609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a1b0bc9-13be-404d-9a2f-655f1068dcd2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f8711d280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.487941 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3a1b0bc9-13be-404d-9a2f-655f1068dcd2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Image not found. Nov 20 20:54:46.488551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a1b0bc9-13be-404d-9a2f-655f1068dcd2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:46.489385 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a1b0bc9-13be-404d-9a2f-655f1068dcd2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc" status: 404 len: 62 microversion: 2.1 time: 0.056126 Nov 20 20:54:46.490320 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1469/2896] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] DELETE /compute/v2.1/images/10e036d5-dd90-46ea-99dc-ca0d024854bc => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:46.496554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:46.497808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.511808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.512721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.513813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.521073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.588445 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-449579ac-0e46-4576-8daf-f3339651067e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 24568 microversion: 2.1 time: 0.095197 Nov 20 20:54:46.590359 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1470/2897] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:46 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 24568 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:46.598979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.599818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.615599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.616511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.617539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.618311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.658567 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b could not be found. Nov 20 20:54:46.659848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:46.660980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb742cf0-0850-4228-87cf-8c5474ee4a88 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 404 len: 111 microversion: 2.1 time: 0.069201 Nov 20 20:54:46.662496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1471/2898] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:46 2021] DELETE /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:46.671065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.672594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.683133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.683720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.684638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.685097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.724124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.724582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.725052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lazy-loading 'fault' on Instance uuid d3d035c3-0fd0-4d00-bff1-2eb652dcc037 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:54:46.771479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:46.781237 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea05f061-0457-42d4-85b7-f2406b784baf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 200 len: 1307 microversion: 2.1 time: 0.116903 Nov 20 20:54:46.783195 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1472/2899] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:46.797003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b7cefa-0cde-4503-a8c6-102e37a1b57d", "name": "network-vif-deleted", "tag": "750b5bfe-3b8d-4aec-8be2-266f1f451b32"}, {"server_uuid": "d3d035c3-0fd0-4d00-bff1-2eb652dcc037", "name": "network-vif-deleted", "tag": "d70779e8-408f-4a77-b101-71a029e143c9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:46.800243 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:46.800243 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:46.813917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.814646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.835441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] Creating event network-vif-deleted:750b5bfe-3b8d-4aec-8be2-266f1f451b32 for instance 51b7cefa-0cde-4503-a8c6-102e37a1b57d on nch1-master-1 Nov 20 20:54:46.836055 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] Creating event network-vif-deleted:d70779e8-408f-4a77-b101-71a029e143c9 for instance d3d035c3-0fd0-4d00-bff1-2eb652dcc037 on nch1-master-1 Nov 20 20:54:46.844078 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-50cb37c7-00d9-4ff9-a605-ca27cda2035c req-f29e1372-f3de-4280-b77d-021682663552 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059014 Nov 20 20:54:46.844861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1473/2900] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:46 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:46.849661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.850412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.858861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.859298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.860248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.860822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.878520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b could not be found. Nov 20 20:54:46.879184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance 0ffe6a66-af8a-40dc-bb9e-a37fd916c78b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:46.879975 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07bf7220-e388-4e43-8670-048c5d6bf7f2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b" status: 404 len: 111 microversion: 2.1 time: 0.034236 Nov 20 20:54:46.883681 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1474/2901] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] GET /compute/v2.1/servers/0ffe6a66-af8a-40dc-bb9e-a37fd916c78b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:46.889738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:46.891550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:46.903232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.903927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.905484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:46.906137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:46.954330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-602f1e47-21de-4c3c-aef3-838fb8d1e141 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.070210 Nov 20 20:54:46.958943 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1475/2902] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:46 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:46.967299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55c7613f-0e91-4532-a29c-bef140454153 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f86ffad30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:46.977287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:46.986556 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c945b767-8723-451b-a5df-fe2315722442 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1350 microversion: 2.1 time: 0.649548 Nov 20 20:54:46.999029 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1428/2903] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1350 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:47.008162 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-55c7613f-0e91-4532-a29c-bef140454153 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Image not found. Nov 20 20:54:47.008770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55c7613f-0e91-4532-a29c-bef140454153 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.010792 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55c7613f-0e91-4532-a29c-bef140454153 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c" status: 404 len: 62 microversion: 2.1 time: 0.053292 Nov 20 20:54:47.012632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1476/2904] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:46 2021] DELETE /compute/v2.1/images/5b0e4e1f-681e-4a4a-8616-694ad6a5794c => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:47.039559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.042422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.058770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.067746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.070109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.070881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.099436 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance b3b2f6df-58af-4fe3-a73b-eac474989b6a could not be found. Nov 20 20:54:47.100364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance b3b2f6df-58af-4fe3-a73b-eac474989b6a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.101402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cef5fa2-0f8f-49b0-b888-9923f94a55b2 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 404 len: 111 microversion: 2.1 time: 0.082247 Nov 20 20:54:47.105665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1429/2905] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:47 2021] DELETE /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:47.114001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.116019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: b3b2f6df-58af-4fe3-a73b-eac474989b6a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.126107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.127252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.128303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.129097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.154414 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance b3b2f6df-58af-4fe3-a73b-eac474989b6a could not be found. Nov 20 20:54:47.155355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance b3b2f6df-58af-4fe3-a73b-eac474989b6a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.156690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a9f3e2c-5cfb-433e-890a-1b69c59161a7 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a" status: 404 len: 111 microversion: 2.1 time: 0.048748 Nov 20 20:54:47.171473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-caf2dd3b-baa0-4e4a-8811-ab900f09f1f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '.version_select at 0x7f3f87b36280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.178488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1477/2906] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:47 2021] GET /compute/v2.1/servers/b3b2f6df-58af-4fe3-a73b-eac474989b6a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:47.211676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-caf2dd3b-baa0-4e4a-8811-ab900f09f1f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Image not found. Nov 20 20:54:47.213330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-caf2dd3b-baa0-4e4a-8811-ab900f09f1f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.215575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-caf2dd3b-baa0-4e4a-8811-ab900f09f1f9 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd" status: 404 len: 62 microversion: 2.1 time: 0.048317 Nov 20 20:54:47.227804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.233232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.237557 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1430/2907] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:47 2021] DELETE /compute/v2.1/images/b3795169-da50-42bc-87b2-942bd1e04ebd => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:54:47.241762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.243164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.245979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.246758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.293166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance 6030db32-94d0-4d8c-884c-b3469acfa23f could not be found. Nov 20 20:54:47.297011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance 6030db32-94d0-4d8c-884c-b3469acfa23f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.300681 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fde4179d-21ec-44e3-833c-c7f01cf53b5f tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 404 len: 111 microversion: 2.1 time: 0.078875 Nov 20 20:54:47.301543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1478/2908] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:47 2021] DELETE /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:47.311911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.312935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] [instance: 6030db32-94d0-4d8c-884c-b3469acfa23f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.327422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.339345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.340927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.341485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.389947 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] HTTP exception thrown: Instance 6030db32-94d0-4d8c-884c-b3469acfa23f could not be found. Nov 20 20:54:47.390622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] Returning 404 to user: Instance 6030db32-94d0-4d8c-884c-b3469acfa23f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.391592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6f72872d-104e-486a-a367-f1b3038dd2b8 tempest-ImagesTestJSON-900118944 tempest-ImagesTestJSON-900118944-project] 10.222.0.41 "GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f" status: 404 len: 111 microversion: 2.1 time: 0.085379 Nov 20 20:54:47.392225 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1431/2909] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:47 2021] GET /compute/v2.1/servers/6030db32-94d0-4d8c-884c-b3469acfa23f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:47.600487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:47.601408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.613375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.616103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.619729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.621297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.705536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc72578b-9fe7-4fbb-8831-d9a13c02faa9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.108553 Nov 20 20:54:47.707050 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1479/2910] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:47 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:47.799811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.800648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d3d035c3-0fd0-4d00-bff1-2eb652dcc037] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.808230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.808915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.812884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.813882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.830890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance d3d035c3-0fd0-4d00-bff1-2eb652dcc037 could not be found. Nov 20 20:54:47.831787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance d3d035c3-0fd0-4d00-bff1-2eb652dcc037 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:47.833506 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb836dc4-7fef-4495-ab7e-b4d8b4212d32 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037" status: 404 len: 111 microversion: 2.1 time: 0.036927 Nov 20 20:54:47.834338 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1432/2911] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:47 2021] GET /compute/v2.1/servers/d3d035c3-0fd0-4d00-bff1-2eb652dcc037 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:47.844591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:47.845558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.853853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.854613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.856165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.856801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.894546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:47.970223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:47.971203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:47.990517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.990964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.995072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:47.996101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:47.999910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0da4fc8-f410-45d0-9989-ea5f367ffeb8 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 204 len: 0 microversion: 2.1 time: 0.160089 Nov 20 20:54:48.000698 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1480/2912] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:47 2021] DELETE /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:48.007318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:48.010421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:48.019412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.020284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.021815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.022781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.095781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a1a4889-8292-439e-bc10-069d5b935cd7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.133019 Nov 20 20:54:48.100590 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1433/2913] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:47 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:48.106302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:48.106995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:48.125667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.126131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.127173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.127769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.321984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:48.331078 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d61665b7-c9e9-4f9c-a07f-47f1eeba9803 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1540 microversion: 2.1 time: 0.328650 Nov 20 20:54:48.343271 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1481/2914] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:48 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1540 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:48.350020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:48.350631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:48.359396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.360109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.361024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.361540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.527381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:48.555823 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb03ff95-ae4e-4762-98b1-28fce019ca63 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1473 microversion: 2.1 time: 0.453881 Nov 20 20:54:48.563454 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1434/2915] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:48 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1473 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:48.716326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9be1a681-493d-43cb-a5f2-5b80307581dc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.371540 Nov 20 20:54:48.717852 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1482/2916] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:54:48 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:48.721033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:48.723067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:48.756045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.758162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.760190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:48.760985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:48.849965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ec79f70-af51-425a-89c8-17ca26641313 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.135920 Nov 20 20:54:48.855105 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1435/2917] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:48 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:54:49.108375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:49.109355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:49.120229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.120843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:49.121697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.127621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:49.199480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62dd73b4-1d40-4d35-9f7c-5644bfeb1e64 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094250 Nov 20 20:54:49.206581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1483/2918] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:49 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:49.585150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:49.586222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:49.603928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.606671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:49.607644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.609178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:49.867183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:49.881440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:49.907422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.908296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:49.910550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:49.912757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:50.024390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-082cf5f6-e39d-40ad-a6d8-7400cfc1a605 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.160631 Nov 20 20:54:50.031135 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1484/2919] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:49 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:50.072384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:50.080770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd59e52f-4033-4179-ac81-3095b3195b5f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1473 microversion: 2.1 time: 0.501833 Nov 20 20:54:50.090986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1436/2920] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:49 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:50.213208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:50.214183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:50.233717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:50.234201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:50.235281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:50.236049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:50.303329 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff287413-9dd5-4963-8ffc-23c9fc02952a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094247 Nov 20 20:54:50.309017 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1437/2921] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:50.694800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c8840b1-efe1-46cc-bb93-62a62a512821 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Calling method '.version_select at 0x7f3f86ae8310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:50.741820 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3c8840b1-efe1-46cc-bb93-62a62a512821 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:50.742638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c8840b1-efe1-46cc-bb93-62a62a512821 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:50.744399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c8840b1-efe1-46cc-bb93-62a62a512821 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "DELETE /compute/v2.1/images/44566cfc-4598-443f-93e2-c48c9a2ed91a/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.571834 Nov 20 20:54:50.750006 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1485/2922] 10.222.0.41 () {58 vars in 1292 bytes} [Sat Nov 20 20:54:50 2021] DELETE /compute/v2.1/images/44566cfc-4598-443f-93e2-c48c9a2ed91a/metadata/os_distro => generated 62 bytes in 579 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:50.757004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48c7c6db-61b0-4839-b57f-63ec3a8a17e7 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Calling method '.version_select at 0x7f3f87a85dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:50.785789 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-48c7c6db-61b0-4839-b57f-63ec3a8a17e7 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:50.787375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48c7c6db-61b0-4839-b57f-63ec3a8a17e7 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:50.788332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48c7c6db-61b0-4839-b57f-63ec3a8a17e7 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "GET /compute/v2.1/images/9a12dea8-01c6-4bd2-ab86-0cddef7f519c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037031 Nov 20 20:54:50.789303 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1438/2923] 10.222.0.41 () {58 vars in 1292 bytes} [Sat Nov 20 20:54:50 2021] GET /compute/v2.1/images/9a12dea8-01c6-4bd2-ab86-0cddef7f519c/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:50.799611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-343817ca-8103-4119-b4c8-00f1d4843805 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Calling method '.version_select at 0x7f3f86ee73a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:50.830697 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-343817ca-8103-4119-b4c8-00f1d4843805 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:50.831554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-343817ca-8103-4119-b4c8-00f1d4843805 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:50.832701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-343817ca-8103-4119-b4c8-00f1d4843805 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "GET /compute/v2.1/images/016bfb48-9f2c-4842-b78e-f9e6bf2714d8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036905 Nov 20 20:54:50.834335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1486/2924] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:54:50 2021] GET /compute/v2.1/images/016bfb48-9f2c-4842-b78e-f9e6bf2714d8/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:50.845938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9c5c9c1-df43-4a6f-b407-b6bf48405248 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Action: 'update_all', calling method: .version_select at 0x7f3f87927b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:50.875147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a9c5c9c1-df43-4a6f-b407-b6bf48405248 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:50.875865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9c5c9c1-df43-4a6f-b407-b6bf48405248 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:50.876884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9c5c9c1-df43-4a6f-b407-b6bf48405248 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "PUT /compute/v2.1/images/df723b98-38a4-4fd5-a665-d6c44762b19a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036716 Nov 20 20:54:50.878702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1439/2925] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:54:50 2021] PUT /compute/v2.1/images/df723b98-38a4-4fd5-a665-d6c44762b19a/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:50.891928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1feadbda-56be-4085-9137-95f96cd75117 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Action: 'update', calling method: .version_select at 0x7f3f86ad0280>, body: {"meta": {"os_distro": "alt"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:50.938490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1feadbda-56be-4085-9137-95f96cd75117 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:50.939437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1feadbda-56be-4085-9137-95f96cd75117 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:50.943386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1feadbda-56be-4085-9137-95f96cd75117 tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "PUT /compute/v2.1/images/a6d42531-e7d6-4d3d-b8b6-99c705a87aaa/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055531 Nov 20 20:54:50.967366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd885baf-eb76-4d94-b23b-17af45308b8b tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Action: 'create', calling method: .version_select at 0x7f3f87a85670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:50.980423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1487/2926] 10.222.0.41 () {60 vars in 1309 bytes} [Sat Nov 20 20:54:50 2021] PUT /compute/v2.1/images/a6d42531-e7d6-4d3d-b8b6-99c705a87aaa/metadata/os_distro => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:51.014723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-fd885baf-eb76-4d94-b23b-17af45308b8b tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] HTTP exception thrown: Image not found. Nov 20 20:54:51.015606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd885baf-eb76-4d94-b23b-17af45308b8b tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] Returning 404 to user: Image not found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:51.017496 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd885baf-eb76-4d94-b23b-17af45308b8b tempest-ImagesMetadataNegativeTestJSON-324252396 tempest-ImagesMetadataNegativeTestJSON-324252396-project] 10.222.0.41 "POST /compute/v2.1/images/46f71059-44cf-4f9c-ac87-d0abf12a358e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.065512 Nov 20 20:54:51.019025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1440/2927] 10.222.0.41 () {60 vars in 1280 bytes} [Sat Nov 20 20:54:50 2021] POST /compute/v2.1/images/46f71059-44cf-4f9c-ac87-d0abf12a358e/metadata => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:54:51.041291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:51.042498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:51.058285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.059384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.060861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.063637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.109938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:51.110794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:51.125569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.125795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.130848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.130848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.184272 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b960a46c-8d5a-4a2d-bc5b-c05f34386611 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.147484 Nov 20 20:54:51.188927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1488/2928] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:51 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:51.323537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:51.326658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:51.338527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.340070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.341669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.342423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.393293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fbbb481a-a74d-4f54-9b5d-4f68117c666c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.079197 Nov 20 20:54:51.398329 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1489/2929] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:51 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:51.732672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:51.733691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:51.742039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.742511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.752498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.753029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.770191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:51.784166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-354be1f1-bc2a-4507-bba0-a5f16f785eba tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 200 len: 1473 microversion: 2.1 time: 0.679889 Nov 20 20:54:51.784758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1441/2930] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:51 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 1473 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:51.789573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-582c9175-c8e3-46f5-bd1f-7ca0504f3de8 req-b309723f-705e-49e9-ab84-9c7111fcf42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "797fe36e-be61-49c1-a438-56124738f92d", "tag": "8732f318-293e-426d-9e8f-6b1fe937a69e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:51.802490 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:51.802490 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:51.810672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-582c9175-c8e3-46f5-bd1f-7ca0504f3de8 req-b309723f-705e-49e9-ab84-9c7111fcf42d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:51.811491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-582c9175-c8e3-46f5-bd1f-7ca0504f3de8 req-b309723f-705e-49e9-ab84-9c7111fcf42d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:51.816691 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a4fd91a4-175b-432e-82dd-ad06ee442c24 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.088498 Nov 20 20:54:51.818039 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1490/2931] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:51 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:51.830008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-582c9175-c8e3-46f5-bd1f-7ca0504f3de8 req-b309723f-705e-49e9-ab84-9c7111fcf42d service nova] Creating event network-changed:8732f318-293e-426d-9e8f-6b1fe937a69e for instance 797fe36e-be61-49c1-a438-56124738f92d on nch1-master-1 Nov 20 20:54:51.840538 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-582c9175-c8e3-46f5-bd1f-7ca0504f3de8 req-b309723f-705e-49e9-ab84-9c7111fcf42d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054254 Nov 20 20:54:51.841622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1442/2932] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:52.201317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:52.202442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:52.220455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.220959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.221776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.222252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.300266 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c0e903e-fe34-4567-a24c-b2e30bf17cd9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.103880 Nov 20 20:54:52.309114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1491/2933] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:52 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:52.409495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:52.411023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:52.428191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.442112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.447645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.449119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.611382 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1979e4b8-be59-4344-b822-df59969717c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.207791 Nov 20 20:54:52.615227 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1443/2934] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:52 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:52.802752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:52.803888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 3fbe1bea-a4aa-4b72-87dd-856345ef5791] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:52.827116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.830921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:52.832041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.832182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:52.835829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.836501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.846394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.846867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.847692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.848133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.874731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance 3fbe1bea-a4aa-4b72-87dd-856345ef5791 could not be found. Nov 20 20:54:52.877717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance 3fbe1bea-a4aa-4b72-87dd-856345ef5791 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:52.879909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1e7ef15-f65d-42de-9438-2d92b65e21f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791" status: 404 len: 111 microversion: 2.1 time: 0.081186 Nov 20 20:54:52.882394 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1492/2935] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:52 2021] GET /compute/v2.1/servers/3fbe1bea-a4aa-4b72-87dd-856345ef5791 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:52.895106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:52.895906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:52.913081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.913807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.914875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:52.916027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:52.926452 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-876623b9-1ba6-4f42-8b9c-b31b1503a467 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.101449 Nov 20 20:54:52.927511 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1444/2936] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:52 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:52.975483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:53.151669 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92099381-ab90-4044-aa91-86bd20c8fe02 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 204 len: 0 microversion: 2.1 time: 0.259586 Nov 20 20:54:53.152860 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1493/2937] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:52 2021] DELETE /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:53.163907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:53.168247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:53.183572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.185245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.186578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.187914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.312851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:53.313878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:53.324169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.324627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.325425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.325857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.402873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cc484a6-4fb1-4ca7-bafe-cff25762a8c9 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.094145 Nov 20 20:54:53.410157 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1494/2938] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:53 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:54:53.635080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:53.636195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:53.649341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.650284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.651324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.651986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.710813 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58da721c-a8ae-4613-b71e-738b797e725e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.087043 Nov 20 20:54:53.716201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1495/2939] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:53 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:53.756791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:53.766589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc87166d-43b1-470c-b0ac-3932c6ddb6bf tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1472 microversion: 2.1 time: 0.608920 Nov 20 20:54:53.768181 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1445/2940] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:53 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:53.878509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4afd42a5-376f-47a7-b88e-7d1f663ba660 req-bd674070-3307-40be-bb9a-047b7f1ebaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fbe1bea-a4aa-4b72-87dd-856345ef5791", "name": "network-vif-deleted", "tag": "418f2718-5a55-4ccb-996a-11201d6702b2"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:53.880831 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:53.880831 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:53.893773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4afd42a5-376f-47a7-b88e-7d1f663ba660 req-bd674070-3307-40be-bb9a-047b7f1ebaf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.894520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4afd42a5-376f-47a7-b88e-7d1f663ba660 req-bd674070-3307-40be-bb9a-047b7f1ebaf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.913076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4afd42a5-376f-47a7-b88e-7d1f663ba660 req-bd674070-3307-40be-bb9a-047b7f1ebaf9 service nova] Creating event network-vif-deleted:418f2718-5a55-4ccb-996a-11201d6702b2 for instance 3fbe1bea-a4aa-4b72-87dd-856345ef5791 on nch2-master-1 Nov 20 20:54:53.920601 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4afd42a5-376f-47a7-b88e-7d1f663ba660 req-bd674070-3307-40be-bb9a-047b7f1ebaf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052466 Nov 20 20:54:53.921705 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1496/2941] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:53.940319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:53.941560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:53.953334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.953809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:53.954675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:53.955116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.027790 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20bf6f1c-e9a0-48e2-af4e-f506f564e851 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.093836 Nov 20 20:54:54.032274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1446/2942] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:53 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:54.416953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:54.418117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:54.436434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.441132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.442218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.442863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.554083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de5edb23-008b-4fbe-aac9-f62fe34df718 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.142435 Nov 20 20:54:54.555562 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1497/2943] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:54 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:54.726752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:54.734658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:54.758299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.758843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.760210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.765845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.857900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7df5c949-fbb3-4806-84e8-d89b8c42c7c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.137414 Nov 20 20:54:54.858819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1498/2944] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:54.871607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:54.874881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:54.886771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.889477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.892213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:54.894800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:54.947597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Calling method '.version_select at 0x7f3f87c39dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:55.010608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2012cd8e-d308-4767-ac9f-d9874ec7eb45 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:55.011593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Neutron security group 2012cd8e-d308-4767-ac9f-d9874ec7eb45 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:54:55.012368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] HTTP exception thrown: Security group 2012cd8e-d308-4767-ac9f-d9874ec7eb45 does not exist Nov 20 20:54:55.012368 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-c4f15ce4-e51c-41fb-aef1-74379d53c20d'] Nov 20 20:54:55.013325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Returning 404 to user: Security group 2012cd8e-d308-4767-ac9f-d9874ec7eb45 does not exist Nov 20 20:54:55.013325 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-c4f15ce4-e51c-41fb-aef1-74379d53c20d'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:55.014665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-470ecd62-72d5-4cb0-9979-9020238744d5 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/2012cd8e-d308-4767-ac9f-d9874ec7eb45" status: 404 len: 194 microversion: 2.1 time: 0.364884 Nov 20 20:54:55.016737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1447/2945] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:54:54 2021] DELETE /compute/v2.1/os-security-groups/2012cd8e-d308-4767-ac9f-d9874ec7eb45 => generated 194 bytes in 367 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:55.028263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75ca0c2a-04b2-4000-8a64-e66986e1b0cc tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004945 Nov 20 20:54:55.029099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1448/2946] 10.222.0.41 () {58 vars in 1163 bytes} [Sat Nov 20 20:54:55 2021] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 20:54:55.048394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1adbedf-606d-4b94-9d1b-c62b55c3d961 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Calling method '.version_select at 0x7f3f879dc8b0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:55.399197 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1adbedf-606d-4b94-9d1b-c62b55c3d961 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.362024 Nov 20 20:54:55.399884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1449/2947] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 20:54:55 2021] GET /compute/v2.1/os-security-groups => generated 707 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:55.404725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:55.405883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:55.412657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.413112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.413903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.414373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.453870 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-accd039c-7e26-4f59-b655-dbebc72fcabb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.052540 Nov 20 20:54:55.454561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1450/2948] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:55 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:55.596255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20cf4371-ac67-4d88-9119-24efbad71beb tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] Calling method '.version_select at 0x7f3f87b65a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:55.656432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20cf4371-ac67-4d88-9119-24efbad71beb tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] 10.222.0.41 "GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059" status: 200 len: 784 microversion: 2.1 time: 0.200416 Nov 20 20:54:55.658891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1451/2949] 10.222.0.41 () {58 vars in 1232 bytes} [Sat Nov 20 20:54:55 2021] GET /compute/v2.1/images/89603187-210f-4d54-a40f-71dfff8bc059 => generated 784 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:55.662481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-288e5a82-12a1-4b13-94f7-257dbba35586 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Calling method '.version_select at 0x7f3f878da430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:55.664184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:55.677537 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cac9097-07b0-434a-9c82-a4e1c0c481da tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 200 len: 1472 microversion: 2.1 time: 0.810731 Nov 20 20:54:55.687191 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1499/2950] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:54 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 1472 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:55.691922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:55.692889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:55.699100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.699554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.700352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.700791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.743773 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5d3d617-7467-4ba4-86ac-d152bd4dde31 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.055027 Nov 20 20:54:55.747738 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1500/2951] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:55 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:55.751512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91384429-23fc-4443-8978-4fecafb92276 tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] Calling method '.version_select at 0x7f3f86f9f1f0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:55.867038 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91384429-23fc-4443-8978-4fecafb92276 tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] 10.222.0.41 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.119211 Nov 20 20:54:55.867038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1501/2952] 10.222.0.41 () {58 vars in 1121 bytes} [Sat Nov 20 20:54:55 2021] GET /compute/v2.1/images => generated 445 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:55.880815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:55.882180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:55.902576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.903912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.905334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:55.905963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:55.974250 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-901e3673-09f4-4edf-961b-45f77ad46d82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.098550 Nov 20 20:54:55.975589 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1502/2953] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:55 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:54:55.987070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-299fcd68-d231-447c-ae48-627f7e344eb0 tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] Calling method '.version_select at 0x7f3f870a5160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:56.051157 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-299fcd68-d231-447c-ae48-627f7e344eb0 tempest-ListImagesTestJSON-66151132 tempest-ListImagesTestJSON-66151132-project] 10.222.0.41 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.074025 Nov 20 20:54:56.053151 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1503/2954] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 20:54:55 2021] GET /compute/v2.1/images/detail => generated 787 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:56.063504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4cae7cc2-e03b-4ba6-8808-949237d3ded3 req-f44fb505-abcc-4fdd-bafb-fbeee75e3500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b25af4d5-11da-4354-91b9-89a2490dea39", "name": "network-vif-deleted", "tag": "48e83d26-e36f-40f3-b0cf-f124edaa6b06"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:56.065487 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:56.065487 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:54:56.075786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4cae7cc2-e03b-4ba6-8808-949237d3ded3 req-f44fb505-abcc-4fdd-bafb-fbeee75e3500 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.076633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4cae7cc2-e03b-4ba6-8808-949237d3ded3 req-f44fb505-abcc-4fdd-bafb-fbeee75e3500 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.091843 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4cae7cc2-e03b-4ba6-8808-949237d3ded3 req-f44fb505-abcc-4fdd-bafb-fbeee75e3500 service nova] Creating event network-vif-deleted:48e83d26-e36f-40f3-b0cf-f124edaa6b06 for instance b25af4d5-11da-4354-91b9-89a2490dea39 on nch2-master-1 Nov 20 20:54:56.098917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4cae7cc2-e03b-4ba6-8808-949237d3ded3 req-f44fb505-abcc-4fdd-bafb-fbeee75e3500 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044137 Nov 20 20:54:56.100352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1504/2955] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:56.343155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-288e5a82-12a1-4b13-94f7-257dbba35586 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:56.344031 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-288e5a82-12a1-4b13-94f7-257dbba35586 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 20 20:54:56.344031 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-c1c82aae-d185-477f-b452-c1313166b00b'] Nov 20 20:54:56.344634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-288e5a82-12a1-4b13-94f7-257dbba35586 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 20 20:54:56.344634 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-c1c82aae-d185-477f-b452-c1313166b00b'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:56.345539 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-288e5a82-12a1-4b13-94f7-257dbba35586 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "DELETE /compute/v2.1/os-security-groups/0c2ae09d-3373-44b2-adfd-4c7dad1b69c4" status: 400 len: 182 microversion: 2.1 time: 0.687120 Nov 20 20:54:56.346127 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1452/2956] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 20:54:55 2021] DELETE /compute/v2.1/os-security-groups/0c2ae09d-3373-44b2-adfd-4c7dad1b69c4 => generated 182 bytes in 688 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:54:56.361788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Calling method '.version_select at 0x7f3f872063a0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:56.402657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG neutronclient.v2_0.client [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36064afc-a86d-4dc0-a946-61061a323fe5 does not exist", "detail": ""}} {{(pid=140942) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:56.403482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.security_group_api [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Neutron security group 36064afc-a86d-4dc0-a946-61061a323fe5 not found {{(pid=140942) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:54:56.404186 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] HTTP exception thrown: Security group 36064afc-a86d-4dc0-a946-61061a323fe5 does not exist Nov 20 20:54:56.404186 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-2ad990b4-c09f-4e1e-9809-923c7a69ee50'] Nov 20 20:54:56.405484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Returning 404 to user: Security group 36064afc-a86d-4dc0-a946-61061a323fe5 does not exist Nov 20 20:54:56.405484 ncdv-master-1 devstack@n-api.service[140942]: Neutron server returns request_ids: ['req-2ad990b4-c09f-4e1e-9809-923c7a69ee50'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:56.407024 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-454bd5f1-657b-4cdf-a219-2a63da41a9bd tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "GET /compute/v2.1/os-security-groups/36064afc-a86d-4dc0-a946-61061a323fe5" status: 404 len: 194 microversion: 2.1 time: 0.050231 Nov 20 20:54:56.419634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Action: 'update', calling method: .version_select at 0x7f3f87a8eaf0>, body: {"security_group": {"name": "tempest-sg-405012790", "description": "tempest-description-461251295"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:56.422864 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1505/2957] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 20:54:56 2021] GET /compute/v2.1/os-security-groups/36064afc-a86d-4dc0-a946-61061a323fe5 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:56.467459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:56.469924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:56.485666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.486171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.489417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.492268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.602394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bddeb15a-cfc1-4bd5-8d12-384b4cf7ab5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.140644 Nov 20 20:54:56.606621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1506/2958] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:56 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:56.649600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG neutronclient.v2_0.client [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78df375a-c81b-4a82-a7df-d69539a8b217 does not exist", "detail": ""}} {{(pid=140941) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 20 20:54:56.650410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Neutron security group 78df375a-c81b-4a82-a7df-d69539a8b217 not found {{(pid=140941) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 20 20:54:56.650929 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] HTTP exception thrown: Security group 78df375a-c81b-4a82-a7df-d69539a8b217 does not exist Nov 20 20:54:56.650929 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-07ba60bd-d3b4-443f-b5a9-dba2f4af31be'] Nov 20 20:54:56.651560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] Returning 404 to user: Security group 78df375a-c81b-4a82-a7df-d69539a8b217 does not exist Nov 20 20:54:56.651560 ncdv-master-1 devstack@n-api.service[140941]: Neutron server returns request_ids: ['req-07ba60bd-d3b4-443f-b5a9-dba2f4af31be'] {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:56.652530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e29165aa-e1fe-4426-8664-04df944a8787 tempest-SecurityGroupsNegativeTestJSON-123852064 tempest-SecurityGroupsNegativeTestJSON-123852064-project] 10.222.0.41 "PUT /compute/v2.1/os-security-groups/78df375a-c81b-4a82-a7df-d69539a8b217" status: 404 len: 194 microversion: 2.1 time: 0.237435 Nov 20 20:54:56.653115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1453/2959] 10.222.0.41 () {60 vars in 1289 bytes} [Sat Nov 20 20:54:56 2021] PUT /compute/v2.1/os-security-groups/78df375a-c81b-4a82-a7df-d69539a8b217 => generated 194 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:56.695358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:56.698360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: b25af4d5-11da-4354-91b9-89a2490dea39] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:56.717960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.718435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.719240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.719674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.753274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance b25af4d5-11da-4354-91b9-89a2490dea39 could not be found. Nov 20 20:54:56.755808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:56.757131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:56.760080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance b25af4d5-11da-4354-91b9-89a2490dea39 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:54:56.761357 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aefe9288-e35f-434a-8600-99cc337f7593 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39" status: 404 len: 111 microversion: 2.1 time: 0.070157 Nov 20 20:54:56.762121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1507/2960] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:56 2021] GET /compute/v2.1/servers/b25af4d5-11da-4354-91b9-89a2490dea39 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:54:56.769520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.769981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.772168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:56.772665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:56.773023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.773477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.783896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.784349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.785163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:56.785591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:56.838389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:56.870605 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2d57b0e-9106-4415-bba0-e232568cd33c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.118416 Nov 20 20:54:56.872120 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1454/2961] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:56 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:54:56.990698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:56.992123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2580003f-c8b2-452d-a88d-c6150f4213fa tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 204 len: 0 microversion: 2.1 time: 0.222036 Nov 20 20:54:56.992291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:56.997802 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1508/2962] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:56 2021] DELETE /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:54:57.003735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:57.004632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:57.012793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.014155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.015206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.015848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.016187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.016313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.017252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.017695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.049665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:54:57.097604 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05d7193c-e732-402e-b906-ac1d276da46f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.113184 Nov 20 20:54:57.098208 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1455/2963] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:56 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:57.173161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58171042-37d2-4dba-b174-e9ee270d32fb tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 204 len: 0 microversion: 2.1 time: 0.172691 Nov 20 20:54:57.174396 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1509/2964] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:54:56 2021] DELETE /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:54:57.183619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:57.185545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:57.194492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.195615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.197451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.198482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.464153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:57.473114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7e7acbd-6ba3-488d-b2a4-12df366832d2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 200 len: 1474 microversion: 2.1 time: 0.294106 Nov 20 20:54:57.476598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1456/2965] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:57 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 1474 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:57.620058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:57.622184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:57.631873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.632651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.633543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.634275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.693878 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36f808bc-493b-401d-8cb8-99704e39797f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.082620 Nov 20 20:54:57.694561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1510/2966] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:57 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:57.887698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:57.888851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:57.898461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.899597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.900748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:57.901711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:57.968817 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88a461cf-2680-4ac1-8ecc-3992806fecd4 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.086298 Nov 20 20:54:57.972800 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1457/2967] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:57 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:58.110982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:58.112012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:58.120383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.120900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.121816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.122510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.185954 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ff87cd1-a046-46a5-bfae-a70665ae9e17 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.079183 Nov 20 20:54:58.186802 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1511/2968] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:58.447377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f878b9a60>, body: {"keypair": {"name": "tempest-keypair-586152223"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:58.463179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:58.468400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:58.494799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:58.496222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:58.507236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.508969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.510767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.511490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.816569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:58.822351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:58.837887 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-368793d8-cbdf-444c-8e4c-bd8c3f5e6f4e tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.527730 Nov 20 20:54:58.838998 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1458/2969] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:54:58 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:54:58.843628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:58.844880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:58.851321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.851770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.852783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:58.853391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:58.886747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:54:58.898812 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aecfd501-a976-4bd0-b7fc-398dba513b15 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 200 len: 1474 microversion: 2.1 time: 0.409373 Nov 20 20:54:58.900403 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1512/2970] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:54:58 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:54:58.902299 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c538e55-afcf-4fcf-bd41-21f18983e18d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 14 microversion: 2.1 time: 0.061850 Nov 20 20:54:58.902937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1459/2971] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:58 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:54:58.908629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d0e4f63-d0b9-47b4-b25d-cc8ed8cb67ec tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f86ad0d30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:58.920658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d0e4f63-d0b9-47b4-b25d-cc8ed8cb67ec tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs/tempest-keypair-586152223" status: 200 len: 691 microversion: 2.1 time: 0.016232 Nov 20 20:54:58.921982 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1513/2972] 10.222.0.41 () {58 vars in 1214 bytes} [Sat Nov 20 20:54:58 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-586152223 => generated 691 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:58.934472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e67b0ff4-f3a1-4961-9a9f-8cb2e586935b tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f87b33ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:54:58.957066 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e67b0ff4-f3a1-4961-9a9f-8cb2e586935b tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586152223" status: 202 len: 0 microversion: 2.1 time: 0.028567 Nov 20 20:54:58.968830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f8693de50>, body: {"keypair": {"name": "tempest-keypair-159016048"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:58.979647 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1460/2973] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:54:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586152223 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:58.991236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:58.993599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:59.004597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:54:59.008813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.012423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.016138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.016893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:54:59.017508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.127854 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f85ed67-4b9e-49cd-8f6f-719e27172495 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.140397 Nov 20 20:54:59.129903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1461/2974] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:58 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:54:59.200910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:59.202023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:59.221694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.225217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.227930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.229993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.342261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e54d1dcf-b5fa-46a5-aec4-412e2bc0e087 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.147162 Nov 20 20:54:59.344777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1462/2975] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:54:59 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:54:59.359902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-cd2903e1-4432-4a3a-902f-fbd0d4d739c5 req-48d4ebbf-1603-43f2-bc70-d852a70bee42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3726050-5f51-48dc-941a-2829539906a7", "name": "network-vif-deleted", "tag": "d2ec2066-92dd-4bf1-94cf-530a3c89abb1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:59.361819 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:54:59.361819 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:54:59.386297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cd2903e1-4432-4a3a-902f-fbd0d4d739c5 req-48d4ebbf-1603-43f2-bc70-d852a70bee42 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.388136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cd2903e1-4432-4a3a-902f-fbd0d4d739c5 req-48d4ebbf-1603-43f2-bc70-d852a70bee42 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.414454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-cd2903e1-4432-4a3a-902f-fbd0d4d739c5 req-48d4ebbf-1603-43f2-bc70-d852a70bee42 service nova] Creating event network-vif-deleted:d2ec2066-92dd-4bf1-94cf-530a3c89abb1 for instance a3726050-5f51-48dc-941a-2829539906a7 on nch1-master-1 Nov 20 20:54:59.422209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-cd2903e1-4432-4a3a-902f-fbd0d4d739c5 req-48d4ebbf-1603-43f2-bc70-d852a70bee42 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075710 Nov 20 20:54:59.423728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1463/2976] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:54:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:54:59.922784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:54:59.923870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:54:59.940549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.942192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:54:59.945353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:54:59.945973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.043127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81de9045-03ad-48cd-9d11-d5aa05d5a0d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 8207 microversion: 2.1 time: 0.131504 Nov 20 20:55:00.047215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1464/2977] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:54:59 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 8207 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:00.052425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:00.053388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: a3726050-5f51-48dc-941a-2829539906a7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:00.068967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.071928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.074636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.076736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.120403 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance a3726050-5f51-48dc-941a-2829539906a7 could not be found. Nov 20 20:55:00.121448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance a3726050-5f51-48dc-941a-2829539906a7 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:00.124025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-271576e4-38c1-4b0b-9e99-aae9bad92309 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7" status: 404 len: 111 microversion: 2.1 time: 0.075536 Nov 20 20:55:00.126864 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1465/2978] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:00 2021] GET /compute/v2.1/servers/a3726050-5f51-48dc-941a-2829539906a7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:00.139420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:00.142400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:00.160372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.161118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.167366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.168148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.209104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:00.220746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:00.241631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e41a899d-9fb0-4e9a-8864-878b06124826 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.276392 Nov 20 20:55:00.242793 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1514/2979] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:54:58 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:00.248406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:00.249560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:00.256848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.257545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.259000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.260111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.328442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-374db0f3-9cbd-4f93-8498-d28c3bb0750a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.084124 Nov 20 20:55:00.329313 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1515/2980] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:00 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:00.348526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13ce994e-24df-4a69-bae4-7664fc55f5e5 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f870e79d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:00.400996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:00.412819 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13ce994e-24df-4a69-bae4-7664fc55f5e5 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-159016048" status: 202 len: 0 microversion: 2.1 time: 0.081744 Nov 20 20:55:00.413404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1516/2981] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:55:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-159016048 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:00.428559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac3f8b2e-bbc1-443d-952d-52dd9529ab90 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 200 len: 1432 microversion: 2.1 time: 0.297184 Nov 20 20:55:00.429864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:00.434726 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1466/2982] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:00 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 1432 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:00.444825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:00.455422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-af907da2-2aaf-4e7c-9ad3-5720ac156773 req-2b6fdf4c-f09f-4608-8145-cc537d31c3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6487b68e-a322-49ab-916e-23d4e8908b45", "name": "network-vif-deleted", "tag": "b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:00.463721 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:00.463721 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:00.464113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.467198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.470089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.470893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.482499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-af907da2-2aaf-4e7c-9ad3-5720ac156773 req-2b6fdf4c-f09f-4608-8145-cc537d31c3b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:00.485663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-af907da2-2aaf-4e7c-9ad3-5720ac156773 req-2b6fdf4c-f09f-4608-8145-cc537d31c3b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:00.523481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-af907da2-2aaf-4e7c-9ad3-5720ac156773 req-2b6fdf4c-f09f-4608-8145-cc537d31c3b0 service nova] Creating event network-vif-deleted:b4cb5e32-52c3-43f1-b0cb-94ab42ade4c6 for instance 6487b68e-a322-49ab-916e-23d4e8908b45 on nch2-master-1 Nov 20 20:55:00.545585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-af907da2-2aaf-4e7c-9ad3-5720ac156773 req-2b6fdf4c-f09f-4608-8145-cc537d31c3b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109367 Nov 20 20:55:00.548069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1467/2983] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:00.553445 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a95ab22c-b4cf-4fab-9196-c4ce31f4236c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.136451 Nov 20 20:55:00.558351 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1517/2984] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:00 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:00.566865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0281f8ca-0f5c-4365-ab38-6c2d54f9a977 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f87a14700>, body: {"keypair": {"name": "tempest-keypair-1949157511", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:00.605551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0281f8ca-0f5c-4365-ab38-6c2d54f9a977 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:00.610991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0281f8ca-0f5c-4365-ab38-6c2d54f9a977 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:00.657998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0281f8ca-0f5c-4365-ab38-6c2d54f9a977 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.107398 Nov 20 20:55:00.658653 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1468/2985] 10.222.0.41 () {60 vars in 1158 bytes} [Sat Nov 20 20:55:00 2021] POST /compute/v2.1/os-keypairs => generated 574 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:00.670932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c036123-60fd-4a0a-9af4-af513c83c6bc tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f86f7f9d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:00.710732 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c036123-60fd-4a0a-9af4-af513c83c6bc tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949157511" status: 202 len: 0 microversion: 2.1 time: 0.045457 Nov 20 20:55:00.711502 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1518/2986] 10.222.0.41 () {58 vars in 1220 bytes} [Sat Nov 20 20:55:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949157511 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:00.722973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f87a8e700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-742292806"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:00.751690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:00.765379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.055551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:01.056984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.073305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.074935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.077062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.078879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.157016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60355ebf-f51b-4fe7-a622-f8ed17e8b7ae tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 16401 microversion: 2.1 time: 0.104733 Nov 20 20:55:01.164242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1519/2987] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:01 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 16401 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:01.180157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:01.185562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.205686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2352e82f-d1c2-4f03-a467-023f60156e34 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.487189 Nov 20 20:55:01.206743 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1469/2988] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:55:00 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:01.218568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f871729d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-997609248"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:01.235732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:01.241835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.342076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:01.343886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.353703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.356644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.359816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.361264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.418798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d607c07a-006a-420d-bd23-9825a993c6d2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.082156 Nov 20 20:55:01.421088 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1470/2989] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:01 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:01.459744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.460953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 6487b68e-a322-49ab-916e-23d4e8908b45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.471072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.471935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.472875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.473564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.475044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:01.483093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.495131 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance 6487b68e-a322-49ab-916e-23d4e8908b45 could not be found. Nov 20 20:55:01.496175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance 6487b68e-a322-49ab-916e-23d4e8908b45 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:01.497173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a459877-c721-462d-a8ff-e8923b88742f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45" status: 404 len: 111 microversion: 2.1 time: 0.048832 Nov 20 20:55:01.500960 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1471/2990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:01 2021] GET /compute/v2.1/servers/6487b68e-a322-49ab-916e-23d4e8908b45 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:01.506450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfb732d0-0afe-407b-a253-1702d6afaa82 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.509296 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0db0a4cf-f88f-4452-9031-9aa22a6b7817 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.295239 Nov 20 20:55:01.516319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1520/2991] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:55:01 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:01.523713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Action: 'create', calling method: .version_select at 0x7f3f869c9a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-669174777"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:01.557850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:01.571513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfb732d0-0afe-407b-a253-1702d6afaa82 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/898d9a64-5d27-48dd-85ce-7f7dfadfb0c1" status: 204 len: 0 microversion: 2.1 time: 0.069106 Nov 20 20:55:01.572997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1472/2992] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/os-server-groups/898d9a64-5d27-48dd-85ce-7f7dfadfb0c1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:01.574926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.579117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:01.580323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.591230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.592765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.593779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.595752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.647742 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62598cc5-b295-47f3-aca3-aaf03041d223 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.073251 Nov 20 20:55:01.648710 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1473/2993] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:01 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:01.654992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.655891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.667657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.668365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.669443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.670094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.684846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:01.693540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Getting quotas for user 3d3b45473315475a91a9ed7d81984a23 and project b0c53057304e4c3692fae13c2502f1ac. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:01.715555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-46f9dcf3-0b62-4618-a533-aee22220f105 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.197852 Nov 20 20:55:01.716877 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1521/2994] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:55:01 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:01.725879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:01.731103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6043ca11-e93b-4844-beea-1fc7a47b5187 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f98e7a9d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.734619 ncdv-master-1 devstack@n-api.service[140942]: WARNING oslo_db.sqlalchemy.utils [None req-6043ca11-e93b-4844-beea-1fc7a47b5187 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:55:01.741053 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6043ca11-e93b-4844-beea-1fc7a47b5187 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs" status: 200 len: 1673 microversion: 2.1 time: 0.017713 Nov 20 20:55:01.748247 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1522/2995] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:55:01 2021] GET /compute/v2.1/os-keypairs => generated 1673 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:01.753200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-938ec8d2-12be-42c4-9e0c-14556258e5f3 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f8711d160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.774854 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-938ec8d2-12be-42c4-9e0c-14556258e5f3 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-669174777" status: 202 len: 0 microversion: 2.1 time: 0.025197 Nov 20 20:55:01.779431 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1523/2996] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-669174777 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:01.796132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54cee6c8-47e0-4be6-9740-0330b2c994c6 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f869bba60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.818088 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54cee6c8-47e0-4be6-9740-0330b2c994c6 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-997609248" status: 202 len: 0 microversion: 2.1 time: 0.037228 Nov 20 20:55:01.820072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1524/2997] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-997609248 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:01.830663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74a0aac9-c15a-4589-9914-ac27f9a8f455 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] Calling method '.version_select at 0x7f3f98c3d310>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.851161 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a410ea4-02a9-42c6-932d-84360720b388 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 204 len: 0 microversion: 2.1 time: 0.198503 Nov 20 20:55:01.851991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1474/2998] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:01.858604 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74a0aac9-c15a-4589-9914-ac27f9a8f455 tempest-KeyPairsV2TestJSON-335138461 tempest-KeyPairsV2TestJSON-335138461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-742292806" status: 202 len: 0 microversion: 2.1 time: 0.033103 Nov 20 20:55:01.859915 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1525/2999] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-742292806 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:01.867095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:01.867778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:01.874784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.875875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.876288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:01.876845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:01.923108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:02.018083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cda59428-5a87-40e5-9eaf-e6b9da1b649c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 204 len: 0 microversion: 2.1 time: 0.159498 Nov 20 20:55:02.019612 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1475/3000] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:01 2021] DELETE /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:02.030985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:02.031719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:02.045687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.046159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.047148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.047774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.173206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:02.174306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:02.182153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.182990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.183966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.184414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.225649 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b39d61bb-1dae-4443-a56b-405b2d9e6111 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 16401 microversion: 2.1 time: 0.056942 Nov 20 20:55:02.227377 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1476/3001] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:02 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 16401 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:02.432108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:02.433281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:02.440321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.441043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.442035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.442813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.498316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7cf5935-d2da-4dd7-8792-f5c13c46d0ad tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.070703 Nov 20 20:55:02.499422 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1477/3002] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:02 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:02.613035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:02.628900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0625751b-5856-4ce8-a5de-7ede0a7d47f2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1473 microversion: 2.1 time: 0.603937 Nov 20 20:55:02.629709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1526/3003] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:02 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1473 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:02.671164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:02.673826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:02.688780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.689629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.691704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:02.693755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:02.791209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82d4c7f6-4b46-42be-b7d8-1957735b408e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.133682 Nov 20 20:55:02.792753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1478/3004] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:02 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:03.237907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:03.239255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:03.247649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.248108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.248912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.253376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.312616 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff79b88a-9b58-47aa-9ba6-84f72e102bf4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 16401 microversion: 2.1 time: 0.078656 Nov 20 20:55:03.317982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1479/3005] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:03 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 16401 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:03.520264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:03.521853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:03.536774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.537511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.539260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.540471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.616061 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6f60035-d41b-4670-8ea8-dcaf94c27850 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.108387 Nov 20 20:55:03.619577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1480/3006] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:03 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:03.649901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:03.650880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:03.662776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.666018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.668698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:03.674535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:03.711382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-827876634", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:03.845923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:04.742348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:04.759904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c047545c-0daf-420b-8ed6-3c4bf49667e5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 200 len: 1473 microversion: 2.1 time: 1.116595 Nov 20 20:55:04.760816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1481/3007] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:03 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 1473 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:05.052219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:05.053196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.061621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.063191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.077629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.080424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.096900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:05.099589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:05.100742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:05.101820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:05.102578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:05.127062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.131010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.132113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.132749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.168311 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfb5f7aa-d2dc-4961-a40a-6a739522218b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.405976 Nov 20 20:55:05.172518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1482/3008] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:04 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:05.177981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:05.179116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.192463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:05.197993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.198483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.199293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.204167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.210642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:05.249582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:05.257265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:05.286536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37d1e7a0-c3b9-43be-863f-cb50827bb027 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 16401 microversion: 2.1 time: 0.116127 Nov 20 20:55:05.287221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1483/3009] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:05 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 16401 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:05.304039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:05.305059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.324969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.325493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.326381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.330529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.377576 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7871306f-85d3-4d11-ad2d-4df41d45903b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.240585 Nov 20 20:55:05.394409 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1527/3010] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 2258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:55:05.434780 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-188c8d71-d3e2-4344-9ecc-a10ba04e8e8a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.126363 Nov 20 20:55:05.437173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-aa6c429c-5b1b-46b5-9535-5ea4cd95e513 req-24c9c4ae-6d55-4101-9177-3d647521ccde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce35b01-3e47-43e4-ae72-64a117b6366f", "name": "network-vif-deleted", "tag": "7dceb653-952e-453b-b961-0478a94a32a1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:05.438023 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1484/3011] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:05 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:05.446888 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:05.446888 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:05.464225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6d96fa8-f1ef-4e75-9668-780992cd8dd0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:05.469803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6d96fa8-f1ef-4e75-9668-780992cd8dd0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.481083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aa6c429c-5b1b-46b5-9535-5ea4cd95e513 req-24c9c4ae-6d55-4101-9177-3d647521ccde service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.481550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aa6c429c-5b1b-46b5-9535-5ea4cd95e513 req-24c9c4ae-6d55-4101-9177-3d647521ccde service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.521617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-aa6c429c-5b1b-46b5-9535-5ea4cd95e513 req-24c9c4ae-6d55-4101-9177-3d647521ccde service nova] Creating event network-vif-deleted:7dceb653-952e-453b-b961-0478a94a32a1 for instance bce35b01-3e47-43e4-ae72-64a117b6366f on nch2-master-1 Nov 20 20:55:05.536384 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-aa6c429c-5b1b-46b5-9535-5ea4cd95e513 req-24c9c4ae-6d55-4101-9177-3d647521ccde service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140225 Nov 20 20:55:05.540806 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1528/3012] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:05.617097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6d96fa8-f1ef-4e75-9668-780992cd8dd0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:05.628846 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6d96fa8-f1ef-4e75-9668-780992cd8dd0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1214 microversion: 2.1 time: 0.185582 Nov 20 20:55:05.630992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1485/3013] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:05 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:05.780539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:05.781863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: bce35b01-3e47-43e4-ae72-64a117b6366f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.803441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.805971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.808398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.811016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.850531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance bce35b01-3e47-43e4-ae72-64a117b6366f could not be found. Nov 20 20:55:05.851604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance bce35b01-3e47-43e4-ae72-64a117b6366f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:05.873468 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-315e33d8-7dfb-40b5-84cc-45f59cc9531f tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f" status: 404 len: 111 microversion: 2.1 time: 0.078466 Nov 20 20:55:05.874074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-07721ab3-9f0b-46fc-84b6-44f17c893371 req-bd96b944-d7a8-4c56-b63c-8d5a7fb4e0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8073278e-06ca-46aa-9b23-ba4cde569a47", "name": "network-vif-deleted", "tag": "fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:05.877401 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:05.877401 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:05.878548 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1529/3014] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:05 2021] GET /compute/v2.1/servers/bce35b01-3e47-43e4-ae72-64a117b6366f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:05.890852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-07721ab3-9f0b-46fc-84b6-44f17c893371 req-bd96b944-d7a8-4c56-b63c-8d5a7fb4e0b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.893665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-07721ab3-9f0b-46fc-84b6-44f17c893371 req-bd96b944-d7a8-4c56-b63c-8d5a7fb4e0b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.907897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:05.909708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:05.930332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-07721ab3-9f0b-46fc-84b6-44f17c893371 req-bd96b944-d7a8-4c56-b63c-8d5a7fb4e0b3 service nova] Creating event network-vif-deleted:fc28a09a-8c72-4e39-8dfa-afe28c0ed5cc for instance 8073278e-06ca-46aa-9b23-ba4cde569a47 on nch2-master-1 Nov 20 20:55:05.937357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.939131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:05.942379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:05.942665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-07721ab3-9f0b-46fc-84b6-44f17c893371 req-bd96b944-d7a8-4c56-b63c-8d5a7fb4e0b3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071849 Nov 20 20:55:05.943555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1486/3015] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:05.944172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.148666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:06.171365 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6736fb25-4d15-4ce7-864c-3dec783fbdc2 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 200 len: 1303 microversion: 2.1 time: 0.289703 Nov 20 20:55:06.186994 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1530/3016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:05 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:06.189473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:06.190624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:06.201355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.202148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.203348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.204012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.281410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4ff729c-dc89-4d6d-9e0c-094d694968ce tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.102132 Nov 20 20:55:06.283084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1487/3017] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:06 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:06.302732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:06.303959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:06.319244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.319730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.320753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.321784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.427586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32d123a5-b975-4131-9826-59d666b74090 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.131952 Nov 20 20:55:06.434752 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1531/3018] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:06 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:06.449540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:06.450974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:06.468418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.472019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.473177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.478701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.615446 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd318bec-0688-4350-8f24-cd979e31cb7e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.170221 Nov 20 20:55:06.623036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1488/3019] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:06 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:06.660266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:06.660986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:06.672378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.672845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.673670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:06.674143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:06.881565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:06.902693 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d9130ea1-b3e7-4eea-8b46-e14b08de9e78 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1266 microversion: 2.1 time: 0.254858 Nov 20 20:55:06.905129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1532/3020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:06 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1266 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:07.192582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:07.193977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: 8073278e-06ca-46aa-9b23-ba4cde569a47] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.208275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.213199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.215913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.217595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.254103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance 8073278e-06ca-46aa-9b23-ba4cde569a47 could not be found. Nov 20 20:55:07.255768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance 8073278e-06ca-46aa-9b23-ba4cde569a47 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:07.258594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2967581-5d7e-465d-8067-d5d6eddf57f1 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47" status: 404 len: 111 microversion: 2.1 time: 0.070221 Nov 20 20:55:07.262350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1533/3021] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:07 2021] GET /compute/v2.1/servers/8073278e-06ca-46aa-9b23-ba4cde569a47 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:07.278329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e6ab9df-ca68-4493-9aab-aa49533097e3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:07.349188 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e6ab9df-ca68-4493-9aab-aa49533097e3 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/8d723fe2-62cd-49cf-a344-895994e71bc0" status: 204 len: 0 microversion: 2.1 time: 0.082877 Nov 20 20:55:07.350639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1534/3022] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 20:55:07 2021] DELETE /compute/v2.1/os-server-groups/8d723fe2-62cd-49cf-a344-895994e71bc0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:07.363352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:07.364479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.375504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.378929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.382509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.383031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.440204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1315056411", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e1689f5d-8863-4b2c-a6d3-375854e48d20"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:07.506864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ec12b67-3089-4111-9127-3c9a203b2243 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.153689 Nov 20 20:55:07.507789 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1535/3023] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:07 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:07.524244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:07.525517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.534460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.536784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.537673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.538559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.561915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] validate_networks() for [('e1689f5d-8863-4b2c-a6d3-375854e48d20', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:07.589643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:07.694539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81b68588-e8fd-49fe-89ea-a25a57386ca5 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 204 len: 0 microversion: 2.1 time: 0.184202 Nov 20 20:55:07.700092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1536/3024] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:07 2021] DELETE /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:07.709522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:07.710328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.719662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.720114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.720902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.721579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.788260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccf3b263-6fe0-449f-982b-a5dc86ac430f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.088923 Nov 20 20:55:07.789860 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1537/3025] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:07 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:07.796418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:07.798229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.806671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.807933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.808912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.809538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.857201 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-16fcfa26-9e98-4366-844c-b9a86b99333a tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.065419 Nov 20 20:55:07.861476 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1538/3026] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:07 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:07.863280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:07.863599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:07.871718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.872183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:07.872987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:07.873460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.028625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:08.029056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:08.029536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:08.029951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:08.030398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:08.042318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.042937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.043775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.044223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.067704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Getting quotas for project 480b4b05733646e88b6eb93050825547. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:08.073457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Getting quotas for user 378c95a8c74d466ea13525dd1bf6fd75 and project 480b4b05733646e88b6eb93050825547. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:08.085630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Going to run 2 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:08.088776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: cde408bf-cb7a-4d41-8b66-ff40aa94f98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:08.125711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=cde408bf-cb7a-4d41-8b66-ff40aa94f98e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:08.183769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a68b5bb-475d-41f3-94bb-e7a314f0e421 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074767 Nov 20 20:55:08.189437 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1489/3027] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:55:08.203964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:08.217292 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28088dec-c54d-4fdf-bacf-50b65ad17c8b tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1473 microversion: 2.1 time: 0.358090 Nov 20 20:55:08.218389 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1539/3028] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:07 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:08.224366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:08.225233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:08.234736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.236156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.237524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.238921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.267230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-189617096", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "736ec84c-e23f-43ed-94e7-211dbb35bbc4"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:08.345036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:08.357303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] validate_networks() for [('736ec84c-e23f-43ed-94e7-211dbb35bbc4', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:08.368666 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eba8c39c-2a5f-4a36-a2f5-993c92752162 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1272 microversion: 2.1 time: 0.146726 Nov 20 20:55:08.371013 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1540/3029] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:08 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:08.386001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:08.391698 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:08.391698 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:08.393738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:08.394718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Searching by: {'deleted': False, 'project_id': '480b4b05733646e88b6eb93050825547'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:55:08.426762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.427428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.430088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.431551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.498981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4bde48e6-e9f5-498d-bc70-6df80f15a50b tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.126345 Nov 20 20:55:08.506904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1541/3030] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:55:08 2021] GET /compute/v2.1/servers => generated 677 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:08.514240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec2588a7-fe67-406a-a518-17fe8fb1a501 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:08.515435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec2588a7-fe67-406a-a518-17fe8fb1a501 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:08.692473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec2588a7-fe67-406a-a518-17fe8fb1a501 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:08.701435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec2588a7-fe67-406a-a518-17fe8fb1a501 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1220 microversion: 2.1 time: 0.192888 Nov 20 20:55:08.703155 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1542/3031] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:08 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1220 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:08.749477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:08.751977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:08.770987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.773206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.777131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.778806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.875572 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78705ad4-4253-4a6c-8d49-5a763d736e86 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.154686 Nov 20 20:55:08.878375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1543/3032] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:08 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:08.890652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:08.892183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:08.913426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.914004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.916195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:08.918795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:08.994789 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e04ed41-9f78-4296-92fb-1db64fcec540 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.113328 Nov 20 20:55:08.996708 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1544/3033] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:08 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:09.004143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:09.007138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:09.022858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.023567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.025649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.026143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.085534 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-19a4d4cc-8fa3-4255-928b-5bf0bd8b7d85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.087313 Nov 20 20:55:09.091194 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1545/3034] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:08 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:09.118264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:09.119633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:09.120361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:09.120986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:09.121879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:09.135107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.135851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.137941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.138823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.163882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Getting quotas for project 55ad41c3ee37467d8298682b08275eb9. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:09.171806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Getting quotas for user 1217211b10f84029b2a8bce2fe75bf58 and project 55ad41c3ee37467d8298682b08275eb9. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:09.187964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:09.190816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:09.242243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:09.242975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:09.260743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.265046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.268039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.268557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.304799 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a6d158b-f195-481f-a9c1-04d7564db3ab tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.118506 Nov 20 20:55:09.306268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1490/3035] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:55:09.320611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ec0dbb2-d303-4e68-a325-7348d23f4140 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:09.323308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ec0dbb2-d303-4e68-a325-7348d23f4140 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:09.426637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ec0dbb2-d303-4e68-a325-7348d23f4140 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:09.436874 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ec0dbb2-d303-4e68-a325-7348d23f4140 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1221 microversion: 2.1 time: 0.122055 Nov 20 20:55:09.450322 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1491/3036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:09 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:09.464064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:09.469697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:09.495566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.496025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.500904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:09.501371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:09.785319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:09.793608 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5116b36b-e096-4b2a-a9d6-822d9765778b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.351462 Nov 20 20:55:09.794260 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1492/3037] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:09 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:09.799565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1052060009", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "736ec84c-e23f-43ed-94e7-211dbb35bbc4"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:09.889311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] validate_networks() for [('736ec84c-e23f-43ed-94e7-211dbb35bbc4', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:10.229354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:10.240799 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92d32789-f6b9-4df6-a208-6306f7f883c0 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1473 microversion: 2.1 time: 1.009751 Nov 20 20:55:10.243623 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1546/3038] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:09 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1473 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:10.261285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:10.263158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.281681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.283410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.299750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.310771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.604765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:10.606040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:10.606732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:10.607317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:10.608047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:10.622662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.623404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.624414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.625063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.634240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:10.645246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b003421-a380-4564-be32-f46f9ec3d023 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1290 microversion: 2.1 time: 0.397754 Nov 20 20:55:10.649942 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1547/3039] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:10 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1290 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:10.661324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:10.668326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.682023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.684517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Getting quotas for project 55ad41c3ee37467d8298682b08275eb9. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:10.685362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.686748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.689994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.697544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Getting quotas for user 1217211b10f84029b2a8bce2fe75bf58 and project 55ad41c3ee37467d8298682b08275eb9. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:10.732034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:10.735550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:10.779437 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-15eceaa4-47c8-4e12-82f7-8b38ad7fd6d8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.127921 Nov 20 20:55:10.782808 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1548/3040] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:10 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:10.793147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:10.802416 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94c34265-5152-4b20-9715-03453d21de16 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.006547 Nov 20 20:55:10.804154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1493/3041] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:09 2021] POST /compute/v2.1/servers => generated 383 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:55:10.810619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:10.812453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.815640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.822145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.822916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.824380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.824994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.861763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.862334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.863213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.864315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.881980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1754b8e-49ea-4b6f-b84b-a07cac303b1b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.072935 Nov 20 20:55:10.888848 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1494/3042] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:10 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:10.903992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2dc550c-41ea-495c-b20a-304e7a0891d4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:10.906344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2dc550c-41ea-495c-b20a-304e7a0891d4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.952148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56c6a0e5-0945-46f7-a5f8-7f33feb0a829 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.167316 Nov 20 20:55:10.957611 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1549/3043] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:10 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:10.965678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:10.966679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:10.980686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.981400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:10.982563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:10.983183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.199130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2dc550c-41ea-495c-b20a-304e7a0891d4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:11.208424 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2dc550c-41ea-495c-b20a-304e7a0891d4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1222 microversion: 2.1 time: 0.317971 Nov 20 20:55:11.220501 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1495/3044] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:10 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1222 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:11.262821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:11.263923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:11.280030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.280523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.281340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.282661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.638433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:11.647463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67a721c8-30d8-4ddc-a740-4e7008695d50 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1473 microversion: 2.1 time: 0.390386 Nov 20 20:55:11.648059 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1496/3045] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:11 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:11.671644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:11.672605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:11.684416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.685166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.686376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.687328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.758247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:11.766370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3186e847-58ba-4f4f-8219-ba3bb972b6b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.806777 Nov 20 20:55:11.769454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1550/3046] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:10 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:11.793896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:11.795214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:11.803535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.804332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.805396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.807020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.858677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:11.866528 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c687e592-0ae5-4f1f-8f72-b9dfda7553cd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.076861 Nov 20 20:55:11.870007 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1551/3047] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:11 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:11.879887 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83714968-9816-4e1a-9efd-5a82af94ef43 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1278 microversion: 2.1 time: 0.211801 Nov 20 20:55:11.886163 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1497/3048] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:11 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:11.896139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:11.898017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:11.907998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.908600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.909510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.910109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.958370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af316d67-67e2-4bdc-aa88-205e7708cd58 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.066254 Nov 20 20:55:11.963818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1552/3049] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:11 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:11.965639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:11.966975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:11.974511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.975203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:11.976182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:11.976865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.023623 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e40919d1-b56e-4daa-8352-421bd4d176ab tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.062127 Nov 20 20:55:12.029464 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1498/3050] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:11 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:12.228440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:12.229574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:12.240378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.241141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.242392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.243122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.666031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:12.667500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:12.675137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.675996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.677147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.677754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.799136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bef88327b9f44c12a76983196b9a3ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60778bfeb31b496081c05ccc33a74a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:12.811050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:12.814192 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-917363e6-d6a2-4aaa-a8e7-28916230aa0c tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 200 len: 1431 microversion: 2.1 time: 0.152528 Nov 20 20:55:12.815616 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1499/3051] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:12 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 1431 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:12.831788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a130d56-a05f-4fd2-a46a-1e9a71bdc0b5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1282 microversion: 2.1 time: 0.607911 Nov 20 20:55:12.839231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:12.843312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1553/3052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:12 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1282 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:12.848400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:12.856356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.858655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.859475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.859918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.882432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:12.884229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:12.891069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.891905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.893137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.894019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.947084 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5edbf149-da66-4121-9f0a-96576d66e939 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.068910 Nov 20 20:55:12.949743 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1554/3053] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:12 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:12.957432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:12.958496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:12.970333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.971125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:12.972945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:12.973846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.098653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:13.117665 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6a6e7ab-ef3f-4d4c-a393-e84c66102917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1278 microversion: 2.1 time: 0.165335 Nov 20 20:55:13.122796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1555/3054] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:12 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:13.132780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:13.136969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:13.151253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.151806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.152698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.153202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.199781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:13.207866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e070731-95d8-474a-95d8-9c935a10722c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.390584 Nov 20 20:55:13.217962 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-837dfe6e-ca10-403a-899a-e55cdbc1756e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.084695 Nov 20 20:55:13.217962 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1556/3055] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:13 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:13.222356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1500/3056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:12 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:13.224713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8992ca22-d339-4d6d-86e1-2df6f687af8a req-baf42b88-8dfc-4d8e-9a80-18cc4a800eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0202d45-4861-4548-b517-c5a02af49a0d", "name": "network-vif-deleted", "tag": "23ec6af6-e448-4b84-a688-acf291e1c23c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:13.228738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:13.229412 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:13.229412 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:13.230288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:13.236972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.237700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.238840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.239446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.252395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8992ca22-d339-4d6d-86e1-2df6f687af8a req-baf42b88-8dfc-4d8e-9a80-18cc4a800eea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.252849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8992ca22-d339-4d6d-86e1-2df6f687af8a req-baf42b88-8dfc-4d8e-9a80-18cc4a800eea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.288366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e1d3f9a-d698-4c7d-a362-c75ea6c8114b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.063857 Nov 20 20:55:13.289711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8992ca22-d339-4d6d-86e1-2df6f687af8a req-baf42b88-8dfc-4d8e-9a80-18cc4a800eea service nova] Creating event network-vif-deleted:23ec6af6-e448-4b84-a688-acf291e1c23c for instance d0202d45-4861-4548-b517-c5a02af49a0d on nch1-master-1 Nov 20 20:55:13.294833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1501/3057] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:13 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:13.297211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8992ca22-d339-4d6d-86e1-2df6f687af8a req-baf42b88-8dfc-4d8e-9a80-18cc4a800eea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083593 Nov 20 20:55:13.304674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1557/3058] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:13.552236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3a26c249-c384-4f9b-8f3c-516b4d5ad042 req-d973330e-2874-4663-a5bf-a34c7af3ff9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293ef3df-319d-4bc8-8921-ed7b90ab89c9", "tag": "f7efeaeb-5641-4aca-8236-410be11d600d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:13.556434 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:13.556434 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:13.585956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a26c249-c384-4f9b-8f3c-516b4d5ad042 req-d973330e-2874-4663-a5bf-a34c7af3ff9a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.586934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a26c249-c384-4f9b-8f3c-516b4d5ad042 req-d973330e-2874-4663-a5bf-a34c7af3ff9a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.620489 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3a26c249-c384-4f9b-8f3c-516b4d5ad042 req-d973330e-2874-4663-a5bf-a34c7af3ff9a service nova] Creating event network-changed:f7efeaeb-5641-4aca-8236-410be11d600d for instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 on nch2-master-1 Nov 20 20:55:13.627554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3a26c249-c384-4f9b-8f3c-516b4d5ad042 req-d973330e-2874-4663-a5bf-a34c7af3ff9a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086621 Nov 20 20:55:13.628491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1502/3059] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:13.835488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:13.837728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] [instance: d0202d45-4861-4548-b517-c5a02af49a0d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:13.850700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.851329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.852479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.853669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.853898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:13.855402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:13.873156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] HTTP exception thrown: Instance d0202d45-4861-4548-b517-c5a02af49a0d could not be found. Nov 20 20:55:13.873798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.874098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] Returning 404 to user: Instance d0202d45-4861-4548-b517-c5a02af49a0d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:13.875064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.875852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-314bdf75-172b-423c-9149-f79c552a6d36 tempest-ServersOnMultiNodesTest-1982442712 tempest-ServersOnMultiNodesTest-1982442712-project] 10.222.0.41 "GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d" status: 404 len: 111 microversion: 2.1 time: 0.046557 Nov 20 20:55:13.876628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.877326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.880784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1558/3060] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:13 2021] GET /compute/v2.1/servers/d0202d45-4861-4548-b517-c5a02af49a0d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:13.961263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:13.963489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:13.976003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.979004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:13.982378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:13.983060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.053914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b20b608-12bb-477f-ad10-44424dca3c5d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.097387 Nov 20 20:55:14.059709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1559/3061] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:14.147083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:14.151171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:14.169181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.170218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.172246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.173584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.236159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:14.247158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-15e75fd1-8c68-4092-b516-b80a49d011c9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1280 microversion: 2.1 time: 0.401043 Nov 20 20:55:14.247747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1503/3062] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:13 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:14.262794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:14.263407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:14.269817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.270310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.271108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.271544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.339952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:14.356224 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91997847-46de-4f5c-92ea-7859db62e2f7 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1278 microversion: 2.1 time: 0.221101 Nov 20 20:55:14.357528 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1560/3063] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:14 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:14.363266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:14.365250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:14.388854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.390594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.391607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.392275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.441817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9dbc1df7-b97e-4dee-ac56-f9a0c408b1a3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.082362 Nov 20 20:55:14.443988 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1561/3064] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:14 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:14.449333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:14.451109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:14.459810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.460510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.462421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:14.462912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:14.514953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8647875a-f9ed-46ea-9ef2-8e0d96772755 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.069983 Nov 20 20:55:14.519142 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1562/3065] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:14 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:14.605011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:14.613078 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ede5c204-03e3-4d6f-a856-cf38d7b64fd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.354854 Nov 20 20:55:14.614314 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1504/3066] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:14 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:15.073977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:15.075633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:15.084694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.085144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.085941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.086961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.158034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dffe623f-f901-4e53-8951-5062e534a428 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.093168 Nov 20 20:55:15.159980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1563/3067] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:15 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:15.266489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:15.268631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:15.286602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.287340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.288888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.290570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.371717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3c7b3b31-ca31-4ac8-abca-ea22f944471e req-f661612b-85d9-402b-8739-54616b6d5056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d796894d-3c49-495b-8406-19241e7fc4b2", "tag": "218ebf70-108c-4096-8a5f-7859c111c4ed"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:15.373668 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:15.373668 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:15.382481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3c7b3b31-ca31-4ac8-abca-ea22f944471e req-f661612b-85d9-402b-8739-54616b6d5056 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.383060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3c7b3b31-ca31-4ac8-abca-ea22f944471e req-f661612b-85d9-402b-8739-54616b6d5056 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.402247 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3c7b3b31-ca31-4ac8-abca-ea22f944471e req-f661612b-85d9-402b-8739-54616b6d5056 service nova] Creating event network-changed:218ebf70-108c-4096-8a5f-7859c111c4ed for instance d796894d-3c49-495b-8406-19241e7fc4b2 on nch1-master-1 Nov 20 20:55:15.407650 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3c7b3b31-ca31-4ac8-abca-ea22f944471e req-f661612b-85d9-402b-8739-54616b6d5056 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042272 Nov 20 20:55:15.409217 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1564/3068] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:15.426256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:15.427182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:15.435658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.436471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.437369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.437928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.849829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:15.860316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5a40de9-fdc9-4fc4-8d88-91095d5a7772 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.599755 Nov 20 20:55:15.861065 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1505/3069] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:15 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:15.875188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:15.876185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:15.883738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.884339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.885408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.885901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.931890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c391702-426c-42c4-b232-d9b353d0b44d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.060016 Nov 20 20:55:15.932912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1506/3070] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:15 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:15.938639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:15.940560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:15.948925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.949657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.950490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:15.950924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:15.997871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c46f2e6d-2b9a-4f7d-9f38-44e6da6188cd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.063329 Nov 20 20:55:16.001754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1507/3071] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:15 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:16.007933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:16.009298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:16.018235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.018671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.019466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.019898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.342835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:16.351338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-218dd046-4503-464f-93a4-fea3f7bf1c46 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.940511 Nov 20 20:55:16.367222 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1565/3072] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:15 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:16.382720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:16.384635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:16.393837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.394674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.396442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.397669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.463826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:16.468788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a909bb9d-d922-4025-b748-0670f92659f8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.089850 Nov 20 20:55:16.471383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1566/3073] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:16.494135 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0baec7dc-1e22-4580-aa35-1152896e5215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.490235 Nov 20 20:55:16.495649 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1508/3074] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:16 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:16.878639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:16.880156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:16.904390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.905096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.907105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.907778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.944837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:16.947251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:16.963231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.963791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:16.964899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:16.965592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.029764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c540af1d-2872-4e14-9f56-3bf33249a220 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.088229 Nov 20 20:55:17.030705 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1509/3075] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:16 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:17.036786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:17.037798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:17.045816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.046553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.047561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.048171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.098914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c9a6105-c90e-433f-bef0-453ff3d0fd09 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.066368 Nov 20 20:55:17.101113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1510/3076] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:17 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:17.372891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:17.374169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:17.382298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.383115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.384735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.385466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.513137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:17.521917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0338867c-0463-4e3b-833a-f4a3032d90f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.648435 Nov 20 20:55:17.535178 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1567/3077] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:16 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:17.540693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-645f558f-c167-49ca-9956-f5f716495cd8 req-f0679737-6d1c-4156-88c2-e56274269814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde408bf-cb7a-4d41-8b66-ff40aa94f98e", "tag": "6298c75b-8fea-4075-8d87-350b7b03ded0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:17.542237 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:17.542237 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:17.555016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-645f558f-c167-49ca-9956-f5f716495cd8 req-f0679737-6d1c-4156-88c2-e56274269814 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.555502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-645f558f-c167-49ca-9956-f5f716495cd8 req-f0679737-6d1c-4156-88c2-e56274269814 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.576251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-645f558f-c167-49ca-9956-f5f716495cd8 req-f0679737-6d1c-4156-88c2-e56274269814 service nova] Creating event network-changed:6298c75b-8fea-4075-8d87-350b7b03ded0 for instance cde408bf-cb7a-4d41-8b66-ff40aa94f98e on nch2-master-1 Nov 20 20:55:17.592097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-645f558f-c167-49ca-9956-f5f716495cd8 req-f0679737-6d1c-4156-88c2-e56274269814 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055360 Nov 20 20:55:17.592981 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1568/3078] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:17.598161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:17.608358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:17.626260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.627084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.628135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.628781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.698254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b2c3c09-4e0d-477b-8c71-627607c45f4b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.103614 Nov 20 20:55:17.706404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1569/3079] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:17 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:17.713949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:17.715055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:17.724198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.725073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.726802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:17.728064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:17.746356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:17.756919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a255b5d0-89d4-4b1c-920d-3eef768275a6 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.388626 Nov 20 20:55:17.760900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1511/3080] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:17 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:18.045590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:18.050396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:18.061063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.062189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.063200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.063888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.130659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-abb63c30-787c-4c6d-8683-2ac154769867 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.092560 Nov 20 20:55:18.137414 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1512/3081] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:18 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:18.153236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:18.156061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:18.170694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.171385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.172687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.173193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.213766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:18.229942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1604409-53ed-446e-aa94-bbbcd09313d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.521336 Nov 20 20:55:18.230928 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1570/3082] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:17 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:18.281927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8395251a-f131-4bca-99f9-bb4c5080bf22 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 24576 microversion: 2.1 time: 0.141616 Nov 20 20:55:18.283277 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1513/3083] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:18 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 24576 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:18.551661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:18.552947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:18.560525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.560977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.561795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:18.562483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:18.761225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1757177100", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:18.823495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:19.264671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:19.265093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:19.265565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:19.265971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:19.266402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:19.283413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.284528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.285713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.286355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.324873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Getting quotas for project 844aeaa7e739473d9415dfd5f9d3d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:19.335525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Getting quotas for user 597235094beb453a9f9732bbaba31944 and project 844aeaa7e739473d9415dfd5f9d3d98a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:19.360831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:19.363759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:19.376026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:19.383630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-317f56ef-894c-48b8-9a67-070b86d99936 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.835483 Nov 20 20:55:19.386932 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1571/3084] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:18 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:19.401331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:19.402806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:19.422232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.423192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.425694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.426495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.508378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76384160-78a8-48b6-a520-7f413560f2dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.119767 Nov 20 20:55:19.512616 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1572/3085] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:19 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:19.528946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:19.529929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:19.541525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.545365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.546501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.549978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.558686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb2f9cab-f0ba-469b-8db0-bf65a3543b24 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.954177 Nov 20 20:55:19.566694 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1514/3086] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:55:19.576046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:19.578258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:19.624665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.625212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.628650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.630624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.726895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56bde3cc-1287-4751-840f-06789d5d1186 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.157613 Nov 20 20:55:19.730779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1515/3087] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:19 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:19.746811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:19.749016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:19.771575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.772966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:19.773788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:19.774670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.064516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:20.074340 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f0339b6-6c68-4c4e-9e14-79ab9790814d tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.560004 Nov 20 20:55:20.075231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1573/3088] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:19 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:20.084738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:20.088826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:20.111948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.112697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.113932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.115635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.120445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:20.131279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed5932c4-ebe0-4a5d-925b-e904215cc6d5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.397850 Nov 20 20:55:20.134417 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1516/3089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:19 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:20.149392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a51e9f3-77b7-424f-8fec-116431e84a90 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:20.150824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1a51e9f3-77b7-424f-8fec-116431e84a90 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:20.222197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fdd3b5aa-707d-4d1b-8384-4425c05f4110 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.143895 Nov 20 20:55:20.225354 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1574/3090] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:20 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:20.233348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "711c77a1-f02a-41ec-8bcc-3b83fc631724", "tag": "755721ae-d227-49d0-947b-f6f75f3cf29a"}, {"name": "network-changed", "server_uuid": "6789903f-f708-4bfa-8252-2c4d5a69921a", "tag": "5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:20.236124 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:20.236124 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:20.237466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1a51e9f3-77b7-424f-8fec-116431e84a90 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:20.244242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a51e9f3-77b7-424f-8fec-116431e84a90 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1214 microversion: 2.1 time: 0.108498 Nov 20 20:55:20.244833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1517/3091] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:20 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:20.248887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.249786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.266547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-84c63ac9-cee6-4f2a-8892-469f54fd17ab req-4802717b-18ee-4259-bf8c-9c6e52b320fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293ef3df-319d-4bc8-8921-ed7b90ab89c9", "name": "network-vif-plugged", "status": "completed", "tag": "f7efeaeb-5641-4aca-8236-410be11d600d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:20.269177 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:20.269177 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:20.271818 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] Creating event network-changed:755721ae-d227-49d0-947b-f6f75f3cf29a for instance 711c77a1-f02a-41ec-8bcc-3b83fc631724 on nch1-master-1 Nov 20 20:55:20.272982 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] Creating event network-changed:5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0 for instance 6789903f-f708-4bfa-8252-2c4d5a69921a on nch1-master-1 Nov 20 20:55:20.282687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7434790d-4edd-4dd2-8506-cc43529d9c22 req-779a525c-e506-4d8c-a7be-dfad3f99374d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055017 Nov 20 20:55:20.283994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-84c63ac9-cee6-4f2a-8892-469f54fd17ab req-4802717b-18ee-4259-bf8c-9c6e52b320fb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.284731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-84c63ac9-cee6-4f2a-8892-469f54fd17ab req-4802717b-18ee-4259-bf8c-9c6e52b320fb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.287213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1575/3092] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:20.303429 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-84c63ac9-cee6-4f2a-8892-469f54fd17ab req-4802717b-18ee-4259-bf8c-9c6e52b320fb service nova] Creating event network-vif-plugged:f7efeaeb-5641-4aca-8236-410be11d600d for instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 on nch2-master-1 Nov 20 20:55:20.309339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-84c63ac9-cee6-4f2a-8892-469f54fd17ab req-4802717b-18ee-4259-bf8c-9c6e52b320fb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063362 Nov 20 20:55:20.310609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1518/3093] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:20.406259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:20.407235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:20.417926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.422700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.423902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.425097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.521865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:20.523938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:20.540812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.541258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.545194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.545490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.609527 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9b8b415-6eb0-4817-be22-dfefa871727a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.091156 Nov 20 20:55:20.611052 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1519/3094] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:20 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:20.742138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:20.743998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:20.751247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.751921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.752999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:20.753426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:20.805912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:20.815927 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6d0d61d-cf5c-402c-bf43-08341f83433a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.414183 Nov 20 20:55:20.825125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1576/3095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:20 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:20.937481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be83d4aa-5b99-45ba-81a1-12ba26055d36 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.198809 Nov 20 20:55:20.939567 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1520/3096] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:20 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:21.091182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:21.092527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.107206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.107834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.108747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.109293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.152433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:21.153554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.168469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.169332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.185064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.186202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.530557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:21.546367 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6274e8cd-a415-4503-bba9-815f977d18bf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.398412 Nov 20 20:55:21.551221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1521/3097] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:21 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:21.556491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:21.557594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.572007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.572687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.573569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.573950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.574383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:21.589206 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec130c36-c67e-46df-a421-0b3bdc8ad8a2 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.501526 Nov 20 20:55:21.589799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1577/3098] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:21 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:21.604200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:21.607481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.626646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.628200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.630918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.631635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.650091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-652dff6c-8869-475a-bb8c-dcdbf7524ba4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.097009 Nov 20 20:55:21.650791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1522/3099] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:21 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:21.661959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:21.667676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.685323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.686302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.687628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.688268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.773516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:21.782751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73b1dff3-427f-4e99-97cf-c786756aef82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.127001 Nov 20 20:55:21.783532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1523/3100] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:21 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:21.790743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c6f268b-e6af-4008-a640-d42ba3faad19 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1272 microversion: 2.1 time: 0.183027 Nov 20 20:55:21.791490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1578/3101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:21 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:21.838604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:21.839962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.866167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.869696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.876075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.879011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.952669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:21.953684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:21.962593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.966102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:21.967193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:21.968860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.023726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c23c0d16-83be-4ce7-8e97-7eacbec58132 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.076888 Nov 20 20:55:22.028983 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1579/3102] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:21 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:22.288675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:22.298258 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0179e8a-d139-407a-9bb5-f17e0ef28fad tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.469003 Nov 20 20:55:22.301595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1524/3103] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:21 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:22.332231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a50ef740-1c75-4f8a-865c-6b30e0240fd6 req-1cf27923-f3c8-46d1-93e8-a70dd71797ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d796894d-3c49-495b-8406-19241e7fc4b2", "name": "network-vif-plugged", "status": "completed", "tag": "218ebf70-108c-4096-8a5f-7859c111c4ed"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:22.334161 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:22.334161 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:22.354819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a50ef740-1c75-4f8a-865c-6b30e0240fd6 req-1cf27923-f3c8-46d1-93e8-a70dd71797ef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:22.355550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a50ef740-1c75-4f8a-865c-6b30e0240fd6 req-1cf27923-f3c8-46d1-93e8-a70dd71797ef service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.368549 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a50ef740-1c75-4f8a-865c-6b30e0240fd6 req-1cf27923-f3c8-46d1-93e8-a70dd71797ef service nova] Creating event network-vif-plugged:218ebf70-108c-4096-8a5f-7859c111c4ed for instance d796894d-3c49-495b-8406-19241e7fc4b2 on nch1-master-1 Nov 20 20:55:22.374640 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a50ef740-1c75-4f8a-865c-6b30e0240fd6 req-1cf27923-f3c8-46d1-93e8-a70dd71797ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048385 Nov 20 20:55:22.375776 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1580/3104] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:22.566977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:22.567600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:22.576252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:22.576717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.577521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:22.577961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.607600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:22.608136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:22.622517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:22.622983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.623794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:22.624237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:22.973222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:22.986086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ece9843f-74c6-4c34-87c4-140b3aad91fc tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.383697 Nov 20 20:55:22.999225 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1581/3105] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:22 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:23.015209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:23.017816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:23.028859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.030445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.031816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.032429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.113828 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-801ea97a-73b8-419c-b42f-d87aa06769ef tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.111411 Nov 20 20:55:23.115570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1582/3106] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:22 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:23.132492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:23.151177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:23.169209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.174725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.177480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.179304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.261866 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa4f7509-efe6-4640-a558-97e22becc611 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.144086 Nov 20 20:55:23.263434 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1583/3107] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:23 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:23.274858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:23.275748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:23.284377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.286009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.287769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.289126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.328174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:23.345979 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fd68606-9dfb-4098-8c33-22cd56ee1b7b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1314 microversion: 2.1 time: 0.782623 Nov 20 20:55:23.353982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1525/3108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:22 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:23.359723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:23.360867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:23.370160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.370865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.371840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.372445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.424376 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69af805f-9349-40aa-9312-c9ec7b48b41e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.068478 Nov 20 20:55:23.431499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1526/3109] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:23 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:23.435499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:23.447861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:23.459636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.460696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.461903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:23.463019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:23.600668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:23.616130 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c8d5a32-e883-44ac-947a-83bc0554cae9 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.350679 Nov 20 20:55:23.629854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1584/3110] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:23 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:23.732169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:23.741818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7dec5a1-35cb-42d8-9ca5-42c3a7edcd76 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.311584 Nov 20 20:55:23.748300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1527/3111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:23 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:24.004596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:24.005439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.019278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.020407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.021502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.022274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.139787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:24.141261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.158538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.159634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.162299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.164405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.248091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-700d078c-ffad-4995-8f75-28b86d557db2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.121368 Nov 20 20:55:24.248762 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1528/3112] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:24 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:24.275696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:24.276879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.284020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.284951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.285961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.286609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.294487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:24.303524 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0261dbd5-e110-45be-b776-de79f7c42661 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.302954 Nov 20 20:55:24.304117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1585/3113] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:23 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:24.318152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5f092e60-18cc-4faa-aef7-4d532ab1c2ae req-86f17b7a-5a63-40cb-89ea-3cfc5bae4205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4682c8fb-76cc-41d0-a971-f7cf0c5b38ee", "tag": "4956aa6a-4c78-4631-8ea7-0eb3de01732b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:24.322752 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:24.322752 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:24.341963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f092e60-18cc-4faa-aef7-4d532ab1c2ae req-86f17b7a-5a63-40cb-89ea-3cfc5bae4205 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.342460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f092e60-18cc-4faa-aef7-4d532ab1c2ae req-86f17b7a-5a63-40cb-89ea-3cfc5bae4205 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.362964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8402e61-fa48-44bf-8cef-1ed1a219555a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.087960 Nov 20 20:55:24.368070 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5f092e60-18cc-4faa-aef7-4d532ab1c2ae req-86f17b7a-5a63-40cb-89ea-3cfc5bae4205 service nova] Creating event network-changed:4956aa6a-4c78-4631-8ea7-0eb3de01732b for instance 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee on nch2-master-1 Nov 20 20:55:24.369047 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1529/3114] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:24.385183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:24.386275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.387234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5f092e60-18cc-4faa-aef7-4d532ab1c2ae req-86f17b7a-5a63-40cb-89ea-3cfc5bae4205 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078667 Nov 20 20:55:24.388197 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1586/3115] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:24.397972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.397972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.398692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.399276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.439920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:24.440929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.448356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.448613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.449324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.449757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.539525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d14d182f-dbed-4539-8473-006682a965e2 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.103274 Nov 20 20:55:24.552654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1587/3116] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:24 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:24.636457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:24.637236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.648517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.649270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.650328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.656055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.791465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:24.799587 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2116bc65-ebed-4af6-b330-f3fff9b52ae2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1501 microversion: 2.1 time: 0.429209 Nov 20 20:55:24.800706 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1530/3117] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:24 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1501 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:24.806374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:24.807764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:24.816788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.817557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:24.822736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:24.823438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.077127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:25.088159 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8851065-98f8-410e-8a16-1adb4580e22f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.285898 Nov 20 20:55:25.089031 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1531/3118] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:24 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:25.094034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:25.094773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.101962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.103028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.104070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.104686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.140240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:25.241811 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa7ce870-eb44-4ead-a826-058a5aced616 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 204 len: 0 microversion: 2.1 time: 0.150781 Nov 20 20:55:25.243318 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1532/3119] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:25 2021] DELETE /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:25.253921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:25.255861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.263066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.263513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.264303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.264735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.287515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:25.295021 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4aed7639-c429-46a4-889b-b548537d4600 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.663186 Nov 20 20:55:25.305034 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1588/3120] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:24 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:25.312123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:25.313324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.327025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.327871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.328992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.330318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.382536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-060928fe-a8ac-4e66-b035-d2f368b3d173 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.074751 Nov 20 20:55:25.384310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1589/3121] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:25 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:25.392703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:25.395094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.403234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.403959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.405284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.406039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.489337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:25.498221 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45e3ea12-ccaa-4e7e-9d67-d55c0e480c00 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1507 microversion: 2.1 time: 0.250069 Nov 20 20:55:25.498801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1533/3122] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:25 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:25.505157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:25.506079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.515683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.516279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.517223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.518025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.583559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88ae0187-9fb7-40bf-954e-06fcc94fcf3f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.083279 Nov 20 20:55:25.585148 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1534/3123] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:25 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:25.592632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:25.593932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:25.603478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.604355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.605362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.605998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.663115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:25.666928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2102308a-3269-4d11-8283-5d6552e82064 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.080162 Nov 20 20:55:25.667948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1535/3124] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:25 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:25.675729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2101c16-bb15-4cca-8831-58bb62444e5c tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.289572 Nov 20 20:55:25.686910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1590/3125] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:25 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:25.780542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ea42f342-ac20-4b71-afc4-7d9513bdb934 req-08f43d69-dfdf-4337-a095-d50ac09f3298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde408bf-cb7a-4d41-8b66-ff40aa94f98e", "name": "network-vif-plugged", "status": "completed", "tag": "6298c75b-8fea-4075-8d87-350b7b03ded0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:25.782584 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:25.782584 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:25.791958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ea42f342-ac20-4b71-afc4-7d9513bdb934 req-08f43d69-dfdf-4337-a095-d50ac09f3298 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:25.792733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ea42f342-ac20-4b71-afc4-7d9513bdb934 req-08f43d69-dfdf-4337-a095-d50ac09f3298 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:25.807916 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ea42f342-ac20-4b71-afc4-7d9513bdb934 req-08f43d69-dfdf-4337-a095-d50ac09f3298 service nova] Creating event network-vif-plugged:6298c75b-8fea-4075-8d87-350b7b03ded0 for instance cde408bf-cb7a-4d41-8b66-ff40aa94f98e on nch2-master-1 Nov 20 20:55:25.813435 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ea42f342-ac20-4b71-afc4-7d9513bdb934 req-08f43d69-dfdf-4337-a095-d50ac09f3298 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036802 Nov 20 20:55:25.814698 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1536/3126] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:26.105098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:26.105718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.112135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.112592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.113389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.113832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.254231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:26.262323 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4cb94bab-bfab-46e1-a1f6-4800c72211aa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.161351 Nov 20 20:55:26.262898 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1591/3127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:26 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:26.313122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:26.313810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.319837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.320281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.321645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.322290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.399092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:26.400324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.406946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.407482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.408349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.408861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.450801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-031f5518-7791-484b-b78c-457b4b0d6a85 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.055115 Nov 20 20:55:26.452045 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1592/3128] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:26 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:26.516343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:26.517042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.524676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.525167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.525921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.526552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.576455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:26.583955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dea1784-959b-4389-8c48-eb2e692d85f4 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.275563 Nov 20 20:55:26.584865 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1537/3129] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:26 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:26.595829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:26.596914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.603535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.604081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.604950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.605462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.656181 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3984b510-c9b7-416f-9c1b-1c3c22293a59 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.063679 Nov 20 20:55:26.657433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1538/3130] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:26 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:26.680599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:26.681615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.691121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.691564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.692364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.692796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.741968 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c65295c1-a597-4ef8-883d-ba8719338e08 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.066619 Nov 20 20:55:26.746965 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1539/3131] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:26 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:26.747765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:26.748683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:26.749739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:26.756344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.756801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.758510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:26.758510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:26.758773 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a2fee96-e0b2-4691-ab88-58bd9a8b078f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 200 len: 1507 microversion: 2.1 time: 0.246507 Nov 20 20:55:26.759977 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1593/3132] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:26 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:27.206035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3fb9599a-bbbc-47da-b0ac-4bd2ae2beefa req-f4560e1b-2005-4ad0-a959-fb79ae86e144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d796894d-3c49-495b-8406-19241e7fc4b2", "name": "network-vif-deleted", "tag": "218ebf70-108c-4096-8a5f-7859c111c4ed"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:27.208937 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:27.208937 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:27.221345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3fb9599a-bbbc-47da-b0ac-4bd2ae2beefa req-f4560e1b-2005-4ad0-a959-fb79ae86e144 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.222342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3fb9599a-bbbc-47da-b0ac-4bd2ae2beefa req-f4560e1b-2005-4ad0-a959-fb79ae86e144 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.238144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3fb9599a-bbbc-47da-b0ac-4bd2ae2beefa req-f4560e1b-2005-4ad0-a959-fb79ae86e144 service nova] Creating event network-vif-deleted:218ebf70-108c-4096-8a5f-7859c111c4ed for instance d796894d-3c49-495b-8406-19241e7fc4b2 on nch1-master-1 Nov 20 20:55:27.244718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3fb9599a-bbbc-47da-b0ac-4bd2ae2beefa req-f4560e1b-2005-4ad0-a959-fb79ae86e144 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042807 Nov 20 20:55:27.245735 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1594/3133] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:27.283353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:27.293442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.309577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.310466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.311967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.312758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.454097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:27.464869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09c9d2e6-c300-4561-83af-103a98fb5ae4 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.719645 Nov 20 20:55:27.466095 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1540/3134] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:26 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:27.470874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:27.471786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.481709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.483530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.484522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.484963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.543259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e3a3432-9b56-4c8e-970d-0211adc0f1d3 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.075558 Nov 20 20:55:27.543503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:27.544835 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1541/3135] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:27.551776 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7446339-69e0-48c9-ac1f-28d74344cc98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.273786 Nov 20 20:55:27.552755 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1595/3136] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:27 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:27.602850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:27.604279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.611732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.612459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.613459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.613928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.669844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:27.670907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.679159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.680778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.682227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.682872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.733966 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-533b34aa-06f2-4ada-9da7-34a238ad0748 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.069175 Nov 20 20:55:27.738221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1596/3137] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:27.757311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:27.758583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.767275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.767991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.768827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.769269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.806362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:27.811409 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d068a3e4-d564-473c-ac1d-521d74962176 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.059485 Nov 20 20:55:27.812227 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1597/3138] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:27.817821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:27.818792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:27.819039 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08115b54-2fde-4ba7-bf9d-61987a78bfe3 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.221805 Nov 20 20:55:27.819622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1542/3139] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:27 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:27.826881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.827212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.828208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.828872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.835024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711c77a1-f02a-41ec-8bcc-3b83fc631724", "name": "network-vif-plugged", "status": "completed", "tag": "755721ae-d227-49d0-947b-f6f75f3cf29a"}, {"server_uuid": "6789903f-f708-4bfa-8252-2c4d5a69921a", "name": "network-vif-plugged", "status": "completed", "tag": "5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:27.837508 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:27.837508 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:27.845613 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. Nov 20 20:55:27.846097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:27.846341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:27.846738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:27.847088 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47f45781-9cf1-430b-b215-3305163eea46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 404 len: 111 microversion: 2.1 time: 0.033622 Nov 20 20:55:27.847668 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1598/3140] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:27 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:27.865927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] Creating event network-vif-plugged:755721ae-d227-49d0-947b-f6f75f3cf29a for instance 711c77a1-f02a-41ec-8bcc-3b83fc631724 on nch1-master-1 Nov 20 20:55:27.866460 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] Creating event network-vif-plugged:5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0 for instance 6789903f-f708-4bfa-8252-2c4d5a69921a on nch1-master-1 Nov 20 20:55:27.872870 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4e841f2a-d835-413d-b256-60e1b88db074 req-71a57104-c086-4fb9-ab5d-9acbfe4eb8c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041527 Nov 20 20:55:27.873500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1543/3141] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:27.956552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-357427475", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:28.016303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:28.451634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:28.452343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:28.453462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:28.453989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:28.454755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:28.473180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.473666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.474499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.474996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.483166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:28.483870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.491132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.491591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.492436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.492883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.496558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:28.501756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:28.514941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:28.517338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:28.566281 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3217552f-24f8-4892-89bf-96da16db810a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613344 Nov 20 20:55:28.572412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1599/3142] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:55:28.572412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:28.573483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.579612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.580179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.581077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.581660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.632435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41b2212d-5280-448c-a39f-fb65e834e849 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.064042 Nov 20 20:55:28.636937 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1600/3143] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:28 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:28.642206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:28.643165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.651498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.651955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.652758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.653199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.684779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:28.693303 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c6e72af3-6c4d-4358-b72f-2ba5d60b984f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1320 microversion: 2.1 time: 0.214076 Nov 20 20:55:28.702372 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1544/3144] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:28 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1320 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:28.702372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-702f0fa2-fcb7-44e3-850f-4a8255fa276d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:28.702372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-702f0fa2-fcb7-44e3-850f-4a8255fa276d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.770300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-702f0fa2-fcb7-44e3-850f-4a8255fa276d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:28.778522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-702f0fa2-fcb7-44e3-850f-4a8255fa276d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1214 microversion: 2.1 time: 0.083556 Nov 20 20:55:28.782421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1545/3145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:28 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:28.788504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:28.788504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.795766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.796221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.797083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.797523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.841519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7df964a-ea54-4d2c-a02c-5bd7e8337734 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.057633 Nov 20 20:55:28.842863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1546/3146] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:28 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:28.855022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:28.855958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.862781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.863228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.864016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.864453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.907523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9568b86b-7f85-4f6c-9aa3-2594400184d0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.063881 Nov 20 20:55:28.908194 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1547/3147] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:28 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:28.913443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:28.914158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:28.921134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.921561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.922589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:28.923028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:28.937544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:28.953750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-10def2ee-454e-4743-87bf-393eee26c011 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1322 microversion: 2.1 time: 0.315370 Nov 20 20:55:28.957986 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1601/3148] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:28 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:29.068891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:29.087426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db172303-b8ff-41b5-b36c-52362016ac96 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.176989 Nov 20 20:55:29.088375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1548/3149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:28 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:29.650172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:29.651525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:29.669923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.670462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.671508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.672010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.712615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:29.714903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:29.723825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.724531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.725819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.727124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.729673 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7eeb3272-c4a9-410e-91e8-0d45afb98678 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.087873 Nov 20 20:55:29.730646 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1602/3150] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:29 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:29.795806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:29.797056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:29.811317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.811779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.812606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.813521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.941354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:29.942509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:29.951640 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd834fdc-78b9-4382-92d6-0ff90c10fd48 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 200 len: 1508 microversion: 2.1 time: 0.244761 Nov 20 20:55:29.952721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1549/3151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:29 2021] GET /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:29.957463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:29.958725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:29.965931 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eec512d-2fae-4cfd-a62f-cd26ad703750 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1272 microversion: 2.1 time: 0.173613 Nov 20 20:55:29.967281 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1603/3152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:29 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:29.969977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.970461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.971243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.971675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.973672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:29.975610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:29.989440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.990023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:29.991104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:29.991547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.021068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c08729bf-4004-42da-a8fb-2a0f791c3017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.066831 Nov 20 20:55:30.022094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1550/3153] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:29 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:30.028194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.028940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: cde408bf-cb7a-4d41-8b66-ff40aa94f98e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.033970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e2a6064-8d79-4a41-82e1-104a24c0afa6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.065104 Nov 20 20:55:30.034782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1604/3154] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:29 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:30.040809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.041343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.041542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.042341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.042468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.042865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.049879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.050364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.051251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.051700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.188934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:30.197233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6bbabdba-faae-4983-a40f-e13b83ed7cd8 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/cde408bf-cb7a-4d41-8b66-ff40aa94f98e" status: 200 len: 1509 microversion: 2.1 time: 0.174094 Nov 20 20:55:30.197812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1551/3155] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:30 2021] GET /compute/v2.1/servers/cde408bf-cb7a-4d41-8b66-ff40aa94f98e => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:30.202557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.203156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.212345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.212789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.213615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.214075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.366755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:30.375921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a327b5b1-63d1-4be3-951d-9bb51f420e4c tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.176593 Nov 20 20:55:30.376499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1552/3156] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:30 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:30.381321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.382028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: cde408bf-cb7a-4d41-8b66-ff40aa94f98e] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.388563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.389237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.390251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.390850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.398942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:30.413899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bf90d91-cc5c-409c-bae4-e400e2542fe2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1517 microversion: 2.1 time: 0.377618 Nov 20 20:55:30.415602 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1605/3157] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:30 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1517 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:30.425678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: cde408bf-cb7a-4d41-8b66-ff40aa94f98e] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:30.451257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:30.452667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.459463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.459991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.461348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.462032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.488603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lazy-loading 'flavor' on Instance uuid 6789903f-f708-4bfa-8252-2c4d5a69921a {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:55:30.526977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90f8c9bd-b8a9-48c5-a20f-f119d9c1d985 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cde408bf-cb7a-4d41-8b66-ff40aa94f98e" status: 204 len: 0 microversion: 2.1 time: 0.148818 Nov 20 20:55:30.528221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1553/3158] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:30 2021] DELETE /compute/v2.1/servers/cde408bf-cb7a-4d41-8b66-ff40aa94f98e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:30.536487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.537316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.545489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.546299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.547273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.547883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.582877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: 711c77a1-f02a-41ec-8bcc-3b83fc631724] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:30.584365 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b3faebe-f062-4742-8b57-3ccada860c68 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action" status: 200 len: 32 microversion: 2.1 time: 0.149117 Nov 20 20:55:30.584973 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1606/3159] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:30 2021] POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:55:30.595638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:30.596856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.606279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.607264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.608535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.609169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.681525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a744daa1-e676-4953-ab3c-82ccee6c30bb tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "DELETE /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724" status: 204 len: 0 microversion: 2.1 time: 0.148693 Nov 20 20:55:30.692693 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1554/3160] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:30 2021] DELETE /compute/v2.1/servers/711c77a1-f02a-41ec-8bcc-3b83fc631724 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:30.741857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:30.743109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:30.750041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.750526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.751299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:30.751728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:30.798544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0866f17-c9cf-4389-b0a5-73bf0d6573bd tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.060961 Nov 20 20:55:30.799568 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1555/3161] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:30 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:30.804262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-826286436", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e1689f5d-8863-4b2c-a6d3-375854e48d20"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:30.859797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] validate_networks() for [('e1689f5d-8863-4b2c-a6d3-375854e48d20', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:31.245351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:31.245856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:31.246441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:31.247106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:31.247612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:31.256495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.256957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.258005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.258484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.278852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Getting quotas for project 480b4b05733646e88b6eb93050825547. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:31.283949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Getting quotas for user 378c95a8c74d466ea13525dd1bf6fd75 and project 480b4b05733646e88b6eb93050825547. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:31.296444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Going to run 2 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:31.298912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:31.331552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=db188a9b-76d3-4bd0-8c8d-6d69715fe374,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:31.385084 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c7b83d8-d94c-4ec4-a829-51b3b737375a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.584658 Nov 20 20:55:31.385991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1556/3162] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:30 2021] POST /compute/v2.1/servers => generated 32 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 20 20:55:31.391604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:31.392219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.398749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.399216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.400000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.400440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.437425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:31.446205 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05d794c5-d911-4803-828f-2b006eb3edb6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.854886 Nov 20 20:55:31.447116 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1607/3163] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:30 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:31.451638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:31.452547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.458731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.459531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.460504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.461669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.499913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:31.510074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1126d00a-6822-44da-96bd-8c5d9f82e96d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1272 microversion: 2.1 time: 0.121834 Nov 20 20:55:31.510617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a485f6f-27c3-4bff-b722-f4ae19be1095 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.061960 Nov 20 20:55:31.511971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1608/3164] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:31 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:31.523027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:31.524386 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1557/3165] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:31 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:31.559463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.572753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.574070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.574070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.574070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.574070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.612060 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-303a4ebe-cdd6-4323-8d62-fcef02f4f105 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.098044 Nov 20 20:55:31.616221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1609/3166] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:31 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:31.618978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:31.622303 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:31.622303 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:31.623726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:31.624179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Searching by: {'deleted': False, 'project_id': '480b4b05733646e88b6eb93050825547'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:55:31.641397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.641833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.642935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.643440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.706686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:55:31.742135 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a6748329-fd19-4778-bed4-e0ebdfd9cce9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.127462 Nov 20 20:55:31.743175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1610/3167] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:55:31 2021] GET /compute/v2.1/servers => generated 1335 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:31.753431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-039f4c89-7b0e-4ebf-af53-6a3b552ad21f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:31.754118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-039f4c89-7b0e-4ebf-af53-6a3b552ad21f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.832078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:31.842344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89dc17b1-a080-4dc8-8c9c-3319008b18a7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.316768 Nov 20 20:55:31.843188 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1558/3168] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:31 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:31.848402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:31.849612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:31.860151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.861090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.862395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:31.863197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:31.930598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-039f4c89-7b0e-4ebf-af53-6a3b552ad21f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:31.942425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a22633a-3ba0-4ab3-a64b-efc331788323 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.096346 Nov 20 20:55:31.943781 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-039f4c89-7b0e-4ebf-af53-6a3b552ad21f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1217 microversion: 2.1 time: 0.193631 Nov 20 20:55:31.944422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1611/3169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:31 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:31.950837 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1559/3170] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:31 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:31.992779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-21f24003-17a8-4ee2-8643-b9fab7728a16 req-ef096be7-75bd-42ab-b40d-530cabe2645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4682c8fb-76cc-41d0-a971-f7cf0c5b38ee", "name": "network-vif-plugged", "status": "completed", "tag": "4956aa6a-4c78-4631-8ea7-0eb3de01732b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:31.994257 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:31.994257 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:32.004166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21f24003-17a8-4ee2-8643-b9fab7728a16 req-ef096be7-75bd-42ab-b40d-530cabe2645f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.006627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21f24003-17a8-4ee2-8643-b9fab7728a16 req-ef096be7-75bd-42ab-b40d-530cabe2645f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.037235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-21f24003-17a8-4ee2-8643-b9fab7728a16 req-ef096be7-75bd-42ab-b40d-530cabe2645f service nova] Creating event network-vif-plugged:4956aa6a-4c78-4631-8ea7-0eb3de01732b for instance 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee on nch2-master-1 Nov 20 20:55:32.063494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-21f24003-17a8-4ee2-8643-b9fab7728a16 req-ef096be7-75bd-42ab-b40d-530cabe2645f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074614 Nov 20 20:55:32.064869 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1612/3171] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:32.466521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:32.467236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:32.479513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.479986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.480793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.481242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.527348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:32.528394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:32.544266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.544730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.545540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.546204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.605994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d6e6191f-8cfe-4a66-9ecc-1e72fd1e92e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.086091 Nov 20 20:55:32.606614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1613/3172] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:32 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:32.611671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:32.612571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:32.620204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.620785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.621762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.622384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.778520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:32.797998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e37cbbf3-8b66-4e08-9d3a-a5d1e58b8a98 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.336972 Nov 20 20:55:32.809661 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1560/3173] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:32 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:32.814534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:32.815539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:32.823880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.824444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:32.825335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:32.825987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.097647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-050418fd-5b5f-48fb-acb4-d05ff86dbd30 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.286654 Nov 20 20:55:33.098446 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1561/3174] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:32 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:33.106415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-bfac5c82-341d-4fd1-a677-1dd0ddc85743 req-74e75a48-ba95-4c4b-b9a7-f7d844fa211d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde408bf-cb7a-4d41-8b66-ff40aa94f98e", "name": "network-vif-deleted", "tag": "6298c75b-8fea-4075-8d87-350b7b03ded0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:33.107950 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:33.107950 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:33.115411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bfac5c82-341d-4fd1-a677-1dd0ddc85743 req-74e75a48-ba95-4c4b-b9a7-f7d844fa211d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.115857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bfac5c82-341d-4fd1-a677-1dd0ddc85743 req-74e75a48-ba95-4c4b-b9a7-f7d844fa211d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.137797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-bfac5c82-341d-4fd1-a677-1dd0ddc85743 req-74e75a48-ba95-4c4b-b9a7-f7d844fa211d service nova] Creating event network-vif-deleted:6298c75b-8fea-4075-8d87-350b7b03ded0 for instance cde408bf-cb7a-4d41-8b66-ff40aa94f98e on nch2-master-1 Nov 20 20:55:33.145060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-bfac5c82-341d-4fd1-a677-1dd0ddc85743 req-74e75a48-ba95-4c4b-b9a7-f7d844fa211d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044797 Nov 20 20:55:33.145987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1562/3175] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:33.153101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:33.153801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:33.160605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.161062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.161841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.162308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.305907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:33.313383 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20a6bf8b-f9bc-453b-9ea0-b394306475f7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1314 microversion: 2.1 time: 0.165954 Nov 20 20:55:33.314133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1563/3176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:33 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:33.318650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:33.319661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:33.326006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.326565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.327506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.328005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.369782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8de97360-2117-4c1b-9a5c-7db001dc9589 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.054324 Nov 20 20:55:33.373826 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1564/3177] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:33 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:33.375617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:33.376316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:33.384366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.385073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.386267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.386598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.456796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:33.465636 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25f62a7b-ce38-4f48-80d7-70b473d37cd0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1275 microversion: 2.1 time: 0.093807 Nov 20 20:55:33.466552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1565/3178] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:33 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:33.618815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:33.619858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:33.626533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.626988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.627777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.628211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.672820 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24cbde69-d83b-40c0-a8e3-e89d7fec0a42 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.058357 Nov 20 20:55:33.674342 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1566/3179] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:33 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:33.824843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:33.825539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:33.833117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.833593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.833937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:33.834428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:33.834891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:33.843800 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7fa69945-6300-4a7a-86ad-d060dbb97b58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 1.235934 Nov 20 20:55:33.844905 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1614/3180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:32 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:33.972270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:33.980565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d24231b7-4afe-4740-adf1-0f2e906cedd0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.159714 Nov 20 20:55:33.981171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1567/3181] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:33 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:34.110654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:34.111770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.118022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.118507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.119299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.119739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.161481 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-793cdef6-4e6c-4920-8bf6-49298fdcebf8 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.054892 Nov 20 20:55:34.162377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1615/3182] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:34 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:34.333366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.334016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.341399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.341833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.342647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.343079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.381277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:34.382707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.390709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.391339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.392719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.393321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.437158 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b24c025f-ebbd-4cce-b2ae-9ec404d9afaa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.059131 Nov 20 20:55:34.438741 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1616/3183] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:34 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:34.487028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.487996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.496713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.497170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.497973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.498446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.518573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:34.529410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8f449d7-9c52-40a0-855e-83eba0a5f6af tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1464 microversion: 2.1 time: 0.201229 Nov 20 20:55:34.544099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1568/3184] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:34.599793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Calling method '.version_select at 0x7f3f87731790>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.610201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.610648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.626820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.627261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.644818 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5070aab-18e6-49dc-871c-b5a2e902e0a1 tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage/844aeaa7e739473d9415dfd5f9d3d98a?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832" status: 200 len: 700 microversion: 2.1 time: 0.099412 Nov 20 20:55:34.645735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1569/3185] 10.222.0.41 () {58 vars in 1411 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/os-simple-tenant-usage/844aeaa7e739473d9415dfd5f9d3d98a?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832 => generated 700 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:34.659042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '.version_select at 0x7f3f87b33160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.668564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.669046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.677545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.677986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.689304 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24ad71d0-4937-4acb-a9c1-b1bedf7c69b7 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage/844aeaa7e739473d9415dfd5f9d3d98a?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832" status: 200 len: 700 microversion: 2.1 time: 0.033827 Nov 20 20:55:34.689879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1570/3186] 10.222.0.41 () {58 vars in 1411 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/os-simple-tenant-usage/844aeaa7e739473d9415dfd5f9d3d98a?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832 => generated 700 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:34.695443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:34.697785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:34.698176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.704826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.705787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.706393 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3cc72bf9-60c0-4b47-b842-0589181d3f26 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1275 microversion: 2.1 time: 0.223209 Nov 20 20:55:34.706542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.707008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.712043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1617/3187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:34.718893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Calling method '.version_select at 0x7f3f98d35550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.720613 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:34.720613 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:34.729540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.729994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.750647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.751109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.760298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f85ee3ac-1f63-45fc-a671-2d7f36e5bdc4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.068057 Nov 20 20:55:34.762606 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1571/3188] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:34.866887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.868859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.876493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.877073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.877869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.878332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.884371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b53065b-d54b-4b01-b189-c76be02469ca tempest-TenantUsagesTestJSON-81729016 tempest-TenantUsagesTestJSON-81729016-project-admin] 10.222.0.41 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832&detailed=1" status: 200 len: 34484 microversion: 2.1 time: 0.170931 Nov 20 20:55:34.885654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1618/3189] 10.222.0.41 () {58 vars in 1334 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-11-19T20%3A55%3A34.539832&end=2021-11-21T20%3A55%3A34.539832&detailed=1 => generated 34484 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:34.918768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:34.919449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:34.926147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.927197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.928118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:34.928788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:34.956076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:35.048858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:35.061494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8dd9f4bc-19d1-42a7-8141-2d2b38997b5b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.204023 Nov 20 20:55:35.063143 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1572/3190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:34 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:35.071917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:35.072842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.079997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.080459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.081492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.081923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.113792 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ece1ad8e-07fa-40c6-9cfc-a1dc75114545 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 204 len: 0 microversion: 2.1 time: 0.198568 Nov 20 20:55:35.114649 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1619/3191] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:34 2021] DELETE /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:35.127873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-18658085-cf07-4622-8e97-ee37952aab51 req-684ef55d-a875-4ff2-8c7c-1d80fdf4f23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "711c77a1-f02a-41ec-8bcc-3b83fc631724", "name": "network-vif-deleted", "tag": "755721ae-d227-49d0-947b-f6f75f3cf29a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:35.129996 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:35.129996 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:35.137393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-18658085-cf07-4622-8e97-ee37952aab51 req-684ef55d-a875-4ff2-8c7c-1d80fdf4f23a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.138025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-18658085-cf07-4622-8e97-ee37952aab51 req-684ef55d-a875-4ff2-8c7c-1d80fdf4f23a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.150483 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-18658085-cf07-4622-8e97-ee37952aab51 req-684ef55d-a875-4ff2-8c7c-1d80fdf4f23a service nova] Creating event network-vif-deleted:755721ae-d227-49d0-947b-f6f75f3cf29a for instance 711c77a1-f02a-41ec-8bcc-3b83fc631724 on nch1-master-1 Nov 20 20:55:35.156712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-18658085-cf07-4622-8e97-ee37952aab51 req-684ef55d-a875-4ff2-8c7c-1d80fdf4f23a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036802 Nov 20 20:55:35.157761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1620/3192] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:35.164988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:35.165795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.172771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.173226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.174217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.174801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.252501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:35.260411 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-650782f4-482e-4faa-93ee-b1a14103bc46 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.195534 Nov 20 20:55:35.261188 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1573/3193] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:35 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:35.268862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:35.269865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.277070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.277517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.278326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.278767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.322405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11df2590-bfb5-4876-8f7c-14cb928e4d79 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.059989 Nov 20 20:55:35.323308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1574/3194] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:35 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:35.450355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:35.451571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.459470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.460306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.462491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.463167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.517050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c908dbda-af12-4eef-aa0c-175226f4a269 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.071432 Nov 20 20:55:35.518477 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1575/3195] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:35 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:35.724784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:35.725549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.732805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.733252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.734029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.734650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.756912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:35.768833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92713b34-4b7c-499b-8c28-12b668f6e10d tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1470 microversion: 2.1 time: 0.608669 Nov 20 20:55:35.769576 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1621/3196] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:35 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1470 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:35.776739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:35.777715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:35.807260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.807260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.807762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:35.808892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:35.832423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:35.842777 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-139d6b79-cdbc-4249-9a12-24febaddea79 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1275 microversion: 2.1 time: 0.121649 Nov 20 20:55:35.845763 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1576/3197] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:35 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1275 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:35.862363 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4458856e-bf83-42ed-9047-8f474f1a2e94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.090516 Nov 20 20:55:35.863811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1622/3198] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:35 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:36.078781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:36.079516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.086570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.087110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.087924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.088381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.227933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:36.235723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d952d6bc-fa37-48b1-a926-10aefd11ea91 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.160537 Nov 20 20:55:36.236308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1577/3199] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:36 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:36.278500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:36.279347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.286621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.287071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.287862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.288300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.333392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:36.334644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.341200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.341649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.342477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.342917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.388058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6abd3c5-23f8-4f9d-9ba5-f568bb7b20e0 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.058150 Nov 20 20:55:36.391901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1578/3200] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:36 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:36.535476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:36.537438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.547253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.547253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.547253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.547826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.594941 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-607cd80a-543a-481c-9713-de068dc33345 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.069230 Nov 20 20:55:36.595764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1579/3201] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:36 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:36.788421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:36.790153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.798091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.798581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.799344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:36.799473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.800036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.814833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec51ee18-f8a1-4bae-985d-c4d53203908f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.539526 Nov 20 20:55:36.816736 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1623/3202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:36 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:36.860896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:36.861914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:36.870466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.871152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:36.872251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:36.872830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.260112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:37.269187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2fd5b69d-aadd-4cb6-863a-bacd7671f6d9 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.412116 Nov 20 20:55:37.279695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1624/3203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:36 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:37.286781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:37.287965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:37.294948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.295588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.296386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.296839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.341259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff84fe59-3473-464a-a92f-059028185496 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.059853 Nov 20 20:55:37.346120 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1625/3204] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:37 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:37.356396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ac1b410e-6236-48a9-bf15-81a7e2b63eae req-43b8bd23-1dd5-4401-a11c-709ae3d09234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6b17e8-3ed4-4602-9524-8aa8b910746a", "tag": "c6735702-3abe-4ed8-a376-4563315d7dc0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:37.358392 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:37.358392 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:37.366655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ac1b410e-6236-48a9-bf15-81a7e2b63eae req-43b8bd23-1dd5-4401-a11c-709ae3d09234 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.368151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ac1b410e-6236-48a9-bf15-81a7e2b63eae req-43b8bd23-1dd5-4401-a11c-709ae3d09234 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.380022 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ac1b410e-6236-48a9-bf15-81a7e2b63eae req-43b8bd23-1dd5-4401-a11c-709ae3d09234 service nova] Creating event network-changed:c6735702-3abe-4ed8-a376-4563315d7dc0 for instance eb6b17e8-3ed4-4602-9524-8aa8b910746a on nch1-master-1 Nov 20 20:55:37.385781 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ac1b410e-6236-48a9-bf15-81a7e2b63eae req-43b8bd23-1dd5-4401-a11c-709ae3d09234 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041297 Nov 20 20:55:37.386527 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1626/3205] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:37.391792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:37.394553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:37.402338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.403053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.404034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.404656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.513114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:37.524440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0f38309-5520-4688-831e-62bb2717d62e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1470 microversion: 2.1 time: 0.741048 Nov 20 20:55:37.534125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1580/3206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:36 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1470 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:37.534125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:37.534125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:37.543697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.544377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.545369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.545971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.596551 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ef97b4b-bf18-46b7-a846-b2ccfb809984 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.070079 Nov 20 20:55:37.597092 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1581/3207] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:37 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:37.609505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:37.610415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:37.618796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.619248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.620036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.620628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.667919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b438130-cfea-4124-b2a8-7c6901f47278 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.063004 Nov 20 20:55:37.670025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1582/3208] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:37 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:37.837675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:37.839235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:37.849835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.851166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.853040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:37.854273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:37.856606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:37.878686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f189acc7-22cc-44b4-a9bc-afe1cdffcb42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.490675 Nov 20 20:55:37.881149 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1627/3209] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:37 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:38.025397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1896bfba-79f1-486a-b34a-5bbfbbe44f47 req-bca970db-7647-4e4c-8fc2-f3804d702c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4682c8fb-76cc-41d0-a971-f7cf0c5b38ee", "name": "network-vif-deleted", "tag": "4956aa6a-4c78-4631-8ea7-0eb3de01732b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:38.027217 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:38.027217 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:38.047171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1896bfba-79f1-486a-b34a-5bbfbbe44f47 req-bca970db-7647-4e4c-8fc2-f3804d702c28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.047957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1896bfba-79f1-486a-b34a-5bbfbbe44f47 req-bca970db-7647-4e4c-8fc2-f3804d702c28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.064009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1896bfba-79f1-486a-b34a-5bbfbbe44f47 req-bca970db-7647-4e4c-8fc2-f3804d702c28 service nova] Creating event network-vif-deleted:4956aa6a-4c78-4631-8ea7-0eb3de01732b for instance 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee on nch2-master-1 Nov 20 20:55:38.071858 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1896bfba-79f1-486a-b34a-5bbfbbe44f47 req-bca970db-7647-4e4c-8fc2-f3804d702c28 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051910 Nov 20 20:55:38.073875 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1628/3210] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:38.228532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:38.237400 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-588d1d6f-94b8-4a40-a05a-308b6318d380 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.408280 Nov 20 20:55:38.237995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1583/3211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:37 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:38.286584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:38.287295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.294892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.295659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.296824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.297331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.353958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:38.355184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.362225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.362831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.364786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.365435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.416365 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-228acb8b-6c94-4ff7-ba45-63f791104135 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.066471 Nov 20 20:55:38.420935 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1584/3212] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:38 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:38.543215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:38.543949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.553762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.555452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.556539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.557398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.627194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.627639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.628174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lazy-loading 'fault' on Instance uuid 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:55:38.682447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597235094beb453a9f9732bbaba31944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '844aeaa7e739473d9415dfd5f9d3d98a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:38.693013 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91246126-4695-4e0b-8956-fa07992b0e0e tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 200 len: 1304 microversion: 2.1 time: 0.154723 Nov 20 20:55:38.702519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1585/3213] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:38 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:38.702519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:38.702519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.707209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.707672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.708488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.709155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.754344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b987c202-b782-49a7-967e-80b2802ddd85 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.059283 Nov 20 20:55:38.755667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1586/3214] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:38 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:38.762346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:38.763509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.771408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.772074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.773050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.773704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.789493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:38.802685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47887ed2-ead5-4fcf-80b2-83aab2c03874 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.520246 Nov 20 20:55:38.806467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1629/3215] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:38 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:38.837635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36006ed8-b02c-4385-9462-af5082039f52 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.079539 Nov 20 20:55:38.839041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1587/3216] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:38 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:38.899124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:38.899967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:38.905776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.906287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:38.907068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:38.907674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.208683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:39.216823 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71cfa1fa-296b-4292-9306-b6104ac36ae9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.321994 Nov 20 20:55:39.217599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1630/3217] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:38 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:39.256076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:39.256811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.266579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.267181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.268305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.268811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.428077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:39.429010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.435847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.436640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.437676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.438362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.483318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c4722b3-02a3-4d75-9e2c-f7b108fb1b7f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.058482 Nov 20 20:55:39.484137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1631/3218] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:39.504260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:39.512928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-759cf2a1-e25f-49db-a72b-059f3292768a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.261418 Nov 20 20:55:39.521523 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1588/3219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:39 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:39.690330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db188a9b-76d3-4bd0-8c8d-6d69715fe374", "tag": "b01dce5f-9b14-481a-bca0-7d462e3a3709"}, {"name": "network-changed", "server_uuid": "f2fa090e-55ec-4abd-8248-6a85b2b91f8a", "tag": "f6f71518-918d-4d53-86d6-5c5fe35e9c70"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:39.691918 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:39.691918 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:39.700913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.701364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.711995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:39.713564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] [instance: 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.715386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] Creating event network-changed:b01dce5f-9b14-481a-bca0-7d462e3a3709 for instance db188a9b-76d3-4bd0-8c8d-6d69715fe374 on nch1-master-1 Nov 20 20:55:39.715920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] Creating event network-changed:f6f71518-918d-4d53-86d6-5c5fe35e9c70 for instance f2fa090e-55ec-4abd-8248-6a85b2b91f8a on nch2-master-1 Nov 20 20:55:39.720757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.721510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.722401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.723065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.724408 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8a6eb192-e8f8-43da-ad8e-a68eeb7f9fc7 req-84c0e983-d6cb-4763-aa42-7f4d1a17395a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037977 Nov 20 20:55:39.725018 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1632/3220] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:39 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:39.739243 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] HTTP exception thrown: Instance 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee could not be found. Nov 20 20:55:39.740227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] Returning 404 to user: Instance 4682c8fb-76cc-41d0-a971-f7cf0c5b38ee could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:39.741336 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4335cbb-9b6a-4819-a1bd-1de62798aa02 tempest-TenantUsagesTestJSON-596550945 tempest-TenantUsagesTestJSON-596550945-project] 10.222.0.41 "GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee" status: 404 len: 111 microversion: 2.1 time: 0.034933 Nov 20 20:55:39.742197 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1589/3221] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:39 2021] GET /compute/v2.1/servers/4682c8fb-76cc-41d0-a971-f7cf0c5b38ee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:39.771174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:39.772388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.780724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.781185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.781985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.782986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.821637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:39.822290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.833232 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f725258e-9b71-4534-a667-390eebf7e46e tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.068413 Nov 20 20:55:39.834788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.834966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.836312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.837152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.839825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1633/3222] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:39 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:39.852324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:39.853546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:39.872261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.874510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.875481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:39.875917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:39.951761 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3ccb52c5-dc91-4ccd-92e0-3df9dc46e2da tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.106298 Nov 20 20:55:39.952818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1634/3223] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:39 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:40.195979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:40.204928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5bf5b16-8b0a-4db1-9808-4dca202da295 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.387913 Nov 20 20:55:40.205626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1590/3224] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:39 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:40.234742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:40.236058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:40.243821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.244350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.245376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.246012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.496666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:40.497643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:40.506552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.508989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.510159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.510811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.561975 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb693677-e06b-4832-97c1-29ab0e3aba68 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.069508 Nov 20 20:55:40.568069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1591/3225] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:40 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:40.575303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:40.575948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:40.587638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.588463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.591911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.592434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.677119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:40.687802 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9d25a81-b74d-4ec2-b675-0b5e9b57b54c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.458353 Nov 20 20:55:40.688985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1635/3226] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:40 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:40.850751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:40.851719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:40.859799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.860260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.861065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.861506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.903187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1b0a549-2f97-4b41-8a7b-efd5b74cae4d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.056055 Nov 20 20:55:40.903889 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1636/3227] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:40 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:40.964374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:40.965440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:40.972968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.973425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:40.974255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:40.974695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.015159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c92f1c2-6cf6-4e5f-ae49-b3c9398460e9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.055453 Nov 20 20:55:41.016569 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1637/3228] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:40 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:41.152645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:41.168772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac2ac2c5-c5ed-412e-a711-c179be7c785f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.594226 Nov 20 20:55:41.184426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1592/3229] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:40 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:41.225583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:41.227391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:41.237137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.238084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.239267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.239833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.422852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:41.433579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b3ee11d7-8238-4b8f-ad8c-5cde41ba74f0 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.214293 Nov 20 20:55:41.434488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1638/3230] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:41 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:41.575833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:41.576758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:41.588579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.589716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.590488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.590864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.648875 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fee3f2ef-e0dc-462b-a2c4-dadefb5603b3 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.076202 Nov 20 20:55:41.650486 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1593/3231] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:41.704899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:41.705850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:41.713675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.714218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.715626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.716151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.873243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:41.880564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a864d785-456d-4204-9a77-b930fcfbd3c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.179697 Nov 20 20:55:41.890738 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1639/3232] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:41 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:41.919877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:41.920947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:41.928144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.928666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.930226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:41.930897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:41.971625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79840982-8f82-47f4-9288-8547510f4998 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.056353 Nov 20 20:55:41.972379 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1594/3233] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:41 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:42.028020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:42.029029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.035167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.035613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.036389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.036821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.082085 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a3f621a-bcde-4582-9ff7-a4a11332d510 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.057330 Nov 20 20:55:42.082752 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1640/3234] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:42 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:42.187407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:42.188246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.196877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.197652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.198696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.199348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.419664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:42.427317 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93f1296b-97c6-421b-97ee-972f6a77d59e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.243928 Nov 20 20:55:42.437791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1595/3235] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:42 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:42.451967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:42.453355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.460680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.462402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.463626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.465390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.662285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:42.663580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.674513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.675470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.676879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.677791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.727809 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44cbbacd-2fae-4139-a274-846927b80ea9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.069133 Nov 20 20:55:42.728478 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1596/3236] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:42 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:42.756155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:42.766592 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75699ba4-4246-4481-ae89-228dccc10917 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.319019 Nov 20 20:55:42.770166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1641/3237] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:42 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:42.899902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:42.900934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.907783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.908230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.909007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.909444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.985139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:42.986911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:42.996723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.997320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:42.998378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:42.998997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.061211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fae3578a-4f74-436f-a77d-2f4870389d80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.080046 Nov 20 20:55:43.074121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1642/3238] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:42 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:43.099774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:43.109167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:43.110196 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bee637ac-ba5f-4cde-b8df-dbad4ab1913e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.214946 Nov 20 20:55:43.110309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:43.120129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.120811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.122192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.122816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.123927 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1597/3239] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:42 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:43.171657 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f55d8073-dfa0-42cd-8940-3c0e07585f31 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.080199 Nov 20 20:55:43.174118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1643/3240] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:43 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:43.386293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-acbb7b7f-8180-43e7-90b8-8f447e0eef2e req-99c97eaa-bc0e-418a-8372-9f4b2dc64c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6b17e8-3ed4-4602-9524-8aa8b910746a", "name": "network-vif-plugged", "status": "completed", "tag": "c6735702-3abe-4ed8-a376-4563315d7dc0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:43.389701 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:43.389701 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:43.400233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-acbb7b7f-8180-43e7-90b8-8f447e0eef2e req-99c97eaa-bc0e-418a-8372-9f4b2dc64c8f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.401517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-acbb7b7f-8180-43e7-90b8-8f447e0eef2e req-99c97eaa-bc0e-418a-8372-9f4b2dc64c8f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.414008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-acbb7b7f-8180-43e7-90b8-8f447e0eef2e req-99c97eaa-bc0e-418a-8372-9f4b2dc64c8f service nova] Creating event network-vif-plugged:c6735702-3abe-4ed8-a376-4563315d7dc0 for instance eb6b17e8-3ed4-4602-9524-8aa8b910746a on nch1-master-1 Nov 20 20:55:43.420299 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-acbb7b7f-8180-43e7-90b8-8f447e0eef2e req-99c97eaa-bc0e-418a-8372-9f4b2dc64c8f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 Nov 20 20:55:43.421144 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1598/3241] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:43.449476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:43.451012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:43.471558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.474340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.475359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.476481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.745204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:43.747092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:43.756668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.758888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.760628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.761866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.839972 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac2ab65d-495d-4eb8-a106-f9942d98f2e5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.101338 Nov 20 20:55:43.847147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1599/3242] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:43 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:43.854981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:43.856083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:43.865769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.866649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.868807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:43.869482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:43.869928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:43.878305 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61f9f023-6b0a-45dc-a1b7-fd1daee056ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.436781 Nov 20 20:55:43.878897 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1644/3243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:43 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:44.079996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:44.081369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:44.089486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.090408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.091447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.092100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.130355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:44.142577 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2757376-f2bf-4aed-af0e-ff53dd07a1bd tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.291928 Nov 20 20:55:44.153480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed589288-0eab-479e-bb01-bf9e09c48690 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.074300 Nov 20 20:55:44.154711 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1600/3244] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:43 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:44.157868 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1645/3245] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:44 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:44.160403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:44.161263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:44.171379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.172221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.173277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.174278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.189364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:44.191058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:44.214279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.214860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.215799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.216300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.302691 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e416709-ac92-4e2f-8a20-c73ef264193c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.119701 Nov 20 20:55:44.309498 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1646/3246] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:44 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:44.548711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:44.567927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e058ba0-5615-41c7-b1c3-b834984f20ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1314 microversion: 2.1 time: 0.411769 Nov 20 20:55:44.569810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1601/3247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:44 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:44.885290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:44.891899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:44.896287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:44.896950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:44.909330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.909765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.910594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.911027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.911588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.913238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:44.915816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:44.917268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.011653 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5f9c0d2-260d-4271-88e2-7551c7da6dea tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.156234 Nov 20 20:55:45.013212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1647/3248] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:44 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:45.167305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:45.168028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:45.183163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.183163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.183441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.183892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.322820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:45.331294 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e402581-977e-4e6d-b66a-6ee775220053 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.439096 Nov 20 20:55:45.332609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1602/3249] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:44 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:45.339565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:45.342093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:45.348664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.349115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.350192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.352279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.430682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-701a7bec-51ad-496d-b536-29e75fbaf99d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.095854 Nov 20 20:55:45.432086 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1603/3250] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:45 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:45.441216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:45.447330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:45.449064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:45.455161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.455871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.457033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.458067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.460265 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e89b9185-ca48-46e7-8fbf-da3c5e935aaf tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.300173 Nov 20 20:55:45.472655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1648/3251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:45 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:45.481142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6bd0414d-a6d9-475d-b1bb-43ce97c421fc req-0911f63d-8cf7-4aef-804d-0a719a5b9cfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db188a9b-76d3-4bd0-8c8d-6d69715fe374", "name": "network-vif-plugged", "status": "completed", "tag": "b01dce5f-9b14-481a-bca0-7d462e3a3709"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:45.483794 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:45.483794 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:45.494231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6bd0414d-a6d9-475d-b1bb-43ce97c421fc req-0911f63d-8cf7-4aef-804d-0a719a5b9cfd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.499616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6bd0414d-a6d9-475d-b1bb-43ce97c421fc req-0911f63d-8cf7-4aef-804d-0a719a5b9cfd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.522928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62d8d6e6-d0f5-4945-8cb8-83a8a01101ca tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.087822 Nov 20 20:55:45.524349 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1604/3252] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:45 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:45.533943 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6bd0414d-a6d9-475d-b1bb-43ce97c421fc req-0911f63d-8cf7-4aef-804d-0a719a5b9cfd service nova] Creating event network-vif-plugged:b01dce5f-9b14-481a-bca0-7d462e3a3709 for instance db188a9b-76d3-4bd0-8c8d-6d69715fe374 on nch1-master-1 Nov 20 20:55:45.536583 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6bd0414d-a6d9-475d-b1bb-43ce97c421fc req-0911f63d-8cf7-4aef-804d-0a719a5b9cfd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061831 Nov 20 20:55:45.537311 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1649/3253] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:45.589611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:45.591196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:45.602351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.602822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:45.603614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:45.604043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.025377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:46.026285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:46.034121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.034588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.035438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.035882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.086456 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffb8e564-ee64-4858-8053-52925215fa04 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.065092 Nov 20 20:55:46.087760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1650/3254] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:46 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:46.319516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:46.330824 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cbd8b40-81aa-4514-9b60-2f64525e79e8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1501 microversion: 2.1 time: 0.747366 Nov 20 20:55:46.331597 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1605/3255] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:45 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1501 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:46.353971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:46.354894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:46.364730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.365195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.366131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.368080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.443573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:46.447401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:46.460453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.463644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.464912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.465577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.647250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:46.654593 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8d8890b-5814-47dc-bb28-1abbe4679b54 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.215453 Nov 20 20:55:46.660045 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1606/3256] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:46 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:46.673870 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3c71c30-f49e-42bc-92b1-a6f89c3c2dc4 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.328914 Nov 20 20:55:46.679110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1651/3257] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:46 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:46.691564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:46.692464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:46.692750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:46.693529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:46.701767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.701985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.702490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.702900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.703389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.703931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.704515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:46.705239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:46.767565 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-080020c6-768f-4699-a01f-5a1782a3a716 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.085269 Nov 20 20:55:46.772918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1652/3258] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:46 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:47.100586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:47.102564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:47.112661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.113116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.113919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.114386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.162772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92f129bc-a416-4808-8919-798a86614845 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.067313 Nov 20 20:55:47.164447 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1653/3259] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:47 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:47.192245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:47.202449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-deaf4d04-c9eb-448f-bc68-678c60731a01 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.540326 Nov 20 20:55:47.203483 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1607/3260] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:46 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:47.671603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:47.672842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:47.681227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.682003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.683205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.683862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.696300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:47.697675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:47.707425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.715764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.716919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.717619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.765295 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-397459bb-15ae-451a-b838-21a66a37d8aa tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.097750 Nov 20 20:55:47.766390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1654/3261] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:47 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:47.780457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:47.781818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:47.790693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.791495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.793286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:47.793949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:47.845626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-671ae88a-9bf2-4cc3-b69c-3047d8c2c4c2 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.067927 Nov 20 20:55:47.847196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1655/3262] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:47 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:47.993451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fbc117a-9caa-41b6-b943-e32e4d68e170"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:47.995313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:48.004301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.005014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.006230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.006891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.068257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:48.095453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02b748f5-0aeb-44a0-bde2-b4a70a27545d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.403002 Nov 20 20:55:48.107328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1608/3263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:47 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:48.127086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4b467647-ea29-4257-a3a4-84e42523ee17 req-56aaf663-56be-4a10-b2cc-319868359c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa090e-55ec-4abd-8248-6a85b2b91f8a", "name": "network-vif-plugged", "status": "completed", "tag": "f6f71518-918d-4d53-86d6-5c5fe35e9c70"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:48.129854 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:48.129854 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:48.148203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4b467647-ea29-4257-a3a4-84e42523ee17 req-56aaf663-56be-4a10-b2cc-319868359c20 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.148919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4b467647-ea29-4257-a3a4-84e42523ee17 req-56aaf663-56be-4a10-b2cc-319868359c20 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.167274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4b467647-ea29-4257-a3a4-84e42523ee17 req-56aaf663-56be-4a10-b2cc-319868359c20 service nova] Creating event network-vif-plugged:f6f71518-918d-4d53-86d6-5c5fe35e9c70 for instance f2fa090e-55ec-4abd-8248-6a85b2b91f8a on nch2-master-1 Nov 20 20:55:48.174654 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4b467647-ea29-4257-a3a4-84e42523ee17 req-56aaf663-56be-4a10-b2cc-319868359c20 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053578 Nov 20 20:55:48.175890 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1609/3264] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:48.186003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:48.188206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:48.202439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.203188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.204279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.204888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.313054 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44aa5fd4-86fe-4091-928f-b550fbdb2ee4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.135187 Nov 20 20:55:48.319683 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1610/3265] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:48 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:48.333314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:48.334298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:48.345579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.346324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.347368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.348026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.466242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de244659-d2d9-4765-b7ce-42fca8893f4b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.479514 Nov 20 20:55:48.470508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1656/3266] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:55:47 2021] POST /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:48.778907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:48.780024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:48.800614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.801074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.801879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.802348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.883202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c41a7615-2bde-4b6b-b9e9-40c9ea9b2235 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.108593 Nov 20 20:55:48.889498 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1657/3267] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:48 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:48.912214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:48.915770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:48.943060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:48.954424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.956051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.958339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f6ee506b-d7b1-45e3-a012-64fd131b034a tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1317 microversion: 2.1 time: 0.634718 Nov 20 20:55:48.959590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:48.960249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:48.960475 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1611/3268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:48 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:49.028211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-913f35f8-defa-4da3-aba8-3089b9528ede tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.131853 Nov 20 20:55:49.029760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1658/3269] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:48 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:49.116395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:49.117574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:49.127643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.129029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.131249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.134674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.329785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:49.330911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:49.340687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.341143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.341947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.342455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.447877 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-edaecb4a-9306-4943-8405-ed7f91ade146 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.124903 Nov 20 20:55:49.453434 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1659/3270] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:49 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:49.502872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:49.510373 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c382a35a-9c25-43c3-9d59-a8fd4e85a821 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.399074 Nov 20 20:55:49.510962 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1612/3271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:49 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:49.909944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:49.911193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:49.919760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.922541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.923513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.930264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.977517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:49.978358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:49.982926 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d530b2c8-6143-4dbc-9200-4fbc221a7728 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.080174 Nov 20 20:55:49.987518 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1660/3272] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:49 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:49.994116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.994783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:49.995931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:49.996509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.043712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:50.045224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.065634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.066538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.069418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.072297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.172471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-66df7f2b-9d9b-49f0-8ccc-36aea221ed5a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.133857 Nov 20 20:55:50.173758 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1661/3273] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:50 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:50.238999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:50.249518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76e7b723-0452-4f81-b1d4-2c2c48e26957 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 200 len: 1505 microversion: 2.1 time: 0.275665 Nov 20 20:55:50.250886 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1613/3274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:49 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:50.274315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:50.275024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.283927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.284387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.285181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.285616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.460685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:50.461732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.468399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.469077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.470012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.471581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.551546 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b77c6433-2943-47ef-bd3b-81809e30dbe7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094504 Nov 20 20:55:50.556063 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1614/3275] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:50.561650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:50.562727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.578151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.579017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.580288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.580875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.753217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:50.766798 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8077b154-201e-4fe1-b3e7-07b2f28fc272 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 200 len: 1506 microversion: 2.1 time: 0.498357 Nov 20 20:55:50.767570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1662/3276] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:50 2021] GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:50.785239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:50.787283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.798811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.799826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.800817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.801409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.831042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:50.907026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:50.919598 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cb436e3-94c2-4561-be61-c480c7633a3c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.362093 Nov 20 20:55:50.920203 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1615/3277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:50 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:50.962945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5143187d-26b5-4162-b314-676cda0387d3 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "DELETE /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 204 len: 0 microversion: 2.1 time: 0.181662 Nov 20 20:55:50.964352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1663/3278] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:50 2021] DELETE /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:50.972973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:50.973761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:50.983326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.983928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.985801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:50.986343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:50.998414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:50.999806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.015863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.016486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.017854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.018203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.062322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:51.078786 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3dd8d6a-4166-4cbc-b397-0081dec0a3c5 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.084867 Nov 20 20:55:51.080073 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1664/3279] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:50 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:51.169317 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6421c80-dd10-49f5-b589-041379a7754f tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 204 len: 0 microversion: 2.1 time: 0.200389 Nov 20 20:55:51.170555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1616/3280] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:50 2021] DELETE /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:55:51.179889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:51.181113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.188172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:51.189420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.190488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.191050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.191976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.192525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.197298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.197896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.200355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.200817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.269920 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2d6ff41-4801-410d-b97b-c80e220e5833 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.087195 Nov 20 20:55:51.271288 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1617/3281] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:51 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:51.567602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:51.569718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.583080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.583715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.584979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.585789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.654471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9edb4a30-2e8e-45a6-8abc-fee148cd588b tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.092362 Nov 20 20:55:51.660107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1618/3282] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:51 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:51.785790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:51.797258 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-020f8610-f2f6-4a7a-9f85-1f3f0d2d9800 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 200 len: 1512 microversion: 2.1 time: 0.622024 Nov 20 20:55:51.799095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1665/3283] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:51 2021] GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 1512 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:51.930403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:51.931476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.938928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:51.939736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:51.940591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.941271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.942415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.943524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.948594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.949062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.949870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:51.950358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:51.982556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:55:52.104249 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e9f3601f-66aa-4abd-9a2c-66b59bf41bc0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 204 len: 0 microversion: 2.1 time: 0.178676 Nov 20 20:55:52.105448 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1619/3284] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:51 2021] DELETE /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:55:52.120519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:52.121849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:52.131329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.131794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.133873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.134483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.220055 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41482be0-9072-43da-ab8f-2be1cfac5600 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.112607 Nov 20 20:55:52.221000 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1620/3285] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:52 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:52.229846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:52.230590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:52.248481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.248974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.249798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.250285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.370630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:52.380514 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c5af855-a435-4af0-afc6-1d0cfd0d517c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.445160 Nov 20 20:55:52.387965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1666/3286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:51 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:52.396102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:52.410232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:52.424231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.424924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.425991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.426525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.490759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-832c2795-c6cd-42e6-99e2-8fd9531dd174 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.100201 Nov 20 20:55:52.495385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1667/3287] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:52 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:52.671317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:52.673474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:52.684774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.685953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.688113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.689276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.764767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f2c6b74-5d87-4590-89e6-3af4ce2f2a4d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.098371 Nov 20 20:55:52.766711 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1668/3288] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:52 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:52.817466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:52.818428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:52.826769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.827438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.828382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:52.828956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:52.999301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:53.012250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4fe7a67-8460-40cc-976f-573f2f074f1b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1553 microversion: 2.1 time: 0.786510 Nov 20 20:55:53.013765 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1621/3289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:52 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1553 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:53.232023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:53.233005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:53.245055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.245509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.246335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.246769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.259256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:53.274251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2bf6e160-9abb-4d62-b103-d61dc6bef742 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 200 len: 1512 microversion: 2.1 time: 0.461695 Nov 20 20:55:53.281542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1669/3290] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:52 2021] GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 1512 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:53.311909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14992d20-a4f7-45c5-8472-dc903ac1d348 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.083511 Nov 20 20:55:53.313728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1622/3291] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:53 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:53.404932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:53.405562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:53.432127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.435021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.436177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.436774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.504034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:53.505738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:53.534577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.535030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.540664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.545055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.701199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ec2d251-2687-4341-b8d6-51690be4704d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.201621 Nov 20 20:55:53.701778 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1623/3292] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:53 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:55:53.779609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:53.781040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:53.788619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.789411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.790991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.791580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.883438 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a3dd816a-beb9-40d9-8b8b-fd97a083e5ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.107516 Nov 20 20:55:53.885108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1624/3293] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:53 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:53.895494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a080c69d-69ea-46af-b04f-5d2429cd325a req-4e7687d7-354c-4bb6-be03-5b3ae5d0dbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2fa090e-55ec-4abd-8248-6a85b2b91f8a", "name": "network-vif-deleted", "tag": "f6f71518-918d-4d53-86d6-5c5fe35e9c70"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:53.897657 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:53.897657 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:53.908711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a080c69d-69ea-46af-b04f-5d2429cd325a req-4e7687d7-354c-4bb6-be03-5b3ae5d0dbea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:53.909412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a080c69d-69ea-46af-b04f-5d2429cd325a req-4e7687d7-354c-4bb6-be03-5b3ae5d0dbea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:53.934759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a080c69d-69ea-46af-b04f-5d2429cd325a req-4e7687d7-354c-4bb6-be03-5b3ae5d0dbea service nova] Creating event network-vif-deleted:f6f71518-918d-4d53-86d6-5c5fe35e9c70 for instance f2fa090e-55ec-4abd-8248-6a85b2b91f8a on nch2-master-1 Nov 20 20:55:53.946378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a080c69d-69ea-46af-b04f-5d2429cd325a req-4e7687d7-354c-4bb6-be03-5b3ae5d0dbea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058489 Nov 20 20:55:53.947981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1625/3294] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:54.032288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:54.033342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:54.043228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.044333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.045946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.046682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.220071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:54.243857 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af7658bf-2a78-4cfa-b3fd-db2f644e4c11 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.845503 Nov 20 20:55:54.245067 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1670/3295] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:53 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:54.293304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:54.294175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:54.318448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.323633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.324342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.325165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.433821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:54.447033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65eaf5a1-db45-4258-8d7c-5a5e4eeb32b9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1553 microversion: 2.1 time: 0.416856 Nov 20 20:55:54.448382 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1626/3296] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:54 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1553 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:54.461628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:54.464913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:54.487953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.491121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.492174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.492562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.640652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ecc4f84-6085-49bf-80cf-70e37c407b80 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.181185 Nov 20 20:55:54.645175 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1627/3297] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:54 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:54.716623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:54.721420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:54.749640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.750094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.761342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.762028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.832652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea99dfa2-f9bf-44c5-ab26-aaa970b29f2a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.122128 Nov 20 20:55:54.837142 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1628/3298] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:54 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:54.897188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:54.899149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:54.912856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.913415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.918209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:54.918749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:54.983711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5560b28e-3b57-4ac4-aeca-1f50a99d53a2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.091379 Nov 20 20:55:54.991263 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1629/3299] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:55:55.157077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '378c95a8c74d466ea13525dd1bf6fd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480b4b05733646e88b6eb93050825547', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:55.172678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-daaed099-b3eb-42c1-b46d-f28d4cae2735 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 200 len: 1470 microversion: 2.1 time: 0.884325 Nov 20 20:55:55.173453 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1671/3300] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:54 2021] GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 1470 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:55.191795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c1c8c5d5-313f-43d8-8de9-e46c9c362c5d req-3c1d4671-a2c3-4a26-8a65-e3af34d886c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db188a9b-76d3-4bd0-8c8d-6d69715fe374", "name": "network-vif-deleted", "tag": "b01dce5f-9b14-481a-bca0-7d462e3a3709"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:55.193347 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:55.193347 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:55.225346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c1c8c5d5-313f-43d8-8de9-e46c9c362c5d req-3c1d4671-a2c3-4a26-8a65-e3af34d886c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.229388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c1c8c5d5-313f-43d8-8de9-e46c9c362c5d req-3c1d4671-a2c3-4a26-8a65-e3af34d886c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.250403 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c1c8c5d5-313f-43d8-8de9-e46c9c362c5d req-3c1d4671-a2c3-4a26-8a65-e3af34d886c1 service nova] Creating event network-vif-deleted:b01dce5f-9b14-481a-bca0-7d462e3a3709 for instance db188a9b-76d3-4bd0-8c8d-6d69715fe374 on nch1-master-1 Nov 20 20:55:55.259386 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c1c8c5d5-313f-43d8-8de9-e46c9c362c5d req-3c1d4671-a2c3-4a26-8a65-e3af34d886c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069766 Nov 20 20:55:55.261216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1630/3301] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:55.264618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:55.265498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:55.278031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.280253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.281283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.282835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.466068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:55.466785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:55.473600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.473763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.474508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.474951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.703895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:55.719142 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b095f732-6e09-4507-bfd6-62ebda66b637 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.462017 Nov 20 20:55:55.723147 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1672/3302] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:55 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:55.731531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:55.735202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:55.747656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.750439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.752006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.753227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.873207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d91b967-157f-4a8c-8ff0-70b94e1e7010 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 32643 microversion: 2.1 time: 0.148258 Nov 20 20:55:55.880701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1673/3303] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:55 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 32643 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:55.887909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:55.891156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:55.903469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.904436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.905946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:55.906715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:55.922265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:55.941501 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-125cf279-3ff0-4747-8a28-ac1c23d9627a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1553 microversion: 2.1 time: 0.479930 Nov 20 20:55:55.942119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1631/3304] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:55 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1553 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:55:55.996874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:55.998290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.007977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6cf5c630-36c6-4b61-ac5c-b859643cc0b9 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.124701 Nov 20 20:55:56.012175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.012825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.013811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.014441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.015082 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1674/3305] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:55 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:56.112992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-376f6bfd-1bf4-4757-9d41-a8c1e6b158a8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.120042 Nov 20 20:55:56.113959 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1632/3306] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:55 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:56.201682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:56.203557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: db188a9b-76d3-4bd0-8c8d-6d69715fe374] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.221293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.221764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.222652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.223100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.292927 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] HTTP exception thrown: Instance db188a9b-76d3-4bd0-8c8d-6d69715fe374 could not be found. Nov 20 20:55:56.294118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Returning 404 to user: Instance db188a9b-76d3-4bd0-8c8d-6d69715fe374 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:56.295636 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7aa891b0-9b81-4522-83b5-21cb75869d76 tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374" status: 404 len: 111 microversion: 2.1 time: 0.098902 Nov 20 20:55:56.297846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1675/3307] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:56 2021] GET /compute/v2.1/servers/db188a9b-76d3-4bd0-8c8d-6d69715fe374 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:56.307276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:56.308178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] [instance: f2fa090e-55ec-4abd-8248-6a85b2b91f8a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.321928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.322429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.323239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.323676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.357908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] HTTP exception thrown: Instance f2fa090e-55ec-4abd-8248-6a85b2b91f8a could not be found. Nov 20 20:55:56.358541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] Returning 404 to user: Instance f2fa090e-55ec-4abd-8248-6a85b2b91f8a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:56.359910 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-304be0ed-d9a6-43e8-8e38-1488d08713ce tempest-MultipleCreateTestJSON-629787600 tempest-MultipleCreateTestJSON-629787600-project] 10.222.0.41 "GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a" status: 404 len: 111 microversion: 2.1 time: 0.057890 Nov 20 20:55:56.360811 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1633/3308] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:56 2021] GET /compute/v2.1/servers/f2fa090e-55ec-4abd-8248-6a85b2b91f8a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:56.741259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:56.742605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.757850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.760705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.762342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.764768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.886655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:56.888509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.898206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.898967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.900227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.900933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.963209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-faa731c8-9a78-44eb-81f1-f8650c2a4c9f tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action" status: 200 len: 40798 microversion: 2.1 time: 0.081900 Nov 20 20:55:56.963882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1634/3309] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:56 2021] POST /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd/action => generated 40798 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:56.977337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:56.978420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:56.989771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.990629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:56.993204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:56.993909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.068114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.069364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.071076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lazy-loading 'fault' on Instance uuid eb6b17e8-3ed4-4602-9524-8aa8b910746a {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:55:57.131018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:57.140995 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a43c9312-3787-452b-b5af-d4fb4621a529 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.404129 Nov 20 20:55:57.148013 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1676/3310] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:56 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:57.153802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:57.158667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:57.159577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:57.162809 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-46428bff-5884-4e49-ba17-53a8dae09a04 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 200 len: 1304 microversion: 2.1 time: 0.195959 Nov 20 20:55:57.172305 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1635/3311] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:56 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:57.172473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.172473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.172473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.172473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.175192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:57.176140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:57.202711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.203192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.204010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.204452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.290743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6d512ea-7cb8-4c6b-8c1e-baabff156825 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.125445 Nov 20 20:55:57.291832 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1636/3312] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:57 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:57.298927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:57.300604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:57.312904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.313363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.314300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.314942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.385848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb441a50-adeb-414a-965c-8703e86883cf tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.092398 Nov 20 20:55:57.389272 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1637/3313] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:57 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:57.401684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a0628ab6-b674-4879-a0ca-924a933f7998 req-368573a0-d725-4421-8634-fa1b754b628a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6b17e8-3ed4-4602-9524-8aa8b910746a", "name": "network-vif-deleted", "tag": "c6735702-3abe-4ed8-a376-4563315d7dc0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:57.404327 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:57.404327 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:57.417215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a0628ab6-b674-4879-a0ca-924a933f7998 req-368573a0-d725-4421-8634-fa1b754b628a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:57.417980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a0628ab6-b674-4879-a0ca-924a933f7998 req-368573a0-d725-4421-8634-fa1b754b628a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:57.433454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a0628ab6-b674-4879-a0ca-924a933f7998 req-368573a0-d725-4421-8634-fa1b754b628a service nova] Creating event network-vif-deleted:c6735702-3abe-4ed8-a376-4563315d7dc0 for instance eb6b17e8-3ed4-4602-9524-8aa8b910746a on nch1-master-1 Nov 20 20:55:57.442445 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a0628ab6-b674-4879-a0ca-924a933f7998 req-368573a0-d725-4421-8634-fa1b754b628a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051351 Nov 20 20:55:57.443809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1638/3314] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:57.617639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:57.629675 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f628ebd-0640-40fc-be56-6992dc8ea4ca tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1694 microversion: 2.1 time: 0.483794 Nov 20 20:55:57.632077 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1677/3315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:57 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1694 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:58.163938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:58.165053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:58.178173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.180761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:58.181771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:58.188260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.189656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.190548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.195700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.196225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.197212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.198497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.233316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. Nov 20 20:55:58.233965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:58.234921 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03e86742-0cb7-41bd-ac6c-83fe08c6dd62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 404 len: 111 microversion: 2.1 time: 0.058499 Nov 20 20:55:58.240542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1678/3316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:58 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:55:58.246537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:58.255142 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:58.255142 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:55:58.257964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:58.261333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Searching by: {'deleted': False, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:55:58.268169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.268975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.270327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.271103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.315770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:55:58.416228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c265037e-9359-4f54-9f02-e0ab60d99722 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.170910 Nov 20 20:55:58.416884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1679/3317] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:55:58 2021] GET /compute/v2.1/servers => generated 333 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:55:58.430710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:58.432163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:58.439689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.440142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.441205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.441798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.501574 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70c32e54-f37f-4fe4-9253-3b5d36a86ffa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.081754 Nov 20 20:55:58.503727 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1680/3318] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:58 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:58.512315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:58.513952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:58.524951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.525787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.526933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:58.527827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.529337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.535024 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0db96716-c39a-4cd3-92f3-45f4a0e2b28c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.377025 Nov 20 20:55:58.543400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1639/3319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:58 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:58.548482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:58.579264 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:55:58.579264 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:55:58.580507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:58.581394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Searching by: {'deleted': False, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:55:58.593847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.594240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.600740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.601918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.611824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a09204c-a099-40b1-a478-c2526fb1f056 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.106231 Nov 20 20:55:58.615186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1681/3320] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:55:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:55:58.626500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:58.629602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:58.639647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.640458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.641538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.642483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.661899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. Nov 20 20:55:58.662879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:55:58.664561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:55:58.664699 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57d3bfe8-8f72-4fe0-a156-e1ddaa0d708d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046792 Nov 20 20:55:58.666300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1682/3321] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:55:58 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:55:58.763690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:55:58.775569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:58.776364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:58.880108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1385607791", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:58.975502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:55:59.183096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2a86457-9278-478e-bfe3-61154dcbc8ef tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.638472 Nov 20 20:55:59.183715 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1640/3322] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:55:58 2021] GET /compute/v2.1/servers/detail => generated 1697 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:55:59.202932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c25b433-2d5e-4089-b4f7-4b0a975d1779 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:59.222357 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c25b433-2d5e-4089-b4f7-4b0a975d1779 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022685 Nov 20 20:55:59.234522 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1641/3323] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:55:59 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:55:59.515598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:55:59.516824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:59.527492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.530936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.532022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.536755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.664315 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eab83de5-1abe-487c-b9cc-7a3e52fc6926 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.153253 Nov 20 20:55:59.671608 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1642/3324] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:55:59 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:55:59.677392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:59.693508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:59.731750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.732417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.733408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.733993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.802269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:55:59.803031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:55:59.803523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:55:59.804107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:55:59.805170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:55:59.819420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.820043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.821218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.821690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.840918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:55:59.846287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:55:59.860703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:55:59.863385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:55:59.927033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9683fa2-5cb3-4b4c-a4e7-f1f0bb80dc9b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050717 Nov 20 20:55:59.927908 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1683/3325] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:55:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:55:59.933461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:55:59.933957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:55:59.941801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.942297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.943085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:55:59.943697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:55:59.993787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:56:00.135049 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a13ff07-7762-44e7-915e-8f5cac667b0d tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "DELETE /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 204 len: 0 microversion: 2.1 time: 0.205849 Nov 20 20:56:00.139435 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1684/3326] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:55:59 2021] DELETE /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:56:00.144938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:00.145979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:00.166278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.171697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:00.173695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.175334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:00.262300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e01809ee-e68f-4d28-93f9-6b574f1b3dc8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.119234 Nov 20 20:56:00.268965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1685/3327] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:00 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:00.273785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32f91684-7e12-4dc6-85f9-2d13f37475e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:00.274917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32f91684-7e12-4dc6-85f9-2d13f37475e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:00.354167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32f91684-7e12-4dc6-85f9-2d13f37475e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:00.371936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:00.376125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32f91684-7e12-4dc6-85f9-2d13f37475e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a" status: 200 len: 1215 microversion: 2.1 time: 0.107671 Nov 20 20:56:00.380962 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2890ba34-3430-4334-b631-9b5b247dd499 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.707269 Nov 20 20:56:00.392691 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1643/3328] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:55:59 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:00.393992 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1686/3329] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:00 2021] GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:00.399380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e45cd193-e225-401c-8059-f857d513a9bd tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:00.400045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:00.403038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:00.409688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e45cd193-e225-401c-8059-f857d513a9bd tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:00.417631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.419860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:00.422000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.423429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:00.456349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e45cd193-e225-401c-8059-f857d513a9bd tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:56:00.889301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:00.899011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e5551c8-291d-4ee1-93c9-19f8f1d57db6 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1700 microversion: 2.1 time: 0.511167 Nov 20 20:56:00.915622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1644/3330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:00 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1700 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:00.926266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:00.931281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:00.947886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.949752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:00.952485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:00.953245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.074366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5e56449-0a26-46d9-b842-624decc7e810 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.155734 Nov 20 20:56:01.076600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1645/3331] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:00 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:01.278660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:01.280726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:01.310694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.312002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.318466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.321506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.409277 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a3998dc5-529d-4a99-9d3f-5a1641a4b07a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.135906 Nov 20 20:56:01.414107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1646/3332] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:01 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:01.465041 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.scheduler.client.report [None req-e45cd193-e225-401c-8059-f857d513a9bd tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Deleted allocations for instance 01403f0e-a121-4b91-b01c-96ddd180ca3a Nov 20 20:56:01.520202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e45cd193-e225-401c-8059-f857d513a9bd tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a" status: 204 len: 0 microversion: 2.1 time: 1.121542 Nov 20 20:56:01.526787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1687/3333] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:56:00 2021] DELETE /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:56:01.534928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:01.542578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:01.570569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.573565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.575647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.577766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.852248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:01.859785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4b4698c-b491-4427-a0f0-b11f888b06a0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.330886 Nov 20 20:56:01.872731 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1688/3334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:01 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:01.878083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:01.884727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:01.891900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.892822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.903423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.904035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.918681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64a6e0c0-6b47-4d47-9034-24e48252d6c8 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-283099500", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:01.920215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. Nov 20 20:56:01.920996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:01.921836 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-64a6e0c0-6b47-4d47-9034-24e48252d6c8 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] HTTP exception thrown: min_count must be <= max_count Nov 20 20:56:01.922197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42c8ad81-ad7f-4345-a653-613d56c81cf6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a" status: 404 len: 111 microversion: 2.1 time: 0.047475 Nov 20 20:56:01.922617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64a6e0c0-6b47-4d47-9034-24e48252d6c8 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Returning 400 to user: min_count must be <= max_count {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:01.930212 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-64a6e0c0-6b47-4d47-9034-24e48252d6c8 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.511005 Nov 20 20:56:01.930212 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1647/3335] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:01 2021] POST /compute/v2.1/servers => generated 74 bytes in 512 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 20:56:01.934415 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1689/3336] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:01 2021] GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:56:01.957826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:01.959023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:01.979975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.982471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:01.985682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:01.986898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:02.088474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2130723594", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:02.215090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:02.771712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:02.786856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-647c37b5-6b2b-44ce-845d-933e596ee12b tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1700 microversion: 2.1 time: 0.848392 Nov 20 20:56:02.797692 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1648/3337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:01 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1700 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:02.802767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:02.806640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:02.821425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:02.825668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:02.826809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:02.829172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:02.903678 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f603c648-2f3f-4b35-b710-565e64bae97b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.104343 Nov 20 20:56:02.905152 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1649/3338] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:02 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:02.914660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f163d16a-03f0-4cf7-908f-ef4e3304b4aa tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-793228384", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "max_count": 0}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:02.919400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f163d16a-03f0-4cf7-908f-ef4e3304b4aa tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:02.920550 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f163d16a-03f0-4cf7-908f-ef4e3304b4aa tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013982 Nov 20 20:56:02.930585 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1650/3339] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:02 2021] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:56:02.943676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:02.947213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:02.964346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:02.966438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:02.971284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:02.972018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.075428 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1af8456-913e-49fe-8146-5f2df557c017 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.135934 Nov 20 20:56:03.083063 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1651/3340] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:02 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:03.104453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:03.108080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:03.138682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.141732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.142902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.143514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.220327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:03.220876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:03.221249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:03.222316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:03.223004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:03.239890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.242190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.244092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.245320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.268381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:03.276700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:03.299459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:03.301978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:03.408534 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61a390de-59ce-4ece-b641-dbd30732599a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327451 Nov 20 20:56:03.415305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1690/3341] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:03.420568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0da7a3f9-8469-492d-9a4f-301ffe532d8d tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-305090362", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "max_count": 2.5}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:03.422010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0da7a3f9-8469-492d-9a4f-301ffe532d8d tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:03.422886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0da7a3f9-8469-492d-9a4f-301ffe532d8d tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006435 Nov 20 20:56:03.432624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1691/3342] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:03 2021] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:56:03.432624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b05902e-533d-4c16-8299-404a675ca9b4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:03.432624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b05902e-533d-4c16-8299-404a675ca9b4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:03.523049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b05902e-533d-4c16-8299-404a675ca9b4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:03.531576 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b05902e-533d-4c16-8299-404a675ca9b4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1215 microversion: 2.1 time: 0.106699 Nov 20 20:56:03.544207 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1692/3343] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:03 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:03.549102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e64a4f2-53aa-4553-aece-ea749a149f16 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-991231969", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 0}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:03.550876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e64a4f2-53aa-4553-aece-ea749a149f16 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:03.551835 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e64a4f2-53aa-4553-aece-ea749a149f16 tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.006447 Nov 20 20:56:03.552519 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1693/3344] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:03 2021] POST /compute/v2.1/servers => generated 130 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:56:03.607718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8617a191-17f9-4c97-8e87-7e3f5bb5736c tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-843265475", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 2.5}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:03.609523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8617a191-17f9-4c97-8e87-7e3f5bb5736c tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:03.610606 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8617a191-17f9-4c97-8e87-7e3f5bb5736c tempest-MultipleCreateNegativeTestJSON-782897580 tempest-MultipleCreateNegativeTestJSON-782897580-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007692 Nov 20 20:56:03.611851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1694/3345] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:03 2021] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 20:56:03.806402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:03.807289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:03.814713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.815763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.817662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:03.823529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:03.955270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:03.965633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53d6730f-f27e-405f-a2d4-d68bba59efdb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.881007 Nov 20 20:56:03.966255 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1652/3346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:03 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:04.014567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:04.022372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:04.080709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:04.081506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:04.082561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:04.083709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:04.171617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:04.189395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec428141-4c68-4e8c-99ff-12a0789d0e3c tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1632 microversion: 2.1 time: 0.387953 Nov 20 20:56:04.200657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1695/3347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:03 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1632 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:04.214534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:04.224778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f4b9e25-4918-4881-84ff-d72be3d857fc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.226195 Nov 20 20:56:04.229854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:04.236768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1653/3348] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:03 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:04.273976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:04.273976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:04.273976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:04.273976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:04.432195 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fba845d9-5f00-4b6a-851b-c19863e6e30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.226809 Nov 20 20:56:04.449208 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1696/3349] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:04 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:04.551162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c870dfc0-bd64-45c2-ba24-21518309244e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:04.551873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c870dfc0-bd64-45c2-ba24-21518309244e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:04.983531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:04.984405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:04.997166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:04.997166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:04.997455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.009277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.105400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c870dfc0-bd64-45c2-ba24-21518309244e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:05.117444 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c870dfc0-bd64-45c2-ba24-21518309244e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1215 microversion: 2.1 time: 0.569765 Nov 20 20:56:05.134149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1654/3350] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:04 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1215 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:05.211550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:05.212668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:05.228087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.228804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.231568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.236826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.477108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffd18846beb2426998ae8a8188fdb333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d1c3af3ff54b5eb9d1972c3dd28026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:05.492778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a8694d0-0095-4041-8e5f-e78c433d3eae tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 200 len: 1632 microversion: 2.1 time: 0.286360 Nov 20 20:56:05.503825 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1655/3351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:05 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 1632 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:05.547813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:05.553914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:05.583010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.584094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.588436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.588903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.721419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8b1f11c-248c-45d9-8237-ce60bfde051b tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.215221 Nov 20 20:56:05.725230 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1656/3352] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:05 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:05.739578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7f9ea7f1-f3fe-4a7b-be9e-aa62a79365e7 req-f0e343fc-2bbd-4169-ab1c-46bab363ef6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649c047e-3541-4d30-a07c-dc2788902dfd", "name": "network-vif-deleted", "tag": "65288fa2-856b-4bcd-b79e-358cb9d13ee1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:05.745731 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:05.745731 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:56:05.766542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7f9ea7f1-f3fe-4a7b-be9e-aa62a79365e7 req-f0e343fc-2bbd-4169-ab1c-46bab363ef6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.771150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7f9ea7f1-f3fe-4a7b-be9e-aa62a79365e7 req-f0e343fc-2bbd-4169-ab1c-46bab363ef6e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.815934 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7f9ea7f1-f3fe-4a7b-be9e-aa62a79365e7 req-f0e343fc-2bbd-4169-ab1c-46bab363ef6e service nova] Creating event network-vif-deleted:65288fa2-856b-4bcd-b79e-358cb9d13ee1 for instance 649c047e-3541-4d30-a07c-dc2788902dfd on nch2-master-1 Nov 20 20:56:05.829513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7f9ea7f1-f3fe-4a7b-be9e-aa62a79365e7 req-f0e343fc-2bbd-4169-ab1c-46bab363ef6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101330 Nov 20 20:56:05.830306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1657/3353] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:05.843367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:05.845930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:05.858247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.859133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.860390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:05.861703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:05.882147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:05.900479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56a6dc31-f75b-461b-a569-649e0e115911 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1523 microversion: 2.1 time: 0.920970 Nov 20 20:56:05.905195 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1697/3354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:04 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1523 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:05.978378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-895802ee-d881-4983-8307-e46477faf74d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.145554 Nov 20 20:56:05.986164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1658/3355] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:05 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:06.136681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:06.137301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:06.175436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.176891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.182731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.187611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.472702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:06.482084 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45f82f76-74c1-41c5-9bc1-3bb9eef0585f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1273 microversion: 2.1 time: 0.351211 Nov 20 20:56:06.483227 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1698/3356] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:06 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:06.516334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:06.520325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] [instance: 649c047e-3541-4d30-a07c-dc2788902dfd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:06.559345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.562451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.568016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.570867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.641474 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] HTTP exception thrown: Instance 649c047e-3541-4d30-a07c-dc2788902dfd could not be found. Nov 20 20:56:06.645188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Returning 404 to user: Instance 649c047e-3541-4d30-a07c-dc2788902dfd could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:06.646810 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd83c4ff-2fce-4a5c-9f89-4687d93e4791 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd" status: 404 len: 111 microversion: 2.1 time: 0.135300 Nov 20 20:56:06.653619 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1659/3357] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:06 2021] GET /compute/v2.1/servers/649c047e-3541-4d30-a07c-dc2788902dfd => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:56:06.662266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e86b7b40-96e0-459c-a7b5-6502d16a33b3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] Calling method '.version_select at 0x7f3f86243ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:06.723942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e86b7b40-96e0-459c-a7b5-6502d16a33b3 tempest-ServersTestJSON-557235685 tempest-ServersTestJSON-557235685-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934884332" status: 202 len: 0 microversion: 2.1 time: 0.065588 Nov 20 20:56:06.724949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1699/3358] 10.222.0.41 () {58 vars in 1220 bytes} [Sat Nov 20 20:56:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934884332 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:06.741391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:06.743084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:06.755517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.758875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.764956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.765655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.870994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb06e524-f5c4-42b0-9d76-7686d98b902a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.135315 Nov 20 20:56:06.872341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1660/3359] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:06 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:06.931399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:06.932796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:06.941776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.945410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.948521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:06.949149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:06.993258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:06.994676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:07.009271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.012000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.013666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.015339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.123759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-673106eb-132d-4887-a42f-67c5f67c88fa tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.135796 Nov 20 20:56:07.125108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1661/3360] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:06 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:07.367515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:07.380015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef43da1c-caf6-4af5-8d00-58c827aa0461 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1503 microversion: 2.1 time: 0.452930 Nov 20 20:56:07.385375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1700/3361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:06 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:07.409612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:07.414952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:07.433396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.433858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.434725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.435174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.507989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:07.508977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:07.524969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.528085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.537677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.538799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.751931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:07.770291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82ac527a-7908-40dd-8c20-921651d4c404 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1273 microversion: 2.1 time: 0.264611 Nov 20 20:56:07.772191 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1701/3362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:07 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:07.890394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:07.892892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:07.908625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.909448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:07.912758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:07.913610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.015502 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b605f6f-2d80-45bc-9625-b793188ee68d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.135396 Nov 20 20:56:08.021160 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1702/3363] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:07 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:56:08.077610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:08.089010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96eaf4bf-e466-4f57-9cb0-ba92b18e7284 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1515 microversion: 2.1 time: 0.681544 Nov 20 20:56:08.094084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1662/3364] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:07 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1515 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:08.127199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63d3d945-4892-4513-bf22-9f6793be6e9c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:08.133187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63d3d945-4892-4513-bf22-9f6793be6e9c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: b90fd7ac-60d7-45fe-b0b4-84f995da45bd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:08.137335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:08.138627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:08.152492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.152944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.153089 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-63d3d945-4892-4513-bf22-9f6793be6e9c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Instance b90fd7ac-60d7-45fe-b0b4-84f995da45bd could not be found. Nov 20 20:56:08.153685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63d3d945-4892-4513-bf22-9f6793be6e9c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 404 to user: Instance b90fd7ac-60d7-45fe-b0b4-84f995da45bd could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:08.154593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63d3d945-4892-4513-bf22-9f6793be6e9c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/b90fd7ac-60d7-45fe-b0b4-84f995da45bd/action" status: 404 len: 111 microversion: 2.1 time: 0.036619 Nov 20 20:56:08.155193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1703/3365] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:08 2021] POST /compute/v2.1/servers/b90fd7ac-60d7-45fe-b0b4-84f995da45bd/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:56:08.156365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.157032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.166921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:08.169708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:08.193214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.193677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.195006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.198604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.235720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95c2ca2d-df24-4522-9661-b5aaaf22574e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.102255 Nov 20 20:56:08.237111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1663/3366] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:08 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:08.370495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4836eab8-3494-4a24-81eb-bc8c5744e680 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 202 len: 0 microversion: 2.1 time: 0.207257 Nov 20 20:56:08.376822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1704/3367] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:08 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:08.387296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:08.388114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:08.415742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.416552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.417562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.418224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.799944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:08.802529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:08.828837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.829463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:08.834403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:08.835919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:09.274345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:09.285410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3044de21-a19a-4170-88ef-ead9e2127577 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1520 microversion: 2.1 time: 0.902011 Nov 20 20:56:09.287532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1664/3368] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:08 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1520 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:09.299443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:09.300596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:09.309311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:09.310114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:09.311188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:09.311776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:09.372669 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5879140a-d953-4ffa-a6b1-7174cde2df82 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.081319 Nov 20 20:56:09.374404 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1665/3369] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:09 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:09.382304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:09.383822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:09.393583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:09.394508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:09.395593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:09.396218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:09.485270 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74cb947c-32e3-41b8-abd3-d78ff3fbe68e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.109065 Nov 20 20:56:09.487123 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1666/3370] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:09 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:09.782747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:09.792904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3ab8c42-818f-403c-8890-72890d6efbaa tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 1.003882 Nov 20 20:56:09.794398 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1705/3371] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:08 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:10.304669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-29ab7840-6c79-44c0-91e2-a7b7d80a0eef req-7b981ca4-c25d-4b66-bff5-aa2e27b77f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be59183b-d051-4d64-96f9-6bbdf8230b4a", "tag": "f8746601-d5fd-409a-9259-84fcd8501552"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:10.310936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:10.311792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:10.318235 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:10.318235 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:56:10.334102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.334845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.339164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.339963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.351090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29ab7840-6c79-44c0-91e2-a7b7d80a0eef req-7b981ca4-c25d-4b66-bff5-aa2e27b77f15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.354032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29ab7840-6c79-44c0-91e2-a7b7d80a0eef req-7b981ca4-c25d-4b66-bff5-aa2e27b77f15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.407963 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-29ab7840-6c79-44c0-91e2-a7b7d80a0eef req-7b981ca4-c25d-4b66-bff5-aa2e27b77f15 service nova] Creating event network-changed:f8746601-d5fd-409a-9259-84fcd8501552 for instance be59183b-d051-4d64-96f9-6bbdf8230b4a on nch2-master-1 Nov 20 20:56:10.442395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-29ab7840-6c79-44c0-91e2-a7b7d80a0eef req-7b981ca4-c25d-4b66-bff5-aa2e27b77f15 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134571 Nov 20 20:56:10.444014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1667/3372] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:10.471490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:10.477812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:10.535677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.536998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.540585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.541862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.619958 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f9a98a0-c2d0-42ee-8b9e-0b3f1ca80794 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.170556 Nov 20 20:56:10.625798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1668/3373] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:10 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:10.640553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:10.642610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:10.663519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.666736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.672121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:10.674605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:10.767927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38a658ea-84a8-4369-aaeb-6ed25d78901f tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.140016 Nov 20 20:56:10.769850 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1669/3374] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:10 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:10.922019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1349729299", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "bf74e6f3-82c8-4978-aa97-a4ecd0f7f700"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:10.954950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:10.965113 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36d48375-a22e-4dff-895d-5cb4a9fdd41f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1500 microversion: 2.1 time: 0.657809 Nov 20 20:56:10.968000 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1706/3375] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:10 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1500 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:10.974016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:10.974656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:11.006574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.007094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.013212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.013713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.079632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] validate_networks() for [('bf74e6f3-82c8-4978-aa97-a4ecd0f7f700', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:11.378118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:11.390657 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-601c7675-6b25-4045-8435-711fcc100044 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.415885 Nov 20 20:56:11.391488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1707/3376] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:10 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:11.408304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:11.409553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:11.415940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.416393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.417297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.417741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.444048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lazy-loading 'flavor' on Instance uuid 293ef3df-319d-4bc8-8921-ed7b90ab89c9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:56:11.461280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Cannot 'rescue' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state paused Nov 20 20:56:11.461896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 409 to user: Cannot 'rescue' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state paused {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:11.462763 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a86ae3ee-66b9-4072-9deb-d3389127a641 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 409 len: 144 microversion: 2.1 time: 0.063613 Nov 20 20:56:11.469361 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1708/3377] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:11 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 144 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:56:11.480984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:11.481765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:11.495385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.497093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.498084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.501533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.614817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fb57a4a-3d50-425c-9896-441b48192acd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 202 len: 0 microversion: 2.1 time: 0.143833 Nov 20 20:56:11.619074 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1709/3378] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:11 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:11.641352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:11.642442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:11.666460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.670306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:11.670902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:11.674338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.008707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:12.019934 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2dae0ba-bb00-4803-b7cb-e2d2a47f8557 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1507 microversion: 2.1 time: 0.383488 Nov 20 20:56:12.022379 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1710/3379] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:11 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:12.031065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:12.032574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:12.063172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.064362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.066310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.067182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.127772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dba3b388-acf1-4bcd-961b-e6ca7b28f59c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.103256 Nov 20 20:56:12.129271 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1711/3380] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:12 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:12.136665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:12.138290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:12.149632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.150750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.151523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.152549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.225375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5bf6751-d1c4-469f-be77-1530c4f8d0a1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.094167 Nov 20 20:56:12.226818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1712/3381] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:12 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:12.267431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:12.268458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:12.269166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:12.269780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:12.270432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:12.282562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.283293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.285111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.285700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.327301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Getting quotas for project 7ed0c564c74644c6baba20a6319cff30. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:12.349642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Getting quotas for user 16e3f2061e4a4b44b9290f05dc5ca6e6 and project 7ed0c564c74644c6baba20a6319cff30. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:12.368573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:12.371169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:12.415720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:12.416578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:12.427161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.430098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.431423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:12.433629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:12.487413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be8acf52-4ed5-47c3-a901-baaaa90e56b3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.715998 Nov 20 20:56:12.488391 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1670/3382] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:12.518243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72a782e6-110f-472e-822a-ffd0dbe5330f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:12.518872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72a782e6-110f-472e-822a-ffd0dbe5330f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:12.685872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-72a782e6-110f-472e-822a-ffd0dbe5330f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:12.696858 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72a782e6-110f-472e-822a-ffd0dbe5330f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1216 microversion: 2.1 time: 0.186046 Nov 20 20:56:12.708359 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1671/3383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:12 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:12.797479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:12.806014 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e787b1d-333c-4948-a75d-6b028f23f2c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.397145 Nov 20 20:56:12.810499 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1713/3384] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:12 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:13.045715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:13.046533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:13.061986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.062544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.063430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.063943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.149002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:13.150098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:13.167686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.168139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.171087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.171547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.263339 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df9ebc0a-ba9f-4a79-b1b0-03b2b352c51a tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.124940 Nov 20 20:56:13.264681 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1714/3385] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:13 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:13.270920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:13.272263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:13.282400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.283096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.284053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.284667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.374707 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8f2e3965-c3ed-45f9-b221-66fdc890dcba tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.095221 Nov 20 20:56:13.377675 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1715/3386] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:13.579903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:13.602881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25921285-bcda-4f4c-85d7-1f19518b5b47 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1515 microversion: 2.1 time: 0.561415 Nov 20 20:56:13.608313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1672/3387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:13 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1515 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:13.719153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:13.720191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:13.742461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.746625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.751874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.753956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.823498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:13.824291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:13.844502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.845339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:13.850918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:13.851654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:14.108750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:14.118041 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b512286-8191-4545-9730-d107161b6fcb tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1212 microversion: 2.1 time: 0.405091 Nov 20 20:56:14.123618 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1716/3388] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:13 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1212 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:14.278865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:14.280855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:14.298965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:14.299682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:14.301002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:14.301599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:14.314873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:14.323918 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1fbfd8c8-d7cd-4449-9183-a6fdb0e41519 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.504359 Nov 20 20:56:14.324956 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1673/3389] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:13 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:14.372189 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d154854c-d544-47a6-a9d3-beddfa1cdf23 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.099696 Nov 20 20:56:14.376457 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1717/3390] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:14 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:56:14.389498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:14.390736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:14.401594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:14.405097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:14.409592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:14.410301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:14.489487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7b0771bc-1213-4f45-a2d0-823a9f61588a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.103622 Nov 20 20:56:14.500531 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1674/3391] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:14 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:15.145403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:15.146126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.160423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.161346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.162739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.164106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.345563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:15.346872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.358413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.364446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.365489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.366156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.455007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:15.466844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1b82a29-f238-43e2-942c-511014652ab2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1274 microversion: 2.1 time: 0.325639 Nov 20 20:56:15.469931 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1718/3392] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:15 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1274 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:15.475145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:15.476305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.492921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.493531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.494488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.495164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.542517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lazy-loading 'flavor' on Instance uuid 293ef3df-319d-4bc8-8921-ed7b90ab89c9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:56:15.682900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:15.701702 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5826b60d-5c85-447f-ac77-74ae1b661bfb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.358311 Nov 20 20:56:15.703750 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1675/3393] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:15 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:15.708524 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54a125a9-999c-45cf-8b13-d1d411d8ac5f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 200 len: 32 microversion: 2.1 time: 0.237076 Nov 20 20:56:15.711445 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1719/3394] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:15 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:56:15.719604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:15.724308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.743811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:15.747435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.765768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.768702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.769172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.769402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.770015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.770685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.771556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.778612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.823118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c526596-2912-4a2a-8912-98142a03c2d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.097376 Nov 20 20:56:15.824626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1720/3395] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:15 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:15.846639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:15.847950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:15.864969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.865913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.868030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:15.868720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:15.872435 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fc121dc-d93a-449f-9cfa-1abfa5d5ccdc tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.164615 Nov 20 20:56:15.877324 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1676/3396] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:15 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:16.485135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:16.485831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:16.499384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.499838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.500637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.501122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.505900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:16.515865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0fb211a-e941-4175-96c0-e0b042e802e5 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.678918 Nov 20 20:56:16.516304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1721/3397] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:15 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:16.722522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:16.723609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:16.735697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.738866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.739972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.742355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.785461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:16.799959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f4de2ee-6205-4b2e-a313-e4f2bc1bb3b2 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1274 microversion: 2.1 time: 0.318599 Nov 20 20:56:16.800531 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1677/3398] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:16 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1274 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:16.837460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:16.838626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:16.853542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.870194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.871706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.872390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.939176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8fcb3f3e-c4f4-4c8f-84d9-361591678f82 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.106874 Nov 20 20:56:16.948355 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1678/3399] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:16.965681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:16.967552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:16.981689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.982515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:16.984472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:16.986615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:17.081642 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-722403f6-4a81-4551-a72d-3b372f64d37c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.131400 Nov 20 20:56:17.082508 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1679/3400] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:16 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:17.243741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:17.256919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e505f14-2f38-433c-a6f3-07e237f90638 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.539806 Nov 20 20:56:17.261738 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1722/3401] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:16 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:17.538170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:17.539397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:17.561741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:17.562573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:17.563547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:17.564189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:17.825375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:17.826479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:17.840668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:17.841244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:17.842335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:17.847198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:17.931885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:17.940266 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bbf2acd0-8024-4398-a108-90f94a9cdf9e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.409250 Nov 20 20:56:17.940859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1680/3402] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:17 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:17.971542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:17.972548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:18.007966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.008851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.012141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.013994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.103348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0603710-dcc2-4245-bca3-7a606072cf94 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.151382 Nov 20 20:56:18.119234 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1681/3403] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:17 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:18.136675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:18.143994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:18.167934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.168402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.176569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.177036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.279902 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f9f4bd23-a8b0-41fb-8dec-4dd8e9bf2a2c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.158909 Nov 20 20:56:18.281697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1682/3404] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:18 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:18.287028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:18.290078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:18.304025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:18.313470 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f405564-3b34-49d1-a728-1fb380c21f0f tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.494635 Nov 20 20:56:18.318645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.319092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.319966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.320394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.334523 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1723/3405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:17 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:18.771684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:18.782044 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5593a116-5031-4629-a208-ba17525001a2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.498670 Nov 20 20:56:18.782640 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1683/3406] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:18 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:18.963960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-549ee143-ee32-4981-a971-649178856653 req-69f1c19d-a29f-46d3-8e27-2203cecada4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be59183b-d051-4d64-96f9-6bbdf8230b4a", "name": "network-vif-plugged", "status": "completed", "tag": "f8746601-d5fd-409a-9259-84fcd8501552"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:18.967406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:18.968221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:18.970168 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:18.970168 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:18.990141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.990792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.992548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:18.995728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:18.995994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-549ee143-ee32-4981-a971-649178856653 req-69f1c19d-a29f-46d3-8e27-2203cecada4d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.000263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-549ee143-ee32-4981-a971-649178856653 req-69f1c19d-a29f-46d3-8e27-2203cecada4d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.040935 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-549ee143-ee32-4981-a971-649178856653 req-69f1c19d-a29f-46d3-8e27-2203cecada4d service nova] Creating event network-vif-plugged:f8746601-d5fd-409a-9259-84fcd8501552 for instance be59183b-d051-4d64-96f9-6bbdf8230b4a on nch2-master-1 Nov 20 20:56:19.058997 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-549ee143-ee32-4981-a971-649178856653 req-69f1c19d-a29f-46d3-8e27-2203cecada4d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102738 Nov 20 20:56:19.063220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1724/3407] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:19.138425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:19.140524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:19.153279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.155989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.157437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.158039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.251131 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b526ef4-63d8-43cd-bf4c-446c07af42d1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.124453 Nov 20 20:56:19.253609 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1725/3408] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:19 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:19.293962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:19.295457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:19.313236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.313943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.315133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.318975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.482671 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a1b5bcb-5307-47d3-8fdb-89a5e23bca92 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.186464 Nov 20 20:56:19.484099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1726/3409] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:19 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:56:19.496363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:19.499071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:19.524256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.525123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.526173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:19.526758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:19.688947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:19.705876 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ade25e27-95fb-46fe-9687-d71f9c8b0aa0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.747205 Nov 20 20:56:19.706591 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1684/3410] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:18 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:20.051573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:20.060847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e19e6d7a-5773-46b1-93e9-4c22534c33a3 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.575331 Nov 20 20:56:20.067590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1727/3411] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:19 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:20.083234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:20.083866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:20.096725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.097176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.108312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.109129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.192553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-cb8d583b-007a-43aa-8687-0b8cd2609975 req-3f96bef1-81b8-4cac-b11d-7b7a2e7ab9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8532a29f-7bec-4295-9b06-8b7fda995ac9", "tag": "b7df387f-70cb-41a7-8942-ab9783f9ba75"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:20.195117 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:20.195117 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:56:20.220454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cb8d583b-007a-43aa-8687-0b8cd2609975 req-3f96bef1-81b8-4cac-b11d-7b7a2e7ab9c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.223000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cb8d583b-007a-43aa-8687-0b8cd2609975 req-3f96bef1-81b8-4cac-b11d-7b7a2e7ab9c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.257377 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-cb8d583b-007a-43aa-8687-0b8cd2609975 req-3f96bef1-81b8-4cac-b11d-7b7a2e7ab9c0 service nova] Creating event network-changed:b7df387f-70cb-41a7-8942-ab9783f9ba75 for instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 on nch1-master-1 Nov 20 20:56:20.263368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-cb8d583b-007a-43aa-8687-0b8cd2609975 req-3f96bef1-81b8-4cac-b11d-7b7a2e7ab9c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.507089 Nov 20 20:56:20.267700 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1685/3412] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:56:20.276607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:20.283024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:20.305301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.305866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.307043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.308363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.393530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24b98a63-3073-478b-8ba4-68bddfd9f947 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.123954 Nov 20 20:56:20.394622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1686/3413] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:20 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:20.494899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:20.495918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:20.508437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.508895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.509707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.510178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.626544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b23e537-0eec-479d-9a7f-ae343f3bbefa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.131726 Nov 20 20:56:20.627179 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1687/3414] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:20 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:20.709009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:20.716405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-24e936ea-6b02-4d07-830f-60453e32646f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1315 microversion: 2.1 time: 0.647488 Nov 20 20:56:20.723147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:20.724084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:20.730270 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1728/3415] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:20 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:20.735744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.739335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:20.742309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:20.752678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.060443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:21.076358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-97db5336-e353-466c-b4f3-c7f60fa3bc97 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.357035 Nov 20 20:56:21.079466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1688/3416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:20 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:21.089380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:21.094671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:21.105270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.106174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.110784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.111398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.409951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:21.414934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:21.434857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.435858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.437071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.437729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.503092 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98b1bad4-af67-4a66-bead-3fa8907fb766 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.099409 Nov 20 20:56:21.508877 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1689/3417] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:21 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:21.607667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:21.633320 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b97c11ff-71db-4d35-b706-d545e48f4c71 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.552125 Nov 20 20:56:21.640086 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1729/3418] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:21 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:21.653769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:21.659169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:21.670603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.672501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.673565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.674270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.747357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:21.747974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:21.758722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.759397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.760539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:21.761190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:21.770176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff7dd31c-c589-43d6-acd3-ba41e6b4e3b7 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.134653 Nov 20 20:56:21.777419 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1690/3419] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:21 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:22.095280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:22.095975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:22.113026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.114600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.117916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.119644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.539958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:22.550652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3781b366-b432-4235-8778-f7d95b652148 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.459581 Nov 20 20:56:22.562534 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1691/3420] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:22 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:22.569388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:22.571139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:22.577454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.578274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.579900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.579900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.667435 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-018ebd9b-1be2-417a-84cc-af4b90b08f8d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.103034 Nov 20 20:56:22.668901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1692/3421] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:22 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:22.677204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:22.682007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:22.696665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.703568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.704727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.705288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.913849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:22.924109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39bfb7a1-adfc-4643-bf84-d4809c73a053 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1503 microversion: 2.1 time: 1.178956 Nov 20 20:56:22.938395 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1730/3422] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:21 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1503 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:22.946037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:22.951245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:22.971102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.971560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:22.972378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:22.972824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.058421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb301fb8-6831-43a9-aa71-4be84d4d15d1 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.116700 Nov 20 20:56:23.059299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1731/3423] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:22 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:23.072918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:23.075004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:23.097543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.098463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.099552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.100752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.265727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91269977-5e34-42cb-ac70-2960ee23be45 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a/action" status: 202 len: 0 microversion: 2.1 time: 0.203610 Nov 20 20:56:23.267785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1732/3424] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:23 2021] POST /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:23.286294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:23.294975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:23.318494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.319380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.320372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.322460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.329354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:23.345717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-55db83c9-5ed2-449d-a03a-c1ae19e3264b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.675993 Nov 20 20:56:23.359812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1693/3425] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:22 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:23.574440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:23.577074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:23.592704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.597328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.601688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.602439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.707555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:23.715277 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f00f8c55-fba8-498c-b3a7-ba9346c80f03 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1508 microversion: 2.1 time: 0.435958 Nov 20 20:56:23.725842 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1733/3426] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:23 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:23.737804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:23.746237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:23.755158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.755681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.757234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:23.759177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:23.835241 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b078331b-9fda-4398-b095-54e06f95bfa2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.105297 Nov 20 20:56:23.836935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1734/3427] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:23 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:23.954890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:23.971535 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f38cff9-9334-496f-acee-6a861fbcad70 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.406451 Nov 20 20:56:23.981456 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1694/3428] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:23 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:24.071093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:24.072807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:24.089586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.091464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.093023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.095159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.175104 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-653e6ae6-519b-426e-91dc-0c576dea4baa tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.108094 Nov 20 20:56:24.176454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1735/3429] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:24 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:24.368006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:24.369012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:24.376902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.377750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.380200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.382001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.561922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:24.574495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-085d94e1-c79a-4a25-b589-38f75fde3b51 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.212683 Nov 20 20:56:24.576442 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1695/3430] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:24 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:24.743960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:24.744945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:24.754517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.755303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.756324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.757529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.848225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:24.849551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:24.857918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.858787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.859817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.860473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.928902 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3984519-6145-4aa6-9bd2-167e1e8ae9b2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.083716 Nov 20 20:56:24.929754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1696/3431] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:24.989196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:24.989895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:24.998534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:24.998993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:24.999804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.000243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.282743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:25.297976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea7252d8-a687-49a7-b43a-6b024d125232 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.312726 Nov 20 20:56:25.310876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1697/3432] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:24 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:25.320432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:25.321820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:25.326346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:25.338462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b4df0a3-5760-47ef-a237-3de4ce65c172 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1488 microversion: 2.1 time: 0.601125 Nov 20 20:56:25.340785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1736/3433] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:24 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1488 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:25.351142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.351869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.356790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:25.357608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:25.361716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.362451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.378631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.379198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.386890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.387401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.446231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:56:25.457565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08426a54-9ae5-470e-8678-221dbc3ed25c tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.139729 Nov 20 20:56:25.461972 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1698/3434] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:25 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:25.595849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:25.597280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:25.613097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.621738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.623472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.624024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.643100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53ac05a5-2936-43ed-a8b0-9771e7444052 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 204 len: 0 microversion: 2.1 time: 0.289485 Nov 20 20:56:25.646761 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1737/3435] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:56:25 2021] DELETE /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:56:25.652719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:25.653405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:25.688677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.689427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.690623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:25.691215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:25.989978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:26.001454 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17912f71-5670-461f-b052-7d82efa769df tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1494 microversion: 2.1 time: 0.352663 Nov 20 20:56:26.004092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1738/3436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:25 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:26.013149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:26.016193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:26.030943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.031409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.034325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.034785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.048117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:26.063288 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3510e8d0-9b37-4ea5-8406-14ffd0fc43b8 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.472948 Nov 20 20:56:26.063908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1699/3437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:25 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:26.108529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e0521b7-6245-4efc-b005-21b599a70a85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.102960 Nov 20 20:56:26.110114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1739/3438] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:26 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:26.315798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:26.316408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:26.324710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.327560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.331955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.333657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.472985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:26.473910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:26.484609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.503180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.504211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:26.504705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:26.603011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95a2a945-6db0-422b-b6bf-c847b585d7f4 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 32650 microversion: 2.1 time: 0.133939 Nov 20 20:56:26.603891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1740/3439] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:26 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 32650 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:56:27.018766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:27.019728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:27.039166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.039874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.040852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.041484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.267521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:27.283568 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4051f881-37af-4261-9406-c4f6edca272a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.964735 Nov 20 20:56:27.285216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1700/3440] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:26 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:27.294486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:27.298779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:27.308133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.308582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.309379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.309813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.379941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:27.399183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d24f8ead-0cb6-4e9c-93e8-22122de1b415 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1494 microversion: 2.1 time: 0.384712 Nov 20 20:56:27.399800 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1741/3441] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:27 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1494 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:27.404378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:27.405296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:27.419804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.420697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.421749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.422404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.523397 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41cde527-3ab7-405a-889f-2664ef1b0867 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.119860 Nov 20 20:56:27.524777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1742/3442] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:27 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:27.615808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:27.617519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:27.632102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.633306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.634804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:27.635441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:27.763864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac2ac886-6c51-401a-a421-8dbc18bb5f1e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action" status: 200 len: 40801 microversion: 2.1 time: 0.150643 Nov 20 20:56:27.764099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1743/3443] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:27 2021] POST /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d/action => generated 40801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:56:27.963672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:27.974558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-842ea825-7391-4f08-b2e5-6f876cc4a880 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.688202 Nov 20 20:56:27.975282 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1701/3444] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:27 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:28.301637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:28.302277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:28.309214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.327740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.331683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.335098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.402682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-078a3b06-ae05-4ee6-987d-c6caca9fd907 req-5bd0798c-6ac2-457d-bb28-6b92de37c765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8532a29f-7bec-4295-9b06-8b7fda995ac9", "name": "network-vif-plugged", "status": "completed", "tag": "b7df387f-70cb-41a7-8942-ab9783f9ba75"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:28.404779 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:28.404779 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:28.451942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-078a3b06-ae05-4ee6-987d-c6caca9fd907 req-5bd0798c-6ac2-457d-bb28-6b92de37c765 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.452435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-078a3b06-ae05-4ee6-987d-c6caca9fd907 req-5bd0798c-6ac2-457d-bb28-6b92de37c765 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.500068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-078a3b06-ae05-4ee6-987d-c6caca9fd907 req-5bd0798c-6ac2-457d-bb28-6b92de37c765 service nova] Creating event network-vif-plugged:b7df387f-70cb-41a7-8942-ab9783f9ba75 for instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 on nch1-master-1 Nov 20 20:56:28.513268 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-078a3b06-ae05-4ee6-987d-c6caca9fd907 req-5bd0798c-6ac2-457d-bb28-6b92de37c765 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524525 Nov 20 20:56:28.520490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1744/3445] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:28.532466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:28.553817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:28.598877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.610404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.620753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.622787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.837248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:28.853827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0a7808c-10b9-49c1-9d61-c828b47222b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.556917 Nov 20 20:56:28.866212 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1702/3446] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:28 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:28.880102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:28.881015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:28.903286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.905154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.907931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:28.908570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:28.963478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:28.980005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45ec89cd-1135-4d33-8365-aabb2081f40c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 200 len: 1452 microversion: 2.1 time: 0.456043 Nov 20 20:56:28.980594 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1745/3447] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:28 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 1452 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:28.985687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:28.990347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:28.992364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d450f512-7e3a-415c-af9d-1f192ae6cfad tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.115621 Nov 20 20:56:29.001921 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1703/3448] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:28 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:29.007072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.012406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9e380ab2-9a08-4563-a848-194543e6fd41 req-084e63e0-5a55-4a91-b76c-048d41989634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be59183b-d051-4d64-96f9-6bbdf8230b4a", "name": "network-vif-deleted", "tag": "f8746601-d5fd-409a-9259-84fcd8501552"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:29.016404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.017699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.019927 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:29.019927 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:56:29.022574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.050855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9e380ab2-9a08-4563-a848-194543e6fd41 req-084e63e0-5a55-4a91-b76c-048d41989634 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.056232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9e380ab2-9a08-4563-a848-194543e6fd41 req-084e63e0-5a55-4a91-b76c-048d41989634 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.120670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9e380ab2-9a08-4563-a848-194543e6fd41 req-084e63e0-5a55-4a91-b76c-048d41989634 service nova] Creating event network-vif-deleted:f8746601-d5fd-409a-9259-84fcd8501552 for instance be59183b-d051-4d64-96f9-6bbdf8230b4a on nch2-master-1 Nov 20 20:56:29.125592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9e380ab2-9a08-4563-a848-194543e6fd41 req-084e63e0-5a55-4a91-b76c-048d41989634 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121972 Nov 20 20:56:29.142427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:56:29.142898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1704/3449] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:29.157803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:29.166941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:29.175784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.176573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.178260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.179406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.346953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f14fe437-daa0-424d-86fe-1eb4368f6c5d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "DELETE /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 204 len: 0 microversion: 2.1 time: 0.364671 Nov 20 20:56:29.360289 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1746/3450] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:56:28 2021] DELETE /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:56:29.387847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:29.389213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:29.396480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.398342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.400532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.401137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.581365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:29.590670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-abc96148-b717-4d5c-9e18-aee006e38795 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1316 microversion: 2.1 time: 0.442043 Nov 20 20:56:29.591286 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1705/3451] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:29 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:29.676739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:29.687887 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57d2d855-5d42-424e-b467-5709bed8b6eb tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1664 microversion: 2.1 time: 0.325977 Nov 20 20:56:29.697713 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1747/3452] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:29 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1664 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:29.883969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:29.884595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:29.896980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.897651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.907195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:29.907664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:29.996830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:29.998292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:30.004884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.016117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:30.017720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.018670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:30.057130 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. Nov 20 20:56:30.060500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:30.064246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99423844-8fb3-49cd-8098-4bbe75e0c778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 404 len: 111 microversion: 2.1 time: 0.071114 Nov 20 20:56:30.073141 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1748/3453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:29 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:56:30.098210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:30.112617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:30.120510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.121367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:30.133972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.134792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:30.220823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:30.233744 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f10fcf2a-f5ae-4191-9d30-c992363a32c8 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.354230 Nov 20 20:56:30.234363 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1706/3454] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:29 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:30.236873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-15f0a054-2069-4f65-a9f9-60add3d5b277 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.161359 Nov 20 20:56:30.242154 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1749/3455] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:30 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:30.386227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-88834988", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:30.517675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:30.607839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:30.608333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:30.621293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.629242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:30.630152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:30.630668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.056118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:31.064539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f5254b0-6369-4bc8-b44d-52bc0360cd25 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1503 microversion: 2.1 time: 0.460934 Nov 20 20:56:31.078245 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1750/3456] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:30 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:31.085575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.086451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.093118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.093791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.094768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.095357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.187730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:31.188828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:31.189479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:31.190096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:31.190792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:31.214848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.216103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.217116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.218288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.250246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:31.259388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:31.274320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:31.279981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:31.380287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-952ce546-4735-4092-9599-82eeaa38762e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998936 Nov 20 20:56:31.384199 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1707/3457] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:31.394416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.395881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.408179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.409314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.410365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.410943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.556731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86f16022-e804-4928-ba0e-32763e2f37c0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.167585 Nov 20 20:56:31.557652 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1708/3458] 10.222.0.41 () {58 vars in 1295 bytes} [Sat Nov 20 20:56:31 2021] DELETE /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9/os-server-password => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:56:31.565967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:31.569635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.570518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:31.579386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d24798a-cdc4-4bb4-9ef9-b9007a61b6d0 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1664 microversion: 2.1 time: 0.499722 Nov 20 20:56:31.585200 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1751/3459] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:31 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1664 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:31.592544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.592735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.593173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.594096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.594527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.607913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.631434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.632218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.633293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.634065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.667801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54eb40e0-16f3-42f3-be9d-7a0158413b40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.107956 Nov 20 20:56:31.669372 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1709/3460] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:31 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:31.679154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12c8a193-829c-4cc9-a1f9-2bdfceb01903 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.683506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12c8a193-829c-4cc9-a1f9-2bdfceb01903 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.767305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12c8a193-829c-4cc9-a1f9-2bdfceb01903 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:31.775347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12c8a193-829c-4cc9-a1f9-2bdfceb01903 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1213 microversion: 2.1 time: 0.104501 Nov 20 20:56:31.775947 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1710/3461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:31 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:31.789928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.791384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.798012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.798515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.799320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.799755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.840533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0aeea728-ac04-46ac-8a1e-9a4c4b64fba6 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.063298 Nov 20 20:56:31.841461 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1711/3462] 10.222.0.41 () {58 vars in 1292 bytes} [Sat Nov 20 20:56:31 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9/os-server-password => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:56:31.852130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:31.853137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:31.863231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.863865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.867222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:31.867932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:31.899914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:56:32.039296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff468379-169c-4150-bf81-a3a41bafd48b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 204 len: 0 microversion: 2.1 time: 0.191870 Nov 20 20:56:32.040084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1712/3463] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:56:31 2021] DELETE /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 20:56:32.054260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:32.055497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:32.062924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.063594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.064653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.066331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.148482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:32.161888 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c8382c8-f2fc-40c3-a79d-be23294b5faa tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.568295 Nov 20 20:56:32.166831 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1752/3464] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:31 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:32.271232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:32.280195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2f8ce58-bcb5-4459-adfc-40acd422f901 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1509 microversion: 2.1 time: 0.235697 Nov 20 20:56:32.290904 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1713/3465] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:32 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:32.596162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:32.596952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:32.605627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.606115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.606924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.607532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.681970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:32.682907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:32.698632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.699195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.700161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.700640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.811478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba9ca733-e4ed-40b7-b30a-fb85479dafc2 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.134121 Nov 20 20:56:32.815648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1714/3466] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:32 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:32.831494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:32.832563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:32.852628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.854251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:32.855738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:32.858187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.093121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:33.102434 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db501eed-ada5-4720-82e9-6097c184a604 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1273 microversion: 2.1 time: 0.285193 Nov 20 20:56:33.110720 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1715/3467] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:32 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:33.184883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:33.185495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:33.202473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.202934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.203919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.204503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.530530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:33.550979 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fc5fdccb-9bc0-4cc1-b6be-2fda7688f5e6 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1664 microversion: 2.1 time: 0.958253 Nov 20 20:56:33.551705 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1753/3468] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:32 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1664 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:33.556849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:33.557593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:33.565273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.577762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.578794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.579353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.787253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:33.796793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5aefc9b2-16f4-43f3-97c0-5a3595842731 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.615753 Nov 20 20:56:33.802701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1716/3469] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:33 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:33.826089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:33.827282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:33.840190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.841310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.842354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:33.843126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:33.936915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffcc3ec9-c42a-428b-8200-282cc2e70873 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.115384 Nov 20 20:56:33.943335 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1717/3470] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:33 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:34.230365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'create', calling method: .version_select at 0x7f3f86ec4670>, body: {"keypair": {"name": "tempest-keypair-133730842"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:34.269287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for project 92267796613943d4aa68073d9406f124. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:34.284483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for user 70ba30240bf642ca9728de33322d949b and project 92267796613943d4aa68073d9406f124. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:34.371766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:34.382810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58575d2c-c545-4643-bcea-43f26fbdcea0 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1509 microversion: 2.1 time: 0.827061 Nov 20 20:56:34.385237 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1754/3471] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:33 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1509 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:34.394016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:34.400057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:34.409423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.415327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.416613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.417274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.613207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for project 92267796613943d4aa68073d9406f124. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:34.619961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for user 70ba30240bf642ca9728de33322d949b and project 92267796613943d4aa68073d9406f124. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:34.654116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31b7db07-bdcf-46dd-bca8-5447cc089621 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.689568 Nov 20 20:56:34.655982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1718/3472] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:56:33 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:34.662186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:34.664007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:34.674371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.674658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:34.675802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.676778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.677361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.684562 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54e8b0f6-a0ea-40d6-8418-dc025704db72 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1271 microversion: 2.1 time: 0.297825 Nov 20 20:56:34.692294 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1755/3473] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:34 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1271 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:34.820075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:34.821834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:34.832042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.833611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.839452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:34.840919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:34.842489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:34.850832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a3656dd-d3d8-4bc0-81bf-93be945e804e tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1598 microversion: 2.1 time: 0.192964 Nov 20 20:56:34.851427 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1719/3474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:34 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:34.949353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:34.950404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:34.999803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.000590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.001558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.002003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.173174 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-542eb938-29f7-467c-b351-ff2ca3c2c565 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.207828 Nov 20 20:56:35.173174 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1720/3475] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:35.403728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:35.404586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:35.417764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.420734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.422622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.423838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.849064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:35.857013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:35.859047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b9e32280-e371-429c-be1d-c2f25b677831 tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1509 microversion: 2.1 time: 0.461174 Nov 20 20:56:35.859639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1721/3476] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:35 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1509 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:35.871620 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a3799f7-8f7f-4a26-938f-34b5d8c4d6f2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 1.053204 Nov 20 20:56:35.872425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:35.873058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:35.873241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1756/3477] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:34 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:35.885927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.887673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.889658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.890186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.894023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:35.894970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:35.925038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.929001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:35.930558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:35.932064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.202584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676538dfd9cc42d6bbbae90e6f4c09ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '170ca59a5b074770be63f18691e7aa40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:36.236538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-419d7f74-063b-42fe-8ddb-7d632a8d1a59 tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 200 len: 1598 microversion: 2.1 time: 0.362077 Nov 20 20:56:36.237827 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1757/3478] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:35 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 1598 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:36.246784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b71812cf-c06e-4023-a8f5-3af1d915adad req-1a592cdf-f192-41ea-b849-f9a47dc8bd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8532a29f-7bec-4295-9b06-8b7fda995ac9", "name": "network-vif-unplugged", "status": "completed", "tag": "b7df387f-70cb-41a7-8942-ab9783f9ba75"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:36.260179 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:36.260179 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:36.286712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b71812cf-c06e-4023-a8f5-3af1d915adad req-1a592cdf-f192-41ea-b849-f9a47dc8bd6d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.288759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b71812cf-c06e-4023-a8f5-3af1d915adad req-1a592cdf-f192-41ea-b849-f9a47dc8bd6d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.331728 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b71812cf-c06e-4023-a8f5-3af1d915adad req-1a592cdf-f192-41ea-b849-f9a47dc8bd6d service nova] Creating event network-vif-unplugged:b7df387f-70cb-41a7-8942-ab9783f9ba75 for instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 on nch1-master-1 Nov 20 20:56:36.346978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b71812cf-c06e-4023-a8f5-3af1d915adad req-1a592cdf-f192-41ea-b849-f9a47dc8bd6d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105381 Nov 20 20:56:36.352121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1758/3479] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:36.380478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bd073516-6a51-441a-89a2-7f916e365442 req-c3132517-9985-4da7-9df8-213336320bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "797fe36e-be61-49c1-a438-56124738f92d", "name": "network-vif-deleted", "tag": "8732f318-293e-426d-9e8f-6b1fe937a69e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:36.392470 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:36.392470 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:36.412743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bd073516-6a51-441a-89a2-7f916e365442 req-c3132517-9985-4da7-9df8-213336320bc9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.413566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bd073516-6a51-441a-89a2-7f916e365442 req-c3132517-9985-4da7-9df8-213336320bc9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.433566 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bd073516-6a51-441a-89a2-7f916e365442 req-c3132517-9985-4da7-9df8-213336320bc9 service nova] Creating event network-vif-deleted:8732f318-293e-426d-9e8f-6b1fe937a69e for instance 797fe36e-be61-49c1-a438-56124738f92d on nch1-master-1 Nov 20 20:56:36.444174 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bd073516-6a51-441a-89a2-7f916e365442 req-c3132517-9985-4da7-9df8-213336320bc9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087992 Nov 20 20:56:36.446626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1759/3480] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:36.453460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:36.455863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:36.464638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.466097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.467662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.468322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.533536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54968a3b-ad54-4ff5-acc9-69d6192d0f2a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.084825 Nov 20 20:56:36.534624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1760/3481] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:36 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:36.549959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:36.558296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7994fea3-6650-4cbe-a3ff-86fd3ef859a3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.697590 Nov 20 20:56:36.570544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1722/3482] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:35 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:36.879999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:36.881628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:36.888447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:36.889203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:36.897625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.915018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.916094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.916826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.925521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.926189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:36.933255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:36.933722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.114627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e3f2061e4a4b44b9290f05dc5ca6e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0c564c74644c6baba20a6319cff30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:37.123872 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea7bc701-eb6e-42cf-bb39-aa51bef6317b tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 200 len: 1467 microversion: 2.1 time: 0.248527 Nov 20 20:56:37.124469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1761/3483] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:36 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 1467 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:37.254665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:37.255286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] [instance: 797fe36e-be61-49c1-a438-56124738f92d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:37.261768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.275073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.276284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.276814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.314282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] HTTP exception thrown: Instance 797fe36e-be61-49c1-a438-56124738f92d could not be found. Nov 20 20:56:37.315454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Returning 404 to user: Instance 797fe36e-be61-49c1-a438-56124738f92d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:37.316628 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b94f6fcc-6b13-4047-b8b9-304423898e0d tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d" status: 404 len: 111 microversion: 2.1 time: 0.066387 Nov 20 20:56:37.317999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1762/3484] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:37 2021] GET /compute/v2.1/servers/797fe36e-be61-49c1-a438-56124738f92d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:56:37.341496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91ee302f-b50b-48f2-8646-12502998867f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] Calling method '.version_select at 0x7f3f86230c10>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:37.451513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91ee302f-b50b-48f2-8646-12502998867f tempest-ServersTestFqdnHostnames-244116495 tempest-ServersTestFqdnHostnames-244116495-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481134419" status: 202 len: 0 microversion: 2.1 time: 0.123249 Nov 20 20:56:37.452471 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1763/3485] 10.222.0.41 () {58 vars in 1220 bytes} [Sat Nov 20 20:56:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1481134419 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:37.549555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:37.550741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:37.567494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.569491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.573510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.574777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.649128 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8f50c9a6-e5f0-4a34-9119-f34a144df113 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.106357 Nov 20 20:56:37.659639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1764/3486] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:37 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:37.667066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:37.668882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:37.677473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.679538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.680574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:37.681170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:37.761660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:37.769271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1421c1dc-1470-45ee-8258-cb00289766d0 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1501 microversion: 2.1 time: 0.884427 Nov 20 20:56:37.784985 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1723/3487] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:36 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1501 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:37.895683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-361491484", "imageRef": "3a475ca0-1709-41cb-a601-a23a24a0ee58", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0ac983b9-9a1d-433d-8824-d40a568b3101"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:37.992827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] validate_networks() for [('0ac983b9-9a1d-433d-8824-d40a568b3101', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:38.339550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:38.357804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-685cf9e4-2973-40ea-ab3d-27561b704215 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.696317 Nov 20 20:56:38.364478 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1765/3488] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:37 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:38.536705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1c95bdf3-3959-46f2-8bb8-6af6010d1f43 req-fd464f90-36f3-43c5-90b6-96c7712a96b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2a37d1-6352-4c63-8de6-2e9e94bf609f", "tag": "6171bf54-836b-4b89-9942-130b6f53b7ac"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:38.539063 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:38.539063 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:38.551823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c95bdf3-3959-46f2-8bb8-6af6010d1f43 req-fd464f90-36f3-43c5-90b6-96c7712a96b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.553777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c95bdf3-3959-46f2-8bb8-6af6010d1f43 req-fd464f90-36f3-43c5-90b6-96c7712a96b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.608999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1c95bdf3-3959-46f2-8bb8-6af6010d1f43 req-fd464f90-36f3-43c5-90b6-96c7712a96b0 service nova] Creating event network-changed:6171bf54-836b-4b89-9942-130b6f53b7ac for instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f on nch2-master-1 Nov 20 20:56:38.627908 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1c95bdf3-3959-46f2-8bb8-6af6010d1f43 req-fd464f90-36f3-43c5-90b6-96c7712a96b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259756 Nov 20 20:56:38.634537 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1766/3489] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:38.642187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef6864fa-67a2-4014-a8ed-07b678b6ff48"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:38.644884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:38.661873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.664814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.674084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.674707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.703643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Cannot 'attach_volume' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state rescued Nov 20 20:56:38.704408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 409 to user: Cannot 'attach_volume' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state rescued {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:38.705446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fcdfc00f-88be-4a20-9e06-ba25164f4079 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069425 Nov 20 20:56:38.706456 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1767/3490] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:56:38 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:56:38.711821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:38.712618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] [instance: 8532a29f-7bec-4295-9b06-8b7fda995ac9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:38.719944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.720547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.721567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.722784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.750630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] HTTP exception thrown: Instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 could not be found. Nov 20 20:56:38.751417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] Returning 404 to user: Instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:56:38.752462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f8db3b7c-ffef-44a6-9241-d87745a83dea tempest-ServerPasswordTestJSON-21371417 tempest-ServerPasswordTestJSON-21371417-project] 10.222.0.41 "GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9" status: 404 len: 111 microversion: 2.1 time: 0.044916 Nov 20 20:56:38.753641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1768/3491] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:38 2021] GET /compute/v2.1/servers/8532a29f-7bec-4295-9b06-8b7fda995ac9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:56:38.762941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bdbe7db3-1e19-487f-b06a-2bb47898df6d req-27bca869-9e12-4d9c-a5cc-ff0bf3158a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8532a29f-7bec-4295-9b06-8b7fda995ac9", "name": "network-vif-deleted", "tag": "b7df387f-70cb-41a7-8942-ab9783f9ba75"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:38.766907 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:38.766907 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:38.782914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bdbe7db3-1e19-487f-b06a-2bb47898df6d req-27bca869-9e12-4d9c-a5cc-ff0bf3158a24 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.783532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bdbe7db3-1e19-487f-b06a-2bb47898df6d req-27bca869-9e12-4d9c-a5cc-ff0bf3158a24 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.804540 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bdbe7db3-1e19-487f-b06a-2bb47898df6d req-27bca869-9e12-4d9c-a5cc-ff0bf3158a24 service nova] Creating event network-vif-deleted:b7df387f-70cb-41a7-8942-ab9783f9ba75 for instance 8532a29f-7bec-4295-9b06-8b7fda995ac9 on nch1-master-1 Nov 20 20:56:38.814079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bdbe7db3-1e19-487f-b06a-2bb47898df6d req-27bca869-9e12-4d9c-a5cc-ff0bf3158a24 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058963 Nov 20 20:56:38.814936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1769/3492] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:38.822062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:38.823286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:38.831147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.831754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.832757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.833312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.891183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4758363c-de00-48f7-b82a-0b811541165e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.073853 Nov 20 20:56:38.892335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1770/3493] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:38 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:38.914793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:38.915609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:38.922992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.923614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:38.924543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:38.925093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.048918 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed41932d-4e45-4ca6-838a-ed7c573f1826 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 202 len: 0 microversion: 2.1 time: 0.149483 Nov 20 20:56:39.050041 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1771/3494] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:38 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:39.060662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:39.061289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:39.075011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.076235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.077335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.078089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.374935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:39.376249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:39.377957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:39.378586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:39.379155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:39.395491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.396317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.399608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.400239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.449430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Getting quotas for project a48484c034b44d9bbd058ca3ed927499. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:39.457513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Getting quotas for user 0ae4f3ed0ddb4c2e8475b8b8f1c47c66 and project a48484c034b44d9bbd058ca3ed927499. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:39.490396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:39.496085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a475ca0-1709-41cb-a601-a23a24a0ee58',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:39.579502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c00c7d9-1629-434c-ba82-270e27cb289e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.793079 Nov 20 20:56:39.581598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1724/3495] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:39.588003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:39.589423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:39.599408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.600494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.601683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:39.602273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:39.839227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:39.852073 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25550872-c1ba-444a-a13e-a00156d1f2a3 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1509 microversion: 2.1 time: 0.795415 Nov 20 20:56:39.854625 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1772/3496] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:39 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1509 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:39.869849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54d5187a-bbe3-4349-abfe-e07abef911ad tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:39.870508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54d5187a-bbe3-4349-abfe-e07abef911ad tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:39.947994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:39.961346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53ec2563-58a2-4017-a388-170fe8be1671 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.377214 Nov 20 20:56:39.974889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1725/3497] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:39 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:39.991025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:39.994759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:40.017779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:40.019789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:40.040990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:40.060719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:40.177346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58b355d6-0ba1-4b6a-bd6e-170ade2af84c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.199288 Nov 20 20:56:40.178532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1726/3498] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:39 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:40.803875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54d5187a-bbe3-4349-abfe-e07abef911ad tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:40.811950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54d5187a-bbe3-4349-abfe-e07abef911ad tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1221 microversion: 2.1 time: 0.955978 Nov 20 20:56:40.815718 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1773/3499] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:39 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1221 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:40.875884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:40.877299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:40.887760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:40.888246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:40.889710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:40.891388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:40.991669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:40.992969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:41.012239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.012874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:41.016701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.018132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:41.503967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:41.548632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b36c2be-3ef8-4245-ab9c-9ba5c0c7c4e6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1509 microversion: 2.1 time: 0.683162 Nov 20 20:56:41.559581 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1727/3500] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:40 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:41.578708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:41.582180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:41.619882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.620255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:41.625584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.626099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:41.741736 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af674510-e416-476f-b064-4ac49c2a3b6a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.180293 Nov 20 20:56:41.743006 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1728/3501] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:41 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:41.832764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:41.833394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:41.847816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.848282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:41.849112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:41.849533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:42.027226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:42.035187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe7d7e2a-aa07-4c9c-b388-c85b9894e9f0 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1279 microversion: 2.1 time: 0.206584 Nov 20 20:56:42.051733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1729/3502] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:41 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1279 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:42.332459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:42.349015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef118152-5a63-4aa2-9266-c1e003ab422d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 1.367717 Nov 20 20:56:42.352064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1774/3503] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:40 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:42.573288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:42.574121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:42.591521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:42.593338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:42.594367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:42.600673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:42.754228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:42.755218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:42.770419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:42.770883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:42.772369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:42.772804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:42.887445 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6966d09a-c904-4506-bbce-dfaccc8c21ab tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.136878 Nov 20 20:56:42.888886 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1775/3504] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:42 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:56:43.058407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:43.060233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:43.070237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:43.084896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:43.085763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:43.091863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:43.533149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:43.544116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4ce0c1d-478c-424d-8a31-2edc845c71d9 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1509 microversion: 2.1 time: 0.976156 Nov 20 20:56:43.544890 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1730/3505] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:42 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1509 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:43.563881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:43.566211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:43.583853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:43.585010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:43.587735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:43.588996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:43.664067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:43.679199 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ede8efa-a8df-4dc5-a548-cde60f82ba75 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1279 microversion: 2.1 time: 0.627181 Nov 20 20:56:43.681882 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1776/3506] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:43 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1279 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:43.698161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1823709789", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "40d8ef56-5653-4804-9a84-8afa72f95421"}], "security_groups": [{"name": "tempest-securitygroup--640463386"}], "key_name": "tempest-keypair-133730842", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:44.361142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:44.370074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d9fae14-3c2f-4f72-9cb7-fee17f7073a6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.819326 Nov 20 20:56:44.373392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1731/3507] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:43 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:44.386900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:44.388098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:44.414104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:44.414820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:44.415789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:44.423076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:44.521213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] validate_networks() for [('40d8ef56-5653-4804-9a84-8afa72f95421', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:44.531287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0292ee85-1dac-4b9c-965c-dc1906c0d7d7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.155688 Nov 20 20:56:44.531974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1732/3508] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:44 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:44.563379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:44.564871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:44.586867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:44.587755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:44.589944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:44.593243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.067988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:45.078258 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6700f544-b9ab-4654-b515-c1c83b69c92b tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1509 microversion: 2.1 time: 0.518955 Nov 20 20:56:45.082200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1733/3509] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:44 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1509 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:45.089570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:45.092224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:45.110495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.111346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.112392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.113653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.227420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:45.235572 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c77911a1-8477-486d-839f-3fbdd07ee4d1 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1279 microversion: 2.1 time: 0.151999 Nov 20 20:56:45.237871 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1734/3510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:45 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:45.388093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:45.388705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:45.397743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.397984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.401049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.402573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.930855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:45.947543 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6f6c76f-b156-4f92-9488-fba4e2f8f618 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.561631 Nov 20 20:56:45.948710 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1735/3511] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:45 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:45.965401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:45.979067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:45.985713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.986556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:45.988734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:45.989336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:46.085213 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb8b43ba-baa1-48ad-8ece-bc3ecf0d16b9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.134442 Nov 20 20:56:46.088306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1736/3512] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:45 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:46.105503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:46.106417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:46.123233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:46.125189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:46.126838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:46.127589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:46.982452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for project 92267796613943d4aa68073d9406f124. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:47.002523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for user 70ba30240bf642ca9728de33322d949b and project 92267796613943d4aa68073d9406f124. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:47.065396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:47.065894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:47.066419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:47.066825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:47.067672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:47.104151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.104151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.104151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.108753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.159350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for project 92267796613943d4aa68073d9406f124. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:47.179199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Getting quotas for user 70ba30240bf642ca9728de33322d949b and project 92267796613943d4aa68073d9406f124. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:47.196627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:47.199338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:47.283704 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c864eb49-d31c-4512-9bf3-6f17967421b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.598697 Nov 20 20:56:47.291096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1777/3513] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:43 2021] POST /compute/v2.1/servers => generated 408 bytes in 3608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:47.296536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:47.297366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:47.321050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.321743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.322921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.323272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.545921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:47.559358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b300df5d-d980-4ac5-834b-594a94664e14 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1515 microversion: 2.1 time: 1.462925 Nov 20 20:56:47.572278 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1737/3514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:46 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1515 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:47.577966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-071fb89a-b808-46ea-ab7c-6a5bef5ecb2b req-bf30b70a-ea08-40c7-97be-bff4889097d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a37d1-6352-4c63-8de6-2e9e94bf609f", "name": "network-vif-plugged", "status": "completed", "tag": "6171bf54-836b-4b89-9942-130b6f53b7ac"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:47.582236 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:47.582236 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:56:47.607466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-071fb89a-b808-46ea-ab7c-6a5bef5ecb2b req-bf30b70a-ea08-40c7-97be-bff4889097d7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.607938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-071fb89a-b808-46ea-ab7c-6a5bef5ecb2b req-bf30b70a-ea08-40c7-97be-bff4889097d7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.633062 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-071fb89a-b808-46ea-ab7c-6a5bef5ecb2b req-bf30b70a-ea08-40c7-97be-bff4889097d7 service nova] Creating event network-vif-plugged:6171bf54-836b-4b89-9942-130b6f53b7ac for instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f on nch2-master-1 Nov 20 20:56:47.664062 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-071fb89a-b808-46ea-ab7c-6a5bef5ecb2b req-bf30b70a-ea08-40c7-97be-bff4889097d7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100015 Nov 20 20:56:47.664687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1738/3515] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:47.694874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:47.701829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:47.723860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.726951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:47.732710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:47.733526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:48.456850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:48.467950 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68d495d1-9bd8-4413-989a-42c6788bfa1f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.795823 Nov 20 20:56:48.469752 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1739/3516] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:47 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:48.485314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:48.488019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:48.505480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:48.506339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:48.509126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:48.509747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:48.595346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95311f81-01a5-433b-9638-7007ff22957a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.122580 Nov 20 20:56:48.596005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1740/3517] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:48 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:48.607514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:48.612396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:48.627424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:48.629032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:48.630415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:48.632314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:48.766809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:48.778086 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36e7f575-21e5-4960-965c-7f0693a0bda2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1273 microversion: 2.1 time: 0.180283 Nov 20 20:56:48.781107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1741/3518] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:48 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:49.226610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:49.227064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:49.238774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:49.239332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:49.240090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:49.245393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:49.444921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:49.471603 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf1d1e5b-05d9-495d-aa56-fafdf07f8bd5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 2.178990 Nov 20 20:56:49.472438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1778/3519] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:47 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:49.493594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:49.496297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:49.521943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:49.539864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:49.539864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:49.539864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.090307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:50.105374 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ee43b2da-667d-4b48-a9f8-2a42adcbe798 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1515 microversion: 2.1 time: 0.883324 Nov 20 20:56:50.123691 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1742/3520] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:49 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1515 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:50.131501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:50.132660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:50.148391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.149351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.155059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.155711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.165490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:50.182379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85db2a35-68dd-41f5-a80b-aa2da15c406b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1313 microversion: 2.1 time: 0.691277 Nov 20 20:56:50.184143 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1779/3521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:49 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:50.210002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:50.211104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:50.234764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.238523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.239478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.240503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.247485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c615199-c0c8-4ad1-8e52-d48671c075bd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.119925 Nov 20 20:56:50.248166 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1743/3522] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:50 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:50.261001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402ed45c-bf42-47f0-9c9a-8a03020d88ea"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:50.267880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:50.280309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.286890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.289043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.289638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.568020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:50.581386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a3e301b-020c-4e31-9466-df167f10ede1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1335 microversion: 2.1 time: 0.395343 Nov 20 20:56:50.596278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1780/3523] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:50 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1335 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:50.601875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:50.605839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:50.627421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.632356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.633526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:50.634248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:50.765801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31eb37e1-2ac0-45c3-ab0f-8ea2b4a4a46c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515762 Nov 20 20:56:50.766954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1744/3524] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:56:50 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:51.309964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-909541606", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:51.413271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:51.676834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:51.694120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5f9b4a0-550a-41b8-a630-e8ef879c8431 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 1.095373 Nov 20 20:56:51.696823 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1781/3525] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:50 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:51.710809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:51.714668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:51.740782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:51.741352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:51.743506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:51.743990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.160974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:53.169335 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47e8f996-9f31-43f4-800e-cf2641865778 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1501 microversion: 2.1 time: 1.470970 Nov 20 20:56:53.175100 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1782/3526] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:51 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1501 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:53.186536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:53.187899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:53.195137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:53.196232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:53.200143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:53.201194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:53.202037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:53.205907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.209676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.213113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.213794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.235805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.236256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.244249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.245841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.305945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:53.311036 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa75d416-b739-41c5-ab22-de5161a744e9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.133893 Nov 20 20:56:53.311715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1783/3527] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:53 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:53.315412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:53.351369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:53.354606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:53.364549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:53.371314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:53.380949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.381584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.402759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.403264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.481578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d30b5a5b-cb99-4bc2-9e78-a313da460f0b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.497706 Nov 20 20:56:53.485974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1745/3528] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:56:53.510780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:53.527404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:53.539178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.539946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:53.540962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:53.543365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.062285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:54.070680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed4ce587-ef70-4caf-a7b2-0776a280a5d3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.565685 Nov 20 20:56:54.075145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1746/3529] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:53 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:54.082267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:54.083336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:54.100351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.101331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.118558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.121500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.184642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lazy-loading 'flavor' on Instance uuid 9a2a37d1-6352-4c63-8de6-2e9e94bf609f {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:56:54.312501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:54.329626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fa2d570-468d-4f4b-9616-8f531de518b1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 1.000766 Nov 20 20:56:54.335308 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1784/3530] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:53 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:54.340160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:54.340916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:54.362331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.362779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.363574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.364010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.558828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:54.571261 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a30339fb-bf14-46f1-be5a-2c5233faa57d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1196 microversion: 2.1 time: 0.234744 Nov 20 20:56:54.582259 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1785/3531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:54 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1196 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:54.587870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ff20a995-f153-40d0-9952-437d8b48d856 req-f2337cda-c790-42f7-aa54-0967198238ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e32689d1-8986-4ec5-84e2-f28bf3843085", "tag": "dfd54190-c8a6-40d7-b314-29f7df09fc83"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:54.589796 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:54.589796 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:54.598350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ff20a995-f153-40d0-9952-437d8b48d856 req-f2337cda-c790-42f7-aa54-0967198238ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.599199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ff20a995-f153-40d0-9952-437d8b48d856 req-f2337cda-c790-42f7-aa54-0967198238ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.613233 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ff20a995-f153-40d0-9952-437d8b48d856 req-f2337cda-c790-42f7-aa54-0967198238ea service nova] Creating event network-changed:dfd54190-c8a6-40d7-b314-29f7df09fc83 for instance e32689d1-8986-4ec5-84e2-f28bf3843085 on nch1-master-1 Nov 20 20:56:54.618716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ff20a995-f153-40d0-9952-437d8b48d856 req-f2337cda-c790-42f7-aa54-0967198238ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034947 Nov 20 20:56:54.619631 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1786/3532] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:54.626441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:54.628212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:54.639155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.640794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.643697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.644306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.757346 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a1fd4b2-9b6b-47c9-9f67-e48256b95179 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.133518 Nov 20 20:56:54.759897 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1787/3533] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:54 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:54.778569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7e8c764f-6436-4a8a-853b-2bd33cb482bb req-3c1b9ce2-570e-4a80-bafb-9f01121d9afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5cd44f-7bf8-498d-96f4-76d5039c2cc3", "tag": "47ef466b-1a47-4f4e-91bb-96045db695b3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:54.780075 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:56:54.780075 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:56:54.799417 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6b222dd-5632-4578-9dcd-548310d77737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f/action" status: 202 len: 0 microversion: 2.1 time: 0.722418 Nov 20 20:56:54.800548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7e8c764f-6436-4a8a-853b-2bd33cb482bb req-3c1b9ce2-570e-4a80-bafb-9f01121d9afd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.801198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7e8c764f-6436-4a8a-853b-2bd33cb482bb req-3c1b9ce2-570e-4a80-bafb-9f01121d9afd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.805787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1747/3534] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:54 2021] POST /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:54.814309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:54.819183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:54.834707 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7e8c764f-6436-4a8a-853b-2bd33cb482bb req-3c1b9ce2-570e-4a80-bafb-9f01121d9afd service nova] Creating event network-changed:47ef466b-1a47-4f4e-91bb-96045db695b3 for instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 on nch2-master-1 Nov 20 20:56:54.844442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7e8c764f-6436-4a8a-853b-2bd33cb482bb req-3c1b9ce2-570e-4a80-bafb-9f01121d9afd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070284 Nov 20 20:56:54.849092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1788/3535] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:56:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:56:54.860897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.861172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:54.862229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:54.862820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.089747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:55.090832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:55.097276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.097725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.098625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.099059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.137542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:55.148802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f660964-8a51-4624-a2bc-68aefd12d24f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.338825 Nov 20 20:56:55.151790 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1748/3536] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:54 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:55.348315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:55.348992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:55.363633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.364340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.365817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.367539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.671121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:55.680602 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a5e91f9-5cd1-4f88-936d-bc48db571651 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.336285 Nov 20 20:56:55.681863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1749/3537] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:55 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:55.687180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:55.688273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:55.695499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.696080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.697073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.697522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.723316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lazy-loading 'flavor' on Instance uuid 293ef3df-319d-4bc8-8921-ed7b90ab89c9 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:56:55.877450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb9ed630-1f25-4a65-a1e5-15a08c4be423 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 200 len: 32 microversion: 2.1 time: 0.193873 Nov 20 20:56:55.879450 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1750/3538] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:56:55 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:56:55.886445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:55.887264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:55.894654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.895205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:55.896960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:55.897858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.001641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:56.014760 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b262fb0-1329-42f6-a0ff-0cc1606ee0a8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1250 microversion: 2.1 time: 0.134827 Nov 20 20:56:56.015731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1751/3539] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:55 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1250 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:56.022316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:56.023508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:56.032982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.033886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.035747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.036353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.098535 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-158c1f7d-5726-4b65-a9ad-fe6074739555 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.080451 Nov 20 20:56:56.100468 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1752/3540] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:56 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:56.106997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:56.108335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:56.118686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.119396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.120501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.121571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.348939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:56.358684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4013f070-ded7-422d-bc97-be578a15a97c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 1.274227 Nov 20 20:56:56.359382 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1789/3541] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:55 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:56.365594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:56.366726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:56.375342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.376074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.377076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.377520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.714709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:56.723260 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7eebab3a-2080-4b7b-b119-36282ba646ae tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.621284 Nov 20 20:56:56.723834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1753/3542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:56 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:56.728280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:56.728955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:56.736688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.737136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.737921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:56.738503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:56.981967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:56.992471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59e3d280-6895-442e-8cce-b714828d4693 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.267112 Nov 20 20:56:56.993157 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1754/3543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:56 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:57.033318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:57.037528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:57.044368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.044647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.045982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.046518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.119776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:57.132610 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-386f3bac-b416-40bd-ab7f-14a50e0e0cd9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1250 microversion: 2.1 time: 0.102900 Nov 20 20:56:57.142075 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1755/3544] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:57 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:57.142075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:57.142075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:57.153265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.153897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.154818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.155315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.219845 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72e111e2-9426-4dce-af5d-2d8502bfe31c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.084758 Nov 20 20:56:57.222091 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1756/3545] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:57 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:57.293909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:57.305407 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1975390-af72-4f20-ab8d-52128bd0440d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.944094 Nov 20 20:56:57.306293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1790/3546] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:56 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:57.377478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:57.378424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:57.387096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.387807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.388680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.389194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.583469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:57.595715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab62c6c8-493e-4064-98ce-cd7756fdc42a tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.222326 Nov 20 20:56:57.597755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1757/3547] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:57 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:57.743029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:57.745346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:57.755295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.756057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.757042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:57.757664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:57.842805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1421936701", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "4398eff6-6bef-490d-9c6c-f0e927a465b8"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:57.897182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] validate_networks() for [('4398eff6-6bef-490d-9c6c-f0e927a465b8', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:56:57.921479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:57.930357 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37cf9fff-d464-4c29-bb38-2912f9b2c09f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.192424 Nov 20 20:56:57.931068 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1758/3548] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:57 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:58.008914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:58.009756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.017353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.017879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.018760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.019259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.167409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:58.176302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57842fe3-934b-47e6-ba21-6f6bb7e4ff3f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.170974 Nov 20 20:56:58.178789 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1759/3549] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:58 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:58.184164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:58.185130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.191396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.191931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.192826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.194006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.264491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:58.271897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8fb90be1-df56-415c-8317-97b5551d23e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1250 microversion: 2.1 time: 0.091743 Nov 20 20:56:58.272680 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1760/3550] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:58 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:58.284981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:58.285976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.294430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.294966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.295818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.296372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.347537 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-497c81ab-a32c-40d8-8059-696d0a18265e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.073608 Nov 20 20:56:58.349077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1761/3551] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:58 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:58.357596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:58.358301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.367749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.368265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.369085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.369514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.543690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:58.552419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad3113e8-06a8-4475-a4e4-827d4d3289e1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.202876 Nov 20 20:56:58.553160 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1762/3552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:58 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:58.614525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:58.615412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.621511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.621963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.622792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.623232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.773430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:58.787756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a1148af-9615-467a-aa6b-81b4e8be8709 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.176395 Nov 20 20:56:58.803658 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1763/3553] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:58 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:58.948153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:58.948882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:58.955527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.955984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:58.956772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:58.957208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.091034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:59.098830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aab738e8-5e88-4fae-9e71-c317c4c57222 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.154687 Nov 20 20:56:59.101290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1764/3554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:58 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:56:59.194245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:59.194948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.201121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.201636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.202506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.203030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.355063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:59.363447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54f1d357-a795-4669-acbf-8996280e9ce6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.173113 Nov 20 20:56:59.373450 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1765/3555] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:59 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:59.373450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:59.373450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.376028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.376575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.377430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.377939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.520131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:59.528205 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0acf1d0-f3de-46b3-a463-9d7bd9cd3f73 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.162704 Nov 20 20:56:59.528980 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1766/3556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:59 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:59.542751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:56:59.543818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.549964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.550444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.551563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.551683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.595970 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b9c8a15-0d8b-4b8a-91f5-ae73b3904ed9 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.056675 Nov 20 20:56:59.596635 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1767/3557] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:56:59 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:56:59.603109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:59.604340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.611085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.611528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.612312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.612738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.671208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:56:59.671988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:56:59.674329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:56:59.674994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:56:59.678980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:56:59.699456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.699930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.702791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.703268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.730124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Getting quotas for project 2f55329346e94280a9753271c6ec6c15. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:56:59.736996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Getting quotas for user 2400f0c35eb34648b051d3aa8312ef9f and project 2f55329346e94280a9753271c6ec6c15. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:56:59.756082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:56:59.760231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:56:59.783677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:56:59.797810 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8810c476-d5e4-4b51-ac52-d6d071362cc1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.199743 Nov 20 20:56:59.799011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1768/3558] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:59 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:56:59.815667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:59.816415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.822197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3cbac4a9-1813-4eff-9a8b-363dcc1937be tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114513 Nov 20 20:56:59.823214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1791/3559] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:56:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:56:59.830515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.833698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d28e761-b615-4ff5-a8e5-7905c15582b3 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:56:59.834828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d28e761-b615-4ff5-a8e5-7905c15582b3 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:56:59.835066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:56:59.836908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:56:59.837715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.012115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:00.025856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7df819a-ae55-4acb-babe-c03a80ac8370 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.213366 Nov 20 20:57:00.030115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1769/3560] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:59 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:00.055530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d28e761-b615-4ff5-a8e5-7905c15582b3 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:00.063028 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d28e761-b615-4ff5-a8e5-7905c15582b3 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1225 microversion: 2.1 time: 0.233174 Nov 20 20:57:00.063611 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1792/3561] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:56:59 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1225 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:00.119749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:00.121957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:00.131727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.132750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.133886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.134736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.308706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:00.321220 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e465f6c5-53f8-4542-b5da-a03d4294763a tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.207823 Nov 20 20:57:00.332941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1770/3562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:00 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:00.381345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:00.382036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:00.392270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fce71828-4361-4bb6-86fc-0df99607a9e2 req-99f68a80-00a6-43d9-9222-8330a6d3afaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5cd44f-7bf8-498d-96f4-76d5039c2cc3", "name": "network-vif-plugged", "status": "completed", "tag": "47ef466b-1a47-4f4e-91bb-96045db695b3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:00.394968 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:00.394968 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:00.401946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.402857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.404094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.404513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.405572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fce71828-4361-4bb6-86fc-0df99607a9e2 req-99f68a80-00a6-43d9-9222-8330a6d3afaf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.406223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fce71828-4361-4bb6-86fc-0df99607a9e2 req-99f68a80-00a6-43d9-9222-8330a6d3afaf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.443872 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fce71828-4361-4bb6-86fc-0df99607a9e2 req-99f68a80-00a6-43d9-9222-8330a6d3afaf service nova] Creating event network-vif-plugged:47ef466b-1a47-4f4e-91bb-96045db695b3 for instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 on nch2-master-1 Nov 20 20:57:00.452701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fce71828-4361-4bb6-86fc-0df99607a9e2 req-99f68a80-00a6-43d9-9222-8330a6d3afaf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066875 Nov 20 20:57:00.454559 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1771/3563] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:57:00.546592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:00.547401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:00.556889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.557337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.558370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.558815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.713896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:00.721829 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86527f6d-fcf4-4918-bf7b-46b93519882b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.180295 Nov 20 20:57:00.722461 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1772/3564] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:00 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:00.728186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:00.729372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:00.736095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.736541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.737348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.737786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.783885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f21535e-3624-4921-b009-00b120a41784 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.060115 Nov 20 20:57:00.784634 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1773/3565] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:00 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:00.815713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:00.816353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:00.823542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.823995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.824792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:00.825282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:00.978439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:00.986476 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d737388-cb0f-4395-9972-7c637582afa2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.174571 Nov 20 20:57:00.989883 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1774/3566] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:00 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:01.043885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:01.044845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:01.051626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.052263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.053226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.053654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.204135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:01.212455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-146c545f-25da-4d6f-9cd2-43806604c9f8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.172306 Nov 20 20:57:01.213253 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1775/3567] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:01 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:01.227134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:01.227745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:01.233852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.234344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.235127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.235564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.299182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:01.306746 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78c3fe02-5846-4c31-9f5b-1032fd19f3ac tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1283 microversion: 2.1 time: 0.083304 Nov 20 20:57:01.307342 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1776/3568] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:01 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:01.324533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:01.332338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-852f7f34-3fdb-4c1c-9820-887e3dc5b9b8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.955197 Nov 20 20:57:01.333294 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1793/3569] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:00 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:01.345836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:01.346635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:01.353354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.353923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.354900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.355409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.531533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:01.544591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc3c36ad-b8f8-4d86-9c0f-fc369e1d8856 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.202043 Nov 20 20:57:01.555132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1777/3570] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:01 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:01.742033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:01.743212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:01.767656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.768358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.772415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.773234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.797412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:01.798601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:01.806163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.807952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.809178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:01.809816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:01.861357 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1676ed02-f632-4cb6-bc2e-12222772b236 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.067999 Nov 20 20:57:01.862626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1778/3571] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:01 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:57:02.007218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:02.008353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.020533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.021361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.022792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.023471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.232759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:02.240770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd6a7165-3ccf-473a-8844-9e1477c3b49c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.504736 Nov 20 20:57:02.250886 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1794/3572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:01 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:02.255729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:02.256559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.263830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.264528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.265708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.266424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.305735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:02.314632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2f3eb8f-c823-4804-8951-b77841f47804 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.313560 Nov 20 20:57:02.325731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1779/3573] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:01 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:02.334171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:02.334171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.341505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.342138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.343343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.343580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.419236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:02.426949 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7e581bf-b6c7-4f50-a0f8-d4fee5cf4101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1283 microversion: 2.1 time: 0.099258 Nov 20 20:57:02.434170 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1780/3574] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:02 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:02.435295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:02.435295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.451807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.453109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.463808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.464436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.747276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:02.754641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-80b411c0-1b2f-44ae-9665-b85236b3e942 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1402 microversion: 2.1 time: 0.324705 Nov 20 20:57:02.755533 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1781/3575] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:02 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1402 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:02.759830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3443f96d-308e-44e8-b7c7-8d0eb00af511 req-12230a71-d02d-424e-8ff1-9fada1931db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a3106c1-4741-490e-aa46-7f3e6614fdd1", "tag": "f8de97a0-2799-4c39-82a8-566fd2fe46e8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:02.761370 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:02.761370 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:02.769148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3443f96d-308e-44e8-b7c7-8d0eb00af511 req-12230a71-d02d-424e-8ff1-9fada1931db0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.769662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3443f96d-308e-44e8-b7c7-8d0eb00af511 req-12230a71-d02d-424e-8ff1-9fada1931db0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.782388 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3443f96d-308e-44e8-b7c7-8d0eb00af511 req-12230a71-d02d-424e-8ff1-9fada1931db0 service nova] Creating event network-changed:f8de97a0-2799-4c39-82a8-566fd2fe46e8 for instance 1a3106c1-4741-490e-aa46-7f3e6614fdd1 on nch1-master-1 Nov 20 20:57:02.790443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:02.792070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3443f96d-308e-44e8-b7c7-8d0eb00af511 req-12230a71-d02d-424e-8ff1-9fada1931db0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030305 Nov 20 20:57:02.795485 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1782/3576] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:02.801020 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aad4a510-2e4d-4cb1-88b8-3516dca84ab9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.548620 Nov 20 20:57:02.810084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:02.810084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.810703 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1795/3577] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:02 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:02.817042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.817635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.819134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.819819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.874477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:02.875559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:02.883434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.884199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.885205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:02.885902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:02.942953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76213d48-06d3-4d80-93b5-d39ff8df7a40 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.071472 Nov 20 20:57:02.944551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1796/3578] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:02 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:03.132890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:03.144759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7849bc56-bc56-4171-a1e4-f10e8d191302 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.347462 Nov 20 20:57:03.157530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1783/3579] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:02 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:03.258871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:03.259841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:03.267269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.267731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.268536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.268994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.335603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:03.336722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:03.350496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.351368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.352732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.353300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.826154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:03.835905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d281c44-0ef3-43e6-a8e7-b248c6aa9e2e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.506589 Nov 20 20:57:03.836643 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1784/3580] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:03 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:03.851136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:03.852041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:03.858726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.859470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.860591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:03.861472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:03.985332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:03.993450 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87442045-f4bc-4d34-a2d8-907f37423d6c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.739115 Nov 20 20:57:04.003576 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1797/3581] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:03 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:04.009199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-46587e65-5dd9-466a-8c3e-f00ee7eebf0b req-5886029f-7675-491c-9381-c4a04f031d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32689d1-8986-4ec5-84e2-f28bf3843085", "name": "network-vif-plugged", "status": "completed", "tag": "dfd54190-c8a6-40d7-b314-29f7df09fc83"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:04.010717 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:04.010717 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:04.020385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-46587e65-5dd9-466a-8c3e-f00ee7eebf0b req-5886029f-7675-491c-9381-c4a04f031d17 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.020835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-46587e65-5dd9-466a-8c3e-f00ee7eebf0b req-5886029f-7675-491c-9381-c4a04f031d17 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.036202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-46587e65-5dd9-466a-8c3e-f00ee7eebf0b req-5886029f-7675-491c-9381-c4a04f031d17 service nova] Creating event network-vif-plugged:dfd54190-c8a6-40d7-b314-29f7df09fc83 for instance e32689d1-8986-4ec5-84e2-f28bf3843085 on nch1-master-1 Nov 20 20:57:04.042743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-46587e65-5dd9-466a-8c3e-f00ee7eebf0b req-5886029f-7675-491c-9381-c4a04f031d17 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037364 Nov 20 20:57:04.043992 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1798/3582] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:04.051269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:04.052585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.060212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.060907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.062653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.063111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.137590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:04.152479 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1654f562-8b83-4d7a-a250-28b829414356 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.305341 Nov 20 20:57:04.153408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1785/3583] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:03 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:04.166851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:04.167795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.178881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.179612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.181084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.182324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.441956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:04.450310 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e3c141b-d046-455d-9683-d253696e5a1e tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.295117 Nov 20 20:57:04.467884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1786/3584] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:04 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:04.472834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:04.473813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.480786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.481067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.481859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.482336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.535025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b722dceb-3d47-4ec6-8974-bbfc5ab801c5 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.065619 Nov 20 20:57:04.535727 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1787/3585] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:04 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:04.545106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:04.546501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.561015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.561601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.562786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.563233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.777028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:04.794828 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b48ec53f-90b7-4bad-9157-c9f5639528ea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1589 microversion: 2.1 time: 0.748626 Nov 20 20:57:04.806312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1799/3586] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:04 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1589 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:04.811909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:04.812085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:04.812759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.823295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.830226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df0c0c6b-9fe7-4d7c-ad37-4365f1a968da tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.290507 Nov 20 20:57:04.830873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.831949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.832631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.841365 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1788/3587] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:04 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:04.863184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:04.863811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:04.877036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.878797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:04.881269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:04.882669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.086396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b417db3c-eb85-413d-936b-80e4f5d3fd9e tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278546 Nov 20 20:57:05.088412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1800/3588] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:57:04 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:05.094717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:05.096422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:05.106235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.107249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.108561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.111548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.118621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:05.135202 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8043ae4-60b0-4cbf-bc70-cbeb5cf78f49 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.283833 Nov 20 20:57:05.137716 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1789/3589] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:04 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:05.171052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:05.171872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:05.179219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.179652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.180453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.180895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.639592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:05.648633 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d6c6ca52-fb11-4d22-86c7-a438a3bca231 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.558642 Nov 20 20:57:05.649465 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1801/3590] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:05 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:05.658493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:05.665926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66af0872-d6a8-45ee-9b58-4c5e533f518b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.499441 Nov 20 20:57:05.675345 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1790/3591] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:05 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:05.675345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:05.675345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:05.676675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:05.677540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:05.684749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.685885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.687270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.688082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.689914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.690080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.699541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.700022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.779901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e02f9cdc-d732-4651-8ca0-f870a406ef72 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.110975 Nov 20 20:57:05.786253 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1791/3592] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:05 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:05.850438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:05.852121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:05.861723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.863168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.864362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:05.865112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:05.998847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:06.009745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89f47c06-4c5c-45cc-88db-f1c518894937 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1321 microversion: 2.1 time: 0.348869 Nov 20 20:57:06.010460 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1802/3593] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:05 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:06.015067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-210a5c50-a17c-4d05-a194-628a8361d4a6 req-84e43586-57b0-41a7-bde0-ff18a98b6abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2", "tag": "1e49a5ca-01de-4fd7-a80d-a16b40d7edaa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:06.017120 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:06.017120 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:06.025216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-210a5c50-a17c-4d05-a194-628a8361d4a6 req-84e43586-57b0-41a7-bde0-ff18a98b6abf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.025933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-210a5c50-a17c-4d05-a194-628a8361d4a6 req-84e43586-57b0-41a7-bde0-ff18a98b6abf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.038885 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-210a5c50-a17c-4d05-a194-628a8361d4a6 req-84e43586-57b0-41a7-bde0-ff18a98b6abf service nova] Creating event network-changed:1e49a5ca-01de-4fd7-a80d-a16b40d7edaa for instance 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 on nch1-master-1 Nov 20 20:57:06.044417 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-210a5c50-a17c-4d05-a194-628a8361d4a6 req-84e43586-57b0-41a7-bde0-ff18a98b6abf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Nov 20 20:57:06.045511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1803/3594] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:06.155750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:06.156448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:06.163006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.163455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.164248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.164852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.405751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:06.414784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e07bd18-679a-4bd8-a352-2c44b7f8498b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.263372 Nov 20 20:57:06.424673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1804/3595] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:06 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:06.521049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:06.535224 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56c787cc-8eeb-4fd7-aec4-96a8151c17c7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.690359 Nov 20 20:57:06.536129 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1792/3596] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:05 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:06.666802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:06.667718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:06.674041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.674808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.675749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.676379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.685054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:06.686467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:06.697827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.698323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.699143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:06.699587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:06.996538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:07.004737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a35973b1-2947-480f-849f-62f82fe8dd63 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.324922 Nov 20 20:57:07.006835 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1793/3597] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:06 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:07.011662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:07.012575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:07.019602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.020254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.021531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.022268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.071459 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f74b0d8-8268-447a-a804-2accf5710651 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.062880 Nov 20 20:57:07.072598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1794/3598] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:07 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:07.079759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:07.080612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:07.087990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.088576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.089474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.090008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.325059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:07.332708 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-317a42e2-f1cc-42dd-9504-0a68b90e872c tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1506 microversion: 2.1 time: 0.258287 Nov 20 20:57:07.333494 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1795/3599] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:07 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:07.337967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:07.339157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:07.357761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.359293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.362720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.366856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.420144 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62ff4659-fc62-4b4f-9ef3-d16a15c41b46 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.085271 Nov 20 20:57:07.424199 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1796/3600] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:07 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:07.433173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a22504b2-a211-4d72-a671-33db1c93312f req-bb8c1b45-a27f-4226-bf53-d91d52a6fbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5cd44f-7bf8-498d-96f4-76d5039c2cc3", "tag": "47ef466b-1a47-4f4e-91bb-96045db695b3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:07.435227 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:07.435227 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:07.437426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:07.446413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a22504b2-a211-4d72-a671-33db1c93312f req-bb8c1b45-a27f-4226-bf53-d91d52a6fbe7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.447541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a22504b2-a211-4d72-a671-33db1c93312f req-bb8c1b45-a27f-4226-bf53-d91d52a6fbe7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.456329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-500ac346-bfc2-4760-bea5-06c52700ac45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.792725 Nov 20 20:57:07.461437 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1805/3601] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:06 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:07.464300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a22504b2-a211-4d72-a671-33db1c93312f req-bb8c1b45-a27f-4226-bf53-d91d52a6fbe7 service nova] Creating event network-changed:47ef466b-1a47-4f4e-91bb-96045db695b3 for instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 on nch2-master-1 Nov 20 20:57:07.467475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:07.472680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a22504b2-a211-4d72-a671-33db1c93312f req-bb8c1b45-a27f-4226-bf53-d91d52a6fbe7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045168 Nov 20 20:57:07.474605 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1797/3602] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:07.479328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:07.501592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.502077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.502871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.503301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.557852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:07.558629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:07.567496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.569191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.570475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:07.571351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:07.806731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:07.840827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1048b446-dd6c-4a2f-8202-976d24697eba tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.286491 Nov 20 20:57:07.854927 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1798/3603] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:07 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:07.962039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:07.973280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54ab592d-3652-40d7-8393-b1375549767c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.510355 Nov 20 20:57:07.973866 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1806/3604] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:07 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:08.024819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:08.025306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:08.037924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.038737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.040993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.042937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.084708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:08.085801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:08.102467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.102937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.104557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.105009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.231981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84a30244-e2d5-4b92-9920-3e076b20aade tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.148069 Nov 20 20:57:08.233122 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1807/3605] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:08 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:08.400754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:08.410005 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78738aa3-8674-4a75-869b-8bae555edcbf tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.388980 Nov 20 20:57:08.410005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1799/3606] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:08 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:08.433984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:08.435233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:08.443853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.444979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.446348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.447017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.474655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:08.476548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:08.486240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.488833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.494129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.495269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.516911 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfa4b51b-d4c6-4c23-b262-715caec557ac tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.087456 Nov 20 20:57:08.520283 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1808/3607] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:08 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:08.764758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:08.774140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-84e470f4-d80f-46e5-9b18-36e3ff7c308b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.302951 Nov 20 20:57:08.782573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1800/3608] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:08 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:08.861236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:08.861953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:08.870473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.871212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.872874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:08.873651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:08.991213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0687cab0-7083-48c0-afcd-34197a5e0e13"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:08.993680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.007897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.008384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.009303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.009782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.090950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:09.108057 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d1d7ec5-3607-4173-8a61-61b35a133012 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.249165 Nov 20 20:57:09.119280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1809/3609] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:08 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:09.124769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:09.125385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.133452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.134225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.135788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.136404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.329837 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fce6dc0e-cce7-45d8-9a93-5166347e30e3 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "POST /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343327 Nov 20 20:57:09.331117 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1801/3610] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 20:57:08 2021] POST /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:09.337979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:09.346277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:09.349130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.354589 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b41ae78-2af2-4ea5-9c51-76edc9f9b53a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.233424 Nov 20 20:57:09.355651 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1810/3611] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:09 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:09.364789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.364789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.364789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.364789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.421029 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bab06d25-035e-4f45-80e7-17c917975ae1 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.081095 Nov 20 20:57:09.422846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1802/3612] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:09 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:09.428238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:09.428856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.435607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.435992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.436877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.437246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.529141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:09.530288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.541633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.546593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.547544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.548075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.611309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-081aa02d-d79b-4455-ae63-1405fa1793b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.087013 Nov 20 20:57:09.612663 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1803/3613] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:09 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:09.652652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:09.661980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c991e67e-7797-446d-914b-eea997864116 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.237220 Nov 20 20:57:09.665580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1811/3614] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:09 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:09.793089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:09.793900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:09.800628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.806470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:09.807490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:09.808589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.035184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ae10cf20-3385-44d0-bedc-2caf7b3aa8d4 req-cd3bfe40-d528-4b5b-b5a9-23db7a0c7b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3106c1-4741-490e-aa46-7f3e6614fdd1", "name": "network-vif-plugged", "status": "completed", "tag": "f8de97a0-2799-4c39-82a8-566fd2fe46e8"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:10.037676 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:10.037676 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:10.048189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ae10cf20-3385-44d0-bedc-2caf7b3aa8d4 req-cd3bfe40-d528-4b5b-b5a9-23db7a0c7b2d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.048970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ae10cf20-3385-44d0-bedc-2caf7b3aa8d4 req-cd3bfe40-d528-4b5b-b5a9-23db7a0c7b2d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.061794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ae10cf20-3385-44d0-bedc-2caf7b3aa8d4 req-cd3bfe40-d528-4b5b-b5a9-23db7a0c7b2d service nova] Creating event network-vif-plugged:f8de97a0-2799-4c39-82a8-566fd2fe46e8 for instance 1a3106c1-4741-490e-aa46-7f3e6614fdd1 on nch1-master-1 Nov 20 20:57:10.068742 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ae10cf20-3385-44d0-bedc-2caf7b3aa8d4 req-cd3bfe40-d528-4b5b-b5a9-23db7a0c7b2d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036354 Nov 20 20:57:10.070027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1812/3615] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:57:10.128047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:10.128757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:10.146901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.147525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.148522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.149144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.364349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:10.374848 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cfce4f18-9f65-40e1-bd38-5a9c612c24d1 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.250639 Nov 20 20:57:10.385312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1813/3616] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:10 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:10.390589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:10.391586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:10.399250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.399710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.400637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.401597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.627617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:10.641627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:10.645178 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25a53388-571e-4e32-ac82-3a2f4c7a68f5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.258541 Nov 20 20:57:10.650734 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53fbffdc-ebe9-4beb-adbb-8c9e5708ecd7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1292 microversion: 2.1 time: 0.861934 Nov 20 20:57:10.651401 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1804/3617] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:09 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1292 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:10.656253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:10.657525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:10.665739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.666536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.667629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.668142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.672149 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1814/3618] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:10 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:10.682159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:10.684197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:10.691514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.692172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.693073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.693733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.740792 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-10da2fea-c37a-4017-847d-d41310e84c1d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.064092 Nov 20 20:57:10.741442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1815/3619] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:10 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:10.749371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-060c6711-24c7-47fa-b717-483fc236a5a7 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.096399 Nov 20 20:57:10.750043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1805/3620] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:10 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:10.753330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:10.754025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:10.770420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.771484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.772749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:10.773198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:10.941407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:10.957463 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d580ae0d-14f7-4988-a17b-bede23fd7ed0 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.214564 Nov 20 20:57:10.959715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1816/3621] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:10 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:11.392583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:11.393310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:11.417150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.417873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.418727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.419246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.667791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:11.668662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:11.676350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.677741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.678734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.679319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.744172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:11.752876 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5633cbae-30d0-449d-809f-6b400870af2d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.364499 Nov 20 20:57:11.766820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1806/3622] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:11 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:11.781875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:11.782714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:11.799839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.806801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.807621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.808068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.925196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:11.937709 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b25e919-89b4-4608-85ac-e1aaa02113f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1472 microversion: 2.1 time: 0.273793 Nov 20 20:57:11.938348 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1817/3623] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:11 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:11.963842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:11.965259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:11.973057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.973791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:11.974785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:11.975530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.025374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d30110a-8e93-4e8c-ab38-10c4a479942c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.065946 Nov 20 20:57:12.026765 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1818/3624] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:11 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:12.033432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:12.035466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:12.043432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.044126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.045470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.046087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.100493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:12.109033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ed05edb-f650-455d-b16b-391f464fc013 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.080404 Nov 20 20:57:12.110194 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5b27371c-3bfa-45fb-aac7-628eaeadab14 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.342070 Nov 20 20:57:12.111101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1819/3625] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:12 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:12.118394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:12.119094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:12.127451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1807/3626] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:11 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:12.131274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.131901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.132888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.133484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.138496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2108756186", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:12.226069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:57:12.312392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:12.322758 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-19ccbda9-e41f-4e32-896d-bdf584926d84 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.208596 Nov 20 20:57:12.323598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1820/3627] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:12 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:12.330410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-884dd888-6b9a-476b-9e9e-5c4912d235d2 req-1c437bc1-211f-40e1-a74a-1e551f7ba034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2", "name": "network-vif-plugged", "status": "completed", "tag": "1e49a5ca-01de-4fd7-a80d-a16b40d7edaa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:12.332156 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:12.332156 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:12.341364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-884dd888-6b9a-476b-9e9e-5c4912d235d2 req-1c437bc1-211f-40e1-a74a-1e551f7ba034 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.342115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-884dd888-6b9a-476b-9e9e-5c4912d235d2 req-1c437bc1-211f-40e1-a74a-1e551f7ba034 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.354520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-884dd888-6b9a-476b-9e9e-5c4912d235d2 req-1c437bc1-211f-40e1-a74a-1e551f7ba034 service nova] Creating event network-vif-plugged:1e49a5ca-01de-4fd7-a80d-a16b40d7edaa for instance 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 on nch1-master-1 Nov 20 20:57:12.360152 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-884dd888-6b9a-476b-9e9e-5c4912d235d2 req-1c437bc1-211f-40e1-a74a-1e551f7ba034 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034552 Nov 20 20:57:12.360856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1821/3628] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:12.788156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:12.788919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:12.799294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.802670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.804101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.806037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.945766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:57:12.946264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:57:12.947219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:57:12.947819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:57:12.948556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:57:12.970488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.971287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.973142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:12.973595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:12.995744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:13.003542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:13.023366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:57:13.026188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:57:13.089271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0dbfeece-1a60-4640-a781-4ee5603d0f69 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959158 Nov 20 20:57:13.095941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1808/3629] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:57:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:57:13.104072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.105772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.127956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.131867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.133497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.134122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.186281 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9326a65-9536-49a2-9dc1-b33246f7e838 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088674 Nov 20 20:57:13.187360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:13.187507 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1809/3630] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:57:13 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:13.195093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:13.196436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.201780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54f36c67-55b9-44f6-bcd5-ee73364934fe tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.421111 Nov 20 20:57:13.204311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.205160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.206217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.206874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.212874 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1822/3631] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:12 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:13.219235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e99ce656-ea18-4834-bd8e-91dca9a914a6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.220143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e99ce656-ea18-4834-bd8e-91dca9a914a6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.241955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e99ce656-ea18-4834-bd8e-91dca9a914a6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:13.292993 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbe0410f-6107-40c0-acb2-b28e35ebf657 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.104168 Nov 20 20:57:13.293727 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1810/3632] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:13 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:13.299849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:13.301008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.309064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.309517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.310327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.310901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.344124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e99ce656-ea18-4834-bd8e-91dca9a914a6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6" status: 204 len: 0 microversion: 2.1 time: 0.129196 Nov 20 20:57:13.344739 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1823/3633] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:13 2021] DELETE /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:13.357729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.358368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.367458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.371365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.372214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.372790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.374481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dd1e4ae-173a-43d4-b17d-9a458341350c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.078286 Nov 20 20:57:13.375646 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1811/3634] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:13 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:13.381172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.381935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.397942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.398779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.399842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.400287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.489584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lazy-loading 'services' on Instance uuid e32689d1-8986-4ec5-84e2-f28bf3843085 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:57:13.585875 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c71d1e51-292a-4d8c-b6dc-224bb9933390 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments/0687cab0-7083-48c0-afcd-34197a5e0e13" status: 202 len: 0 microversion: 2.1 time: 0.209322 Nov 20 20:57:13.586930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1812/3635] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 20:57:13 2021] DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments/0687cab0-7083-48c0-afcd-34197a5e0e13 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:13.603112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.603966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.611833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.612284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.616298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:13.616757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:13.668265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:13.705422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5281b6d3-b14c-45b1-885e-bb8757e75f46 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.349956 Nov 20 20:57:13.706995 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1824/3636] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:13 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:13.717281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ff6010b-56a4-4acd-b34b-c93d10bcb4b4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:13.717583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ff6010b-56a4-4acd-b34b-c93d10bcb4b4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:13.734408 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-9ff6010b-56a4-4acd-b34b-c93d10bcb4b4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. Nov 20 20:57:13.735270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ff6010b-56a4-4acd-b34b-c93d10bcb4b4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:13.736597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ff6010b-56a4-4acd-b34b-c93d10bcb4b4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6" status: 404 len: 111 microversion: 2.1 time: 0.028636 Nov 20 20:57:13.740352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1825/3637] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:13 2021] GET /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:13.795486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:13.824454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3956d24f-7c84-435f-8b14-4fe4e97e2ca2 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1325 microversion: 2.1 time: 0.236225 Nov 20 20:57:13.827169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1813/3638] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:13 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1325 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:13.842351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1468991364", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:13.901015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:57:14.220211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:14.220737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:14.227406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.227850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.228630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.229068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.381756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:14.390747 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-376a1a2f-0616-4de4-bc95-c9301c21f5cd tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.174185 Nov 20 20:57:14.391664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1814/3639] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:14 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:14.397740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:14.397740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:14.403814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.404288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.405255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.405838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.450173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60cf69b0-402b-41e2-bcfe-3448c9a19fea tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.056847 Nov 20 20:57:14.452882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1815/3640] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:14 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:14.458833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:14.460363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:14.472283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.473144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.474373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.474892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.521570 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e826972d-49b4-455a-ac15-d7edc943abcc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.066914 Nov 20 20:57:14.522272 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1816/3641] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:14 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:14.664037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:57:14.664327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:57:14.664804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:57:14.665243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:57:14.665656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:57:14.674980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.675437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.676265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.676749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.699331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:14.704584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:14.718449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:57:14.720873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:57:14.725080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:14.726273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:14.734354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.734925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.735927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.736561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.775212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6065bfc8-0d4c-423c-a038-0bea63fe8634 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936268 Nov 20 20:57:14.776214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1826/3642] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:57:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:57:14.781414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:14.783053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:14.791040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.791752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.792700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:14.793428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:14.914214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:14.922685 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4978dbe5-24d3-48f5-8dc5-ccbd505093d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.203877 Nov 20 20:57:14.928327 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1817/3643] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:14 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:14.938523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d551a623-bdc3-46c5-8fc1-d4be9867df76 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:14.939175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d551a623-bdc3-46c5-8fc1-d4be9867df76 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.011844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d551a623-bdc3-46c5-8fc1-d4be9867df76 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:15.023711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d551a623-bdc3-46c5-8fc1-d4be9867df76 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1221 microversion: 2.1 time: 0.094151 Nov 20 20:57:15.024316 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1818/3644] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:14 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:15.033049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.034270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.047026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.047778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.051132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.065004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.092234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3e5891b4-782e-4d60-993c-967dce9b0547 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.314574 Nov 20 20:57:15.101073 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1827/3645] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:57:14 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments => generated 25 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:15.214781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.215713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.222027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.222531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.223333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.224199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.261095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f3ae3cc-8151-4f8f-bcdd-81beff06dfc9 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050026 Nov 20 20:57:15.262030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1828/3646] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:57:15.305914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:15.316384 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0fca3b9c-713d-4e47-8dc3-55755c7552c9 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1521 microversion: 2.1 time: 0.290654 Nov 20 20:57:15.318114 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1819/3647] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:15.329161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.329886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.335105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.335950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.336636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.337276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.338351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.339027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.346448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.346982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.347896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.348406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.380515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:15.389574 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] HTTP exception thrown: Action 999 not found Nov 20 20:57:15.390872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Returning 404 to user: Action 999 not found {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:15.392184 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5ebb36f-bec6-4023-9e79-b796f107d9c8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.061283 Nov 20 20:57:15.396658 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1820/3648] 10.222.0.41 () {58 vars in 1307 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2/os-instance-actions/999 => generated 66 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 20 20:57:15.410988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89e76a3b-2c99-4513-b39f-28966e7b6305 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '.version_select at 0x7f3f86f35430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.412138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89e76a3b-2c99-4513-b39f-28966e7b6305 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: db34d05c-104e-483a-9553-55149c04057c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.419151 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-89e76a3b-2c99-4513-b39f-28966e7b6305 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] HTTP exception thrown: Instance db34d05c-104e-483a-9553-55149c04057c could not be found. Nov 20 20:57:15.419751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89e76a3b-2c99-4513-b39f-28966e7b6305 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Returning 404 to user: Instance db34d05c-104e-483a-9553-55149c04057c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:15.420764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89e76a3b-2c99-4513-b39f-28966e7b6305 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/db34d05c-104e-483a-9553-55149c04057c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.013627 Nov 20 20:57:15.421812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1821/3649] 10.222.0.41 () {58 vars in 1295 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/db34d05c-104e-483a-9553-55149c04057c/os-instance-actions => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:15.429663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.430603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.437532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.437990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.438851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.439403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.504575 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4293ad38-fa31-4b32-bf6d-71e560e1cfc8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 204 len: 0 microversion: 2.1 time: 0.178599 Nov 20 20:57:15.505843 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1829/3650] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:15 2021] DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:15.512999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.513905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.527740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.529867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.530830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.531286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.579997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:15.649869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:15.663392 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8dd50f75-ea86-4265-abf2-ccd02f511b87 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.240329 Nov 20 20:57:15.679522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9dcc612-7242-415c-bdb7-d9f3b36698d8 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 204 len: 0 microversion: 2.1 time: 0.171414 Nov 20 20:57:15.680624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1830/3652] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:15 2021] DELETE /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:15.683337 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1822/3652] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:15.686437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:15.687667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.690378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.691258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.694933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.695464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.696343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.696858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.697499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.698142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.698928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.699712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.738890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-925e23e2-5c89-46d7-9395-bf23e91a9d9b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 14 microversion: 2.1 time: 0.056080 Nov 20 20:57:15.742893 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1831/3653] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:15 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:15.746931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:15.748053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.757957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.758460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.759330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.759844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.807293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d159ba6-a766-42f3-80cf-65d8e5eed3f0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.065143 Nov 20 20:57:15.808119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1832/3654] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:15 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:15.816878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.818456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.826291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.826830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.827698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.828212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.856078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:15.863466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e752cc73-5c5b-491b-81d1-d9e4146d10bc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1512 microversion: 2.1 time: 0.179075 Nov 20 20:57:15.864118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1823/3655] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:15.941206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:15.941947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:15.948335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.948811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:15.949598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:15.950041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.084666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:16.092307 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-64fcd4e6-f271-4428-be6a-69b4ed897b3f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.154974 Nov 20 20:57:16.092898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1824/3656] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:16.097207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:16.097812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:16.103952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.104387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.105173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.105635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.149082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:16.163526 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3583b09d-7f86-4bd1-9ee2-f1d9a51ef101 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1527 microversion: 2.1 time: 0.350403 Nov 20 20:57:16.164614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1833/3657] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:15 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1527 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:16.200771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:16.210980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc4e2e7e-18b3-485b-895a-ecd2ca6641ce tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1273 microversion: 2.1 time: 0.116234 Nov 20 20:57:16.211600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1825/3658] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:16 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:16.684607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:16.685637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:16.693823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.694571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.695507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.696064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.750984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:16.752275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:16.762553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.763247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.764255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.764918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.831694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16a27190-78e5-4900-8ab4-2574e285fa20 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 8154 microversion: 2.1 time: 0.084283 Nov 20 20:57:16.837229 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1826/3659] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:16 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 8154 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:16.843144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:16.844231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:16.855698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.856461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.860222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.860960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.935753 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6d7b18b-5f68-465d-82e3-4a97ebe1a6dc tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.096592 Nov 20 20:57:16.936760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1827/3660] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:16 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:16.941988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:16.943079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:16.950214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.950664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:16.951447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:16.951880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.132052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:17.143436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dae5d6da-9b9f-48a4-889c-5b07f9ee0615 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1567 microversion: 2.1 time: 0.462293 Nov 20 20:57:17.151225 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1834/3661] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:16 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1567 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.162258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:17.162960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:17.166936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:17.175782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41969d8c-b467-439d-a286-17a86e74e7c5 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1512 microversion: 2.1 time: 0.237519 Nov 20 20:57:17.177775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.178487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.179355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.179740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.187603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1828/3662] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:16 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1512 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.193451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:17.194847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:17.215273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.215855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.216748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.217240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.378941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:17.388222 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d639602-1032-4b13-9e5c-5c601229a0f7 tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1527 microversion: 2.1 time: 0.199396 Nov 20 20:57:17.388908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1829/3663] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:17 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.394032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:17.394677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:17.401288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.401825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.402752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.403261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.537719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:17.545201 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91d133f2-df69-4940-9bde-297843e11d58 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.155257 Nov 20 20:57:17.545981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1830/3664] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:17 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.801561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:17.809647 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e39b13b-2084-46c8-9a2a-0b226511f02f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.652372 Nov 20 20:57:17.810442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1835/3665] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:17 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.843002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:17.843977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:17.851502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.851957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.852751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.853191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.893413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9aa77b46-895b-4009-91e7-5f6096b1452d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 8154 microversion: 2.1 time: 0.053823 Nov 20 20:57:17.896912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1831/3666] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:17 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 8154 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:17.949768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:17.951448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:17.957400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.958806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:17.959853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:17.960450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.011976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc9dc64b-4a49-4b04-90bd-9520643294e8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.066438 Nov 20 20:57:18.016796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1836/3667] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:17 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:18.163869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.164786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.171856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.172976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.173866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.174554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.201327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.202894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.216979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.218106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.219251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.220293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.439218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:18.449380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52fcebae-893c-48d7-8e89-ed7d9514da65 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1547 microversion: 2.1 time: 0.290352 Nov 20 20:57:18.449966 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1832/3668] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:18 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1547 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:18.456069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.456921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.465307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.466076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.466886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.467316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.694892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:18.706894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78d497ca-af83-42d4-89ac-4429c35f8607 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1512 microversion: 2.1 time: 0.516517 Nov 20 20:57:18.709402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1837/3669] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:18 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1512 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:18.714700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.715511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.716966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2400f0c35eb34648b051d3aa8312ef9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f55329346e94280a9753271c6ec6c15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:18.722355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.722817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.723968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.724335 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f546e75b-ab16-4614-8c3c-7ad9d25c175b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 200 len: 1527 microversion: 2.1 time: 0.273044 Nov 20 20:57:18.724922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.740411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1833/3670] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:18 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:18.748325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.748904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.776157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.776157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.776157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.776157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.887723 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Cannot 'detach_volume' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state rescued Nov 20 20:57:18.888543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 409 to user: Cannot 'detach_volume' instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 while it is in vm_state rescued {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:18.889685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-109321af-0184-4c7b-9eb8-5a9f72d608a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments/402ed45c-bf42-47f0-9c9a-8a03020d88ea" status: 409 len: 152 microversion: 2.1 time: 0.178994 Nov 20 20:57:18.896177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1838/3671] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 20:57:18 2021] DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments/402ed45c-bf42-47f0-9c9a-8a03020d88ea => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:57:18.905118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:18.905785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:18.914537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.915320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:18.916950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:18.919097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.067470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:19.087557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f231fc61-7b98-4e9c-b5c5-66cb893da5c4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.343511 Nov 20 20:57:19.089033 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1834/3672] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:18 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:19.106455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:19.107494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:19.121441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.122259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.123886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.124672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.245495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a319c33-080d-482d-9ab3-8d210339313e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action" status: 202 len: 0 microversion: 2.1 time: 0.142935 Nov 20 20:57:19.247694 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1835/3673] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:19 2021] POST /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:19.252841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:19.253895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:19.261869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.262364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.263159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.263592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.319695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fde00fa8-c8ba-4b88-aef6-5a482ec71022 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 16342 microversion: 2.1 time: 0.070270 Nov 20 20:57:19.320882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1836/3674] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:19 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 16342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:19.326452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c22d32ae-3b06-44a0-8072-4eca99e0cc35 req-3f767d07-d2d8-4f84-acd0-88320b0e5435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2", "name": "network-vif-deleted", "tag": "1e49a5ca-01de-4fd7-a80d-a16b40d7edaa"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:19.328722 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:19.328722 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:19.339668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c22d32ae-3b06-44a0-8072-4eca99e0cc35 req-3f767d07-d2d8-4f84-acd0-88320b0e5435 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.340489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c22d32ae-3b06-44a0-8072-4eca99e0cc35 req-3f767d07-d2d8-4f84-acd0-88320b0e5435 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.355164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c22d32ae-3b06-44a0-8072-4eca99e0cc35 req-3f767d07-d2d8-4f84-acd0-88320b0e5435 service nova] Creating event network-vif-deleted:1e49a5ca-01de-4fd7-a80d-a16b40d7edaa for instance 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 on nch1-master-1 Nov 20 20:57:19.361279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c22d32ae-3b06-44a0-8072-4eca99e0cc35 req-3f767d07-d2d8-4f84-acd0-88320b0e5435 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038383 Nov 20 20:57:19.363672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1837/3675] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:19.372636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:19.373889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:19.384579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.385258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.386325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.387086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:19.388344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.429499 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e399a027-4ab5-47ee-8012-b959ef952696 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.526767 Nov 20 20:57:19.430590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1839/3676] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:18 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:19.441974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:19.443902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:19.456812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.457548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.459291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.459973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.461147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27b54464-3ed7-46d0-8bb2-25be150ce5de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.091443 Nov 20 20:57:19.465704 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1838/3677] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:19 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:19.745926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:19.747051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:19.762588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.762992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.763849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.764291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.882631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:19.883091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:19.887092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lazy-loading 'fault' on Instance uuid e32689d1-8986-4ec5-84e2-f28bf3843085 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:57:19.997229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ae4f3ed0ddb4c2e8475b8b8f1c47c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48484c034b44d9bbd058ca3ed927499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:20.006780 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d05110bf-1191-44df-ba68-4f79009018e8 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 200 len: 1307 microversion: 2.1 time: 0.268571 Nov 20 20:57:20.008036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1839/3678] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:19 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 1307 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:20.013206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:20.013986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] [instance: 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:20.022549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.023184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.024200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.024700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.043562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] HTTP exception thrown: Instance 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 could not be found. Nov 20 20:57:20.044298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] Returning 404 to user: Instance 3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:20.045441 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4469f8d-6029-436a-a15e-4db8c7139d7b tempest-InstanceActionsNegativeTestJSON-40938797 tempest-InstanceActionsNegativeTestJSON-40938797-project] 10.222.0.41 "GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2" status: 404 len: 111 microversion: 2.1 time: 0.035878 Nov 20 20:57:20.047972 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1840/3679] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:20 2021] GET /compute/v2.1/servers/3a7c13e8-e550-4975-bfd8-6e1d3b4a46f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:20.106841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:20.107483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:20.114076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.114590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.115634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.116084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.349828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:20.364005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d66d492-a09a-41c7-a69e-c885e311b98f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1555 microversion: 2.1 time: 0.930016 Nov 20 20:57:20.368097 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1840/3680] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:19 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1555 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:20.379070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:20.380501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:20.388805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.389378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.390121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.390560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.478772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-90f467f2-954e-4169-ac30-c3626a42eca1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 16342 microversion: 2.1 time: 0.109087 Nov 20 20:57:20.480430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1841/3681] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:20 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 16342 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:20.486006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:20.487070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:20.496272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.497010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.497991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.498629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.878590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:20.899029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:20.910552 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-895a1c9e-6532-45e4-9361-378cc047035e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.424343 Nov 20 20:57:20.911796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1842/3682] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:20 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:20.917336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:20.918879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:20.926712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.927433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.928433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:20.929162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:20.960056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d064334e-82ef-43d8-aef2-af39cc0e4ea0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.852212 Nov 20 20:57:20.973409 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1841/3683] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:20 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:21.013545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ada0af4-ae65-41f3-a3a2-d7bb811bdece tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.099992 Nov 20 20:57:21.015239 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1843/3684] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:20 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:21.025142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:21.025783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:21.033064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.033524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.034636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.035080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.056321 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] HTTP exception thrown: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. Nov 20 20:57:21.056923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Returning 404 to user: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:21.057933 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-278a9c97-5507-47e6-ba85-5315d5b721fc tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 404 len: 111 microversion: 2.1 time: 0.037551 Nov 20 20:57:21.058672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1842/3685] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:21 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:57:21.385150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:21.386881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:21.387025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e32689d1-8986-4ec5-84e2-f28bf3843085", "name": "network-vif-deleted", "tag": "dfd54190-c8a6-40d7-b314-29f7df09fc83"}, {"name": "network-changed", "server_uuid": "01bb9904-cd08-4768-af33-180dd86ce1b6", "tag": "33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:21.388846 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:21.388846 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:21.395155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.395837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.397098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.397869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.405435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.405889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.421037 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] Creating event network-vif-deleted:dfd54190-c8a6-40d7-b314-29f7df09fc83 for instance e32689d1-8986-4ec5-84e2-f28bf3843085 on nch1-master-1 Nov 20 20:57:21.421790 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] Creating event network-changed:33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728 for instance 01bb9904-cd08-4768-af33-180dd86ce1b6 on nch2-master-1 Nov 20 20:57:21.435958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-39e2b5e4-d712-47a0-ae3a-2599a595997a req-cabc5ece-19e2-428a-9432-7a4ab717cadb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053497 Nov 20 20:57:21.443132 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1844/3686] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:21 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:21.492561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:21.493763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:21.502107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.502847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.504076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.505192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.568317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-88fafcb8-4c4a-4cf9-997d-9931e26d88cd tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 16342 microversion: 2.1 time: 0.080756 Nov 20 20:57:21.573171 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1845/3687] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:21 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 16342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:21.929635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:21.930574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:21.944807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.947119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:21.952943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:21.953587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.107838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:22.116862 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5718da57-ebaa-499d-9850-9e1aec99e793 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1555 microversion: 2.1 time: 0.737181 Nov 20 20:57:22.121912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1843/3688] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:21 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1555 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:22.126572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:22.127215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:22.141216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.141490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.142906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.143686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.425915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:22.433676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6666a51-be33-4873-bc7d-9108a583bb78 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.310460 Nov 20 20:57:22.434293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1844/3689] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:22 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:22.449211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:22.450524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:22.466197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.472176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.473283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.477197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.558634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ea5722a-2fc9-4f2d-ba76-8b594dec82de tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.119799 Nov 20 20:57:22.559347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1845/3690] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:22 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:22.569875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:22.580182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:22.581190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:22.582896 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8827e1cf-aa44-4fe3-857a-abc48b4b4d34 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.658158 Nov 20 20:57:22.594883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1846/3691] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:21 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:22.601009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.601389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.602264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:22.602706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:22.669819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d22657f4-8bef-448f-989f-a5d6fec507ff tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 16342 microversion: 2.1 time: 0.093482 Nov 20 20:57:22.670524 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1846/3692] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:22 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 16342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:23.135039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.135633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.149013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.150232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.153184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.153184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.341961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.343047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.359776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.360467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.362942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.363576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.375097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:23.387484 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c6aa13a-96af-4caa-beea-108fa7bab41e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1561 microversion: 2.1 time: 0.256309 Nov 20 20:57:23.401086 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1847/3693] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:23 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:23.403323 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] HTTP exception thrown: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. Nov 20 20:57:23.404105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Returning 404 to user: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:23.406026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c458ae94-a12e-4b6d-adf7-172ef23b7714 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 404 len: 111 microversion: 2.1 time: 0.068999 Nov 20 20:57:23.407012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1847/3694] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:23 2021] DELETE /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:57:23.416582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.417726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] [instance: e32689d1-8986-4ec5-84e2-f28bf3843085] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.426436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.427413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.428353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.428789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.454326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.454938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.471115 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] HTTP exception thrown: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. Nov 20 20:57:23.471924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] Returning 404 to user: Instance e32689d1-8986-4ec5-84e2-f28bf3843085 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:23.473503 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-138b571c-e9c5-404e-b3d8-c43aa085c469 tempest-AttachSCSIVolumeTestJSON-782544545 tempest-AttachSCSIVolumeTestJSON-782544545-project] 10.222.0.41 "GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085" status: 404 len: 111 microversion: 2.1 time: 0.062321 Nov 20 20:57:23.474734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.475361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.475941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1848/3695] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:23 2021] GET /compute/v2.1/servers/e32689d1-8986-4ec5-84e2-f28bf3843085 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:57:23.476498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.477085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.484227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.485887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.498950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.499698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.500747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.501644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.642379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lazy-loading 'services' on Instance uuid 293ef3df-319d-4bc8-8921-ed7b90ab89c9 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:57:23.744780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1a8e723c-3a52-4b36-b8ac-a88c5a8b38b6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments/402ed45c-bf42-47f0-9c9a-8a03020d88ea" status: 202 len: 0 microversion: 2.1 time: 0.267359 Nov 20 20:57:23.745564 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1849/3696] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 20:57:23 2021] DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments/402ed45c-bf42-47f0-9c9a-8a03020d88ea => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:23.752852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:23.754559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.763183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.764094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.765271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.766439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.823536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-185f4ead-0af1-4d6e-9096-a96a5b689a49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.075391 Nov 20 20:57:23.825181 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1850/3697] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:23 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:23.832733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:23.834094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.843186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.843805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.844723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.845486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.877819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:23.889193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70d17c95-4469-4a0f-a6a5-2da71765dbe0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.436702 Nov 20 20:57:23.902702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1848/3698] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:23 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:23.914393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:23.917804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:23.931783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.933127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:23.934396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:23.934993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.040364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1d4c4ce-df65-49b5-b73c-f567de97743f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.134354 Nov 20 20:57:24.041041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1849/3699] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:23 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:24.047619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:24.049134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:24.058473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.059300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.060423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.061018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.094189 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2cf0b36-1838-44be-9104-9201b1bcf2a6 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051652 Nov 20 20:57:24.094995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1850/3700] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:57:24 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:24.154858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:24.168441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd786c55-b0ce-41d2-9dbe-3a98b994729b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.341843 Nov 20 20:57:24.169324 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1851/3701] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:23 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:24.837241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:24.839254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:24.847690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.849239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.850637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.851478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.908604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:24.909839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:24.913578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4ab0ada-3b33-4ce8-a19e-f25b79b78e27 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.081193 Nov 20 20:57:24.914830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1851/3702] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:24 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:24.924742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.925116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:24.925915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:24.926377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.053328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:25.054871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.063015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.063862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.064913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.065610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.115608 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c657ad2-bf8c-4d59-815d-884732038021 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.066951 Nov 20 20:57:25.116371 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1852/3703] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:25 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:25.122318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:25.123620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.131977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.132434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.133444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.134031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.171368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-740836e9-e59c-49ed-a7f2-6f27983a9927 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053424 Nov 20 20:57:25.174184 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1853/3704] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 20:57:25 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:57:25.188745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:25.190864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.199302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.200134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.201174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.201769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.412178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:25.431743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2a0d121-febb-478c-93ee-fa88cb3aa610 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.526784 Nov 20 20:57:25.441765 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1852/3705] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:24 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:25.445788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:25.447074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.453441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.455213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.456025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.456616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.496214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Cannot 'reboot' instance 6789903f-f708-4bfa-8252-2c4d5a69921a while it is in vm_state rescued Nov 20 20:57:25.497297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 409 to user: Cannot 'reboot' instance 6789903f-f708-4bfa-8252-2c4d5a69921a while it is in vm_state rescued {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:25.498579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05ec86bb-f60d-47cb-9b16-5c9f2e0df787 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action" status: 409 len: 145 microversion: 2.1 time: 0.057539 Nov 20 20:57:25.500197 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1853/3706] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:25 2021] POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:57:25.510038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:25.512077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.519055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.519743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.521293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.522283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.562329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Cannot 'rebuild' instance 6789903f-f708-4bfa-8252-2c4d5a69921a while it is in vm_state rescued Nov 20 20:57:25.563205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 409 to user: Cannot 'rebuild' instance 6789903f-f708-4bfa-8252-2c4d5a69921a while it is in vm_state rescued {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:25.563871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82d7ed64-691c-4b51-86aa-fc094551d18c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action" status: 409 len: 146 microversion: 2.1 time: 0.058415 Nov 20 20:57:25.564798 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1854/3707] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:25 2021] POST /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a/action => generated 146 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:57:25.738362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:25.748080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72661148-2527-473a-9d50-bf2421037737 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1507 microversion: 2.1 time: 0.564796 Nov 20 20:57:25.749226 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1854/3708] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:25 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1507 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:25.930303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:25.931260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:25.940286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.940997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:25.941847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:25.942436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.008366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1502c2b3-69d4-42f5-95c6-a3672e8a7989 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.085450 Nov 20 20:57:26.009431 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1855/3709] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:25 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:26.127634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:26.130007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:26.136928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.137491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.138412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.139222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.191038 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c24b1dd-d513-4344-a3c5-848d6f6068c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.067002 Nov 20 20:57:26.196402 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1855/3710] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:26 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:26.449598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:26.450345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:26.458778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.459411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.460306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.460914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.767957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:26.768661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:26.796940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.797423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:26.810356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:26.811316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.206899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:27.218516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ca47ba1-eff7-463c-b46e-b5070d498421 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.772793 Nov 20 20:57:27.221863 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1856/3711] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:26 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:27.249402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5cdbf22b-445e-499c-b31d-f3861d24e153 req-acc7fe03-939a-4d8e-b438-1533a011ce99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bb9904-cd08-4768-af33-180dd86ce1b6", "name": "network-vif-plugged", "status": "completed", "tag": "33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:27.252645 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:27.252645 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:27.263351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5cdbf22b-445e-499c-b31d-f3861d24e153 req-acc7fe03-939a-4d8e-b438-1533a011ce99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:27.264070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5cdbf22b-445e-499c-b31d-f3861d24e153 req-acc7fe03-939a-4d8e-b438-1533a011ce99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.278198 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5cdbf22b-445e-499c-b31d-f3861d24e153 req-acc7fe03-939a-4d8e-b438-1533a011ce99 service nova] Creating event network-vif-plugged:33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728 for instance 01bb9904-cd08-4768-af33-180dd86ce1b6 on nch2-master-1 Nov 20 20:57:27.284040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5cdbf22b-445e-499c-b31d-f3861d24e153 req-acc7fe03-939a-4d8e-b438-1533a011ce99 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060788 Nov 20 20:57:27.285271 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1857/3712] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:27.293330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:27.294581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:27.298767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:27.306725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:27.307508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.309358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:27.310194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.356154 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f408c66e-be53-4718-8493-a87e4af1869b tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1528 microversion: 2.1 time: 0.592807 Nov 20 20:57:27.358321 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1856/3713] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:26 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:27.390583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:27.392301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:27.400221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:27.400812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.401740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:27.402334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:27.427657 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3674948c-2df4-42a4-b9da-3910f7027e85 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.138988 Nov 20 20:57:27.428614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1858/3714] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:27 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:27.459192 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7a2e50c-20df-45c2-8f74-cc35845118ae tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.098030 Nov 20 20:57:27.460014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1857/3715] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:27 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:28.063245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:28.064275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:28.076084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.076847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.077922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.079186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.135822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:28.241008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:28.241975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:28.255038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.260696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.268271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.268965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.349621 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c99bb54-3a12-451f-8bca-08a168aa2a4f tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 204 len: 0 microversion: 2.1 time: 0.291955 Nov 20 20:57:28.350333 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1859/3716] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:28 2021] DELETE /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:28.358976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:28.359679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:28.371512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.372077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.372768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.373208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.662446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:28.684427 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fee64177-7fa0-446e-97f0-393a13fdf6ac tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.449167 Nov 20 20:57:28.689575 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1858/3717] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:28 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:28.712383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:28.713032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:28.746106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.754673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.758736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:28.761438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:28.948059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:28.963809 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52c6b773-e7e2-4e48-b62a-99403325b2dc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1509 microversion: 2.1 time: 0.609187 Nov 20 20:57:28.965286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1860/3718] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:28 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:28.979058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:28.985246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:29.000619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.001305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.006312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.007083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.095036 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2bcd5c0-d720-4b42-a822-be7ffc77d567 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.127670 Nov 20 20:57:29.099949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1861/3719] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:28 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:29.109155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:29.109712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:29.110962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:29.117259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-35fa9431-dc35-4c2f-b397-3f05e5300928 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.425597 Nov 20 20:57:29.122034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.123152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.124140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.124743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.129271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1859/3720] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:28 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:29.218215 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bca177b8-56f6-4e1b-8f9e-219555abda7a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.110387 Nov 20 20:57:29.219743 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1862/3721] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:29 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:29.701817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:29.702467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:29.713622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.714091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.714914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.715350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.797533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b0827a83-a1b7-4298-ac87-e241019bffdb req-f73d65e7-c690-4715-be5f-cfd4ccac1c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a37d1-6352-4c63-8de6-2e9e94bf609f", "name": "network-vif-plugged", "status": "completed", "tag": "6171bf54-836b-4b89-9942-130b6f53b7ac"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:29.802857 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:29.802857 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:29.824331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b0827a83-a1b7-4298-ac87-e241019bffdb req-f73d65e7-c690-4715-be5f-cfd4ccac1c50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.828974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b0827a83-a1b7-4298-ac87-e241019bffdb req-f73d65e7-c690-4715-be5f-cfd4ccac1c50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:29.866021 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b0827a83-a1b7-4298-ac87-e241019bffdb req-f73d65e7-c690-4715-be5f-cfd4ccac1c50 service nova] Creating event network-vif-plugged:6171bf54-836b-4b89-9942-130b6f53b7ac for instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f on nch2-master-1 Nov 20 20:57:29.881414 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b0827a83-a1b7-4298-ac87-e241019bffdb req-f73d65e7-c690-4715-be5f-cfd4ccac1c50 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087342 Nov 20 20:57:29.882439 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1863/3722] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:29.982763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:29.983710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:29.993646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:29.996333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.001042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.001756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.305348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:30.318862 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4072e7ed-1882-4fb9-8fc3-a4fff9e166a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1321 microversion: 2.1 time: 0.620590 Nov 20 20:57:30.319787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1860/3723] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:29 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:30.332103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:30.333537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:30.351172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.351858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.352826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.353420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.471324 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5e204a8-1281-4524-a755-2c5d8bd0e923 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.148347 Nov 20 20:57:30.475736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1861/3724] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:30 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:30.484425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:30.485146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:30.514493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.515313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.516622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.517278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.703143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:30.712130 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-975ea21c-ad46-4f6a-9f5e-3eef73590291 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1509 microversion: 2.1 time: 0.733770 Nov 20 20:57:30.718851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1864/3725] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:29 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1509 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:30.733336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:30.741334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:30.762383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.763064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.763956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:30.764404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:30.872320 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a100d80-87ed-4190-a0e7-35c09dd18633 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.149971 Nov 20 20:57:30.877182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1865/3726] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:30 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:31.074092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:31.090426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-306795c1-1fd8-47a3-985e-c9124af6b552 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.616727 Nov 20 20:57:31.092054 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1862/3727] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:30 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:31.336586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:31.337911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:31.353087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.354020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.355092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.358066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.483808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:31.484883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:31.495883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.497919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.498764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.500918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.581786 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d47c094-edfb-4d26-841f-1c35bf816666 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.101825 Nov 20 20:57:31.583905 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1863/3728] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:31 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:57:31.735923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:31.737144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:31.749996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.756406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.757526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:31.758207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:31.943336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:31.951969 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d744830-997f-4df9-ae69-3d7fcb12e0b2 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 200 len: 1467 microversion: 2.1 time: 0.220580 Nov 20 20:57:31.957299 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1864/3729] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:31 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 1467 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:31.981413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:31.985931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:32.013500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.013980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.014839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.021089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.079797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45078eb0-0e89-4c73-9192-f9a24fd18f11 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.114800 Nov 20 20:57:32.081014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1865/3730] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:31 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:32.097223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:32.111455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:32.118477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:32.127306 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0730d7cc-160c-46b4-8b62-ba348910f952 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1501 microversion: 2.1 time: 0.793777 Nov 20 20:57:32.132581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1866/3731] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:31 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1501 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:32.169785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.171893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.174662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.176060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.179011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:32.182928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:32.225738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.229827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.233791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.236548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.632441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:32.641125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3243c353-48f6-4b99-85bc-51e2dcfc46c3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.536304 Nov 20 20:57:32.654943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1866/3732] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:32 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:32.668266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3812e974-61ce-4875-b739-8866348fdad2 req-2046b452-fb15-4869-8a65-f6e8cf9e8a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6789903f-f708-4bfa-8252-2c4d5a69921a", "name": "network-vif-deleted", "tag": "5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:32.670389 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:32.670389 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:32.692773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3812e974-61ce-4875-b739-8866348fdad2 req-2046b452-fb15-4869-8a65-f6e8cf9e8a83 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.699448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3812e974-61ce-4875-b739-8866348fdad2 req-2046b452-fb15-4869-8a65-f6e8cf9e8a83 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.720975 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3812e974-61ce-4875-b739-8866348fdad2 req-2046b452-fb15-4869-8a65-f6e8cf9e8a83 service nova] Creating event network-vif-deleted:5b6e8e1d-0d75-4232-a86c-9c7360bd9ee0 for instance 6789903f-f708-4bfa-8252-2c4d5a69921a on nch1-master-1 Nov 20 20:57:32.730103 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3812e974-61ce-4875-b739-8866348fdad2 req-2046b452-fb15-4869-8a65-f6e8cf9e8a83 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073598 Nov 20 20:57:32.735111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1867/3733] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:32.744932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:32.746205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:32.765386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.766383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.767360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.771137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.883743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d8ab7d2-781c-4581-a777-da71de96e97e tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.146980 Nov 20 20:57:32.885225 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1868/3734] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:32 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:32.976450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:32.977239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 6789903f-f708-4bfa-8252-2c4d5a69921a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:32.993446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:32.998397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:32.999562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.000237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.028229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Instance 6789903f-f708-4bfa-8252-2c4d5a69921a could not be found. Nov 20 20:57:33.030546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 404 to user: Instance 6789903f-f708-4bfa-8252-2c4d5a69921a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:33.035004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa0686e3-641d-47a9-9642-d24b06aa1e8c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a" status: 404 len: 111 microversion: 2.1 time: 0.064368 Nov 20 20:57:33.037998 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1869/3735] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:32 2021] GET /compute/v2.1/servers/6789903f-f708-4bfa-8252-2c4d5a69921a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:33.049288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:33.053397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:33.065279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.067736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.068797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.072339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.127623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:33.233617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:33.244561 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0184c22-01fa-4909-acaf-667e575c8cb2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1501 microversion: 2.1 time: 1.099457 Nov 20 20:57:33.248629 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1867/3736] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:32 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1501 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:33.255194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:33.272525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:33.293473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.297281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.298425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.300418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.355518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2b8bec2-e7c1-426e-9b6e-ad5d8119dcfb tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 204 len: 0 microversion: 2.1 time: 0.313344 Nov 20 20:57:33.356759 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1870/3737] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:33 2021] DELETE /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:33.365537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:33.371525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:33.388981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.389766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.391188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.391843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.401283 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d758bad-e958-4cca-8a3a-29d5a566f1a1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.149955 Nov 20 20:57:33.402591 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1868/3738] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:33 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:33.408029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:33.422095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:33.431038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.431843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.432873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.436351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.456992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:33.615057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f93a27c1-b15e-4652-ba7c-df2dcc58bffa tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 204 len: 0 microversion: 2.1 time: 0.255845 Nov 20 20:57:33.617510 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1871/3739] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:33 2021] DELETE /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:57:33.630474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:33.631184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:33.662634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.665477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:33.667593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:33.670935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.033669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:34.048697 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1bc14e5e-3555-490d-84b1-3f7f44686c4a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1507 microversion: 2.1 time: 0.426502 Nov 20 20:57:34.057315 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1872/3740] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:33 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:34.063155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:34.064001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:34.072909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.073623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.075112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.076219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.275539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:34.291323 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1fbeaf8-4eb6-47c3-a3b7-aabe72026206 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.886431 Nov 20 20:57:34.294254 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1869/3741] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:33 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:34.303186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:34.309965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:34.324374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.327532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.328725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.330636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.426040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55ef573d-1636-4d85-9480-928a6687a5d4 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action" status: 200 len: 40695 microversion: 2.42 time: 0.126931 Nov 20 20:57:34.428523 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1870/3742] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 20:57:34 2021] POST /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/action => generated 40695 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:57:34.439083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:34.440436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:34.449949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.455174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.458810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.461383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.471361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:34.484631 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0ab2bdd-5ef4-4e71-a15f-a22ab83e2792 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.425288 Nov 20 20:57:34.485570 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1873/3743] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:34 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:34.499880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:34.506688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:34.516823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.525380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.526578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:34.528513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:34.579291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5403301b-8f00-4a19-9b52-982407ce6f8a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.149090 Nov 20 20:57:34.590933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1871/3744] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:34 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:35.001922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:35.011906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:35.016851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:35.019859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07697eee-a070-426a-8fd8-617c6e057c0c tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2955 microversion: 2.42 time: 0.533085 Nov 20 20:57:35.024403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1874/3745] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:57:34 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2955 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:57:35.062544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:35.068097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:35.068913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:35.078920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:35.081869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.087818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:35.093337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.093878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:35.100699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.103799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:35.104770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.118125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:35.694738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:35.711114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e6af7ea-cde2-4f61-9cbd-19d9ec9e0e10 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1507 microversion: 2.1 time: 0.647152 Nov 20 20:57:35.711707 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1875/3746] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:35 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1507 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:35.721972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:35.722907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:35.753714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.755189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:35.756518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:35.759299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.120766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:36.131130 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51c04dd8-d54c-43e2-bab9-b136f1355f1c tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.418148 Nov 20 20:57:36.131683 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1876/3747] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:35 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:36.149381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:36.150158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:36.173724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.174487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.175500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.176093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.191872 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ac9c5cc-be14-4dc3-a9f5-5748ea763408 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 1.133679 Nov 20 20:57:36.193216 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1872/3748] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 20:57:35 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6/os-interface => generated 1831 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:57:36.202538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:36.203935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:36.239193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.240020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.240906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.241356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.411031 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8b2d493-2f23-4a63-9837-af3bcb8f92cb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.216275 Nov 20 20:57:36.415368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1873/3749] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:36 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:36.731997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:36.733004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:36.751891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.753914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.758345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:36.760319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:36.913356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:36.933204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6239b683-ce4b-4488-972e-5831086cccc8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.800323 Nov 20 20:57:36.944551 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1877/3750] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:36 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:37.152162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:37.152740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:37.164032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.164508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.165336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.165783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.483035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:37.492232 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11d7d079-f769-4a1a-a354-117029f5885e tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 0.346556 Nov 20 20:57:37.495157 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1878/3751] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:37 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:37.500872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:37.502142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:37.524541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.525827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.533471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.534246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.621926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb828707-ce39-4e95-847b-a74c56ef6f76 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.125457 Nov 20 20:57:37.622795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1879/3752] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:37 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:37.649645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-acdde212-f08e-4d78-afce-f587bd18f24c req-6059cf0f-fff0-46d7-92c9-a19f11da75d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bb9904-cd08-4768-af33-180dd86ce1b6", "name": "network-vif-deleted", "tag": "33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:37.651466 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:37.651466 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:37.669775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-acdde212-f08e-4d78-afce-f587bd18f24c req-6059cf0f-fff0-46d7-92c9-a19f11da75d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.673691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-acdde212-f08e-4d78-afce-f587bd18f24c req-6059cf0f-fff0-46d7-92c9-a19f11da75d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.708368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-acdde212-f08e-4d78-afce-f587bd18f24c req-6059cf0f-fff0-46d7-92c9-a19f11da75d9 service nova] Creating event network-vif-deleted:33bea6cb-a3e9-45d1-8fc6-c50cf5d2f728 for instance 01bb9904-cd08-4768-af33-180dd86ce1b6 on nch2-master-1 Nov 20 20:57:37.715731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-acdde212-f08e-4d78-afce-f587bd18f24c req-6059cf0f-fff0-46d7-92c9-a19f11da75d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070605 Nov 20 20:57:37.716598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1880/3753] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:37.855791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:37.872150 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43bda0c3-5309-469b-98dd-99605d3e4a33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 200 len: 1507 microversion: 2.1 time: 1.146559 Nov 20 20:57:37.872784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1874/3754] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:36 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 1507 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:37.961634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:37.962359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:37.980719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.981186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:37.982521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:37.993549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.509290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:38.510543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:38.531980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.532448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.540269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.540735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.576503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:38.587331 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3636bcb-9948-4cda-aa50-9f194d73003d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.628387 Nov 20 20:57:38.597702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1881/3755] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:37 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:38.633213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:38.636874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:38.652069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.652996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.654008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.654623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.710341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9aae18a1-695e-4029-8221-31dac05b4f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.081035 Nov 20 20:57:38.715377 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1882/3756] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:38 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:38.893093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:38.896101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:38.922327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.924119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.925013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:38.927201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:38.968651 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. Nov 20 20:57:38.969286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:38.970028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c448a9e9-e2f3-4b41-bb7b-bd4172719e25 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 404 len: 111 microversion: 2.1 time: 0.082006 Nov 20 20:57:38.975283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1883/3757] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:38 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:38.986185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: .version_select at 0x7f3f98e2be50>, body: {"keypair": {"name": "tempest-key-269789145"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:39.024895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:39.041384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:39.522940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:39.547389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6822da27-5680-4e87-935c-d23ac571564d tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1521 microversion: 2.1 time: 1.041552 Nov 20 20:57:39.561262 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1875/3758] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:38 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1521 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:39.605257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:39.606294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:39.621498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:39.622242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:39.623286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:39.623941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:39.694608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:39.704918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:39.724489 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b48f7785-1fa4-4a57-862b-e7dea6561fb1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.743308 Nov 20 20:57:39.725645 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1884/3759] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:57:38 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:39.734536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:39.735772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:39.742866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:39.743724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:39.744716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:39.745449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:39.814645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa4a423e-45c8-4968-8b53-94bce4994244 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 24520 microversion: 2.1 time: 0.087059 Nov 20 20:57:39.815470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1885/3760] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:39 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 24520 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:39.823224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df57f6dc-7fda-4e13-a7fe-72191cb9856f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '.version_select at 0x7f3f86eabf70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:39.829054 ncdv-master-1 devstack@n-api.service[140941]: WARNING oslo_db.sqlalchemy.utils [None req-df57f6dc-7fda-4e13-a7fe-72191cb9856f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 20 20:57:39.839163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df57f6dc-7fda-4e13-a7fe-72191cb9856f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.021242 Nov 20 20:57:39.840390 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1886/3761] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:57:39 2021] GET /compute/v2.1/os-keypairs => generated 544 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:40.011909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-526694516", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "key_name": "tempest-key-269789145", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:40.126002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:57:40.408169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:40.417068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabfdd3d-0872-4144-b226-76ed54092fff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.815458 Nov 20 20:57:40.421297 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1876/3762] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:39 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:40.609689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: .version_select at 0x7f3f98e15940>, body: {"keypair": {"name": "tempest-keypair-475445537"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:40.638183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:40.658475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:41.060008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:41.074134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:41.143372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c2b5375-6056-4294-b693-2fb2855b1057 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.718073 Nov 20 20:57:41.154462 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1877/3763] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 20:57:40 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:41.167822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:41.168628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:41.177257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.177710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.178539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.184301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.362550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1217211b10f84029b2a8bce2fe75bf58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55ad41c3ee37467d8298682b08275eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:41.377725 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35fb8df2-b533-4977-aa56-b5866f8eb8cc tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 200 len: 1479 microversion: 2.1 time: 0.217012 Nov 20 20:57:41.388065 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1878/3764] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:41 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 1479 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:41.400875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:41.404227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:41.434594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.435104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.435950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.436389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.570836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de705f6c-59f0-4fcf-ab18-7c26bd78adcf tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.189160 Nov 20 20:57:41.571586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1879/3765] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:41 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:41.590038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cdf5f266-5aa2-4913-94e8-0204f8e78d27 req-d4de6a1e-b053-42a0-a8a7-aba8d74e6fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293ef3df-319d-4bc8-8921-ed7b90ab89c9", "name": "network-vif-deleted", "tag": "f7efeaeb-5641-4aca-8236-410be11d600d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:41.595074 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:41.595074 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:41.615422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cdf5f266-5aa2-4913-94e8-0204f8e78d27 req-d4de6a1e-b053-42a0-a8a7-aba8d74e6fdd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.616108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cdf5f266-5aa2-4913-94e8-0204f8e78d27 req-d4de6a1e-b053-42a0-a8a7-aba8d74e6fdd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.641500 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cdf5f266-5aa2-4913-94e8-0204f8e78d27 req-d4de6a1e-b053-42a0-a8a7-aba8d74e6fdd service nova] Creating event network-vif-deleted:f7efeaeb-5641-4aca-8236-410be11d600d for instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 on nch2-master-1 Nov 20 20:57:41.656433 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cdf5f266-5aa2-4913-94e8-0204f8e78d27 req-d4de6a1e-b053-42a0-a8a7-aba8d74e6fdd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075248 Nov 20 20:57:41.657516 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1880/3766] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:41.675255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:41.680690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:41.693539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.695018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:41.698507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:41.699193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.014371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:57:42.015352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:57:42.016107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:57:42.016525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:57:42.016941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:57:42.032600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.033361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.034550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.035231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.062633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:42.069581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:42.093687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:57:42.096720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:57:42.231355 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a12329be-3b95-49c3-8c88-dabde1a062f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223469 Nov 20 20:57:42.237795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1887/3767] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:57:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 2231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 20:57:42.245701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b76f806-b906-40c3-bc0d-453f6151249e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:42.246620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b76f806-b906-40c3-bc0d-453f6151249e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:42.356680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b76f806-b906-40c3-bc0d-453f6151249e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:42.366507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b76f806-b906-40c3-bc0d-453f6151249e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1227 microversion: 2.1 time: 0.127153 Nov 20 20:57:42.368339 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1888/3768] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:42 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1227 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:42.401011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:42.402627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] [instance: 293ef3df-319d-4bc8-8921-ed7b90ab89c9] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:42.415693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.417613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.420093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.421472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.458221 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] HTTP exception thrown: Instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 could not be found. Nov 20 20:57:42.458957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] Returning 404 to user: Instance 293ef3df-319d-4bc8-8921-ed7b90ab89c9 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:57:42.460566 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81ff985b-bfd9-4f74-bfbc-b71716f817f7 tempest-ServerRescueNegativeTestJSON-204801631 tempest-ServerRescueNegativeTestJSON-204801631-project] 10.222.0.41 "GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9" status: 404 len: 111 microversion: 2.1 time: 0.066935 Nov 20 20:57:42.464578 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1889/3769] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:42 2021] GET /compute/v2.1/servers/293ef3df-319d-4bc8-8921-ed7b90ab89c9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:57:42.583522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:42.584765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:42.601797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.604326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.606895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:42.610252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:42.731485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99050db9-edf0-4857-a397-e5ed85bcec17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.152182 Nov 20 20:57:42.739055 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1890/3770] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:42 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:43.386393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:43.387093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:43.409689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:43.410239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:43.411100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:43.411554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:43.617245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:43.632836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1eb77413-fbfb-4893-8f35-357c13805a19 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 1.972377 Nov 20 20:57:43.633376 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1881/3771] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:41 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:43.654304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:43.664340 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e41b2a1c-d7cd-402d-aea1-727159ab172c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1223 microversion: 2.1 time: 0.282382 Nov 20 20:57:43.666415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1891/3772] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:43 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1223 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:43.751821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:43.753014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:43.776537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:43.777770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:43.778813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:43.779590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:43.915174 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67c5c87c-8d83-45a1-82f9-1a57d0f8c418 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.167985 Nov 20 20:57:43.916077 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1882/3773] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:43 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:44.657291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:44.657920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:44.669432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:44.669791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:44.674187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:44.674649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:44.684880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:44.686273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:44.697393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:44.700041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:44.707454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:44.708388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:45.013406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:45.028629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-31231bd5-e176-474c-abee-d540c0aff41e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1285 microversion: 2.1 time: 0.348469 Nov 20 20:57:45.029233 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1883/3774] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:44 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:45.046891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:45.047869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:45.069308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:45.069781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:45.070624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:45.074676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:45.166975 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50cc0f97-ed25-4583-9fad-60d514bd68a8 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.136379 Nov 20 20:57:45.168001 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1884/3775] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:45 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:45.336516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:45.345504 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-837c725e-7843-405c-ae04-6bd5bb23b030 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.692544 Nov 20 20:57:45.348150 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1892/3776] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:44 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:46.048896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:46.049674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:46.061559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.068656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.069752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.071085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.182606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:46.189249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:46.222658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.223241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.227093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.229344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.274499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:46.286109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4edb2f29-4cb1-4ffc-8232-3fe52a549e45 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1285 microversion: 2.1 time: 0.241488 Nov 20 20:57:46.287599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1885/3777] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:46 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:46.296921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2090276-9448-447b-a7ab-140f3e0b5e04 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.120810 Nov 20 20:57:46.297592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1893/3778] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:46 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:46.365441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:46.366116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:46.386810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.387279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.388126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:46.388575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:46.898717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:46.911431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd2f8112-9ac0-4732-8467-c6dcf4c70790 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.547908 Nov 20 20:57:46.912321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1886/3779] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:46 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:47.309559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:47.313695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:47.319421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:47.320282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:47.342281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.345318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:47.346258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.346403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.346792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:47.347629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:47.348851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.349556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:47.420783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5dbb77de-a6e8-41c8-a495-c6eea306095d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.115742 Nov 20 20:57:47.421941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1887/3780] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:47 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:47.891264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:47.905770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75c9737a-b8fc-456b-a3de-18579c0e9a52 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.605424 Nov 20 20:57:47.909399 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1894/3781] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:47 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:47.937854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:47.939438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:47.959316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.961270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:47.963818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:47.966274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:48.033357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2025757529", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bafdbd34-4234-401f-abb5-0b7b5a2562ab"}], "security_groups": [{"name": "tempest-securitygroup--471371780"}], "key_name": "tempest-keypair-475445537", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:48.593341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] validate_networks() for [('bafdbd34-4234-401f-abb5-0b7b5a2562ab', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:57:48.680107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:48.701183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86299061-656b-42ab-83e9-92c140cee603 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.775140 Nov 20 20:57:48.702706 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1888/3782] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:47 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:48.709111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:48.710369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:48.726295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:48.726863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:48.727950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:48.728494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:48.815911 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a8e0f5a-1c54-4fff-bd16-b3a0902b7542 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.111728 Nov 20 20:57:48.817540 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1889/3783] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:48 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:48.927739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:48.929492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:48.947785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:48.950846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:48.951843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:48.954620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:49.464678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:49.472294 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13258fed-1ae7-435f-a4f4-2fba74a8d3f0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.549053 Nov 20 20:57:49.478404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1890/3784] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:48 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:49.497404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1b86f3fe-e50d-476e-92f4-6033a8d0f0a8 req-73a56ceb-3fac-495e-afb3-ffb4dfe6c543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38ec66af-f8b0-4f25-83ae-85f58885a718", "tag": "a6d1b525-e620-4e9a-ad16-660dd0870311"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:49.499006 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:49.499006 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:49.524609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1b86f3fe-e50d-476e-92f4-6033a8d0f0a8 req-73a56ceb-3fac-495e-afb3-ffb4dfe6c543 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:49.525324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1b86f3fe-e50d-476e-92f4-6033a8d0f0a8 req-73a56ceb-3fac-495e-afb3-ffb4dfe6c543 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:49.560472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1b86f3fe-e50d-476e-92f4-6033a8d0f0a8 req-73a56ceb-3fac-495e-afb3-ffb4dfe6c543 service nova] Creating event network-changed:a6d1b525-e620-4e9a-ad16-660dd0870311 for instance 38ec66af-f8b0-4f25-83ae-85f58885a718 on nch1-master-1 Nov 20 20:57:49.571778 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1b86f3fe-e50d-476e-92f4-6033a8d0f0a8 req-73a56ceb-3fac-495e-afb3-ffb4dfe6c543 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090947 Nov 20 20:57:49.572421 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1891/3785] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:49.725534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:49.726227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:49.741992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:49.742999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:49.746101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:49.746814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.203976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:50.214635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ec604ac-1a22-443c-a3e3-a931aa3024d2 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.497229 Nov 20 20:57:50.215238 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1892/3786] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:49 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:50.225963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:50.227125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:50.233512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.234246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.235215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.235810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.374154 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ecbd2a3a-58d1-4a2c-8309-1582078a1548 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.155910 Nov 20 20:57:50.389056 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1893/3787] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:50 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:50.501808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:50.502913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:50.518726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.519197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.523968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.524660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.572313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:57:50.572768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:57:50.573208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:57:50.573782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:57:50.574261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:57:50.601052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.601510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.602370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:50.602818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:50.662821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:57:50.671606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:57:50.712204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:57:50.722514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:57:50.826842 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d53da0f-1d54-4882-94c1-9ec266f9f2e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.791734 Nov 20 20:57:50.827747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1895/3788] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:57:48 2021] POST /compute/v2.1/servers => generated 408 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:57:50.857339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f34c064-7ac3-44f2-9e0b-d31c974669ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:50.858279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f34c064-7ac3-44f2-9e0b-d31c974669ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:50.955234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:50.968850 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69a8b7d1-2b00-4ea9-b5cb-9f4348a1d9fe tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.482635 Nov 20 20:57:50.971131 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1894/3789] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:50 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:51.123865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f34c064-7ac3-44f2-9e0b-d31c974669ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:51.132700 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f34c064-7ac3-44f2-9e0b-d31c974669ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1238 microversion: 2.1 time: 0.292516 Nov 20 20:57:51.135807 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1896/3790] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:50 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1238 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:51.236557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:51.237314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:51.249518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:51.249981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:51.260790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:51.261305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:51.397281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:51.398263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:51.417731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:51.423546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:51.430448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:51.431659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:51.536197 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30d27956-3ee7-43b2-806f-cfd3f8c6c5b0 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.143236 Nov 20 20:57:51.550926 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1897/3791] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:51 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:51.680066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:51.692088 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-401b0418-ea0b-4a7c-903e-15c2dbdac864 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.462052 Nov 20 20:57:51.698030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1895/3792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:51 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:51.990277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:51.992039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:52.024053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.025513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.030441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.033562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.154817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:52.155476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:52.175460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.177925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.179104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.179934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.298465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:52.311144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7202f42-98d0-4f2c-959e-cb5f411f1b68 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1290 microversion: 2.1 time: 0.160269 Nov 20 20:57:52.313399 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1896/3793] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:52 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1290 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:52.573980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:52.575685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:52.594516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.597224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.612255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.613018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.683415 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-321b9064-f674-4851-ab85-6bc0436c3e12 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.114511 Nov 20 20:57:52.684692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1897/3794] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:52 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:52.715182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:52.718542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:52.730578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.730942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:52.731729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:52.732159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:53.229759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:53.259423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-340085c3-a701-423b-a0a6-3e8baf78df43 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 1.274864 Nov 20 20:57:53.267195 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1898/3795] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:51 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:53.277191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:53.292762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11a89def-9eaa-4f15-950b-4582e2f9be42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1523 microversion: 2.1 time: 0.581781 Nov 20 20:57:53.294109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1898/3796] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:52 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1523 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:53.329171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:53.330353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:53.337917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:53.339273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:53.340252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:53.341130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:53.440163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:53.454642 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0265d2f-e485-48d1-af7d-9f93017aa1f5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1296 microversion: 2.1 time: 0.128453 Nov 20 20:57:53.458699 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1899/3797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:53 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1296 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:53.694660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:53.695795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:53.717741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:53.718492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:53.719505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:53.720272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:53.800000 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5b45f64-4f45-410b-bfea-3a84adc273b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.109318 Nov 20 20:57:53.804744 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1899/3798] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:53 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:54.276967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:54.277577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:54.293190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.294258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:54.297812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.298492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:54.313335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:54.315687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:54.331896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.332914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:54.348428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.348892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:54.861778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:54.874822 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18030dd6-ee8e-4e85-ab7e-394c8f962567 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.601861 Nov 20 20:57:54.887729 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1900/3799] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:54 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:54.898174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:54.912073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:54.927893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.929319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:54.930443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:54.931496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:55.288935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:55.299318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41d30d36-69e1-42d6-b95a-0fe61ae88983 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1505 microversion: 2.1 time: 0.987983 Nov 20 20:57:55.300187 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1900/3800] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:54 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1505 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:55.310314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:55.314770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:55.328407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:55.329303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:55.329697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:55.330169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:55.424590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0419d1ab-e211-41f6-8971-6e8239346583 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.120066 Nov 20 20:57:55.425416 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1901/3801] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:55 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:55.449070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:55.462395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f50f11c-b623-4e59-88ef-0e889519cbea tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.572026 Nov 20 20:57:55.464609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1901/3802] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:54 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:55.893157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:55.893848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:55.909865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:55.910866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:55.911672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:55.912281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.041107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1df1dcce-97ae-4d5a-a67a-908162528680 req-f501e5bd-940c-4ce5-9dc4-194615d62585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec66af-f8b0-4f25-83ae-85f58885a718", "name": "network-vif-plugged", "status": "completed", "tag": "a6d1b525-e620-4e9a-ad16-660dd0870311"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:56.043582 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:56.043582 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:57:56.054667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1df1dcce-97ae-4d5a-a67a-908162528680 req-f501e5bd-940c-4ce5-9dc4-194615d62585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.055656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1df1dcce-97ae-4d5a-a67a-908162528680 req-f501e5bd-940c-4ce5-9dc4-194615d62585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.091325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1df1dcce-97ae-4d5a-a67a-908162528680 req-f501e5bd-940c-4ce5-9dc4-194615d62585 service nova] Creating event network-vif-plugged:a6d1b525-e620-4e9a-ad16-660dd0870311 for instance 38ec66af-f8b0-4f25-83ae-85f58885a718 on nch1-master-1 Nov 20 20:57:56.103458 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1df1dcce-97ae-4d5a-a67a-908162528680 req-f501e5bd-940c-4ce5-9dc4-194615d62585 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067082 Nov 20 20:57:56.105605 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1902/3803] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:57:56.320582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:56.322307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:56.338764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.339461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.341269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.341942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.372899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:56.388339 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84c1c7de-c32c-4ca5-a51f-569f66e2f9f3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.499226 Nov 20 20:57:56.388999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1902/3804] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:55 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:56.437637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:56.438797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:56.447472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.448160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.449245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.449710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.521726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ae9f7c7-d67f-46ea-ad78-1cbfebbee30d tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.088309 Nov 20 20:57:56.533800 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1903/3805] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:56 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:57:56.544131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:56.544840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:56.562362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.562813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.563615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:56.564050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:56.817084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:56.833194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ceba6199-1938-438f-8bc3-430c4db3767b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.297877 Nov 20 20:57:56.844864 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1904/3806] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:56 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:56.847100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-83728b94-7849-41c0-be40-49f60f27c585 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86116280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:56.950537 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-83728b94-7849-41c0-be40-49f60f27c585 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/eab55441-b110-401d-967c-ff260090887c" status: 200 len: 343 microversion: 2.1 time: 0.111078 Nov 20 20:57:56.951361 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1905/3807] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 20:57:56 2021] GET /compute/v2.1/os-volumes/eab55441-b110-401d-967c-ff260090887c => generated 343 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:57.007772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-96b0834a-512a-43b0-9978-2f22e1a866fe req-f5f6930d-33e6-45a2-a512-6e371965e74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:57.009616 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:57.009616 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:57.033438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-96b0834a-512a-43b0-9978-2f22e1a866fe req-f5f6930d-33e6-45a2-a512-6e371965e74f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.034152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-96b0834a-512a-43b0-9978-2f22e1a866fe req-f5f6930d-33e6-45a2-a512-6e371965e74f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.060991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-96b0834a-512a-43b0-9978-2f22e1a866fe req-f5f6930d-33e6-45a2-a512-6e371965e74f service nova] Creating event network-changed:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 20:57:57.074177 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-96b0834a-512a-43b0-9978-2f22e1a866fe req-f5f6930d-33e6-45a2-a512-6e371965e74f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073809 Nov 20 20:57:57.076818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1906/3808] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:57:57.408335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:57.409776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:57.419808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:57.421634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.424383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.425337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.425856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.456559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5286a9ef-6a9c-4d26-a8b3-5643e65334b5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1505 microversion: 2.1 time: 1.141767 Nov 20 20:57:57.460639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1903/3809] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:56 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1505 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:57.539146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:57.540122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:57.555255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.555744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.557287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.557786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.674525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0af5f3fc-9e66-40c0-a053-39ee48c93dc3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.139580 Nov 20 20:57:57.676895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1904/3810] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:57 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:57.789707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:57.801010 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-24b3fba8-57e5-4885-9536-f0e571fb3b79 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1327 microversion: 2.1 time: 0.397268 Nov 20 20:57:57.802509 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1907/3811] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:57 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1327 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:57:57.853342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:57.854072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:57.868236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.868699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:57.869661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:57.869942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.121008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8eb07b20-a87e-4c6f-9631-7ac1dccc2bcc req-28057ac7-c4a6-4992-a95a-d3fe6b204114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a37d1-6352-4c63-8de6-2e9e94bf609f", "name": "network-vif-unplugged", "status": "completed", "tag": "6171bf54-836b-4b89-9942-130b6f53b7ac"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:58.122599 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:57:58.122599 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:57:58.132010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8eb07b20-a87e-4c6f-9631-7ac1dccc2bcc req-28057ac7-c4a6-4992-a95a-d3fe6b204114 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.132715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8eb07b20-a87e-4c6f-9631-7ac1dccc2bcc req-28057ac7-c4a6-4992-a95a-d3fe6b204114 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.175702 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8eb07b20-a87e-4c6f-9631-7ac1dccc2bcc req-28057ac7-c4a6-4992-a95a-d3fe6b204114 service nova] Creating event network-vif-unplugged:6171bf54-836b-4b89-9942-130b6f53b7ac for instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f on nch2-master-1 Nov 20 20:57:58.190957 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8eb07b20-a87e-4c6f-9631-7ac1dccc2bcc req-28057ac7-c4a6-4992-a95a-d3fe6b204114 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072331 Nov 20 20:57:58.195009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1908/3812] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:57:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:58.417618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:58.425609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-361c4901-4f8a-4bbd-8295-20ec8e08b0bc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.576046 Nov 20 20:57:58.427532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1905/3813] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:57 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:58.480767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:58.482215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:58.489372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.490080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.491194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.491855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.634690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:58.642578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1af3cf5a-3afe-4062-9892-4d24eaf7d9dc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 200 len: 1448 microversion: 2.1 time: 0.170311 Nov 20 20:57:58.643357 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1909/3814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:58 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 1448 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:58.661076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:58.661768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:58.667635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0c8b3c2-bd04-45c0-8d73-7c9d28eaf0be tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86a7a040>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:58.668343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.668791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.669581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.670016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.696597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:57:58.702897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.api [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Working on deleting snapshot a4343ad3-6d8f-45ac-9627-ef50339af9eb from shelved instance... Nov 20 20:57:58.719489 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0c8b3c2-bd04-45c0-8d73-7c9d28eaf0be tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/db054416-9aec-4e4b-85aa-14e648e12ef5" status: 200 len: 342 microversion: 2.1 time: 0.056314 Nov 20 20:57:58.734119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1910/3815] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 20:57:58 2021] GET /compute/v2.1/os-volumes/db054416-9aec-4e4b-85aa-14e648e12ef5 => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:57:58.739678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:57:58.740917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:58.750234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.751437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.752532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.752972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.814703 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7e6f732-6b23-4138-a666-8b5c5dfcd660 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.081505 Nov 20 20:57:58.818025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1911/3816] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:57:58 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:57:58.828007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:58.831774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:58.846690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.853346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:58.854729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:58.857402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:59.729876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Doing local delete in cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140941) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 20 20:57:59.730761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:59.731308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:59.731802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.api [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 20 20:57:59.736716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] deallocate_for_instance() {{(pid=140941) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 20 20:57:59.802564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:57:59.810771 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-10f8a62a-dd50-4732-b4e1-501d7bd00e53 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1507 microversion: 2.1 time: 0.991284 Nov 20 20:57:59.824137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1912/3817] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:58 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1507 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:57:59.829655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:57:59.830633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:57:59.838828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:59.839630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:57:59.840691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:57:59.841373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.132327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:00.141457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33a5cd4b-20d7-4780-8642-cc35e19e4ef0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.316180 Nov 20 20:58:00.142472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1913/3818] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:57:59 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:00.149826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:00.151536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:00.160878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.161710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.162811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.163475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.229764 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69d9391a-c547-48f3-b48a-5e1be4aee59b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.085612 Nov 20 20:58:00.236699 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1914/3819] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:00 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:00.246769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:00.247746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:00.258622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.259328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.260718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.261601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.689392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:00.703497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-003e80e6-9360-4329-b9c9-235a4d722674 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1507 microversion: 2.1 time: 0.465059 Nov 20 20:58:00.715690 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1915/3820] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:00 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:00.721469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bed25838-d18c-41d2-974b-453b9fe452d1 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f869f2280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:00.788558 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bed25838-d18c-41d2-974b-453b9fe452d1 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/9d45cf2c-0b35-460d-b681-0db7f4ba2518" status: 200 len: 344 microversion: 2.1 time: 0.071392 Nov 20 20:58:00.797570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1916/3821] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 20:58:00 2021] GET /compute/v2.1/os-volumes/9d45cf2c-0b35-460d-b681-0db7f4ba2518 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:00.804087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:00.805241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:00.814469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.815171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.816229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:00.816907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:00.846335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:58:00.993306 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d835e1c2-c596-4b16-9f3a-27c19d18394f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 204 len: 0 microversion: 2.1 time: 0.193373 Nov 20 20:58:00.995549 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1917/3822] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:58:00 2021] DELETE /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:01.009689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe16a186-9c3d-42b1-8ef0-814aac3a2165 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f8622f9d0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:01.096081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Updating instance_info_cache with network_info: [] {{(pid=140941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:58:01.298661 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe16a186-9c3d-42b1-8ef0-814aac3a2165 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.297168 Nov 20 20:58:01.299722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1918/3823] 10.222.0.41 () {58 vars in 1133 bytes} [Sat Nov 20 20:58:00 2021] GET /compute/v2.1/os-volumes => generated 1012 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:01.313692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:01.314836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:01.328097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.329096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.330463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.331156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.857107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:01.868911 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d26bee91-0805-4e85-96b5-7b25d1b3643b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1513 microversion: 2.1 time: 0.567078 Nov 20 20:58:01.869892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1919/3824] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:01 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1513 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:01.883191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:01.886826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:01.895942 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33d8eec9-3f8b-4668-856a-81f0771b54f9 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 204 len: 0 microversion: 2.1 time: 3.239160 Nov 20 20:58:01.903566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.904267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.905142 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1906/3825] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:57:58 2021] DELETE /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 0 bytes in 3246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:01.905295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.908759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.912551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2d2ea379-348d-4fe3-a241-19038eff2733 req-670401a5-3625-4476-a961-b043515e73d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a37d1-6352-4c63-8de6-2e9e94bf609f", "name": "network-vif-deleted", "tag": "6171bf54-836b-4b89-9942-130b6f53b7ac"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:01.915140 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:01.915140 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:01.929915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2d2ea379-348d-4fe3-a241-19038eff2733 req-670401a5-3625-4476-a961-b043515e73d2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.930713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2d2ea379-348d-4fe3-a241-19038eff2733 req-670401a5-3625-4476-a961-b043515e73d2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.947917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.server_external_events [req-2d2ea379-348d-4fe3-a241-19038eff2733 req-670401a5-3625-4476-a961-b043515e73d2 service nova] Unable to find a host for instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f. Dropping event network-vif-deleted {{(pid=140941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 20:58:01.948897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2d2ea379-348d-4fe3-a241-19038eff2733 req-670401a5-3625-4476-a961-b043515e73d2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.042511 Nov 20 20:58:01.949873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1907/3826] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 20 20:58:01.955189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:01.956238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:01.967160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.967818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:01.968753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:01.969199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:02.019576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02a39611-3467-4d2c-9151-8860398a0a49 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.068209 Nov 20 20:58:02.020334 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1908/3827] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:01 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:02.025560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3bbba8e6-7859-4bde-9d1d-db5d81835a05 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86ea3700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.149223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3bbba8e6-7859-4bde-9d1d-db5d81835a05 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.127533 Nov 20 20:58:02.149878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1909/3828] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:02.155695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.156691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:02.166135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:02.166810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:02.168073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:02.168718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:02.195354 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. Nov 20 20:58:02.197369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:58:02.198709 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56b809ca-22de-4275-a273-c2f759792943 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 404 len: 111 microversion: 2.1 time: 0.046999 Nov 20 20:58:02.199658 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1910/3829] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:58:02.232955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56659017-f2ff-4fc5-a02d-8afc94fbae16 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f98e2b820>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.275326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:02.289720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-419b2d11-38e9-4341-acd7-5d4a01453509 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.412237 Nov 20 20:58:02.291891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1920/3830] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:01 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:02.378405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56659017-f2ff-4fc5-a02d-8afc94fbae16 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1012 microversion: 2.1 time: 0.176181 Nov 20 20:58:02.387817 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1911/3831] 10.222.0.41 () {58 vars in 1133 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes => generated 1012 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:02.391758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8e55c41-fb70-4007-9ec5-3460ac5347cc tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86a0a5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.408392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2131705696", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:02.549237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:58:02.561370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8e55c41-fb70-4007-9ec5-3460ac5347cc tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.174016 Nov 20 20:58:02.562239 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1921/3832] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:02.576450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb27ac3f-3c21-46d4-9d5d-21b0272afaaf tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86af1670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.695031 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb27ac3f-3c21-46d4-9d5d-21b0272afaaf tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.124373 Nov 20 20:58:02.696914 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1922/3833] 10.222.0.41 () {58 vars in 1169 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:58:02.710964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13b7743b-078b-45ec-ada8-c861ddf5fae8 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f8766daf0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.822015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13b7743b-078b-45ec-ada8-c861ddf5fae8 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.116107 Nov 20 20:58:02.822775 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1923/3834] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:02.834853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae26021c-af96-42b2-a441-033c17be4b4c tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f98c50a60>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.977330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ae26021c-af96-42b2-a441-033c17be4b4c tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.146918 Nov 20 20:58:02.977971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1924/3835] 10.222.0.41 () {58 vars in 1187 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:58:02.994458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:02.995081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:03.018922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.020006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.020790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.021236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.552686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:03.560544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45cdef3b-d849-4aa3-b717-955f10a65035 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 200 len: 1513 microversion: 2.1 time: 0.569729 Nov 20 20:58:03.561446 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1925/3836] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:02 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:03.566812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5488ac7-23e0-46c6-9b11-afd5db4f84c3 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] Calling method '.version_select at 0x7f3f86a0a5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:03.568316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:58:03.569199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:58:03.570112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:58:03.570671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:58:03.572743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:58:03.603522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.606438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.607484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.608146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.652181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:58:03.657664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:58:03.673839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:58:03.676867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:58:03.695103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5488ac7-23e0-46c6-9b11-afd5db4f84c3 tempest-VolumesTestJSON-430761339 tempest-VolumesTestJSON-430761339-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1012 microversion: 2.1 time: 0.132461 Nov 20 20:58:03.716781 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1926/3837] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 20:58:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1012 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:03.726603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:03.741058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-094e9caf-1ea4-4e65-a1c8-dd735922a35e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.337566 Nov 20 20:58:03.745972 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1912/3838] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:58:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:58:03.749928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:03.793575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.794478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.796071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.796877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.921475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6df375f5-b043-4de8-90e2-8c4691c11609 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.203100 Nov 20 20:58:03.922735 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1927/3839] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:03 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:03.936394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:03.938242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:03.950194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.951457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:03.952790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:03.953521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:04.079273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-489243241", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7dde530b-f780-469d-8a3e-3b58058fca24"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:04.187548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] validate_networks() for [('7dde530b-f780-469d-8a3e-3b58058fca24', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:58:04.263883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:04.275381 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bafdadce-6dfb-4936-ac9d-22ea5e58d9b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.349699 Nov 20 20:58:04.282453 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1928/3840] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:03 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:04.288515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7553ea4d-9d01-49cd-9b0b-d7cb162bea6e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:04.289210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7553ea4d-9d01-49cd-9b0b-d7cb162bea6e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:04.401195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7553ea4d-9d01-49cd-9b0b-d7cb162bea6e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:04.431625 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7553ea4d-9d01-49cd-9b0b-d7cb162bea6e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1215 microversion: 2.1 time: 0.147748 Nov 20 20:58:04.435090 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1929/3841] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:04 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:04.457470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e0d91400-bc51-45e0-bd6f-4f201c1165cf req-3a9d19c1-a21a-4e77-bd15-19f1d16e0859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38ec66af-f8b0-4f25-83ae-85f58885a718", "name": "network-vif-deleted", "tag": "a6d1b525-e620-4e9a-ad16-660dd0870311"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:04.461774 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:04.461774 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:04.498361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e0d91400-bc51-45e0-bd6f-4f201c1165cf req-3a9d19c1-a21a-4e77-bd15-19f1d16e0859 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:04.499175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e0d91400-bc51-45e0-bd6f-4f201c1165cf req-3a9d19c1-a21a-4e77-bd15-19f1d16e0859 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:04.567134 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e0d91400-bc51-45e0-bd6f-4f201c1165cf req-3a9d19c1-a21a-4e77-bd15-19f1d16e0859 service nova] Creating event network-vif-deleted:a6d1b525-e620-4e9a-ad16-660dd0870311 for instance 38ec66af-f8b0-4f25-83ae-85f58885a718 on nch1-master-1 Nov 20 20:58:04.588431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e0d91400-bc51-45e0-bd6f-4f201c1165cf req-3a9d19c1-a21a-4e77-bd15-19f1d16e0859 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146322 Nov 20 20:58:04.591299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1930/3842] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:04.611413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:04.618239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:04.650789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:04.651553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:04.655819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:04.656960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:04.684005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. Nov 20 20:58:04.684688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:58:04.685794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0bef0995-62f3-4394-89da-b8f2ba4ddcab tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 404 len: 111 microversion: 2.1 time: 0.092017 Nov 20 20:58:04.686667 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1931/3843] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:04 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:58:04.696282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-362ff90a-cfa5-4275-b580-41cce1f7cd90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '.version_select at 0x7f3f86af1ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:04.730324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-362ff90a-cfa5-4275-b580-41cce1f7cd90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-key-269789145" status: 202 len: 0 microversion: 2.1 time: 0.038032 Nov 20 20:58:04.743343 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1932/3844] 10.222.0.41 () {58 vars in 1205 bytes} [Sat Nov 20 20:58:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-key-269789145 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:58:04.852546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1448437037", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:04.914786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:58:04.990950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:58:04.992185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:58:04.993555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:58:04.994222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:58:04.995067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:58:05.008679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.009520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.010766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.011603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.032197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Getting quotas for project 81f065ce4dee4b479d5ab54d07605e61. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:58:05.038884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Getting quotas for user e877a5425d344711bc81f09650d9fc0b and project 81f065ce4dee4b479d5ab54d07605e61. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:58:05.055301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:58:05.058352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:58:05.132485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19daadec-24dd-4e73-bb69-dabb970381b6 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383199 Nov 20 20:58:05.134818 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1913/3845] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:58:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:58:05.149581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:05.151599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:05.166409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.167218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.168291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.168884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.243074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8942c096-be65-4e91-883b-bb1df9a08333 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.095013 Nov 20 20:58:05.246312 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1914/3846] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:05 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:05.260453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e669756-ea36-4fb7-8043-8e5d37c30d9a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:05.264099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e669756-ea36-4fb7-8043-8e5d37c30d9a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:05.474010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e669756-ea36-4fb7-8043-8e5d37c30d9a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:05.488442 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e669756-ea36-4fb7-8043-8e5d37c30d9a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1223 microversion: 2.1 time: 0.240014 Nov 20 20:58:05.503558 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1915/3847] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:05 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1223 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:05.508847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:05.528029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:05.545874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.556251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.559462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.561736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.901953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:58:05.903738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:58:05.904208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:58:05.904691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:58:05.905114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:58:05.920884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.921464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.922340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:05.923478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:05.938629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:05.947368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d15c864-112e-4e79-9e99-4c61798edd02 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.442067 Nov 20 20:58:05.961104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1916/3848] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:05 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:05.963526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:58:05.970084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-700bf578-074a-41d0-bf01-bfd7a0fde410 req-a1ac5a57-6278-4574-a2c3-c4a9363d4a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-plugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:05.975045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:58:05.977220 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:05.977220 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:05.996234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-700bf578-074a-41d0-bf01-bfd7a0fde410 req-a1ac5a57-6278-4574-a2c3-c4a9363d4a88 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.000328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:58:06.000492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-700bf578-074a-41d0-bf01-bfd7a0fde410 req-a1ac5a57-6278-4574-a2c3-c4a9363d4a88 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.002726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:58:06.026339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-700bf578-074a-41d0-bf01-bfd7a0fde410 req-a1ac5a57-6278-4574-a2c3-c4a9363d4a88 service nova] Creating event network-vif-plugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 20:58:06.040980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-700bf578-074a-41d0-bf01-bfd7a0fde410 req-a1ac5a57-6278-4574-a2c3-c4a9363d4a88 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078126 Nov 20 20:58:06.047599 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1917/3849] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:06.063654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:06.064521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:06.087540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.088151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.089109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.089667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.100347 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c9c506e-56c2-4294-9f4d-37f93dcbf980 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251907 Nov 20 20:58:06.101005 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1933/3850] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:58:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:58:06.111829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1151a5c2-c351-4363-bd24-0d8a74a7b221 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:06.112438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1151a5c2-c351-4363-bd24-0d8a74a7b221 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:06.214990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:06.227052 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01406741-532b-4fa8-b331-a1111cfc1d62 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1273 microversion: 2.1 time: 0.177804 Nov 20 20:58:06.240554 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1918/3851] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:06 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:06.252630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1151a5c2-c351-4363-bd24-0d8a74a7b221 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:06.256417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:06.257458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:06.265229 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1151a5c2-c351-4363-bd24-0d8a74a7b221 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1209 microversion: 2.1 time: 0.156967 Nov 20 20:58:06.266406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1934/3852] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:06 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1209 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:06.277531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.284289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.292119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.292680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.477216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dcd29466-8edb-4a61-b238-00307f12698c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.224548 Nov 20 20:58:06.486235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1919/3853] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:06 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:06.520780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:06.521664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:06.528400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.536668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.540538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:06.544864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:06.778285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:06.799904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50637ea1-b309-4ca1-8c83-4c08f117d46c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1275 microversion: 2.1 time: 0.283350 Nov 20 20:58:06.817748 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1935/3854] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:06 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:06.967200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:06.967910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:07.009225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.014253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.016452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.018616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.250518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:07.251200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:07.265954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.266467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.267504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.271643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.502208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:07.518387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2af32b90-82ac-4a59-9312-e4a2e382e94a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1363 microversion: 2.1 time: 0.550234 Nov 20 20:58:07.520814 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1920/3855] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:06 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1363 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:07.529911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:07.540518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:07.583151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.587841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.589785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.590068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.858896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:07.868083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b731490-ef90-4df9-909d-8458a2f568ed tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1261 microversion: 2.1 time: 0.345231 Nov 20 20:58:07.873358 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1921/3856] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:07 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1261 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:07.881700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:07.884959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:07.911132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.911591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.925316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:07.933867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:07.995727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b78248b-ac90-49db-8b3c-2da57cf3612f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.120383 Nov 20 20:58:07.999813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1922/3857] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:07 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:08.005929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:08.006769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:08.025344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.025912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:08.026639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.027077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:08.115744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:08.123759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d910c9c-2086-4d0d-aeeb-0970939e3cf8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 0.880147 Nov 20 20:58:08.133089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1936/3858] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:07 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:08.172963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:08.185772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bcec3010-bfa1-4f59-8e71-b8d01c6678b9 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1281 microversion: 2.1 time: 0.186133 Nov 20 20:58:08.187671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1923/3859] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:07 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:08.537965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:08.539139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:08.548023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.550727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:08.553406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.562480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:08.891009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:08.891886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:08.903908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.904709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:08.908501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:08.909193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.077017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:09.081013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:09.085141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ada21f79-9bc7-49a2-914d-0b9c4c840ab8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1550 microversion: 2.1 time: 0.552114 Nov 20 20:58:09.089629 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1937/3860] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:08 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1550 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:09.092844 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d8f148c-a02a-46e5-b8a7-dfe2d1ac51a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1267 microversion: 2.1 time: 0.206068 Nov 20 20:58:09.099920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:09.101374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:09.103931 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1924/3861] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:08 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:09.115796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:09.116316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:09.116467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.117029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.117954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.118524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.130130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.133026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.134112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.134713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.193842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9fe44e26-91ca-402f-9147-c846c1c76850 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.102790 Nov 20 20:58:09.199069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1938/3862] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:09 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:09.206022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:09.210962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:09.223940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.227075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.228053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.228672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.874125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3fa64f64-ba32-456e-9e93-c756bd70564b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.768980 Nov 20 20:58:09.875213 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1925/3863] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 20:58:09 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/os-interface => generated 285 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:09.879895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:09.880665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:09.900980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.901865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:09.903428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:09.909125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:10.094771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:10.106778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cd96561-2d51-4d74-87e2-98f09e539419 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1281 microversion: 2.1 time: 0.230036 Nov 20 20:58:10.109899 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1926/3864] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:09 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:10.121060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:10.126396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:10.163506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:10.164209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:10.165184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:10.165757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:10.419442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:10.442494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51a354b4-7b33-403c-be72-0bafbeceed33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1267 microversion: 2.1 time: 0.331071 Nov 20 20:58:10.449114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:10.461175 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1927/3865] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:10 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:10.464813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:10.465737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:10.470644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3348d37d-873a-4ba5-987e-abd3231b1ee0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 1.269869 Nov 20 20:58:10.474825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1939/3866] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:09 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:10.544958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:10.545533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:10.546412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:10.546852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:10.653921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7f09cad-0c03-4eb0-8b6d-228870f5a935 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.193803 Nov 20 20:58:10.660785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1928/3867] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:10 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:11.130590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:11.131719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:11.141662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:11.142388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:11.143308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:11.144767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:11.461066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:11.461780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:11.482694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:11.483376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:11.484226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:11.484731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.198835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:12.214287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60f0d567-609e-496b-8aa0-a19a334da8be tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 1.089181 Nov 20 20:58:12.227393 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1940/3868] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:11 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:12.242221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:12.244696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:12.254747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:12.255679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.260199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:12.261087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.614650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:12.628544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88ce9fe4-fcd8-4edc-8c64-e04a957eb8cf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 1.172518 Nov 20 20:58:12.631019 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1929/3869] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:11 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:12.641286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:12.665999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:12.679107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:12.680909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.682556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:12.684037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.750581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-071f8c40-908d-4e64-8083-a346ef96a2c9 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.113182 Nov 20 20:58:12.752044 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1930/3870] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:12 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:12.759005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4faeaf6d-1ac2-406e-84e8-ef7fb7c39f50 req-c6fc8ea0-ef62-4df0-8372-72842f028a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1e03721-bed1-4ab2-93cf-46282cbec99f", "tag": "8db776c8-e246-49f6-8f5f-c227f2b7e7c9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:12.761544 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:12.761544 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:12.771908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4faeaf6d-1ac2-406e-84e8-ef7fb7c39f50 req-c6fc8ea0-ef62-4df0-8372-72842f028a33 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:12.772754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4faeaf6d-1ac2-406e-84e8-ef7fb7c39f50 req-c6fc8ea0-ef62-4df0-8372-72842f028a33 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:12.790923 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4faeaf6d-1ac2-406e-84e8-ef7fb7c39f50 req-c6fc8ea0-ef62-4df0-8372-72842f028a33 service nova] Creating event network-changed:8db776c8-e246-49f6-8f5f-c227f2b7e7c9 for instance e1e03721-bed1-4ab2-93cf-46282cbec99f on nch1-master-1 Nov 20 20:58:12.798080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4faeaf6d-1ac2-406e-84e8-ef7fb7c39f50 req-c6fc8ea0-ef62-4df0-8372-72842f028a33 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043250 Nov 20 20:58:12.801272 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1931/3871] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:13.146145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:13.147185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:13.167768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.168415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.169407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.170010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.296343 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-097de35f-6d23-43f7-91ce-1f6ac8da8a75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.152506 Nov 20 20:58:13.299322 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1932/3872] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:13 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:58:13.321315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-028439f8-c632-49c6-bee9-505a9af579b5 req-dd9e9af7-2233-4883-8a77-df23670ccda4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:13.325486 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:13.325486 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:13.334765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-028439f8-c632-49c6-bee9-505a9af579b5 req-dd9e9af7-2233-4883-8a77-df23670ccda4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.335472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-028439f8-c632-49c6-bee9-505a9af579b5 req-dd9e9af7-2233-4883-8a77-df23670ccda4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.349256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-028439f8-c632-49c6-bee9-505a9af579b5 req-dd9e9af7-2233-4883-8a77-df23670ccda4 service nova] Creating event network-changed:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 20:58:13.359695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-028439f8-c632-49c6-bee9-505a9af579b5 req-dd9e9af7-2233-4883-8a77-df23670ccda4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056572 Nov 20 20:58:13.360918 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1933/3873] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:13.369462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:13.370729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:13.381063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.381747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.383292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.383939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.430985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:13.440100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8489cf9-5240-46bd-87ba-70d3bff7a39f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 1.210453 Nov 20 20:58:13.447496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1941/3874] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:12 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:13.648244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:13.648881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:13.651846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:13.660149 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b50310b2-125e-413f-8fce-bcf4d5642ef2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.297062 Nov 20 20:58:13.660752 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1934/3875] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:13 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:13.667017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.667481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.668298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.668754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.764481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:13.765676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:13.785723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.789198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.793062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:13.793839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:13.886391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48cfee99-eee3-4afd-8d21-061f083d6816 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.127337 Nov 20 20:58:13.887853 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1935/3876] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:13 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:14.309665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:14.310764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:14.331838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.332155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.333134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.333566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.404921 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8da86bb1-ceea-48e8-8752-591bb504bb61 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.099448 Nov 20 20:58:14.405884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1936/3877] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:14 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 20:58:14.420687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:14.443172 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e60a916c-c08e-464c-b8e6-91e5de4aa147 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.799747 Nov 20 20:58:14.444408 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1942/3878] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:13 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:14.463761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:14.464449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:14.476374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.476877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.477683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.478143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.680371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:14.681273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:14.694391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.697649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.698862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:14.701152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:14.977792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:14.987313 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0f77820-6533-4559-a4e9-1b0cbc49aae1 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 0.526147 Nov 20 20:58:14.989830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1937/3879] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:14 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:15.002269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:15.005807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:15.020581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.023211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.027403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.028315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.121871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10c9585e-db19-4641-a4b8-eacf6ec3ba06 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.127386 Nov 20 20:58:15.126141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1938/3880] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:14 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:15.169801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-966b454e-8b6e-48e4-864d-c2a190c29449 req-8ad0acfd-d0c9-407f-8334-7188e1e354a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:15.175440 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:15.175440 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:15.198332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-966b454e-8b6e-48e4-864d-c2a190c29449 req-8ad0acfd-d0c9-407f-8334-7188e1e354a4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.211488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-966b454e-8b6e-48e4-864d-c2a190c29449 req-8ad0acfd-d0c9-407f-8334-7188e1e354a4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.264751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-966b454e-8b6e-48e4-864d-c2a190c29449 req-8ad0acfd-d0c9-407f-8334-7188e1e354a4 service nova] Creating event network-changed:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:58:15.286084 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-966b454e-8b6e-48e4-864d-c2a190c29449 req-8ad0acfd-d0c9-407f-8334-7188e1e354a4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144808 Nov 20 20:58:15.287571 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1939/3881] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:15.423927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:15.429139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:15.475621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.483602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.487235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.488608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.554619 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c4547ea-bb01-4b4b-a79d-2740a9ea7e10 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.135678 Nov 20 20:58:15.557042 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1940/3882] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:15 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:58:15.583897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:15.584612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:15.598380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.599290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.600285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:15.600948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:15.641756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:15.651993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2926754-193c-4e14-833b-dc9ff8053d3f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.976523 Nov 20 20:58:15.655186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1943/3883] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:14 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:16.008752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:16.010127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:16.025486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.028435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.029424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.032329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.559327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:16.569234 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4aa291a4-186c-4e17-9808-c3b94fcd167a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 1.010460 Nov 20 20:58:16.570816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1941/3884] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:15 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:16.583967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:16.587208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:16.605829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.618558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.619687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.620132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.702374 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dab1bff0-db89-4cd4-ae24-534599f54f08 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.126256 Nov 20 20:58:16.703927 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1942/3885] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:16 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:16.717387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:16.722142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:16.730980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.731708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.732874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.733600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.788352 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69d03861-2330-4620-8bfc-81261b22351f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.080984 Nov 20 20:58:16.788999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1943/3886] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:16 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:58:16.796244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:16.796941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:16.807482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.807957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:16.808768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:16.809830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.193760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:17.212048 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b821eb9a-63eb-4a35-8a38-ad3b34743802 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.420212 Nov 20 20:58:17.222889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1944/3887] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:16 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:17.238978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:17.248738 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdfc63dc-2441-4551-bbbd-0489f17a2c56 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 1.246905 Nov 20 20:58:17.252045 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1944/3888] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:16 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:17.454431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2eebff4a-fe7b-4dae-a681-d048498171f9 req-4004af35-518b-4481-8293-e836f70d1628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f740d9f-2e25-44ef-95b1-b05cfb73a79f", "tag": "fbb98294-0032-45b6-818d-7bb8780a27d3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:17.456505 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:17.456505 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:17.466685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2eebff4a-fe7b-4dae-a681-d048498171f9 req-4004af35-518b-4481-8293-e836f70d1628 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.468160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2eebff4a-fe7b-4dae-a681-d048498171f9 req-4004af35-518b-4481-8293-e836f70d1628 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.552840 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2eebff4a-fe7b-4dae-a681-d048498171f9 req-4004af35-518b-4481-8293-e836f70d1628 service nova] Creating event network-changed:fbb98294-0032-45b6-818d-7bb8780a27d3 for instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f on nch1-master-1 Nov 20 20:58:17.571668 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2eebff4a-fe7b-4dae-a681-d048498171f9 req-4004af35-518b-4481-8293-e836f70d1628 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114253 Nov 20 20:58:17.572672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1945/3889] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:17.588078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:17.589313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:17.599650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.600793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.602015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.603012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.719516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:17.721184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:17.735048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.735904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.737518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.739694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.844779 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ae41072-971c-4280-b12d-7ff8cedf6380 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.132730 Nov 20 20:58:17.845876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1946/3890] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:17 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:17.852846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:17.853871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:17.862418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.863184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.864021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:17.865155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:17.922485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed2892fc-fa0b-478f-8c40-2bebe68e01f6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.074733 Nov 20 20:58:17.926979 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1947/3891] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:17 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:58:18.074493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:18.081899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c45bd9dc-5d0e-4468-b2cd-9291a23c63bf tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.498941 Nov 20 20:58:18.082625 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1945/3892] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:17 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:18.231437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:18.232153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:18.243809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.244326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.245184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.245627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.270189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:18.271485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:18.287946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.288553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.289420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.289868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.861532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:18.869548 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e92a132f-d6bd-4275-b60c-b9d76ee7c538 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 0.604139 Nov 20 20:58:18.874177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1946/3893] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:18 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:18.884698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:18.885971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:18.898013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.899098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.902116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.902737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:18.951546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2561c1a6-dca9-483c-a3f4-a8f2fd7a04e3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.075129 Nov 20 20:58:18.955874 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1947/3894] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:18 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:18.970257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:18.975464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:18.993533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:18.994306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:18.996742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.000598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:19.001226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.006958 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3ca7f0d-45cc-4052-a4e6-829f39557dd1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.780297 Nov 20 20:58:19.016515 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1948/3895] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:18 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:19.070765 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-83564c0f-5507-4a29-ae60-4872d47c1832 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 14 microversion: 2.1 time: 0.110159 Nov 20 20:58:19.072254 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1948/3896] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:18 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 20:58:19.100026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:19.100807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:19.114863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:19.117096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.118957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:19.122817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.527870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:19.543351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be0e7579-4144-483c-bbef-ed1001b55930 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.448402 Nov 20 20:58:19.548755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1949/3897] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:19 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:19.890697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:19.891422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:19.908440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:19.911719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.913454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:19.915093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:19.974777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:19.990921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:20.023259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.023899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.028150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.028636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.115171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec292805-927a-4143-b18f-73770e086f89 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.154601 Nov 20 20:58:20.123444 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1950/3898] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:19 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:20.147738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:20.148876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:20.162085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.162416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.167123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.170959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.347666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:20.360664 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-042f2eb2-450c-4220-934a-0939f3e091a0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 0.475278 Nov 20 20:58:20.371722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1949/3899] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:19 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:20.382097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:20.386699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:20.401981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.403353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.404347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.411749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.482535 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-585bfcbc-6fe0-491e-93a8-bdb931246a18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 8204 microversion: 2.1 time: 0.109212 Nov 20 20:58:20.483587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1950/3900] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:20 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 8204 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:20.564032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:20.568434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:20.579727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:20.581814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.590810 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6df328a-4c32-4d8c-9a04-4a0a97efda68 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.457983 Nov 20 20:58:20.592033 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1951/3901] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:20 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:20.595468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.599885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:20.603862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:20.819245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:20.834880 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1051cc85-dd0f-405f-bab0-35e6b423a325 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.277834 Nov 20 20:58:20.844220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1951/3902] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:20 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:21.137772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:21.144980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:21.167650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.168238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.170658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.173610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.257603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56328db2-bde3-416d-9884-9513fae85b4c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.124816 Nov 20 20:58:21.258843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1952/3903] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:21 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:21.378588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:21.379369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:21.392032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.393654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.395826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.400665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.500138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:21.501127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:21.513241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.514018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.522873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.523670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.624940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32d801ae-8cdf-4e61-801f-37d1f1e31126 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 16396 microversion: 2.1 time: 0.133619 Nov 20 20:58:21.625615 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1953/3904] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:21 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 16396 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:21.631468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:21.632415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:21.639376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.639817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.641328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.641769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.811088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:21.827013 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-338b4f77-9d85-4ed3-9ae6-a589e28b8dec tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 0.451827 Nov 20 20:58:21.839807 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1952/3905] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:21 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:21.853178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:21.856030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:21.863977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.864677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.865658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:21.866505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:21.928622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:21.943297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93419a47-82ac-441c-91f6-f01534c68a6c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.316199 Nov 20 20:58:21.944160 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1954/3906] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:21 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:22.169007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:22.187219 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d0fbe50-e522-41ba-8352-05d31cb61b1a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.337451 Nov 20 20:58:22.189857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1953/3907] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:21 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:22.275295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:22.279367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:22.288405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.288963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.290283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.290892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.410491 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78c8df1c-e120-4af3-81db-b8ca34370bed tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.142498 Nov 20 20:58:22.411809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1955/3908] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:22 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:22.636958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:22.637885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:22.656432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.658699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.659766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.663789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.758703 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-311fe8d3-6a8b-4f48-89f2-25ea3414fe30 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 16396 microversion: 2.1 time: 0.125192 Nov 20 20:58:22.773799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1954/3909] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:22 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 16396 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:22.845297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:22.846009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:22.854861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.855318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.856126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.856563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.867532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bb17d6a4-5286-4be1-b100-207e49f529f6 req-91d67dd9-53d7-4496-953e-22ae2f9bf952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e03721-bed1-4ab2-93cf-46282cbec99f", "name": "network-vif-plugged", "status": "completed", "tag": "8db776c8-e246-49f6-8f5f-c227f2b7e7c9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:22.869385 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:22.869385 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:22.896465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bb17d6a4-5286-4be1-b100-207e49f529f6 req-91d67dd9-53d7-4496-953e-22ae2f9bf952 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.896959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bb17d6a4-5286-4be1-b100-207e49f529f6 req-91d67dd9-53d7-4496-953e-22ae2f9bf952 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.921320 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bb17d6a4-5286-4be1-b100-207e49f529f6 req-91d67dd9-53d7-4496-953e-22ae2f9bf952 service nova] Creating event network-vif-plugged:8db776c8-e246-49f6-8f5f-c227f2b7e7c9 for instance e1e03721-bed1-4ab2-93cf-46282cbec99f on nch1-master-1 Nov 20 20:58:22.944258 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bb17d6a4-5286-4be1-b100-207e49f529f6 req-91d67dd9-53d7-4496-953e-22ae2f9bf952 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081907 Nov 20 20:58:22.945558 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1955/3910] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:58:22.963816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:22.971204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:22.981629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.982491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:22.983521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:22.984179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.353760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:23.373587 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73fb79e4-c6d8-4f3b-821d-82938bae2b4a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.415387 Nov 20 20:58:23.374632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1956/3911] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:22 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:23.385141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:23.388638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:23.406681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.415908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.418975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.420049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.746384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:23.764183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58fb82b5-a3f5-4fe5-bedf-ec618ab109ea tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.387255 Nov 20 20:58:23.766590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1957/3912] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:23 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:23.777316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:23.780003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:23.795929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.797238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.799228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.801123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.903431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-51700e3f-2826-4817-8005-9424fa436e91 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.135413 Nov 20 20:58:23.904592 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1958/3913] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:23 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:23.916909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:23.918029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:23.943785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.947997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.949041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:23.949645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:23.953917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:23.963347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a13e6b55-fa12-4f9c-be71-a9f24cdb3c32 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1315 microversion: 2.1 time: 1.122217 Nov 20 20:58:23.972433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1956/3914] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:22 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:24.038855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78c613af-cb12-42e1-a9d6-8f4774838e36 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 16396 microversion: 2.1 time: 0.132389 Nov 20 20:58:24.042391 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1959/3915] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:23 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 16396 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:24.393075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:24.394838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:24.404046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:24.404508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:24.407008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:24.409919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:24.786362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:24.787077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:24.796605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:24.797072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:24.797896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:24.798370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.102576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:25.113797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18ad0260-7720-4ce7-b6a6-c000b3b6b82b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.725833 Nov 20 20:58:25.131895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1957/3916] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:24 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:25.139376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:25.145329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:25.160810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.166658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.168152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.168808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.185888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:25.195727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b72e906-374f-49b7-9d6b-307f4c20dc39 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.416052 Nov 20 20:58:25.199902 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1960/3917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:24 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:25.220517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:25.224156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:25.255840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.258565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.260357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.260923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.302361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b56d5c6a-a561-4517-8528-e94f1325af2f tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.159725 Nov 20 20:58:25.307474 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1958/3918] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:25 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:25.322529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:25.327757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:25.340567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.342505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.348706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.349475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.431206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67b30507-7240-4a8a-ada8-fef5f525da11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 16396 microversion: 2.1 time: 0.121874 Nov 20 20:58:25.434669 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1959/3919] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:25 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 16396 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:25.449943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d5988beb-153b-48f4-8a7c-dd6a038e915b req-070e1fb4-0064-425c-879b-39a985eb96dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "name": "network-vif-plugged", "status": "completed", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:25.460991 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:25.460991 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:25.490575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d5988beb-153b-48f4-8a7c-dd6a038e915b req-070e1fb4-0064-425c-879b-39a985eb96dc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.491178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d5988beb-153b-48f4-8a7c-dd6a038e915b req-070e1fb4-0064-425c-879b-39a985eb96dc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.513827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d5988beb-153b-48f4-8a7c-dd6a038e915b req-070e1fb4-0064-425c-879b-39a985eb96dc service nova] Creating event network-vif-plugged:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:58:25.533518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d5988beb-153b-48f4-8a7c-dd6a038e915b req-070e1fb4-0064-425c-879b-39a985eb96dc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097113 Nov 20 20:58:25.537395 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1960/3920] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:25.586647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:25.598637 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8958aa19-2e6d-4528-92da-472e3c1415c0 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1502 microversion: 2.1 time: 0.394672 Nov 20 20:58:25.620489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5320233-c21d-41c2-89ec-1ec1c7b32e6f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:25.626266 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1961/3921] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:25 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:25.627351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5320233-c21d-41c2-89ec-1ec1c7b32e6f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.628618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5320233-c21d-41c2-89ec-1ec1c7b32e6f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.785788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5320233-c21d-41c2-89ec-1ec1c7b32e6f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 20:58:25.891319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5320233-c21d-41c2-89ec-1ec1c7b32e6f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f/action" status: 202 len: 0 microversion: 2.1 time: 0.279958 Nov 20 20:58:25.892705 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1961/3922] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:25 2021] POST /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 20:58:25.900606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:25.901224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:25.913679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.914178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:25.914998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:25.915449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.133003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:26.133730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:26.158103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.158636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.159534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.160001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.231200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:26.239368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab0dde03-6677-4153-addd-291fc1093338 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.342400 Nov 20 20:58:26.239955 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1962/3923] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:25 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:26.252290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:26.255064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:26.269947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.270441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.271257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.273190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.461336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:26.472940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a81ceb7e-b5eb-4575-ba8c-3fabeb121c9e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1323 microversion: 2.1 time: 0.345422 Nov 20 20:58:26.473524 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1962/3924] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:26 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1323 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:26.492538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:26.493807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:26.505654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.506478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.507463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.508064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.574346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f246704-fe06-47eb-b1fb-8b9fa1c5b7d3 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.097646 Nov 20 20:58:26.579216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1963/3925] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:26 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:26.590603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:26.591812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:26.608247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.608944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.609907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:26.610525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:26.705322 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2f9700f-0af8-435d-87d3-580b5b2acc86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.124416 Nov 20 20:58:26.706027 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1964/3926] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:26 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:26.936263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:26.945044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-77e77d2a-83f0-477b-a5d8-2bc143f06db8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.697438 Nov 20 20:58:26.950400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1963/3927] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:26 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:27.257448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:27.258174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:27.270837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.271296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.272108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.274322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.491040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:27.491929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:27.500651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.504122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.505735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.507905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.606034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:27.615682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b2d573b-f6bd-4860-8ec2-f2bc93563eb7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.362563 Nov 20 20:58:27.625764 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1965/3928] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:27 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:27.635344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:27.636909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:27.645304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.646012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.647033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.647638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.700411 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b82c7d3-e536-4ddf-a2f3-456170d948e5 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.072410 Nov 20 20:58:27.702089 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1966/3929] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:27 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:27.722673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:27.724122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:27.733653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.734405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.735437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.736071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.819624 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96cc9991-a3e1-4bf3-bc06-015cabb6b1f1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.103435 Nov 20 20:58:27.823505 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1967/3930] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:27 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:27.845414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:27.862901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df5d3c2d-0c3c-402c-aa43-00b290e41278 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1520 microversion: 2.1 time: 0.376533 Nov 20 20:58:27.863523 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1964/3931] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:27 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:27.882113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8a96b0a-c6f9-499d-bb01-8626de4400a4 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'create', calling method: .version_select at 0x7f3f86f35af0>, body: {"pool": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:27.925426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9403ea66-c110-493e-a416-747f10f27736 req-5c937563-efbd-4bfe-b3f3-2ee1e9dcd868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f740d9f-2e25-44ef-95b1-b05cfb73a79f", "name": "network-vif-plugged", "status": "completed", "tag": "fbb98294-0032-45b6-818d-7bb8780a27d3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:27.927480 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:27.927480 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:27.949712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9403ea66-c110-493e-a416-747f10f27736 req-5c937563-efbd-4bfe-b3f3-2ee1e9dcd868 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:27.950415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9403ea66-c110-493e-a416-747f10f27736 req-5c937563-efbd-4bfe-b3f3-2ee1e9dcd868 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:27.965389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9403ea66-c110-493e-a416-747f10f27736 req-5c937563-efbd-4bfe-b3f3-2ee1e9dcd868 service nova] Creating event network-vif-plugged:fbb98294-0032-45b6-818d-7bb8780a27d3 for instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f on nch1-master-1 Nov 20 20:58:27.977137 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9403ea66-c110-493e-a416-747f10f27736 req-5c937563-efbd-4bfe-b3f3-2ee1e9dcd868 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055131 Nov 20 20:58:27.978113 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1965/3932] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:27.985291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:27.999087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:28.013240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.014027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:28.015698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.016324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:28.353164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:28.361129 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86ea3edb-386c-4127-9999-efd7f354537c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.381256 Nov 20 20:58:28.363965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1966/3933] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:27 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:28.635090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:28.636122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:28.649666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.651194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:28.653722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.655505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:28.923282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:28.938016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a56bb20-0d72-4823-b825-b1f241315b42 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.307730 Nov 20 20:58:28.950020 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1967/3934] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:28 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:28.956792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:28.958337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:28.964861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.965641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:28.966689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:28.967344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:29.012125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8457a528-2b35-4b7b-b023-e99770c6a4c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.060028 Nov 20 20:58:29.013998 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1968/3935] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:28 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:29.025121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:29.026994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:29.035680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:29.036807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:29.037861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:29.038954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:29.098194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7abf879-c8cb-4ee5-9b81-e732cfa37492 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.081139 Nov 20 20:58:29.105383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1969/3936] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:29 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:29.382609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:29.383662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:29.405025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:29.405517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:29.411711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:29.412221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.131793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:30.146968 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98df83ff-fc9d-4d22-8955-ac6f96f0bf33 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1309 microversion: 2.1 time: 0.769565 Nov 20 20:58:30.148227 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1970/3937] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:29 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1309 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:30.152797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:30.153776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:30.164341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.165137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.166367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.168026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.480789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:30.489711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-204fee6c-3ae3-4a57-b76d-b1ce79d22a08 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.340344 Nov 20 20:58:30.490715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1971/3938] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:30 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:30.495505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:30.496755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:30.504179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.505014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.506073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.506740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.561063 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e658af4-4bc7-4eae-9422-c8b7e1871d19 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.068847 Nov 20 20:58:30.562758 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1972/3939] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:30 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:30.569260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:30.570819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:30.578873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.579735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.580957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:30.581619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:30.638439 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82006fb1-7751-49a5-9b4e-1e628c2dbaa2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.073985 Nov 20 20:58:30.639376 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1973/3940] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:30 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:30.728350 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8a96b0a-c6f9-499d-bb01-8626de4400a4 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.850257 Nov 20 20:58:30.730183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1968/3941] 10.222.0.41 () {60 vars in 1169 bytes} [Sat Nov 20 20:58:27 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:30.862848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1639954378", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7dde530b-f780-469d-8a3e-3b58058fca24"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:30.931093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] validate_networks() for [('7dde530b-f780-469d-8a3e-3b58058fca24', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:58:31.185048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:31.187203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:31.204475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.205489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.206901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.208309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.478639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:31.490830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afd8dd5e-158b-4650-8030-2ca2727c30b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1490 microversion: 2.1 time: 0.329201 Nov 20 20:58:31.491741 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1969/3942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:31 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1490 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:31.507915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:31.509058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:31.519785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.520664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.521701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.522424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.702570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:58:31.703085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:58:31.703464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:58:31.703881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:58:31.704301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:58:31.721736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.722243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.723046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.724078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.747082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Getting quotas for project 81f065ce4dee4b479d5ab54d07605e61. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:58:31.753354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Getting quotas for user e877a5425d344711bc81f09650d9fc0b and project 81f065ce4dee4b479d5ab54d07605e61. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:58:31.768218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:58:31.771739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:58:31.797038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:31.811140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1b43159-e110-4000-ac00-12b868c3eadc tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.307785 Nov 20 20:58:31.812626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1970/3943] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:31 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:31.820860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:31.822831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:31.831153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.832349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.834851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.836911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.843942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-905ff1e9-ccfa-417b-bda5-f33e7e91660e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985420 Nov 20 20:58:31.845190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1974/3944] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:58:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:58:31.851080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:31.852402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:31.860471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.861382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.863062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:31.863994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:31.920478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e94a962-298e-44f5-9a8d-8308e13231ef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.073560 Nov 20 20:58:31.921639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1975/3945] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:31 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:31.929385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1448437037", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:31.945971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ee328dbf-ae05-4db4-9ca3-8f422fd456f7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.130746 Nov 20 20:58:31.949948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1971/3946] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:31 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:31.973597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-97b6f68f-77d6-42ea-8984-9ae95506f997 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:31.976059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-97b6f68f-77d6-42ea-8984-9ae95506f997 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:32.011286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:58:32.107290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-97b6f68f-77d6-42ea-8984-9ae95506f997 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:32.124463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-97b6f68f-77d6-42ea-8984-9ae95506f997 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1224 microversion: 2.1 time: 0.171808 Nov 20 20:58:32.126537 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1972/3947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:31 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1224 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:32.829859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:32.831245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:32.839625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:32.840087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:32.840888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:32.841352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.002613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:33.026399 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d727599-7335-46a4-838e-c073c06121bb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.201310 Nov 20 20:58:33.027003 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1973/3948] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:32 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:33.031651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:33.037248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:33.073051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.073915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.074954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.075543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.120183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:58:33.120669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:58:33.121060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:58:33.121469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:58:33.121875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:58:33.148199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.151983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.153086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.153609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.166471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7b54050d-a724-48a6-8af2-288fcf1d6354 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.137832 Nov 20 20:58:33.174411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1974/3949] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:33 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:33.210913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:58:33.223142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:58:33.232356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:33.235648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:33.260444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.262774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.263668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.266992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.273284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:58:33.275779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:58:33.353834 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e80fee4e-2ade-4448-b1ee-45273c2ce2c2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.149781 Nov 20 20:58:33.358489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1975/3950] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:33 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:33.365381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:33.366777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:33.385257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.387495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.389906 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-072dd653-7319-4290-a7ed-8ba97f9e5c9a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466810 Nov 20 20:58:33.390773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:33.392034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:33.402123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1976/3951] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:58:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:58:33.423244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c74b5f1e-bd37-487e-a585-bb96ef51e748 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:33.435003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c74b5f1e-bd37-487e-a585-bb96ef51e748 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:33.511963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:33.540469 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79f7f0f3-0460-4eec-a288-211bcb80682e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1294 microversion: 2.1 time: 0.179574 Nov 20 20:58:33.541347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1976/3952] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:33 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1294 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:33.551589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c74b5f1e-bd37-487e-a585-bb96ef51e748 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:33.562504 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c74b5f1e-bd37-487e-a585-bb96ef51e748 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1209 microversion: 2.1 time: 0.159176 Nov 20 20:58:33.587990 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1977/3953] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:33 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:34.049413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:34.051881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:34.064526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.064981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.066126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.066571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.181040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:34.182816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:34.202152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.202964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.203967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.204695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.272309 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34a25d8b-fe6e-437e-8bc5-06391e441278 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.095305 Nov 20 20:58:34.275226 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1978/3954] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:34 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:34.366182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:34.367194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:34.369114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:34.379004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31ed83ac-a241-4aa5-bdda-693e12f2b0d8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.338869 Nov 20 20:58:34.380560 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1977/3955] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:34 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:34.381654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.382134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.382947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.383568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.436717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4651740f-9b07-481a-b602-356119a14da2 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.075354 Nov 20 20:58:34.438031 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1979/3956] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:34 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:34.558931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:34.559900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:34.568113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.568892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.569916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.570592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.622407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:34.622983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:34.656617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.658473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.673191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:34.676582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:34.990240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:34.991666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:35.008191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b4407a6-c03c-4adc-8c4e-dfef0280cdf2 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.454059 Nov 20 20:58:35.008975 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1978/3957] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:34 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:35.014917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd7903a9-04a5-4490-8e34-988b6f6aff16 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1261 microversion: 2.1 time: 0.427345 Nov 20 20:58:35.016355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1980/3958] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:34 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1261 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:35.286026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:35.289384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:35.300070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.300919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.302258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.302859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.377943 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba487ca2-e514-414b-aeb7-d16513f000cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.096548 Nov 20 20:58:35.379494 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1979/3959] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:35 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:35.400773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:35.406462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:35.439412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.441149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.461642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:35.467629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:35.476156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.476899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.505204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.507299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.512824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:35.514534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:35.579092 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d68457fd-932c-4973-b528-362a83c4a1b6 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.132889 Nov 20 20:58:35.580006 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1980/3960] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:35 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:35.907101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:35.919595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ead16aa8-25e1-4521-b12b-2787cda20d4d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.527117 Nov 20 20:58:35.923767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1981/3961] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:35 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:36.035194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:36.037050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:36.038328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:36.040769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:36.048430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.048820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.051844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.051999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.052372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.053228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.054243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.055079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.189524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:36.202494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b69a46a-0626-4d2f-91e0-7ff326830416 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1267 microversion: 2.1 time: 0.173203 Nov 20 20:58:36.213844 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1982/3962] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:36 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:36.351747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:36.361481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e82cb905-d603-4513-ba9d-60d77721114f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.338604 Nov 20 20:58:36.365544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1981/3963] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:36 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:36.389359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:36.390634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:36.402746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.403866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.406205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.407895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.530002 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df6d7888-3785-46b8-81e3-3736fc25b809 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.143969 Nov 20 20:58:36.534314 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1983/3964] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:36 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:36.593146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:36.594094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:36.607470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.607741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.609061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.611440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.681615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-903c5822-1922-4c56-b24b-45199b1b872b tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.093622 Nov 20 20:58:36.682797 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1982/3965] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:36 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:36.933379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4ba5726b-d034-4c41-b1e8-0a72c99b1f06 req-abe9622b-c0e0-478a-abf6-03da5491820e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dd9356-273f-4e77-95cc-dbf55d4e893a", "tag": "a7ce0b65-d28b-4643-8243-0f2177a3136c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:36.935299 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:36.935299 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:36.939038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:36.939735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:36.956878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.958351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.961676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ba5726b-d034-4c41-b1e8-0a72c99b1f06 req-abe9622b-c0e0-478a-abf6-03da5491820e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.962001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:36.962643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.973171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ba5726b-d034-4c41-b1e8-0a72c99b1f06 req-abe9622b-c0e0-478a-abf6-03da5491820e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:36.990218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4ba5726b-d034-4c41-b1e8-0a72c99b1f06 req-abe9622b-c0e0-478a-abf6-03da5491820e service nova] Creating event network-changed:a7ce0b65-d28b-4643-8243-0f2177a3136c for instance f9dd9356-273f-4e77-95cc-dbf55d4e893a on nch2-master-1 Nov 20 20:58:36.996701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4ba5726b-d034-4c41-b1e8-0a72c99b1f06 req-abe9622b-c0e0-478a-abf6-03da5491820e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072573 Nov 20 20:58:36.997848 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1984/3966] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:37.228579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:37.232441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:37.244133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.245060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.246425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.247380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.326654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:37.340079 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0564e931-bc86-4db2-967f-45c2ab77c03f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.404605 Nov 20 20:58:37.343196 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1983/3967] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:36 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:37.380573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:37.381265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:37.388277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.390797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.391683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.392135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.710034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:37.719299 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ec94348-b7df-4023-9522-5430e7318dac tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.344190 Nov 20 20:58:37.724141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1984/3968] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:37 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:37.730846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:37.732223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:37.757923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.758720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.759886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.760476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.798503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:37.813586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c07585e-8353-43b5-8fa5-ad6825d142f4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.594289 Nov 20 20:58:37.827532 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1985/3969] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:37 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:37.828825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6dfc4ddf-0eab-4797-bc85-bbf89abf0a63 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 24560 microversion: 2.1 time: 0.099518 Nov 20 20:58:37.830145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1985/3970] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:37 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 24560 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:37.834868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:37.836046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:37.845086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.846223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.866459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:37.867228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:37.917704 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67e75be6-92d2-4e4d-83f0-c9b0301b6199 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.088086 Nov 20 20:58:37.926570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1986/3971] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:37 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:38.367043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:38.368621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:38.376009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.392554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:38.403442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.403835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:38.622959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:38.632114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0e6fe73-ce0d-4b3b-a17d-6c9aea14b47f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.275696 Nov 20 20:58:38.645582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1986/3972] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:38 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:38.742112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:38.743115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:38.751497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.752205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:38.753855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.754619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:38.835039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:38.836031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:38.847845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.848573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:38.849587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:38.850957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.097261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:39.105592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbdba398-eca3-41c4-aec8-c2fe59bd174b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.278197 Nov 20 20:58:39.113554 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1987/3973] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:38 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:39.119687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:39.120867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:39.136092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.136554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.137387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.137789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.208455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a6c23d8-e567-445b-904b-8ad122af8adf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.093224 Nov 20 20:58:39.212878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1988/3974] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:39 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:39.219796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:39.220995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:39.230519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.231285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.232342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.233332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.283235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9306916-0f13-49d9-9aa1-9e44413dd988 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.067003 Nov 20 20:58:39.284532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1989/3975] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:39 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:39.290390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-152599c4-7c3f-415f-ab2b-85112d2ad0b7 req-e5396e41-9ba1-4c48-b36d-90d6ffc978b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca994f7-8d6e-4750-8730-bde156622c5a", "tag": "6da7361f-a92e-42ab-9cff-9cb6272a1d49"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:39.292384 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:39.292384 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:39.302774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-152599c4-7c3f-415f-ab2b-85112d2ad0b7 req-e5396e41-9ba1-4c48-b36d-90d6ffc978b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.303311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-152599c4-7c3f-415f-ab2b-85112d2ad0b7 req-e5396e41-9ba1-4c48-b36d-90d6ffc978b0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.313693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:39.323031 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-152599c4-7c3f-415f-ab2b-85112d2ad0b7 req-e5396e41-9ba1-4c48-b36d-90d6ffc978b0 service nova] Creating event network-changed:6da7361f-a92e-42ab-9cff-9cb6272a1d49 for instance fca994f7-8d6e-4750-8730-bde156622c5a on nch2-master-1 Nov 20 20:58:39.327017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2eb03078-b1dd-4ab0-aee4-7322edc1890b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.590694 Nov 20 20:58:39.327967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1987/3976] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:38 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:39.329008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-152599c4-7c3f-415f-ab2b-85112d2ad0b7 req-e5396e41-9ba1-4c48-b36d-90d6ffc978b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042303 Nov 20 20:58:39.329681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1990/3977] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:39.651187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:39.652061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:39.659893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.660370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.661672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:39.662145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:39.928442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:39.937733 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3709d8c6-3c49-42f4-914f-afae7fe394d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.289830 Nov 20 20:58:39.939570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1988/3978] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:39 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:40.123829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:40.125198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:40.136205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.136960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.137823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.138450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.221191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:40.222880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:40.233557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.234932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.236060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.236658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.285360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7cd523cc-f4f3-437b-9469-1169c3cdd29a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.068221 Nov 20 20:58:40.286726 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1989/3979] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:40 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:40.297742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:40.300202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:40.309548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.310355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.312041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.312971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.370724 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b229fa11-66c4-402e-b9fb-28738bd5b077 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.078536 Nov 20 20:58:40.372186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1990/3980] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:40 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:40.377559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:40.378783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:40.387848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.388767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.389816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.390777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.418506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:40.430129 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49095cd8-726c-4550-92b5-615429e57891 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.310076 Nov 20 20:58:40.441058 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1991/3981] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:40 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:40.566564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:40.574623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c054cb0e-7c36-4754-b9f3-e79463c4ce59 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.201076 Nov 20 20:58:40.575203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1991/3982] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:40 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:40.954401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:40.955029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:40.963580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.964123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:40.964993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:40.965434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.299246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:41.300871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:41.319557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.320025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.320850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.321287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.369616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:41.379847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6d6e1d5-e75a-4f28-9fcf-2cac7bf311e3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.429025 Nov 20 20:58:41.392151 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1992/3983] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:40 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:41.397264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64885908-9866-4f41-aab9-14acfd9ada28 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.103322 Nov 20 20:58:41.398073 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1992/3984] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:41 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:41.398621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:41.399746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:41.410394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.413554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.414683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.415079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.450159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:41.451198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:41.459357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.460140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.461016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.461685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.483969 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89799ca9-72bf-4981-a416-9dab49c5285a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.089848 Nov 20 20:58:41.485154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1993/3985] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:41 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:41.594445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:41.595510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:41.606016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.606587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.607817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:41.608471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:41.633958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:41.643386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ea14fc5-ce9d-469e-8c39-0e26e2d836e3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.197794 Nov 20 20:58:41.644293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1993/3986] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:41 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:41.910430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:41.917904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9592fd00-17ea-4f3f-b697-030a6c8a923a tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.328852 Nov 20 20:58:41.918742 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1994/3987] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:41 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:42.398232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:42.399862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:42.408471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:42.409940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:42.413060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.413793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.416837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.417490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.418374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.419043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.420037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.420816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.486485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-113b8329-464a-4785-a4b7-e895ae3b5172 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.081007 Nov 20 20:58:42.488926 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1995/3988] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:42 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:42.498568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:42.500174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:42.509930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.510874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.511951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.518754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.592342 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f065595e-f202-49e4-b6ef-42b47e8125f1 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.097145 Nov 20 20:58:42.597543 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1996/3989] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:42 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:42.661536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:42.662266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:42.672967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.673428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.674291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.675438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.723553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:42.731780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-609dd4e7-f20f-4606-9fd3-645b00e354d4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.337255 Nov 20 20:58:42.733076 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1994/3990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:42 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:42.935904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:42.936855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:42.950833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.951666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:42.952565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:42.953071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.029031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:43.039776 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1bd62dbd-b98c-426d-a5b2-7539d5703731 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.382685 Nov 20 20:58:43.043316 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1997/3991] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:42 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:43.162942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:43.172868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1dd608d-7bd6-476c-aec8-7e63b8167601 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.239705 Nov 20 20:58:43.185127 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1995/3992] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:42 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:43.500002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:43.501190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:43.522078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.522906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.527857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.528636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.567220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9bf07f03-91c3-4cc6-9ad2-2219e71b972a req-b857d153-2a52-41f8-96a0-b461a542e93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dd9356-273f-4e77-95cc-dbf55d4e893a", "name": "network-vif-plugged", "status": "completed", "tag": "a7ce0b65-d28b-4643-8243-0f2177a3136c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:43.570032 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:43.570032 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:43.588216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9bf07f03-91c3-4cc6-9ad2-2219e71b972a req-b857d153-2a52-41f8-96a0-b461a542e93a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.588972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9bf07f03-91c3-4cc6-9ad2-2219e71b972a req-b857d153-2a52-41f8-96a0-b461a542e93a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.610175 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1907a27-6b1f-4dd1-9456-67d9a81d55e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.109730 Nov 20 20:58:43.612848 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1998/3993] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:43 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:43.625151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:43.628541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:43.628739 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9bf07f03-91c3-4cc6-9ad2-2219e71b972a req-b857d153-2a52-41f8-96a0-b461a542e93a service nova] Creating event network-vif-plugged:a7ce0b65-d28b-4643-8243-0f2177a3136c for instance f9dd9356-273f-4e77-95cc-dbf55d4e893a on nch2-master-1 Nov 20 20:58:43.639173 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9bf07f03-91c3-4cc6-9ad2-2219e71b972a req-b857d153-2a52-41f8-96a0-b461a542e93a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075867 Nov 20 20:58:43.640198 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1996/3994] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:58:43.648800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.649791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.651457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.652138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.706319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc4c8b81-a0e8-4467-a604-9997f33f0866 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.091458 Nov 20 20:58:43.707474 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 1999/3995] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:43 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:43.749133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:43.750170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:43.757610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.758080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:43.760743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:43.760968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.057985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:44.058774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:44.073716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.074207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.075007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.075443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.199235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:44.207155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e5d08ffb-7c7d-4079-b9d7-e51d66f0264d tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.462116 Nov 20 20:58:44.207741 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1997/3996] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:43 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:44.212920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:44.214025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:44.238002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.238565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.239462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.241049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.294748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:44.305462 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c104b00e-a8d6-4002-88ab-803ed6a7f814 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.251593 Nov 20 20:58:44.315708 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2000/3997] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:44 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:44.484428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:44.492851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d66eeada-07a2-4d58-957e-7934a1d56564 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1324 microversion: 2.1 time: 0.284081 Nov 20 20:58:44.493429 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1998/3998] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:44 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:44.622648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:44.624330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:44.631618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.632095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.632883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.633321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.678515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3103349-c270-42a5-8daa-9cd30f8335ca tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.059259 Nov 20 20:58:44.679187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2001/3999] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:44 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:44.720442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:44.722192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:44.729902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.730513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.731574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:44.731752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:44.777442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c41abd1-3f5d-464a-a078-fa0bb3e6341a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.062134 Nov 20 20:58:44.778113 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 1999/4000] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:44 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:45.225574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:45.226560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.235886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.236412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.238386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.238899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.325258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:45.326551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.336663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.337312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.338622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.339067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.421266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:45.429514 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c891a9bf-e448-4f82-b2a9-f625b524f722 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.209070 Nov 20 20:58:45.430126 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2002/4001] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:45 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:45.511316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:45.511937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.521929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.525174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.526257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.526710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.571832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:45.597758 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fc91b0a-f21e-4eea-8da6-602f9f8490f9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.276124 Nov 20 20:58:45.598614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2000/4002] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:45 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:45.693261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:45.694536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.701548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.702218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.703384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.703980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.767770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61b07c57-7f2d-40a5-9bc0-595f03dd488e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.080463 Nov 20 20:58:45.770519 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2001/4003] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:45 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:58:45.792233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:45.794286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.804219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.805162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.806169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.806770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.839869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:45.849783 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec1af52a-cc44-40ca-a410-cc10b2d60cc3 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 200 len: 1520 microversion: 2.1 time: 0.342854 Nov 20 20:58:45.854197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67b12dca-b212-433a-9006-9f0dda93ae2a tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.067389 Nov 20 20:58:45.854848 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2002/4004] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:45 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:45.867914 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2003/4005] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:45 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:45.874526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.231"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:45.876007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:45.884395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.885041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.885925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:45.886396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:45.918104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Acquired lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:58:46.447764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:46.448597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:46.457542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.458000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.460497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.460972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.722657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:46.730348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf8bbc1b-ef4b-4211-9b43-41a747fa512a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.286828 Nov 20 20:58:46.730977 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2004/4006] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:46 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:46.735275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:46.735884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:46.742570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.743029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.744011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.744515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.912586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:46.922475 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c90fca71-e9b2-4d11-9b72-38991d723451 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.190401 Nov 20 20:58:46.923077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2005/4007] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:46 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:46.928776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:46.930327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:46.939160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.939613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.941024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.941459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:46.984175 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1883b95-c1ac-4bde-b3e8-6dceba6e0bd4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.059208 Nov 20 20:58:46.984987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2006/4008] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:46 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:46.990894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:46.991952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:46.999374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:46.999846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.000635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.001074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.044633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c2ea45f-bbff-43ef-9c4d-20742d46be32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.058019 Nov 20 20:58:47.048618 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2007/4009] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:46 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:47.050891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7195fd98-3935-4bb3-8232-ec6f88818d74 req-29283d0e-1fe1-4b83-8f5a-2102d5dc6a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca994f7-8d6e-4750-8730-bde156622c5a", "name": "network-vif-plugged", "status": "completed", "tag": "6da7361f-a92e-42ab-9cff-9cb6272a1d49"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:47.052440 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:47.052440 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:47.060621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7195fd98-3935-4bb3-8232-ec6f88818d74 req-29283d0e-1fe1-4b83-8f5a-2102d5dc6a53 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.061069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7195fd98-3935-4bb3-8232-ec6f88818d74 req-29283d0e-1fe1-4b83-8f5a-2102d5dc6a53 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.073431 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7195fd98-3935-4bb3-8232-ec6f88818d74 req-29283d0e-1fe1-4b83-8f5a-2102d5dc6a53 service nova] Creating event network-vif-plugged:6da7361f-a92e-42ab-9cff-9cb6272a1d49 for instance fca994f7-8d6e-4750-8730-bde156622c5a on nch2-master-1 Nov 20 20:58:47.078261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7195fd98-3935-4bb3-8232-ec6f88818d74 req-29283d0e-1fe1-4b83-8f5a-2102d5dc6a53 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Nov 20 20:58:47.078783 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2008/4010] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:47.750653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:47.751361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:47.759539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.759996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.760804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.761363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.919916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:47.929027 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fac222b-f2c3-4a5b-84d1-d944ea7704a4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.184237 Nov 20 20:58:47.929617 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2009/4011] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:47 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:47.940136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:47.941123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:47.947135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.947796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:47.949399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:47.950006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.365596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:48.380106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f9cc94fa-6231-47c0-b4f8-2456f5e37d1f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1309 microversion: 2.1 time: 0.444229 Nov 20 20:58:48.382663 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2010/4012] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:47 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1309 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:48.387614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:48.388753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:48.397124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.398213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.399241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.399881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.491928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfb5b932-642b-4c4f-b610-f792411cbbdc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.107704 Nov 20 20:58:48.492808 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2011/4013] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:48 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:48.507162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:48.507375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:58:48.508965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:48.529400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.530104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.531216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.531847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.619384 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd4348bd-126f-4282-83aa-d3aec53e359c tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 32591 microversion: 2.1 time: 0.124905 Nov 20 20:58:48.624289 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2012/4014] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:48 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 32591 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:48.631402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ae279635-55a2-449b-b131-f3a08aeea561 req-60bc059b-96af-4fc8-8c96-32d7824782df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:48.637093 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:48.637093 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:48.660836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ae279635-55a2-449b-b131-f3a08aeea561 req-60bc059b-96af-4fc8-8c96-32d7824782df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.660836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ae279635-55a2-449b-b131-f3a08aeea561 req-60bc059b-96af-4fc8-8c96-32d7824782df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.687991 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ae279635-55a2-449b-b131-f3a08aeea561 req-60bc059b-96af-4fc8-8c96-32d7824782df service nova] Creating event network-changed:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:58:48.699309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ae279635-55a2-449b-b131-f3a08aeea561 req-60bc059b-96af-4fc8-8c96-32d7824782df service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073182 Nov 20 20:58:48.700380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2013/4015] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:48.949404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:48.950277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:48.971873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.976284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:48.981581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:48.982312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.309241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:49.321080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-245049a5-3448-4f70-aef3-561c00e979fb tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.376328 Nov 20 20:58:49.322471 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2014/4016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:48 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:58:49.399984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:49.400885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:49.411217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.423145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.432503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.433079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.708155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:49.719798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2aa3c39d-8c78-420a-9f37-8c53b33ef556 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1489 microversion: 2.1 time: 0.324244 Nov 20 20:58:49.720601 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2015/4017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:49 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1489 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:49.727012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:49.728294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:49.734771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.735460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.736421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.737775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.788800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dedac575-1b07-4396-bfdc-82e0a4237b51 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.065875 Nov 20 20:58:49.790914 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2016/4018] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:49 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:49.797521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:49.798893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:49.815906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.816357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.817731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.818517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.883656 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-052202e8-4ecf-4a48-833c-41653c1bf9dc tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action" status: 200 len: 40743 microversion: 2.1 time: 0.090633 Nov 20 20:58:49.885420 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2017/4019] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:49 2021] POST /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3/action => generated 40743 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:49.895028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:49.896054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:49.904436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.904921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:49.905756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:49.906231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.104697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:50.120484 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c21f5fb-6a74-477a-bc6d-5db72695f6e7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1490 microversion: 2.1 time: 0.233604 Nov 20 20:58:50.121085 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2018/4020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:49 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1490 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:50.129112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:50.129736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:50.140458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.141086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.141924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.144330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.327436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:50.338419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-992eb908-80f0-4931-b957-6f9bcaf57f32 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1707 microversion: 2.1 time: 0.215847 Nov 20 20:58:50.340359 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2019/4021] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:50 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1707 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:50.350238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:50.351916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:50.368037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.370332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.372950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.375427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.490456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Updating instance_info_cache with network_info: [{"id": "cfd0dca9-fc25-4b7e-a3c0-929991afa254", "address": "fa:16:3e:8f:45:7b", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcfd0dca9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:58:50.505843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Releasing lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:58:50.506965 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e7a50a1-7b95-45da-81ae-6a12c033366f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action" status: 202 len: 0 microversion: 2.1 time: 4.640302 Nov 20 20:58:50.507944 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2003/4022] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:45 2021] POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action => generated 0 bytes in 4642 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:58:50.525829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:50.526746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:50.534844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.535607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.536611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.537273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.590163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:50.598539 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91203a81-82fc-4e86-86a1-56f3af0f0d27 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1489 microversion: 2.1 time: 0.253550 Nov 20 20:58:50.599116 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2020/4023] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:50 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1489 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:50.603748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.231"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:50.604989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:50.617940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.618996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.619456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:50.620385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:50.654877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Acquired lock "refresh_cache-f9dd9356-273f-4e77-95cc-dbf55d4e893a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:58:51.048353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:51.060321 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3e4896c0-86c5-4fe8-8247-1dd144c86418 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.550913 Nov 20 20:58:51.060843 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2004/4024] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:50 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:51.069337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:51.069846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:51.089330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.089796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.091948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.092481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.141673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:58:51.277606 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8bad8db4-42d9-4a5c-a0a0-0e16e0ad5a61 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 204 len: 0 microversion: 2.1 time: 0.214548 Nov 20 20:58:51.281293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2005/4025] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:58:51 2021] DELETE /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:51.301846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:51.306459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:51.313600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.314342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.316392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.317082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.367033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25948d08-260c-404f-9a7b-526587daeab5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.083688 Nov 20 20:58:51.371883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2006/4026] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:51 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:51.378626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:51.383678 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:51.383678 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:51.385032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:51.385969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Searching by: {'deleted': False, 'project_id': '92267796613943d4aa68073d9406f124'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:58:51.395381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.396016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.396996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.397568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.430085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:58:51.465275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79d3190d-cfae-445b-9168-f49db04158b7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.091761 Nov 20 20:58:51.466527 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2007/4027] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:58:51 2021] GET /compute/v2.1/servers => generated 340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:51.488880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:51.489725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:51.497122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.497758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:51.498424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:51.498869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:52.225213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:52.233179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4cf8988-1deb-454e-8cc3-a406b18b2fd1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1495 microversion: 2.1 time: 0.762532 Nov 20 20:58:52.233769 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2008/4028] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:51 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1495 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:52.249275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:52.256203 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:52.256203 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:52.262948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:52.264517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Searching by: {'deleted': False, 'project_id': '92267796613943d4aa68073d9406f124'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:58:52.272420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:52.273265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:52.274519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:52.275135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:52.333700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 20:58:52.391224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:52.399390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:52.401663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:52.837429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13ef0935-a3a3-4b45-b1dd-6b7b5303cf17 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.597599 Nov 20 20:58:52.838019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2009/4029] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 20:58:52 2021] GET /compute/v2.1/servers/detail => generated 1710 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:52.844508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:52.845471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:52.854241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:52.855151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:52.856223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:52.857024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:53.395064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:53.414901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1892c8a7-7524-44b7-880b-53f144972446 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.575216 Nov 20 20:58:53.416009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2010/4030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:52 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:53.420712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:53.421869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:53.435760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:53.439328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:53.440504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:53.441794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:53.496656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50740944-5b42-4c9c-ae1a-dcda91e7d857 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.079214 Nov 20 20:58:53.504231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2011/4031] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:53 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:53.511641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47fac916-621b-49c8-9e0e-d5e405499cc7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:53.543105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47fac916-621b-49c8-9e0e-d5e405499cc7 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036522 Nov 20 20:58:53.544208 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2012/4032] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 20:58:53 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:53.551597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:53.552484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:53.560170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:53.560875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:53.561823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:53.562834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:53.807719 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.neutron [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] re-assign floating IP 172.35.1.231 from instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 Nov 20 20:58:53.873231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Building network info cache for instance {{(pid=140941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:58:54.164463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:54.175579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1a315c2-a6c2-4e95-bc70-1aacc316fb2b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 200 len: 1495 microversion: 2.1 time: 0.629576 Nov 20 20:58:54.178779 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2013/4033] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:53 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 1495 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:54.189368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0af109de-99e5-4c5a-9399-6b16b00abfd4 req-79f66e34-8ebb-4e33-a7fe-c86e9a1b35a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:54.194312 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:54.194312 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:54.218455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0af109de-99e5-4c5a-9399-6b16b00abfd4 req-79f66e34-8ebb-4e33-a7fe-c86e9a1b35a4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:54.219885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0af109de-99e5-4c5a-9399-6b16b00abfd4 req-79f66e34-8ebb-4e33-a7fe-c86e9a1b35a4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:54.251726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0af109de-99e5-4c5a-9399-6b16b00abfd4 req-79f66e34-8ebb-4e33-a7fe-c86e9a1b35a4 service nova] Creating event network-changed:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:58:54.293465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0af109de-99e5-4c5a-9399-6b16b00abfd4 req-79f66e34-8ebb-4e33-a7fe-c86e9a1b35a4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100668 Nov 20 20:58:54.295680 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2014/4034] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:54.307866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:54.316052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:54.337847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:54.344236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:54.345852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:54.347241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:54.435288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:58:54.665037 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e439c05-5aea-45a6-a420-5ac068aedcd4 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 204 len: 0 microversion: 2.1 time: 0.364300 Nov 20 20:58:54.669430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2015/4035] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:58:54 2021] DELETE /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:54.696708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:54.703547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:54.720236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:54.720707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:54.723986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:54.727212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:54.912842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Updating instance_info_cache with network_info: [{"id": "cfd0dca9-fc25-4b7e-a3c0-929991afa254", "address": "fa:16:3e:8f:45:7b", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcfd0dca9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:58:54.928057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Building network info cache for instance {{(pid=140941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:58:55.506508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:55.520454 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74ba2e21-e0a2-4c32-ba3d-f0b4342cc4f8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1512 microversion: 2.1 time: 0.849591 Nov 20 20:58:55.524121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2016/4036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:54 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1512 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:55.535920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:55.540645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:55.555922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:55.559240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:55.560550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:55.562710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:55.649618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5829c8ec-1467-4194-92ed-18b03f76cca0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.123136 Nov 20 20:58:55.650590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2017/4037] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:55 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:55.660719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:55.662698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:55.684430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:55.685938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:55.692617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:55.694581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:55.910614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Updating instance_info_cache with network_info: [{"id": "a7ce0b65-d28b-4643-8243-0f2177a3136c", "address": "fa:16:3e:05:b8:25", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa7ce0b65-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:58:55.942421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Releasing lock "refresh_cache-f9dd9356-273f-4e77-95cc-dbf55d4e893a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:58:55.947259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af62ad10-ba47-4e1b-aa34-515a4a27f856 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a/action" status: 202 len: 0 microversion: 2.1 time: 5.346946 Nov 20 20:58:55.948495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2021/4038] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:50 2021] POST /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a/action => generated 0 bytes in 5349 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:58:55.957296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6d350960-e3e0-4aea-8a3f-43a8751f5130 req-5a118bed-6b42-45a5-b9ba-e36bba1b5eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca994f7-8d6e-4750-8730-bde156622c5a", "name": "network-vif-deleted", "tag": "6da7361f-a92e-42ab-9cff-9cb6272a1d49"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:55.961379 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:55.961379 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:58:55.974477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6d350960-e3e0-4aea-8a3f-43a8751f5130 req-5a118bed-6b42-45a5-b9ba-e36bba1b5eb8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:55.975603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6d350960-e3e0-4aea-8a3f-43a8751f5130 req-5a118bed-6b42-45a5-b9ba-e36bba1b5eb8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.002298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6d350960-e3e0-4aea-8a3f-43a8751f5130 req-5a118bed-6b42-45a5-b9ba-e36bba1b5eb8 service nova] Creating event network-vif-deleted:6da7361f-a92e-42ab-9cff-9cb6272a1d49 for instance fca994f7-8d6e-4750-8730-bde156622c5a on nch2-master-1 Nov 20 20:58:56.013583 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6d350960-e3e0-4aea-8a3f-43a8751f5130 req-5a118bed-6b42-45a5-b9ba-e36bba1b5eb8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063044 Nov 20 20:58:56.016191 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2022/4039] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:56.021373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:56.022096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:56.040199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.042498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.047367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.048126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.069466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. Nov 20 20:58:56.070470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:58:56.071565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-214b3f12-fddb-414d-8568-782ff8cc2cff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 404 len: 111 microversion: 2.1 time: 0.054248 Nov 20 20:58:56.073569 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2023/4040] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:56 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:58:56.080327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.231"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:56.274583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:56.282475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.285588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.287614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.288133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.663725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] HTTP exception thrown: Floating IP 172.35.1.231 is not associated with instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8. Nov 20 20:58:56.664657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Returning 409 to user: Floating IP 172.35.1.231 is not associated with instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:58:56.665982 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0ef613b-cd01-496a-a466-471105000446 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action" status: 409 len: 146 microversion: 2.1 time: 0.590765 Nov 20 20:58:56.666738 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2024/4041] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:56 2021] POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action => generated 146 bytes in 592 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 20:58:56.671869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:56.672552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:56.693002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.693532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.698451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.706724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.760663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:58:56.765098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:56.775059 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b932509d-c66a-4c74-9e72-16448f30b109 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1713 microversion: 2.1 time: 1.122735 Nov 20 20:58:56.777779 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2018/4042] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:55 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1713 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:56.803430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-634896c0-8cc5-4f7f-bf5d-4782e72a85fd req-a21a6b3b-bda3-4e0c-892e-5102deeea915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dd9356-273f-4e77-95cc-dbf55d4e893a", "tag": "a7ce0b65-d28b-4643-8243-0f2177a3136c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:56.808308 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:58:56.808308 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:58:56.825823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-634896c0-8cc5-4f7f-bf5d-4782e72a85fd req-a21a6b3b-bda3-4e0c-892e-5102deeea915 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.827486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-634896c0-8cc5-4f7f-bf5d-4782e72a85fd req-a21a6b3b-bda3-4e0c-892e-5102deeea915 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.850493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-634896c0-8cc5-4f7f-bf5d-4782e72a85fd req-a21a6b3b-bda3-4e0c-892e-5102deeea915 service nova] Creating event network-changed:a7ce0b65-d28b-4643-8243-0f2177a3136c for instance f9dd9356-273f-4e77-95cc-dbf55d4e893a on nch2-master-1 Nov 20 20:58:56.866529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-634896c0-8cc5-4f7f-bf5d-4782e72a85fd req-a21a6b3b-bda3-4e0c-892e-5102deeea915 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070696 Nov 20 20:58:56.867438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2019/4043] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:58:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:58:56.881760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:56.882860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:56.900313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.901248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:56.903351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:56.904090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.010292 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c7dab78-4b7b-4d72-877d-c5da6abfa680 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 204 len: 0 microversion: 2.1 time: 0.341944 Nov 20 20:58:57.011388 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2025/4044] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:58:56 2021] DELETE /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:57.018150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:57.019587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:57.025745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.026253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.027171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.027647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.086990 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-139fb7e2-64d2-4a72-8496-4b507623c1dd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.073824 Nov 20 20:58:57.088496 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2026/4045] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:57 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:57.095073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.231"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:57.507638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:57.521853 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff80e741-20a2-47ae-9c5c-03bf2064ffca tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1489 microversion: 2.1 time: 0.651428 Nov 20 20:58:57.523030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2020/4046] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:56 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1489 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:57.538888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:57.539564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:57.551834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.552260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.558685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.559352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.716388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:57.723097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.723482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:57.724365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:57.724807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:58.125903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:58.135003 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b85d8e70-5fba-414b-8e6b-89b22bcede65 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1496 microversion: 2.1 time: 0.610467 Nov 20 20:58:58.135606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2021/4047] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:57 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1496 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:58.141291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:58.142070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:58.149351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:58.149809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:58.150795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:58.151298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:58.182000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:58:58.183408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Acquired lock "refresh_cache-f9dd9356-273f-4e77-95cc-dbf55d4e893a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:58:58.263574 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e7500292-2762-4bb0-b03b-3df2b42e0b38 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 204 len: 0 microversion: 2.1 time: 0.126432 Nov 20 20:58:58.264368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2022/4048] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:58:58 2021] DELETE /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:58:58.270855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:58.271929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:58.279614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:58.280313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:58.281362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:58.282410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:59.138246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:58:59.146515 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aadfd0c6-ad7b-4484-be99-ad8acb8fe377 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1713 microversion: 2.1 time: 0.880384 Nov 20 20:58:59.147117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2023/4049] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:58 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1713 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:58:59.177029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:58:59.179252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:59.191846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:59.193401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:59.194978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:59.199064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:59.279245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Building network info cache for instance {{(pid=140941) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:58:59.284724 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-638e96e5-4f3f-4a9b-b272-50d5c051abd7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.120404 Nov 20 20:58:59.287792 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2024/4050] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:59 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:58:59.303862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:58:59.309477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:58:59.329925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:59.334879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:58:59.335842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:58:59.336545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.151363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:00.163429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5df04c8e-139b-48d1-89c6-23ff284d118e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1495 microversion: 2.1 time: 0.874175 Nov 20 20:59:00.172255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2025/4051] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:58:59 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1495 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:00.185842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:00.186987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:00.198314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.199035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.200114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.200859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.281846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Updating instance_info_cache with network_info: [{"id": "a7ce0b65-d28b-4643-8243-0f2177a3136c", "address": "fa:16:3e:05:b8:25", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapa7ce0b65-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140941) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:59:00.303052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Releasing lock "refresh_cache-f9dd9356-273f-4e77-95cc-dbf55d4e893a" {{(pid=140941) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:59:00.307205 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-39a7cc83-eab4-45cb-bdea-002a31248366 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a/action" status: 202 len: 0 microversion: 2.1 time: 3.215590 Nov 20 20:59:00.309964 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2027/4052] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:58:57 2021] POST /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a/action => generated 0 bytes in 3220 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:59:00.322460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0bdd113f-9195-4a5e-9f74-ea31cba73bb7 req-ffacac3a-ad46-4519-81c3-738f16d45588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9dd9356-273f-4e77-95cc-dbf55d4e893a", "tag": "a7ce0b65-d28b-4643-8243-0f2177a3136c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:00.329935 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:00.329935 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:00.360550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0bdd113f-9195-4a5e-9f74-ea31cba73bb7 req-ffacac3a-ad46-4519-81c3-738f16d45588 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.363657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0bdd113f-9195-4a5e-9f74-ea31cba73bb7 req-ffacac3a-ad46-4519-81c3-738f16d45588 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.388014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0bdd113f-9195-4a5e-9f74-ea31cba73bb7 req-ffacac3a-ad46-4519-81c3-738f16d45588 service nova] Creating event network-changed:a7ce0b65-d28b-4643-8243-0f2177a3136c for instance f9dd9356-273f-4e77-95cc-dbf55d4e893a on nch2-master-1 Nov 20 20:59:00.406659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0bdd113f-9195-4a5e-9f74-ea31cba73bb7 req-ffacac3a-ad46-4519-81c3-738f16d45588 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093061 Nov 20 20:59:00.408920 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2028/4053] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:00.426072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:00.428619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:00.447140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.448466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.449314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.449749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.526879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.529862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.531708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lazy-loading 'fault' on Instance uuid 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:59:00.586436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70ba30240bf642ca9728de33322d949b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92267796613943d4aa68073d9406f124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:00.598876 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d0b7f3c-6b13-452b-9bc8-096f73a69b07 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 200 len: 1367 microversion: 2.1 time: 0.183484 Nov 20 20:59:00.599763 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2029/4054] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:00 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:00.604941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:00.606157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:00.615313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.617567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.619441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.625711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.716278 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce31871b-94d7-466f-a213-784e98644a49 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.114886 Nov 20 20:59:00.716947 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2030/4055] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:00 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:00.726605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fa545f3b-c9ca-4be1-bdd3-97152ceb477c req-cc41aaad-533d-40dc-be23-4072d10c7d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5cd44f-7bf8-498d-96f4-76d5039c2cc3", "name": "network-vif-deleted", "tag": "47ef466b-1a47-4f4e-91bb-96045db695b3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:00.728166 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:00.728166 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:00.737922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fa545f3b-c9ca-4be1-bdd3-97152ceb477c req-cc41aaad-533d-40dc-be23-4072d10c7d48 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.738412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fa545f3b-c9ca-4be1-bdd3-97152ceb477c req-cc41aaad-533d-40dc-be23-4072d10c7d48 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.766162 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fa545f3b-c9ca-4be1-bdd3-97152ceb477c req-cc41aaad-533d-40dc-be23-4072d10c7d48 service nova] Creating event network-vif-deleted:47ef466b-1a47-4f4e-91bb-96045db695b3 for instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 on nch2-master-1 Nov 20 20:59:00.773715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fa545f3b-c9ca-4be1-bdd3-97152ceb477c req-cc41aaad-533d-40dc-be23-4072d10c7d48 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054782 Nov 20 20:59:00.774814 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2031/4056] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:00.792911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:00.795238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:00.832922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.833466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.834549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:00.835209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:00.882470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:59:00.933838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:00.950337 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac629852-42ca-4f9b-b3b5-32548a097299 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1496 microversion: 2.1 time: 0.776509 Nov 20 20:59:00.955110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2026/4057] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:00 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1496 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:01.067100 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-faf09a33-3fde-4b18-82e3-4fd0b022e41b tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 204 len: 0 microversion: 2.1 time: 0.287937 Nov 20 20:59:01.068183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2032/4058] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:00 2021] DELETE /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:59:01.080662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.231"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:01.082642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:01.092429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.093363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.095506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.096937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.165774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Acquired lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:59:01.192998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:01.195429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:01.221417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.222173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.223048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.223497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.506810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:01.515038 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8833195f-2a52-47c4-9e00-4568b81b639a tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1495 microversion: 2.1 time: 0.329235 Nov 20 20:59:01.525153 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2033/4059] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:01 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1495 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:01.617630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:01.618686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] [instance: 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:01.627966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.628814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.629787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.630462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.659667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] HTTP exception thrown: Instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 could not be found. Nov 20 20:59:01.663198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Returning 404 to user: Instance 8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:01.664267 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f1ed395-9431-4e57-b0e6-559c4c5512eb tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3" status: 404 len: 111 microversion: 2.1 time: 0.050803 Nov 20 20:59:01.666713 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2034/4060] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:01 2021] GET /compute/v2.1/servers/8f5cd44f-7bf8-498d-96f4-76d5039c2cc3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:01.677388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7a2d7e1-189c-4e9c-81dd-ed65827a1689 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] Calling method '.version_select at 0x7f3f87a14160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:01.719777 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7a2d7e1-189c-4e9c-81dd-ed65827a1689 tempest-ServersTestManualDisk-589802056 tempest-ServersTestManualDisk-589802056-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133730842" status: 202 len: 0 microversion: 2.1 time: 0.049375 Nov 20 20:59:01.725292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2035/4061] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 20:59:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133730842 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:59:01.731919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:01.733060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:01.768568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.769396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.771277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.771834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.850612 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-366112a5-2418-487a-b82b-1d3dd1d81fb9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.122292 Nov 20 20:59:01.852702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2036/4062] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:01 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:01.973615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:01.975097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:01.983648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.984567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:01.985544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:01.986144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:02.029686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:02.030206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:02.030701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lazy-loading 'fault' on Instance uuid 0f740d9f-2e25-44ef-95b1-b05cfb73a79f {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:59:02.139404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:02.155497 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2517cab0-51d2-4639-80bd-2912f0ac1a0c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 200 len: 1299 microversion: 2.1 time: 0.186874 Nov 20 20:59:02.156103 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2037/4063] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:01 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:02.543222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:02.545227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:02.555881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:02.556483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:02.558423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:02.558981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.420459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:03.430288 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-318d3472-d0f9-4b5e-851c-bbd4b88f29d6 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 200 len: 1495 microversion: 2.1 time: 0.901814 Nov 20 20:59:03.431130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2038/4064] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:02 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 1495 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:03.436779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e004aac5-2eb0-4bc3-8f0f-1766b181851e req-95577270-b6dc-4251-b925-8f303617b977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f740d9f-2e25-44ef-95b1-b05cfb73a79f", "name": "network-vif-deleted", "tag": "fbb98294-0032-45b6-818d-7bb8780a27d3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:03.438452 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:03.438452 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:03.448111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e004aac5-2eb0-4bc3-8f0f-1766b181851e req-95577270-b6dc-4251-b925-8f303617b977 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:03.448996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e004aac5-2eb0-4bc3-8f0f-1766b181851e req-95577270-b6dc-4251-b925-8f303617b977 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.464149 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e004aac5-2eb0-4bc3-8f0f-1766b181851e req-95577270-b6dc-4251-b925-8f303617b977 service nova] Creating event network-vif-deleted:fbb98294-0032-45b6-818d-7bb8780a27d3 for instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f on nch1-master-1 Nov 20 20:59:03.472283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e004aac5-2eb0-4bc3-8f0f-1766b181851e req-95577270-b6dc-4251-b925-8f303617b977 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038063 Nov 20 20:59:03.473813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2039/4065] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:03.492601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:03.508243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:03.525841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:03.528331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.529480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:03.532255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.615871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-29aef107-5bc3-41c8-9907-0711e44b2b1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.139480 Nov 20 20:59:03.622071 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2040/4066] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:03 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:03.633673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:03.638361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:03.660094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:03.664809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.666907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:03.669543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:03.704824 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. Nov 20 20:59:03.707333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:03.708204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f9252ed1-e268-4982-9b60-1c2160302347 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 404 len: 111 microversion: 2.1 time: 0.084632 Nov 20 20:59:03.716040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2041/4067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:03 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:03.938654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-774139367", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:04.051090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:59:05.264895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:59:05.266986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:59:05.268593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:59:05.269874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:59:05.270443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:59:05.305093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.307558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:59:05.308532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.309524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.311307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.333822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:59:05.343767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:59:05.362670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:59:05.366380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:05.430450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-171e3753-a6b3-4d62-8f2b-3e9e60ad45a0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.495699 Nov 20 20:59:05.431873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2042/4068] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:59:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:59:05.441100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:05.442075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:05.448742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.450992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.452005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.452631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.472216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. Nov 20 20:59:05.473640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:05.474743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bf96a5c-f755-472f-ba5b-28483393cfdf tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 404 len: 111 microversion: 2.1 time: 0.038880 Nov 20 20:59:05.478747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2043/4069] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:05 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:05.499122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:05.500157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:05.509045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.509496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.510315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.510753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.581715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffb103b3-a325-47be-a4e2-9a39b5b0dad4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.102198 Nov 20 20:59:05.585593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2044/4070] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:05 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:05.595052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c9d9eac8-4843-4b31-8bf3-d121e443804d req-35576025-7b8a-40ff-8cbd-bb02217276d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9dd9356-273f-4e77-95cc-dbf55d4e893a", "name": "network-vif-deleted", "tag": "a7ce0b65-d28b-4643-8243-0f2177a3136c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:05.605627 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:05.605627 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:05.618287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c9d9eac8-4843-4b31-8bf3-d121e443804d req-35576025-7b8a-40ff-8cbd-bb02217276d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.621084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c9d9eac8-4843-4b31-8bf3-d121e443804d req-35576025-7b8a-40ff-8cbd-bb02217276d9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.648121 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c9d9eac8-4843-4b31-8bf3-d121e443804d req-35576025-7b8a-40ff-8cbd-bb02217276d9 service nova] Creating event network-vif-deleted:a7ce0b65-d28b-4643-8243-0f2177a3136c for instance f9dd9356-273f-4e77-95cc-dbf55d4e893a on nch2-master-1 Nov 20 20:59:05.668603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c9d9eac8-4843-4b31-8bf3-d121e443804d req-35576025-7b8a-40ff-8cbd-bb02217276d9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080960 Nov 20 20:59:05.672523 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2045/4071] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:05.683664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f2c6bee-c86b-42c8-af5a-422bad8a3410 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:05.691997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f2c6bee-c86b-42c8-af5a-422bad8a3410 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:05.828759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f2c6bee-c86b-42c8-af5a-422bad8a3410 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:05.836456 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f2c6bee-c86b-42c8-af5a-422bad8a3410 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1208 microversion: 2.1 time: 0.160713 Nov 20 20:59:05.837604 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2046/4072] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:05 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1208 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:05.843609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1e03721-bed1-4ab2-93cf-46282cbec99f", "name": "network-vif-deleted", "tag": "8db776c8-e246-49f6-8f5f-c227f2b7e7c9"}, {"name": "network-changed", "server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:05.846195 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:05.846195 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:05.863575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:05.864376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:05.892050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] Creating event network-vif-deleted:8db776c8-e246-49f6-8f5f-c227f2b7e7c9 for instance e1e03721-bed1-4ab2-93cf-46282cbec99f on nch1-master-1 Nov 20 20:59:05.899090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] Creating event network-changed:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:59:05.910273 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c897a3a1-e1e7-42f8-83d2-0b57caeb3657 req-ae579945-dcb1-4f96-b9d6-197e544d9e3d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071323 Nov 20 20:59:05.914709 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2047/4073] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:05 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:05.926109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-658016912", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c3915836-86cb-49e6-9e5c-f9e82114304b"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:05.992961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] validate_networks() for [('c3915836-86cb-49e6-9e5c-f9e82114304b', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:59:06.145569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Updating instance_info_cache with network_info: [{"id": "cfd0dca9-fc25-4b7e-a3c0-929991afa254", "address": "fa:16:3e:8f:45:7b", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcfd0dca9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:59:06.161329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Releasing lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:59:06.162610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-22f9bd40-c466-42e7-81b5-4582570c5211 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action" status: 202 len: 0 microversion: 2.1 time: 5.087177 Nov 20 20:59:06.163373 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2027/4074] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:01 2021] POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action => generated 0 bytes in 5088 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 20 20:59:06.173368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76a14b4e-9cb3-4e44-82f3-b658bbea7346 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '.version_select at 0x7f3f8776eb80>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:06.552667 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76a14b4e-9cb3-4e44-82f3-b658bbea7346 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/os-floating-ips/8100fa9b-3d19-4559-a8cc-a35b4182154e" status: 200 len: 185 microversion: 2.1 time: 0.383020 Nov 20 20:59:06.553295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2028/4075] 10.222.0.41 () {58 vars in 1259 bytes} [Sat Nov 20 20:59:06 2021] GET /compute/v2.1/os-floating-ips/8100fa9b-3d19-4559-a8cc-a35b4182154e => generated 185 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:59:06.566149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.231"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:06.925923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:06.940611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:06.942658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:06.945930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:06.946707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.208086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:59:07.209082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:59:07.209708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:59:07.210324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:59:07.210893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:59:07.228590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.229320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.231412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.232026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.279401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:59:07.285250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Getting quotas for user 7d7584016cee47439932a58f846cd04f and project fc809fb7bd984e43bfa1433cf0c79430. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:59:07.301816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:59:07.305216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:07.385578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47dcea4a-9b2a-4e84-bac6-f87b77baecd3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467237 Nov 20 20:59:07.387072 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2048/4076] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:59:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:59:07.396759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:07.398333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:07.409641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.410576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.412657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.414576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.416823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Acquired lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 20 20:59:07.476739 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fffb8e6-982f-41c9-b23f-1cea09020d7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.087038 Nov 20 20:59:07.478875 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2049/4077] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:07 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:07.494097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:07.494907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:07.507158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.507461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.509032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:07.509734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:07.842724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:07.859339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-388b85a1-d36b-41da-b666-a8692c350a34 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1266 microversion: 2.1 time: 0.377849 Nov 20 20:59:07.861931 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2050/4078] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:07 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:07.875899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acfe694e-2dac-46a8-9be7-722cdfba7008 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:07.876640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acfe694e-2dac-46a8-9be7-722cdfba7008 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:07.993283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-acfe694e-2dac-46a8-9be7-722cdfba7008 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:08.006570 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acfe694e-2dac-46a8-9be7-722cdfba7008 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1214 microversion: 2.1 time: 0.138378 Nov 20 20:59:08.017712 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2051/4079] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:07 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:08.496344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:08.499961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:08.526832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:08.527648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:08.529333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:08.530318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:08.602991 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58101024-4f38-41c0-8584-336269505d9d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.116488 Nov 20 20:59:08.612008 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2052/4080] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:08 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:08.879194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:08.880036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:08.901223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:08.901683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:08.903158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:08.903836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.109562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Building network info cache for instance {{(pid=140942) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Nov 20 20:59:09.113421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:09.122362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-244d3be1-667f-4cb0-88cf-ca0003a2f3b1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1266 microversion: 2.1 time: 0.248151 Nov 20 20:59:09.124996 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2053/4081] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:08 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:09.138065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:09.139405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:09.152137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:09.154041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.155045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:09.158816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.325021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:09.337383 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8616cec5-0415-4bf1-ae34-3b62746e3c2f tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1272 microversion: 2.1 time: 0.208835 Nov 20 20:59:09.338271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2054/4082] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:09 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:09.351527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-470e73e8-4cb7-47d3-b764-cde12feeb32b req-f16ef3a9-13c7-405f-97b5-ae1813c07795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:09.354301 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:09.354301 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:09.368971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-470e73e8-4cb7-47d3-b764-cde12feeb32b req-f16ef3a9-13c7-405f-97b5-ae1813c07795 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:09.373025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-470e73e8-4cb7-47d3-b764-cde12feeb32b req-f16ef3a9-13c7-405f-97b5-ae1813c07795 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.401955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-470e73e8-4cb7-47d3-b764-cde12feeb32b req-f16ef3a9-13c7-405f-97b5-ae1813c07795 service nova] Creating event network-changed:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:59:09.407767 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-470e73e8-4cb7-47d3-b764-cde12feeb32b req-f16ef3a9-13c7-405f-97b5-ae1813c07795 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067551 Nov 20 20:59:09.411072 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2055/4083] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:09.618803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:09.619816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:09.633547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:09.643478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.645599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:09.655593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:09.738479 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87fd39ff-6914-4303-8aa0-508314d17d8d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.124969 Nov 20 20:59:09.739839 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2056/4084] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:09 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:10.141285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:10.142331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:10.150627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.151335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.152327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.152923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.660947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:10.668460 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f91b2d4a-3698-4bc1-b1fc-a65e9bcaab6b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.531455 Nov 20 20:59:10.679147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2057/4085] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:10 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:10.684416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:10.685219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:10.701516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.702269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.703977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.705936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.819735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Updating instance_info_cache with network_info: [{"id": "cfd0dca9-fc25-4b7e-a3c0-929991afa254", "address": "fa:16:3e:8f:45:7b", "network": {"id": "7dde530b-f780-469d-8a3e-3b58058fca24", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1034105966-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "81f065ce4dee4b479d5ab54d07605e61", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapcfd0dca9-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 20:59:10.839774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Releasing lock "refresh_cache-c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" {{(pid=140942) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 20 20:59:10.844211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03e6a33f-d693-4ad8-8804-b8e4bdc181ab tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action" status: 202 len: 0 microversion: 2.1 time: 4.283364 Nov 20 20:59:10.848645 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2029/4086] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:06 2021] POST /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8/action => generated 0 bytes in 4288 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Nov 20 20:59:10.862712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:10.870908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:10.890082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.891716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.895126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:10.896756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:10.985779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-443f34a2-f9c1-487d-a398-ae1bfaaa67dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.132032 Nov 20 20:59:10.987382 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2030/4087] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:10 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:10.995571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:10.996451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:11.006568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.007950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:11.008970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.009782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:11.034134 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] HTTP exception thrown: Instance f9dd9356-273f-4e77-95cc-dbf55d4e893a could not be found. Nov 20 20:59:11.035391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Returning 404 to user: Instance f9dd9356-273f-4e77-95cc-dbf55d4e893a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:11.036425 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c810a0dd-3e37-4e4b-afcb-1b1573cb3902 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 404 len: 111 microversion: 2.1 time: 0.047665 Nov 20 20:59:11.037532 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2031/4088] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:10 2021] DELETE /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:11.047251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:11.049740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: f9dd9356-273f-4e77-95cc-dbf55d4e893a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:11.057294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.058017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:11.059068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.059511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:11.082504 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] HTTP exception thrown: Instance f9dd9356-273f-4e77-95cc-dbf55d4e893a could not be found. Nov 20 20:59:11.083212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Returning 404 to user: Instance f9dd9356-273f-4e77-95cc-dbf55d4e893a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:11.084165 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ddc35b0f-8881-49dc-80a5-6fd219bd204f tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a" status: 404 len: 111 microversion: 2.1 time: 0.041657 Nov 20 20:59:11.085308 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2032/4089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:11 2021] GET /compute/v2.1/servers/f9dd9356-273f-4e77-95cc-dbf55d4e893a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:11.097841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f281dc7-cc0e-484f-baa6-3d2bccbd5e2e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '.version_select at 0x7f3f87206430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:11.596212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:11.607229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6d1d3b5-dfa6-46b7-b4d1-d84c4b7dad94 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.926516 Nov 20 20:59:11.607902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2058/4090] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:10 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:11.691302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:11.692764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:11.701371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.701980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:11.703534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:11.704141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:12.306548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:12.324638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07cf1e5b-d40e-408e-b26a-ab33cf252541 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.638148 Nov 20 20:59:12.334720 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2059/4091] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:11 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:12.339287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:12.341215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:12.348778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:12.349374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:12.352815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:12.355690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:12.494560 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b8928da-f2e7-4b03-97e1-546447551afc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.162546 Nov 20 20:59:12.501011 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2060/4092] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:12 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:12.535298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c5b02ff1-88f2-469d-bb68-5f97bce76169 req-7d5ee4f2-ec09-4e66-8230-4db8736c0b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a64f1609-c8a6-41c0-b66b-b0ade6aca0f4", "tag": "4dd59798-a2b7-4da4-9f76-8a780af1bf3e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:12.542784 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:12.542784 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:12.599275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5b02ff1-88f2-469d-bb68-5f97bce76169 req-7d5ee4f2-ec09-4e66-8230-4db8736c0b67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:12.600113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c5b02ff1-88f2-469d-bb68-5f97bce76169 req-7d5ee4f2-ec09-4e66-8230-4db8736c0b67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:12.654296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c5b02ff1-88f2-469d-bb68-5f97bce76169 req-7d5ee4f2-ec09-4e66-8230-4db8736c0b67 service nova] Creating event network-changed:4dd59798-a2b7-4da4-9f76-8a780af1bf3e for instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 on nch2-master-1 Nov 20 20:59:12.686708 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c5b02ff1-88f2-469d-bb68-5f97bce76169 req-7d5ee4f2-ec09-4e66-8230-4db8736c0b67 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180610 Nov 20 20:59:12.687751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2061/4093] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:12.693663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:12.695992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:12.709828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:12.711091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:12.712120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:12.712734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.097806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:13.106455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16b2cb06-8712-460b-bb0c-60db6a9d1935 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.417002 Nov 20 20:59:13.107898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2062/4094] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:12 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:13.341730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:13.342624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:13.353100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:13.354502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.356222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:13.363606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.824218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:13.832483 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2335cbad-cc05-4719-b23c-bb3ed9a8cf8e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.494401 Nov 20 20:59:13.841762 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2063/4095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:13 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:13.848786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-29e37f7b-1942-4574-b78b-cebda3d54032 req-bcf67774-eb6f-44ec-af9a-5762030eac4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef2710d9-715b-4af3-832d-bd8d130d00fc", "tag": "59693434-f8c7-46df-aa97-c3ac4d0552b1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:13.850644 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:13.850644 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:13.859336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29e37f7b-1942-4574-b78b-cebda3d54032 req-bcf67774-eb6f-44ec-af9a-5762030eac4c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:13.859784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29e37f7b-1942-4574-b78b-cebda3d54032 req-bcf67774-eb6f-44ec-af9a-5762030eac4c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.876400 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-29e37f7b-1942-4574-b78b-cebda3d54032 req-bcf67774-eb6f-44ec-af9a-5762030eac4c service nova] Creating event network-changed:59693434-f8c7-46df-aa97-c3ac4d0552b1 for instance ef2710d9-715b-4af3-832d-bd8d130d00fc on nch1-master-1 Nov 20 20:59:13.882232 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-29e37f7b-1942-4574-b78b-cebda3d54032 req-bcf67774-eb6f-44ec-af9a-5762030eac4c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039494 Nov 20 20:59:13.883465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2064/4096] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:13.889746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:13.891405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:13.898569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:13.899092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.899902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:13.900335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:13.943247 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c38a7b04-fd67-4bb7-ab7f-37f8f15073e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.058152 Nov 20 20:59:13.944934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2065/4097] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:13 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:14.064678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f281dc7-cc0e-484f-baa6-3d2bccbd5e2e tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "DELETE /compute/v2.1/os-floating-ips/8100fa9b-3d19-4559-a8cc-a35b4182154e" status: 202 len: 0 microversion: 2.1 time: 2.972861 Nov 20 20:59:14.076947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2033/4098] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 20:59:11 2021] DELETE /compute/v2.1/os-floating-ips/8100fa9b-3d19-4559-a8cc-a35b4182154e => generated 0 bytes in 2986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:59:14.080963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:14.082761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:14.109807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.116560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.120511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.124650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.129154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:14.130004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:14.148826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.149623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.151254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.151903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.232225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:59:14.399979 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-29dc3cb5-de91-4b71-9d36-58e70da882e1 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 204 len: 0 microversion: 2.1 time: 0.324881 Nov 20 20:59:14.403108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2066/4099] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:14 2021] DELETE /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:59:14.413465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:14.415446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:14.425776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.426635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.427797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.428744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.824342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:14.839513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f6b7c9c-5725-48ff-9a88-23b38fbe9d23 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.717866 Nov 20 20:59:14.842619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2034/4100] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:14 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:14.868661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:14.872853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:14.894458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.896070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:14.898121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:14.900001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:15.087371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:15.101000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60a8808d-2ba7-4c6d-b20e-825d82042c4c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1526 microversion: 2.1 time: 0.693322 Nov 20 20:59:15.101617 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2067/4101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:14 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1526 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:15.111482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:15.112956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:15.137460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:15.138862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:15.141393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:15.144299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:15.256026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2fe3bd2a-7be0-4e82-9c3e-46c7379ea941 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.152842 Nov 20 20:59:15.256747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2068/4102] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:15 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:15.385453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:15.397557 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-153301ea-eebb-4b61-a5b0-1a48431131d1 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.549037 Nov 20 20:59:15.398230 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2035/4103] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:14 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:15.865263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:15.865991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:15.885512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:15.886442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:15.887785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:15.889313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.120242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:16.120882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:16.140831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.141305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.142229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.142918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.702344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:16.714391 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d245c396-ce8d-486d-927f-cd3ff5eef89c tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1526 microversion: 2.1 time: 0.598373 Nov 20 20:59:16.717089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2036/4104] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:16 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1526 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:16.729778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:16.732741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:16.742465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.742921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.743914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.745130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.794399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1e6e76b-b9eb-40f6-b711-a31579b3d5cb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.075505 Nov 20 20:59:16.796203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2037/4105] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:16 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:16.803026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:16.803776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:16.816052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.816775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.817754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:16.818753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:16.858421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:16.873096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f1195f8-b36c-406b-9eb1-8a71ee65b109 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 1.017072 Nov 20 20:59:16.877168 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2069/4106] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:15 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:17.447905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e17f9b28-a776-4528-ad80-463432cb5efa req-d3f09411-d447-4c05-b19d-b4c3980b1abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8", "name": "network-vif-deleted", "tag": "cfd0dca9-fc25-4b7e-a3c0-929991afa254"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:17.449792 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:17.449792 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:17.451331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:17.467777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e17f9b28-a776-4528-ad80-463432cb5efa req-d3f09411-d447-4c05-b19d-b4c3980b1abb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.468446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e17f9b28-a776-4528-ad80-463432cb5efa req-d3f09411-d447-4c05-b19d-b4c3980b1abb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.495612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fff54a8a-41fb-4e6c-802d-f6a54179bf77 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.698013 Nov 20 20:59:17.498538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2038/4107] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:16 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:17.515189 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e17f9b28-a776-4528-ad80-463432cb5efa req-d3f09411-d447-4c05-b19d-b4c3980b1abb service nova] Creating event network-vif-deleted:cfd0dca9-fc25-4b7e-a3c0-929991afa254 for instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 on nch1-master-1 Nov 20 20:59:17.536186 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e17f9b28-a776-4528-ad80-463432cb5efa req-d3f09411-d447-4c05-b19d-b4c3980b1abb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081643 Nov 20 20:59:17.537117 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2070/4108] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:59:17.544960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6417fc16-41df-4856-8957-7bb222b13657 req-cfbe5e34-1950-4b6b-83c2-db1138aa5311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64f1609-c8a6-41c0-b66b-b0ade6aca0f4", "name": "network-vif-plugged", "status": "completed", "tag": "4dd59798-a2b7-4da4-9f76-8a780af1bf3e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:17.548738 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:17.548738 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:17.569493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6417fc16-41df-4856-8957-7bb222b13657 req-cfbe5e34-1950-4b6b-83c2-db1138aa5311 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.569987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6417fc16-41df-4856-8957-7bb222b13657 req-cfbe5e34-1950-4b6b-83c2-db1138aa5311 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.617069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6417fc16-41df-4856-8957-7bb222b13657 req-cfbe5e34-1950-4b6b-83c2-db1138aa5311 service nova] Creating event network-vif-plugged:4dd59798-a2b7-4da4-9f76-8a780af1bf3e for instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 on nch2-master-1 Nov 20 20:59:17.632769 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6417fc16-41df-4856-8957-7bb222b13657 req-cfbe5e34-1950-4b6b-83c2-db1138aa5311 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102276 Nov 20 20:59:17.635546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2039/4109] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:17.736578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:17.737717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:17.747894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.748383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.749188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.765904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.807775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:17.809479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:17.822886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.828100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.831405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.833202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.879849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:17.880397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:17.885774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lazy-loading 'fault' on Instance uuid c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:59:17.961251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1284c9d0-8420-4bd1-907c-e03a83431f1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.157548 Nov 20 20:59:17.962788 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2040/4110] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:17 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:17.989065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:17.995072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:18.010579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:18.012981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:18.014020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:18.018791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:18.090859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e877a5425d344711bc81f09650d9fc0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81f065ce4dee4b479d5ab54d07605e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:18.104166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70e3e365-ffa0-4e2e-9c2e-940307e2dc61 tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 200 len: 1313 microversion: 2.1 time: 0.372209 Nov 20 20:59:18.106229 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2071/4111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:17 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:18.496013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:18.507450 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f7a1c23-c85f-48d9-81c5-de5390875827 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.537197 Nov 20 20:59:18.517963 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2041/4112] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:17 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:18.520754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:18.521359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:18.533241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:18.536706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:18.539931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:18.540578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:18.937659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:18.953891 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8abae3e7-e9ca-4984-b466-ee181e368f7d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1308 microversion: 2.1 time: 0.436768 Nov 20 20:59:18.957575 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2072/4113] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:18 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:18.976846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:18.987562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:19.009074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.009862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.010984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.012569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.082578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ebda8b2-69ff-4427-811b-9827b2ad2908 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.112110 Nov 20 20:59:19.087041 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2042/4114] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:18 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:19.123565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:19.125353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] [instance: c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:19.138650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.139391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.143211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.145946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.197852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] HTTP exception thrown: Instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 could not be found. Nov 20 20:59:19.198884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] Returning 404 to user: Instance c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:19.202883 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-de28394e-b1d6-4484-81d1-c851fb33427d tempest-FloatingIPsAssociationTestJSON-1741444872 tempest-FloatingIPsAssociationTestJSON-1741444872-project] 10.222.0.41 "GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8" status: 404 len: 111 microversion: 2.1 time: 0.083545 Nov 20 20:59:19.205646 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2073/4115] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:19 2021] GET /compute/v2.1/servers/c6babf7c-ca49-49f5-a1b3-2493e1cc7eb8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:19.526711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:19.527501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:19.547861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.548615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.549832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.550488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.974304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:19.974910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:19.994665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.995133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:19.995949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:19.997625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.094626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:20.105801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92cc27b6-2a61-4f53-8f90-b66049d8ecf4 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.584488 Nov 20 20:59:20.122119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2043/4116] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:19 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:20.137087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:20.138762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:20.155084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.159005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.161820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.164791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.223259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18f6a770-7846-4d9e-bdbe-cd03853a8900 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.098744 Nov 20 20:59:20.231271 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2044/4117] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:20 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:20.346971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:20.355911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-fdb7eb0c-e59a-45fd-b44c-3e5ef61fad1a req-9b30cb48-3b5a-4458-b62c-505b01f8b9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2710d9-715b-4af3-832d-bd8d130d00fc", "name": "network-vif-plugged", "status": "completed", "tag": "59693434-f8c7-46df-aa97-c3ac4d0552b1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:20.362605 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:20.362605 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:20.394460 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aad708fb-2ab0-43b1-b36a-79e128270576 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1488 microversion: 2.1 time: 0.417740 Nov 20 20:59:20.395328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2074/4118] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:19 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1488 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:20.410358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fdb7eb0c-e59a-45fd-b44c-3e5ef61fad1a req-9b30cb48-3b5a-4458-b62c-505b01f8b9f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.410898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fdb7eb0c-e59a-45fd-b44c-3e5ef61fad1a req-9b30cb48-3b5a-4458-b62c-505b01f8b9f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.413624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:20.420669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:20.444611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.446089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.447702 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-fdb7eb0c-e59a-45fd-b44c-3e5ef61fad1a req-9b30cb48-3b5a-4458-b62c-505b01f8b9f0 service nova] Creating event network-vif-plugged:59693434-f8c7-46df-aa97-c3ac4d0552b1 for instance ef2710d9-715b-4af3-832d-bd8d130d00fc on nch1-master-1 Nov 20 20:59:20.449247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.450503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.466115 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-fdb7eb0c-e59a-45fd-b44c-3e5ef61fad1a req-9b30cb48-3b5a-4458-b62c-505b01f8b9f0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132220 Nov 20 20:59:20.467177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2045/4119] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:59:20.617919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-878b729d-f78b-4833-8476-5c85797f1666 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "PUT /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1083 microversion: 2.1 time: 0.210937 Nov 20 20:59:20.627721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2075/4120] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 20:59:20 2021] PUT /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1083 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:20.634895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:20.635703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:20.655874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.656423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:20.657330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:20.657922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.134928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:21.135791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:21.142670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.151671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.152537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.156558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.336723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:21.352173 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5dda5c7-720d-4254-a02c-819ef900f016 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1509 microversion: 2.1 time: 0.720190 Nov 20 20:59:21.353175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2046/4121] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:20 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1509 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:21.359794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:21.360974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:21.367772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.368439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.369349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.369865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.439351 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ece10d99-cf23-44f2-b489-40839caa3790 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.082436 Nov 20 20:59:21.442454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2047/4122] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:21 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:21.452806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:21.453859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:21.463505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.464795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.466103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:21.466749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:21.607466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:21.618343 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bcb6b6fc-43fe-4d00-9a60-06815115da85 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1314 microversion: 2.1 time: 0.493620 Nov 20 20:59:21.622284 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2076/4123] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:21 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:22.162531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:22.177204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2432cf1-9c6a-41ec-9b34-a320d9e1d3da tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1509 microversion: 2.1 time: 0.727572 Nov 20 20:59:22.196051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:22.196568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:22.198434 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2048/4124] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:21 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1509 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:22.225370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.229822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.232249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.234909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.301775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:59:22.452024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:22.453046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:22.464873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.471508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.473308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.473884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.512872 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7b1030d-e5c6-4123-aed6-2b244edbf6f6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 204 len: 0 microversion: 2.1 time: 0.320433 Nov 20 20:59:22.517539 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2077/4125] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:22 2021] DELETE /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:59:22.536074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:22.536851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:22.550103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.550712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.552645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.553260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.563064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f3f88dc-fc0d-4586-8980-910dba096624 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.114681 Nov 20 20:59:22.565123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2049/4126] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:22 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:22.639004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:22.640009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:22.665733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.666449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.667727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:22.668310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:22.844203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:22.855820 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04178578-f13d-4689-b300-38650c5f989d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1515 microversion: 2.1 time: 0.335606 Nov 20 20:59:22.857185 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2078/4127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:22 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:23.076452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:23.085116 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2fc42878-fde6-4a95-8529-5788abe49c92 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1501 microversion: 2.1 time: 0.450843 Nov 20 20:59:23.085914 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2050/4128] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:22 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1501 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:23.114788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:23.115357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:23.132859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.134801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.135662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.138352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.216833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lazy-loading 'flavor' on Instance uuid ef2710d9-715b-4af3-832d-bd8d130d00fc {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 20:59:23.331326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9651d3de-a985-4dba-bcb0-c16d18ab6091 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "POST /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc/action" status: 202 len: 0 microversion: 2.1 time: 0.221205 Nov 20 20:59:23.335351 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2079/4129] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:23 2021] POST /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:59:23.340144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:23.340758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:23.350145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.350788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.351836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.352882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.576264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:23.577611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:23.597169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.597727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.599090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.599538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.671500 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a131066-228e-4a72-83e0-1852f9643401 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.097841 Nov 20 20:59:23.678225 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2080/4130] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:23 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:23.884006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:23.884713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:23.899613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.900080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.903116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:23.903602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:23.993027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:24.037998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95d3fffb-fcc3-4879-a4b7-b9c41ffb8f70 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1509 microversion: 2.1 time: 0.700551 Nov 20 20:59:24.056337 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2051/4131] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:23 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:24.688904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:24.690552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:24.708413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:24.708875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:24.709742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:24.710228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:24.758869 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-efdf9b62-42ce-4a56-b59c-17cba5a9b2b2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.074135 Nov 20 20:59:24.759534 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2052/4132] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:24 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:24.990003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:24.999747 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-552c29ac-4d52-4c8e-91a0-c9c3303f579a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1515 microversion: 2.1 time: 1.125198 Nov 20 20:59:25.000204 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2081/4133] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:23 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1515 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:25.073067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:25.074438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:25.099983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.101533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.104594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.105230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.772555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:25.773527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:25.785725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.788143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.789280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.790409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.820017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:25.830557 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-409cdb35-0c68-4e8d-b82c-6ff04fde4d22 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1492 microversion: 2.1 time: 0.761423 Nov 20 20:59:25.846003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2053/4134] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:25 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1492 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:25.870192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:25.871131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:25.871518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45fd6100-dc4e-4f01-856d-614ea7464736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.104797 Nov 20 20:59:25.882639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2082/4135] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:25 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:25.885184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.887952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.891497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:25.893093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:25.990601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:59:26.021369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:26.022100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:26.042020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.042536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.043376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.043864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.185904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:26.200732 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-951790f1-456d-4567-ab10-b7a18542a0d8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 200 len: 1473 microversion: 2.1 time: 0.181087 Nov 20 20:59:26.207096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2083/4136] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:26 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 1473 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:26.211791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5a1ee912-aa3c-49fe-a223-19407fea8244 req-02801500-2dc6-4748-a967-13bf89e58e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a64f1609-c8a6-41c0-b66b-b0ade6aca0f4", "name": "network-vif-deleted", "tag": "4dd59798-a2b7-4da4-9f76-8a780af1bf3e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:26.217270 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:26.217270 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:26.226435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5a1ee912-aa3c-49fe-a223-19407fea8244 req-02801500-2dc6-4748-a967-13bf89e58e1e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.227122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5a1ee912-aa3c-49fe-a223-19407fea8244 req-02801500-2dc6-4748-a967-13bf89e58e1e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.231198 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a4c45ee-c2c8-4f7b-9a1a-b815ad0d5f63 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 204 len: 0 microversion: 2.1 time: 0.378018 Nov 20 20:59:26.234414 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2054/4137] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:25 2021] DELETE /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 20:59:26.259053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:26.261441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:26.268827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5a1ee912-aa3c-49fe-a223-19407fea8244 req-02801500-2dc6-4748-a967-13bf89e58e1e service nova] Creating event network-vif-deleted:4dd59798-a2b7-4da4-9f76-8a780af1bf3e for instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 on nch2-master-1 Nov 20 20:59:26.275435 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5a1ee912-aa3c-49fe-a223-19407fea8244 req-02801500-2dc6-4748-a967-13bf89e58e1e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067109 Nov 20 20:59:26.276244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2084/4138] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:26.284146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.284805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.285749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.286557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.684408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:26.693533 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7cbe69a8-18a7-41f4-8af1-233dc7e939c8 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1498 microversion: 2.1 time: 0.453609 Nov 20 20:59:26.700490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2055/4139] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:26 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1498 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:26.886153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:26.893632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:26.901907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.902755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.903899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:26.904626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:26.961163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a735364-0932-4342-b41e-953e83ccc5cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.080557 Nov 20 20:59:26.964231 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2085/4140] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:26 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:27.221253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:27.222604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:27.237810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:27.239467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:27.241443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:27.242564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:27.283863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. Nov 20 20:59:27.285759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:27.287621 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-173333e7-2aa7-482b-aa30-47c067f79729 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 404 len: 111 microversion: 2.1 time: 0.072066 Nov 20 20:59:27.290455 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2056/4141] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:27 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:27.483179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1853648854", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "00efdad1-1d3a-4059-9b5a-980ee6794339"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:27.637080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] validate_networks() for [('00efdad1-1d3a-4059-9b5a-980ee6794339', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:59:27.723864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:27.724456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:27.730758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:27.734768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:27.738442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:27.739119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:28.386212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:28.394519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5780f30e-7955-4574-8dfc-b21742c5f7c7 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1498 microversion: 2.1 time: 0.675081 Nov 20 20:59:28.395335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2057/4142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:27 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1498 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:28.410739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:28.412035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:28.439778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:28.440638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:28.442969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:28.444821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:28.543288 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a1fcec1-3cfb-47da-9b8c-03a42786d1e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.146453 Nov 20 20:59:28.544370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2058/4143] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:28 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:28.608638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:59:28.609071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:59:28.609516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:59:28.609927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:59:28.610364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:59:28.632819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:28.633216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:28.634185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:28.634629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:28.692596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:59:28.711020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Getting quotas for user 77f54427832d4eab90907dcb084d62c4 and project bfc3f13200ff407ea8e320abdbb3c456. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:59:28.761866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:59:28.768759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:28.893254 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a17e63f3-6f41-4d41-a886-1359f99a5563 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418177 Nov 20 20:59:28.893906 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2086/4144] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:59:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:59:28.903784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aaddd135-6c7a-4864-872b-cac818308c8c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:28.914526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aaddd135-6c7a-4864-872b-cac818308c8c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:29.100022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aaddd135-6c7a-4864-872b-cac818308c8c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:29.109036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aaddd135-6c7a-4864-872b-cac818308c8c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1209 microversion: 2.1 time: 0.208805 Nov 20 20:59:29.124038 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2087/4145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:28 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1209 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:29.193274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] Calling method '.version_select at 0x7f3f86af1f70>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:29.226403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.227110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.234413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.237060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.300273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b88b0b0-3086-4473-932b-3379018003b5 tempest-AbsoluteLimitsTestJSON-1915463065 tempest-AbsoluteLimitsTestJSON-1915463065-project] 10.222.0.41 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.671529 Nov 20 20:59:29.331859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2059/4146] 10.222.0.41 () {58 vars in 1121 bytes} [Sat Nov 20 20:59:28 2021] GET /compute/v2.1/limits => generated 511 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:59:29.413581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:29.414376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:29.422372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.429893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.432198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.432751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.443438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-136c0b09-d8bf-4a05-81a1-c2028c985588 req-d726c36f-1de5-4ae6-bb79-b7e51bdcdad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef2710d9-715b-4af3-832d-bd8d130d00fc", "name": "network-vif-deleted", "tag": "59693434-f8c7-46df-aa97-c3ac4d0552b1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:29.444950 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:29.444950 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:29.453174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-136c0b09-d8bf-4a05-81a1-c2028c985588 req-d726c36f-1de5-4ae6-bb79-b7e51bdcdad9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.453907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-136c0b09-d8bf-4a05-81a1-c2028c985588 req-d726c36f-1de5-4ae6-bb79-b7e51bdcdad9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.467511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-136c0b09-d8bf-4a05-81a1-c2028c985588 req-d726c36f-1de5-4ae6-bb79-b7e51bdcdad9 service nova] Creating event network-vif-deleted:59693434-f8c7-46df-aa97-c3ac4d0552b1 for instance ef2710d9-715b-4af3-832d-bd8d130d00fc on nch1-master-1 Nov 20 20:59:29.486674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-136c0b09-d8bf-4a05-81a1-c2028c985588 req-d726c36f-1de5-4ae6-bb79-b7e51bdcdad9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046929 Nov 20 20:59:29.488303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2060/4147] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 20:59:29.556088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:29.557104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:29.569871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.570360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.577392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:29.585830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:29.662023 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d43589b3-1b0d-4170-a193-9847ef34fd7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.109995 Nov 20 20:59:29.663814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2061/4148] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:29 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:29.728563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7584016cee47439932a58f846cd04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc809fb7bd984e43bfa1433cf0c79430', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:29.737830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86aa409d-a7f6-4c48-9899-f5549057f7ff tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 200 len: 1456 microversion: 2.1 time: 0.328639 Nov 20 20:59:29.741384 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2088/4149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:29 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 1456 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:30.131503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:30.132200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.148406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.148941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.150019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.150686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.293392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:30.301429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9fe3ac05-de77-4749-a4a7-f1e4e181793d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1213 microversion: 2.1 time: 0.174870 Nov 20 20:59:30.306602 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2062/4150] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:30 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:30.675035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:30.676537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.695118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.695696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.698135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.700004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.756172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:30.756788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.764192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.765174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.765982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.766437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.787026 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. Nov 20 20:59:30.787615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:30.789214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f858cd0-1738-4b37-b47e-25e98c5923ac tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 404 len: 111 microversion: 2.1 time: 0.038051 Nov 20 20:59:30.789977 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2063/4151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:30 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:59:30.801004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:30.801693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.808103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.810918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.811930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.815527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.823682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d6bd15a2-b623-4782-9e7e-ce924098f476 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.153125 Nov 20 20:59:30.830171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2089/4152] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:30 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:30.841897 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. Nov 20 20:59:30.842759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:30.843808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89232b44-1615-4558-b88f-7fd1496b6113 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 404 len: 111 microversion: 2.1 time: 0.047434 Nov 20 20:59:30.847896 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2064/4153] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:30 2021] DELETE /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:59:30.853793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:30.866613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: ef2710d9-715b-4af3-832d-bd8d130d00fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.896483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.896846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.897671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.898137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.953229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. Nov 20 20:59:30.953858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance ef2710d9-715b-4af3-832d-bd8d130d00fc could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:30.958563 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2f09e1a-c295-4141-a4a2-9aa462790069 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc" status: 404 len: 111 microversion: 2.1 time: 0.105833 Nov 20 20:59:30.962708 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2090/4154] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:30 2021] GET /compute/v2.1/servers/ef2710d9-715b-4af3-832d-bd8d130d00fc => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:30.969189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:30.969677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:30.978183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.985908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:30.987051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:30.987739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.011547 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. Nov 20 20:59:31.012146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.012987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca686327-168b-461f-beeb-226e1c55970e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 404 len: 111 microversion: 2.1 time: 0.047551 Nov 20 20:59:31.022111 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2065/4155] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:30 2021] DELETE /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.023456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.024069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: e1e03721-bed1-4ab2-93cf-46282cbec99f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.038868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.039352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.043010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.043485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.135493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. Nov 20 20:59:31.136772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance e1e03721-bed1-4ab2-93cf-46282cbec99f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.149058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a5d78a1f-15c9-4d2b-89a9-b6ef43f00be5 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f" status: 404 len: 111 microversion: 2.1 time: 0.126212 Nov 20 20:59:31.154816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2091/4156] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:31 2021] GET /compute/v2.1/servers/e1e03721-bed1-4ab2-93cf-46282cbec99f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.168243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.168878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.184886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.184886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.184886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.197054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.240159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. Nov 20 20:59:31.241027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.241904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a05831b1-2220-42b4-9ffb-c8e1adcd0e58 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 404 len: 111 microversion: 2.1 time: 0.083477 Nov 20 20:59:31.253211 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2066/4157] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:31 2021] DELETE /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.260593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.261488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 9a2a37d1-6352-4c63-8de6-2e9e94bf609f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.275697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.278414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.284076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.284625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.316964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. Nov 20 20:59:31.321229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 9a2a37d1-6352-4c63-8de6-2e9e94bf609f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.322262 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34aa7f81-dd68-4209-9798-efca8fca9f33 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f" status: 404 len: 111 microversion: 2.1 time: 0.067792 Nov 20 20:59:31.323360 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2092/4158] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:31 2021] GET /compute/v2.1/servers/9a2a37d1-6352-4c63-8de6-2e9e94bf609f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:59:31.328440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.330395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.338852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.339630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.339745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.340142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.341007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.341776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.362643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.366455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.373633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.377853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.426850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. Nov 20 20:59:31.427943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.429116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56c65ca4-f6d2-4883-a34a-e32d6a1c01ce tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 404 len: 111 microversion: 2.1 time: 0.096852 Nov 20 20:59:31.434393 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2093/4159] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:31 2021] DELETE /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:59:31.441446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.442349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: be59183b-d051-4d64-96f9-6bbdf8230b4a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.453828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.455078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.459737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.460410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.499524 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. Nov 20 20:59:31.500548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance be59183b-d051-4d64-96f9-6bbdf8230b4a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.501850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21d10970-280e-4534-9c36-e74d9b56fc3e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a" status: 404 len: 111 microversion: 2.1 time: 0.066156 Nov 20 20:59:31.506684 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2094/4160] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:31 2021] GET /compute/v2.1/servers/be59183b-d051-4d64-96f9-6bbdf8230b4a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.523871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.536452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.556044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.556626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.557604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.558916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.583892 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. Nov 20 20:59:31.584404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.585493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca3e1480-09e1-4af6-8c69-f57ddcfe240c tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a" status: 404 len: 111 microversion: 2.1 time: 0.077219 Nov 20 20:59:31.586888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2095/4161] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:31 2021] DELETE /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.604517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:31.606409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: 01403f0e-a121-4b91-b01c-96ddd180ca3a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.623271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.623830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.630988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.631586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.649387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. Nov 20 20:59:31.666960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance 01403f0e-a121-4b91-b01c-96ddd180ca3a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:31.671298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:31.675671 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3581631b-7aea-4e21-b00e-cbbd77bb124e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a" status: 404 len: 111 microversion: 2.1 time: 0.072579 Nov 20 20:59:31.679978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-066b1cb2-c622-4e91-b05b-542c7417a835 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1267 microversion: 2.1 time: 0.360350 Nov 20 20:59:31.680841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2096/4162] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:31 2021] GET /compute/v2.1/servers/01403f0e-a121-4b91-b01c-96ddd180ca3a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:31.681829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2067/4163] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:31 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:31.837103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:31.838213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:31.850539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.852670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.854787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:31.855651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:31.942848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd0c0377-a4d4-49ae-9ed1-83121534a1d7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.110162 Nov 20 20:59:31.950004 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2097/4164] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:31 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:32.702492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:32.704055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:32.713352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:32.719001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:32.720743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:32.721490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:32.957237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:32.958279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:32.979060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:32.979507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:32.980315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:32.980752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.034554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-140db2a3-74af-48ee-a440-230fed1b4aad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.079983 Nov 20 20:59:33.036007 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2098/4165] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:32 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:33.041727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:33.042591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:33.052003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.052757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.053844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.054561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.082284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. Nov 20 20:59:33.083333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:33.084332 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af467f19-a6b5-4afe-9cf9-bc3ac884e2db tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 404 len: 111 microversion: 2.1 time: 0.046911 Nov 20 20:59:33.088162 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2099/4166] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:33 2021] DELETE /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:33.093042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:33.093851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: eb6b17e8-3ed4-4602-9524-8aa8b910746a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:33.101238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.102003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.103084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.103736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.122913 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. Nov 20 20:59:33.123926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance eb6b17e8-3ed4-4602-9524-8aa8b910746a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:33.125575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-672eb19f-3dce-44a9-8fc6-0052f9d2ae0e tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a" status: 404 len: 111 microversion: 2.1 time: 0.036277 Nov 20 20:59:33.127024 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2100/4167] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:33 2021] GET /compute/v2.1/servers/eb6b17e8-3ed4-4602-9524-8aa8b910746a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:33.135296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:33.136083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:33.143650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.145114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.146215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.146964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.165020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. Nov 20 20:59:33.166621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:33.167851 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0283909-fa0a-4178-a4a0-a87c35911028 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 404 len: 111 microversion: 2.1 time: 0.036568 Nov 20 20:59:33.172681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2101/4168] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 20:59:33 2021] DELETE /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 20:59:33.178511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:33.179444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] [instance: d796894d-3c49-495b-8406-19241e7fc4b2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:33.185968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.186755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.187796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:33.188824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:33.205889 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] HTTP exception thrown: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. Nov 20 20:59:33.206673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] Returning 404 to user: Instance d796894d-3c49-495b-8406-19241e7fc4b2 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 20:59:33.207814 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78c81143-4576-4a9c-8c99-f4fc780bbab3 tempest-DeleteServersTestJSON-1053652199 tempest-DeleteServersTestJSON-1053652199-project] 10.222.0.41 "GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2" status: 404 len: 111 microversion: 2.1 time: 0.033749 Nov 20 20:59:33.208912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2102/4169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:33 2021] GET /compute/v2.1/servers/d796894d-3c49-495b-8406-19241e7fc4b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 20:59:33.485230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:33.496356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95beccc3-decc-4eeb-a825-ceff80117877 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.797380 Nov 20 20:59:33.504118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2068/4170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:32 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:34.047102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:34.048573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:34.061751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:34.064653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:34.065779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:34.066413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:34.145747 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36fe7053-92ba-444f-b3b9-40280dff1107 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.102087 Nov 20 20:59:34.149870 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2103/4171] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:34 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:34.321696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-e6c1d07c-5c0b-4fe4-b70c-1c559f97a764 req-b3862dec-30f9-463f-aa82-c38202b9f7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374eedfb-69c7-4878-98ca-3e74106cf023", "tag": "5c849f08-17cc-461e-bc76-e9f2cac336fb"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:34.323417 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:34.323417 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:34.362145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e6c1d07c-5c0b-4fe4-b70c-1c559f97a764 req-b3862dec-30f9-463f-aa82-c38202b9f7e4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:34.362832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-e6c1d07c-5c0b-4fe4-b70c-1c559f97a764 req-b3862dec-30f9-463f-aa82-c38202b9f7e4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:34.399926 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-e6c1d07c-5c0b-4fe4-b70c-1c559f97a764 req-b3862dec-30f9-463f-aa82-c38202b9f7e4 service nova] Creating event network-changed:5c849f08-17cc-461e-bc76-e9f2cac336fb for instance 374eedfb-69c7-4878-98ca-3e74106cf023 on nch2-master-1 Nov 20 20:59:34.412040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-e6c1d07c-5c0b-4fe4-b70c-1c559f97a764 req-b3862dec-30f9-463f-aa82-c38202b9f7e4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095693 Nov 20 20:59:34.413390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2069/4172] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:34.524750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:34.526016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:34.550887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:34.551442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:34.552119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:34.557309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:35.161851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:35.163560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:35.182596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:35.183104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:35.185522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:35.185977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:35.270794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:35.272899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81bf295b-1093-4f00-8922-133db033301f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.118664 Nov 20 20:59:35.278859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2070/4173] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:35 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:35.279727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-431299be-f17b-4c51-8bc0-aa5d09fe6dec tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.759913 Nov 20 20:59:35.290576 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2104/4174] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:34 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:36.311988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:36.315464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:36.318918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:36.324652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:36.352492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:36.356399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:36.357715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:36.358756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:36.361353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:36.361915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:36.362822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:36.366866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:36.540288 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72413515-f7fc-4e73-9279-e461011ad60f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.254879 Nov 20 20:59:36.545339 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2071/4175] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:36 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:37.095239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:37.105193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec7a7576-d7e4-4348-82e7-b94d5fcc5bf2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.809408 Nov 20 20:59:37.106636 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2105/4176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:36 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:37.561664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:37.563092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:37.607514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:37.608893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:37.632543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:37.633008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:37.780826 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-136b48e4-a2c1-4688-a406-27457ecdfda9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.227077 Nov 20 20:59:37.786897 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2072/4177] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:37 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:38.121492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:38.122125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:38.135984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:38.136428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:38.137234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:38.137668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:38.762755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1867277235", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "75b827dc-6833-4bfb-88ea-ff6bce0d0650"}, {"uuid": "26b4e903-e81a-4dfe-8f45-7cde89d8557a"}, {"uuid": "75b827dc-6833-4bfb-88ea-ff6bce0d0650"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:38.880991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] validate_networks() for [('75b827dc-6833-4bfb-88ea-ff6bce0d0650', None, None, None, None, None), ('26b4e903-e81a-4dfe-8f45-7cde89d8557a', None, None, None, None, None), ('75b827dc-6833-4bfb-88ea-ff6bce0d0650', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:59:38.929981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:38.939449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91f45cbb-11ef-4d49-8af0-0a22e84ec331 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.820579 Nov 20 20:59:38.941116 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2106/4178] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:38 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:38.969564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:38.977957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:38.992300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:38.994442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:39.009213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:39.013630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:39.089874 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9475f27-1a5f-4a30-bf7c-235bc02cf45b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.131747 Nov 20 20:59:39.091273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2107/4179] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:38 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:39.963203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:39.964598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:39.973926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:39.975331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:39.976303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:39.977001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:40.394289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:40.404352 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ba2b063-2838-44f3-8623-51cacbfcc02d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.445957 Nov 20 20:59:40.405517 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2108/4180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:39 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:40.427374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:40.428421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:40.438803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:40.439793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:40.440832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:40.441707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:40.510404 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f5c5b3d-979f-467d-9e3c-b2d0bc286629 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.099811 Nov 20 20:59:40.519174 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2109/4181] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:40 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:40.965963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:59:40.967021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:59:40.967833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:59:40.968454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:59:40.969078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:59:40.982473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:40.983319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:40.984401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:40.986189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:41.009155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Getting quotas for project 4ec4545fe17f4700bc073f25016da683. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:59:41.016104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Getting quotas for user bd1afe99ea084fea8a86d7d6a8a6057b and project 4ec4545fe17f4700bc073f25016da683. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:59:41.040135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:59:41.044303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:41.147187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4a39d30-f27c-4066-910b-0640afe4e1cd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.391079 Nov 20 20:59:41.148425 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2073/4182] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:59:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:59:41.163246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59f77e1e-1378-419a-88e5-e863cdb1de31 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:41.164063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59f77e1e-1378-419a-88e5-e863cdb1de31 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:41.377396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59f77e1e-1378-419a-88e5-e863cdb1de31 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:41.389477 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59f77e1e-1378-419a-88e5-e863cdb1de31 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1213 microversion: 2.1 time: 0.232694 Nov 20 20:59:41.402335 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2110/4183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:41 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:41.425803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:41.426483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:41.438067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:41.440010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:41.442477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:41.442963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:41.526578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:41.527664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:41.555171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:41.555685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:41.564152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:41.567346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:41.652120 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a524f60-9b2d-4111-9010-d95ad970a031 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.128670 Nov 20 20:59:41.656866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2111/4184] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:41 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 20:59:41.862899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:41.872149 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9132fc34-8f97-4885-9cab-8543e58e9f1e tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 0.454369 Nov 20 20:59:41.884816 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2074/4185] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:41 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:42.022552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1298404686", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "6909f76c-6cf0-49e8-9350-bbb4acb8a084"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:42.131481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] validate_networks() for [('6909f76c-6cf0-49e8-9350-bbb4acb8a084', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 20:59:42.412146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:42.414539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:42.431032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:42.432350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:42.434462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:42.435278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:42.654855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:42.665421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c017c226-4f26-4a9d-be74-9a0b968fae06 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1265 microversion: 2.1 time: 0.260200 Nov 20 20:59:42.686612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2075/4186] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:42 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:42.700727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:42.701251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:42.726383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:42.731884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:42.732816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:42.736135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:42.868176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 20:59:43.112953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62fddfb3-4167-4e2f-90e6-2e2685d56157 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 204 len: 0 microversion: 2.42 time: 0.424889 Nov 20 20:59:43.114774 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2076/4187] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 20:59:42 2021] DELETE /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 20:59:43.141752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:43.149041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:43.184639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.186271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.188380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.197348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.316938 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14763e21-8a16-46c4-a808-fa3466d9b67c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.194578 Nov 20 20:59:43.321706 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2077/4188] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:43 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:43.337862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:43.341506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:43.366128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.369183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.372068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.372744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.846916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 20:59:43.847342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 20:59:43.847681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 20:59:43.848098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 20:59:43.848521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 20:59:43.883642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.884098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.909457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:43.911107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:43.963706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Getting quotas for project 71afe10ea2e54e09af1aef5ee9f07261. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 20:59:43.975160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Getting quotas for user 1252ae31200b44dda39395c98f6153cc and project 71afe10ea2e54e09af1aef5ee9f07261. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 20:59:44.015946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Going to run 3 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 20:59:44.025123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:44.070392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=11b186c3-e02d-4b49-9299-6f493455e3e3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:44.120274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=e60d5cd6-1736-4303-8340-35b914be8dce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 20:59:44.228401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-578d8682-3556-403d-897c-d233fb72b701 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572557 Nov 20 20:59:44.231376 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2112/4189] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 20:59:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 20:59:44.240782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:44.243022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:44.260487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:44.260851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:44.261834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:44.262307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:44.732078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:44.746192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-439a634c-68a9-46fc-9ccd-2f501bb9447a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 1.422609 Nov 20 20:59:44.754433 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2078/4190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:43 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:44.767568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:44.768733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:44.784355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:44.791870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:44.795041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:44.801010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:44.995983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.007227 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12886288-6efa-4d5f-8362-14d1d9947606 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1271 microversion: 2.1 time: 0.251393 Nov 20 20:59:45.011595 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2079/4191] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:44 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:45.029647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:45.039816 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:45.039816 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:45.041369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.042804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 20:59:45.083156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.083805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.084877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.085600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.113618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-677de2a8-b0b6-431d-bd71-2fde474db59e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.088267 Nov 20 20:59:45.119992 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2080/4192] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 20:59:45 2021] GET /compute/v2.1/servers => generated 1018 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:45.119992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:45.121477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:45.130278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.131060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.132193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.133148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.218581 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-48ef3100-adb2-44b3-9be7-2647af8782a7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 32632 microversion: 2.1 time: 0.101833 Nov 20 20:59:45.220080 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2081/4193] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:45 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 32632 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:45.240467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3a8d3773-2ae2-4f66-81ce-0b6e9db42747 req-27ab9389-0ef5-49f7-8709-69571d4ee9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374eedfb-69c7-4878-98ca-3e74106cf023", "name": "network-vif-plugged", "status": "completed", "tag": "5c849f08-17cc-461e-bc76-e9f2cac336fb"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:45.242694 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:45.242694 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:45.267765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3a8d3773-2ae2-4f66-81ce-0b6e9db42747 req-27ab9389-0ef5-49f7-8709-69571d4ee9df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.269048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3a8d3773-2ae2-4f66-81ce-0b6e9db42747 req-27ab9389-0ef5-49f7-8709-69571d4ee9df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.304450 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3a8d3773-2ae2-4f66-81ce-0b6e9db42747 req-27ab9389-0ef5-49f7-8709-69571d4ee9df service nova] Creating event network-vif-plugged:5c849f08-17cc-461e-bc76-e9f2cac336fb for instance 374eedfb-69c7-4878-98ca-3e74106cf023 on nch2-master-1 Nov 20 20:59:45.316982 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3a8d3773-2ae2-4f66-81ce-0b6e9db42747 req-27ab9389-0ef5-49f7-8709-69571d4ee9df service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095112 Nov 20 20:59:45.324322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2082/4194] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:45.338438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42a1739e-341e-4582-aab7-05a6413ea816 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:45.340095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42a1739e-341e-4582-aab7-05a6413ea816 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:45.535574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42a1739e-341e-4582-aab7-05a6413ea816 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.548829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42a1739e-341e-4582-aab7-05a6413ea816 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1223 microversion: 2.1 time: 0.218737 Nov 20 20:59:45.558916 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2083/4195] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:45 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:45.606383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.626783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.638255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:45.643539 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8823b16-518e-4606-ada7-51c926959467 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2961 microversion: 2.42 time: 1.409410 Nov 20 20:59:45.645962 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2113/4196] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:44 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2961 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:45.769996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:45.771274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:45.786335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.787841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:45.791392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:45.792708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:46.028652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:46.029936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:46.049411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:46.058084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:46.064815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:46.071555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:47.744383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:47.754796 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30432a1e-703f-4d6b-b421-1221910fc514 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1313 microversion: 2.1 time: 1.729709 Nov 20 20:59:47.756428 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2114/4197] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:46 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1313 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:47.761415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:47.762713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:47.770828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:47.771682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:47.773456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:47.774325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:47.880774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82d6111a-8f6e-4049-8a48-371d1195d377 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 40787 microversion: 2.1 time: 0.122866 Nov 20 20:59:47.881457 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2115/4198] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:47 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 40787 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 20:59:47.891029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:47.894966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:47.910871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:47.911906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:47.916480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:47.917161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.069684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:48.085405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-328e2242-bf81-4dad-8d9c-7082595e96c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1281 microversion: 2.1 time: 0.202438 Nov 20 20:59:48.087762 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2116/4199] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:47 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:48.099431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:48.100062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:48.107315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:48.115618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.116077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.116886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.117333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.118506 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b618fdb1-0c3f-4b1d-b117-83558c100cc7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1309 microversion: 2.1 time: 2.352788 Nov 20 20:59:48.119096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2084/4200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:45 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1309 bytes in 2354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:48.132445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:48.133242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:48.149429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.150736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.152170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.154005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.433612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:48.448801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:48.453306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:48.455591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8bdb4f9-0a5b-4420-80d2-17d04134a08d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2940 microversion: 2.42 time: 0.366845 Nov 20 20:59:48.468267 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2117/4201] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:48 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2940 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:48.489374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-cacf7519-f7f8-42fc-8142-c72f9d6f9341 req-745efc5e-6ac1-4ced-b44e-704c950855df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "39839f43-d46e-414e-93c9-a7955f617fd1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:48.494590 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:48.494590 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:48.506320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cacf7519-f7f8-42fc-8142-c72f9d6f9341 req-745efc5e-6ac1-4ced-b44e-704c950855df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.507065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cacf7519-f7f8-42fc-8142-c72f9d6f9341 req-745efc5e-6ac1-4ced-b44e-704c950855df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.562476 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-cacf7519-f7f8-42fc-8142-c72f9d6f9341 req-745efc5e-6ac1-4ced-b44e-704c950855df service nova] Creating event network-vif-unplugged:39839f43-d46e-414e-93c9-a7955f617fd1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:48.578948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-cacf7519-f7f8-42fc-8142-c72f9d6f9341 req-745efc5e-6ac1-4ced-b44e-704c950855df service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096653 Nov 20 20:59:48.580119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2118/4202] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:48.773039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:48.774477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:48.790896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.792698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:48.794138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:48.794756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.058537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:49.069421 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b184128a-0b95-42e1-bd38-f40994f8dfad tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1313 microversion: 2.1 time: 0.300205 Nov 20 20:59:49.070635 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2119/4203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:48 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:49.085783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:49.103763 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-db8b3fab-a92b-4af6-871b-8be0723bb994 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.982205 Nov 20 20:59:49.106937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:49.110605 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2085/4204] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:48 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:49.112326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:49.131680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1278566126"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:49.134432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:49.139932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.140741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.144649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.145117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.152124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.155096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.156228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.164474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.643443 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07e76c34-e100-4ac2-ba17-07b9544db0c6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.523046 Nov 20 20:59:49.648957 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2086/4205] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:49 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Nov 20 20:59:49.654644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:49.655890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:49.665273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.666117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.667239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.667857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.712756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:49.728591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-46b80e68-639e-45b7-99f3-8c1a24a9c3a3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1281 microversion: 2.1 time: 0.627191 Nov 20 20:59:49.741321 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2120/4206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:49 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1281 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 20:59:49.753443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:49.754382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:49.760847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.761755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:49.762886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:49.763477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.346631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:50.380742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:50.382645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:50.385406 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95020090-93c9-4655-8687-2ac83d734be6 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2940 microversion: 2.42 time: 0.641554 Nov 20 20:59:50.402670 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2121/4207] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:49 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2940 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:50.409640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:50.413009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:50.447600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.449551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.454685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.455677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.672883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:50.683191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58d687d4-c8ae-4a11-9998-c1e69af5081a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1490 microversion: 2.1 time: 1.032931 Nov 20 20:59:50.683950 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2087/4208] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:49 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1490 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:50.695612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4ba2cdb4-d48a-4c76-b9f0-75c0c0ba8ec5 req-c2d94d8f-4639-4882-8c70-0233ac2c0f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "46000a03-6d74-43bc-957f-eb13e3558ac6"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:50.702975 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:50.702975 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 20:59:50.714808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ba2cdb4-d48a-4c76-b9f0-75c0c0ba8ec5 req-c2d94d8f-4639-4882-8c70-0233ac2c0f6c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.718023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ba2cdb4-d48a-4c76-b9f0-75c0c0ba8ec5 req-c2d94d8f-4639-4882-8c70-0233ac2c0f6c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.757750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4ba2cdb4-d48a-4c76-b9f0-75c0c0ba8ec5 req-c2d94d8f-4639-4882-8c70-0233ac2c0f6c service nova] Creating event network-vif-unplugged:46000a03-6d74-43bc-957f-eb13e3558ac6 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:50.771071 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4ba2cdb4-d48a-4c76-b9f0-75c0c0ba8ec5 req-c2d94d8f-4639-4882-8c70-0233ac2c0f6c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083750 Nov 20 20:59:50.778968 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2088/4209] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:50.799562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1894251523"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:50.800866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:50.831129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.831596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.842273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.843313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.944330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8cf531f-58cd-4296-beeb-0ed0631bd26c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "PUT /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1075 microversion: 2.1 time: 0.160009 Nov 20 20:59:50.945824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2089/4210] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 20:59:50 2021] PUT /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1075 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:50.951512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:50.975289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:50.992154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.995288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:50.996103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:50.997089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:51.198384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:51.217915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52e529dc-516e-4fa4-b1ee-a881abf12bf0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1313 microversion: 2.1 time: 0.813498 Nov 20 20:59:51.218895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2122/4211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:50 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1313 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:51.223913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:51.224528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:51.249271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:51.249732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:51.253864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:51.255783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:51.679735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:51.706274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be1e3137-60f1-498c-a194-4a09fa415763 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1501 microversion: 2.1 time: 0.485423 Nov 20 20:59:51.708158 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2123/4212] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:51 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1501 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:51.714758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:51.716398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:51.730488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:51.730946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:51.749521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:51.753195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:52.231121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:52.243892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:52.245391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:52.246675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ac43757-58ed-4c5c-986e-46787531131a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2872 microversion: 2.42 time: 0.537397 Nov 20 20:59:52.267130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2124/4213] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:51 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2872 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:52.284455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:52.285270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:52.291593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:52.302934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:52.304083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:52.304675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:52.920487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:52.939653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e86d72cc-e6c6-4fb4-977c-964dfb195ba6 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1501 microversion: 2.1 time: 0.670902 Nov 20 20:59:52.943057 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2125/4214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:52 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1501 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:52.954524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0abc47ee-7fbb-43a0-bdad-819b26aaa0ea req-8e47663b-7171-44e6-951b-14cdcbb4b4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-deleted", "tag": "46000a03-6d74-43bc-957f-eb13e3558ac6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:52.972433 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:52.972433 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:53.017598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0abc47ee-7fbb-43a0-bdad-819b26aaa0ea req-8e47663b-7171-44e6-951b-14cdcbb4b4b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.018842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0abc47ee-7fbb-43a0-bdad-819b26aaa0ea req-8e47663b-7171-44e6-951b-14cdcbb4b4b3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.049789 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0abc47ee-7fbb-43a0-bdad-819b26aaa0ea req-8e47663b-7171-44e6-951b-14cdcbb4b4b3 service nova] Creating event network-vif-deleted:46000a03-6d74-43bc-957f-eb13e3558ac6 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:53.059250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0abc47ee-7fbb-43a0-bdad-819b26aaa0ea req-8e47663b-7171-44e6-951b-14cdcbb4b4b3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108726 Nov 20 20:59:53.060421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2126/4215] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:53.090077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:53.092185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:53.113680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.114689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.115515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.116143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.645353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:53.655550 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a9ed119-3b5b-4229-af3f-313b8c017a6e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1334 microversion: 2.1 time: 0.592058 Nov 20 20:59:53.660804 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2127/4216] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:53 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1334 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:53.672700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2221b40a-3d99-490f-926f-ca7e0425e2f8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:53.683200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2221b40a-3d99-490f-926f-ca7e0425e2f8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.685668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2221b40a-3d99-490f-926f-ca7e0425e2f8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.748257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2221b40a-3d99-490f-926f-ca7e0425e2f8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 20:59:53.860859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2221b40a-3d99-490f-926f-ca7e0425e2f8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "POST /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023/action" status: 202 len: 0 microversion: 2.1 time: 0.198370 Nov 20 20:59:53.864973 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2128/4217] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 20:59:53 2021] POST /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 20:59:53.873606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "8d29ec6b-5e92-4f5c-9a33-b37b39856ff1"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "1906ffcc-f920-4444-989d-3996e905079f"}, {"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "74631941-cda7-49c4-b33a-f60122f88759"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:53.876238 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:53.876238 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:53.885691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.886643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.903591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Creating event network-vif-unplugged:8d29ec6b-5e92-4f5c-9a33-b37b39856ff1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:53.904412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Creating event network-vif-unplugged:1906ffcc-f920-4444-989d-3996e905079f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:53.905587 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] Creating event network-vif-unplugged:74631941-cda7-49c4-b33a-f60122f88759 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:53.915343 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-14571b38-c57e-4cce-a1f2-d34cc21b1828 req-ac9b4994-2d4a-47fd-9cbe-768e62183530 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.047392 Nov 20 20:59:53.917478 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2129/4218] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:53 2021] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:53.924700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:53.926488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:53.937425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.942263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:53.952866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:53.958828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:54.082711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:54.111376 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-357eb052-c635-4689-9a57-c33a1fdc5bcb tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 3.158457 Nov 20 20:59:54.126072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2090/4219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:50 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:54.148311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:54.178032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:54.189084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:54.190973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:54.192033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:54.193695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:56.220915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:56.243332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:56.247436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:56.249055 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcdc5ccc-2e6b-4fe1-a1c7-28c8a83df30d tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2711 microversion: 2.42 time: 2.329893 Nov 20 20:59:56.249639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2130/4220] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:53 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2711 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:56.278262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:56.281401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:56.312780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:56.313772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:56.318432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:56.318972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:57.152155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:57.174446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f862496-18c0-4802-a48a-4050e9145e82 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 3.046728 Nov 20 20:59:57.184729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2091/4221] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:54 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 3058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:57.191121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:57.193436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:57.223473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:57.223969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:57.235321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:57.236094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:57.917781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:57.929225 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcbefcab-2745-4647-b95a-076dd69f96c7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1334 microversion: 2.1 time: 1.663838 Nov 20 20:59:57.930331 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2131/4222] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:56 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1334 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:57.936405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-211b85b5-f1eb-4c28-a94b-a3a9e3341557 req-a6b29037-004f-473d-b4a4-aeba90c0b728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-deleted", "tag": "8d29ec6b-5e92-4f5c-9a33-b37b39856ff1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:57.943429 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:57.943429 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:57.965315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-211b85b5-f1eb-4c28-a94b-a3a9e3341557 req-a6b29037-004f-473d-b4a4-aeba90c0b728 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:57.970168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-211b85b5-f1eb-4c28-a94b-a3a9e3341557 req-a6b29037-004f-473d-b4a4-aeba90c0b728 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:58.003457 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-211b85b5-f1eb-4c28-a94b-a3a9e3341557 req-a6b29037-004f-473d-b4a4-aeba90c0b728 service nova] Creating event network-vif-deleted:8d29ec6b-5e92-4f5c-9a33-b37b39856ff1 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:58.016629 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-211b85b5-f1eb-4c28-a94b-a3a9e3341557 req-a6b29037-004f-473d-b4a4-aeba90c0b728 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084696 Nov 20 20:59:58.021679 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2132/4223] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:58.030889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f80438ac-2d88-4bc4-bfcd-b1a3266716fc req-b76b2647-b374-46ef-8981-656a20895f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-unplugged", "status": "completed", "tag": "a2255729-67f4-48eb-af4e-86e677b04463"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 20:59:58.035365 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 20:59:58.035365 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 20:59:58.054912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f80438ac-2d88-4bc4-bfcd-b1a3266716fc req-b76b2647-b374-46ef-8981-656a20895f43 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:58.055638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f80438ac-2d88-4bc4-bfcd-b1a3266716fc req-b76b2647-b374-46ef-8981-656a20895f43 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:58.093890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f80438ac-2d88-4bc4-bfcd-b1a3266716fc req-b76b2647-b374-46ef-8981-656a20895f43 service nova] Creating event network-vif-unplugged:a2255729-67f4-48eb-af4e-86e677b04463 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 20:59:58.107465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f80438ac-2d88-4bc4-bfcd-b1a3266716fc req-b76b2647-b374-46ef-8981-656a20895f43 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084209 Nov 20 20:59:58.113500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2133/4224] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:58 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 20:59:58.128769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:58.131022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:58.150757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:58.151853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:58.153639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:58.163068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:59.230127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:59.248121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f921ac5f-f303-44f8-a71b-4a96ca5cbd07 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 2.056626 Nov 20 20:59:59.251988 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2092/4225] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:57 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 20:59:59.280349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:59.284977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:59.315651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:59.316164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:59.317266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:59.320442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:59.323434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:59.356019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:59.358789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:59.371157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2a3f4f9-8a04-499d-8438-49da639dc77a tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2550 microversion: 2.42 time: 1.250482 Nov 20 20:59:59.372147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2134/4226] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 20:59:58 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2550 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 20:59:59.387530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 20:59:59.391976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 20:59:59.406330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:59.408757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:59.411242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 20:59:59.412901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 20:59:59.951033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 20:59:59.980748 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0220ee49-79e3-4e82-88cc-0db5d6ba05f4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1334 microversion: 2.1 time: 0.601130 Nov 20 20:59:59.983381 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2135/4227] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:59 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1334 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:00.017935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f8ce771d-5ae5-4420-b008-7b40d6c41877 req-bd8aedff-243e-42a5-a1b3-3fe92983e008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26516cdf-b525-4abc-8716-ad60c3b81c35", "tag": "f5e13635-ad44-4f1b-8927-600136df3f15"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:00.022249 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:00.022249 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:00.042501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8ce771d-5ae5-4420-b008-7b40d6c41877 req-bd8aedff-243e-42a5-a1b3-3fe92983e008 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.043642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8ce771d-5ae5-4420-b008-7b40d6c41877 req-bd8aedff-243e-42a5-a1b3-3fe92983e008 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.061705 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f8ce771d-5ae5-4420-b008-7b40d6c41877 req-bd8aedff-243e-42a5-a1b3-3fe92983e008 service nova] Creating event network-changed:f5e13635-ad44-4f1b-8927-600136df3f15 for instance 26516cdf-b525-4abc-8716-ad60c3b81c35 on nch1-master-1 Nov 20 21:00:00.070888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f8ce771d-5ae5-4420-b008-7b40d6c41877 req-bd8aedff-243e-42a5-a1b3-3fe92983e008 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072376 Nov 20 21:00:00.071753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2136/4228] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 20:59:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:00.130407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0efbd80b-d625-4594-ad48-af4232d0ae61 req-a0b72ef0-954c-4915-a5cc-3179d69975e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-plugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:00.140463 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:00.140463 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:00.186176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0efbd80b-d625-4594-ad48-af4232d0ae61 req-a0b72ef0-954c-4915-a5cc-3179d69975e6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.186901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0efbd80b-d625-4594-ad48-af4232d0ae61 req-a0b72ef0-954c-4915-a5cc-3179d69975e6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.214847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0efbd80b-d625-4594-ad48-af4232d0ae61 req-a0b72ef0-954c-4915-a5cc-3179d69975e6 service nova] Creating event network-vif-plugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:00:00.227848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0efbd80b-d625-4594-ad48-af4232d0ae61 req-a0b72ef0-954c-4915-a5cc-3179d69975e6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103964 Nov 20 21:00:00.228803 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2137/4229] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:00.245758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a18dffd9-957b-4444-8c0d-b9e7f5f534d0 req-6200c5bd-d280-4c18-a0a7-1f748472a149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-deleted", "tag": "1906ffcc-f920-4444-989d-3996e905079f"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:00.247592 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:00.247592 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:00.257061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a18dffd9-957b-4444-8c0d-b9e7f5f534d0 req-6200c5bd-d280-4c18-a0a7-1f748472a149 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.270712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a18dffd9-957b-4444-8c0d-b9e7f5f534d0 req-6200c5bd-d280-4c18-a0a7-1f748472a149 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.292949 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a18dffd9-957b-4444-8c0d-b9e7f5f534d0 req-6200c5bd-d280-4c18-a0a7-1f748472a149 service nova] Creating event network-vif-deleted:1906ffcc-f920-4444-989d-3996e905079f for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 21:00:00.312603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a18dffd9-957b-4444-8c0d-b9e7f5f534d0 req-6200c5bd-d280-4c18-a0a7-1f748472a149 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082137 Nov 20 21:00:00.314274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2138/4230] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:00.319762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:00.321735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:00.343247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.344713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.347097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.352293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.940973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:00.949035 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-386d3ae3-3c89-40d4-8450-a34c1c224d90 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 1.693490 Nov 20 21:00:00.955181 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2093/4231] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 20:59:59 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:00.964366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:00.965221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:00.986351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.987166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:00.988233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:00.991644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:02.091470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:02.114106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:02.116278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:02.117819 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f974abae-5e0e-4497-ae1a-4d809a682ffd tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2347 microversion: 2.42 time: 1.161393 Nov 20 21:00:02.119077 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2094/4232] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:00 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2347 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:00:02.135781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:02.136826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:02.167757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:02.169050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:02.170324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:02.171013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:02.223907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:02.231571 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5e7a776-9d7c-4384-9fd9-59aa59a8da5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 1.915804 Nov 20 21:00:02.237157 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2139/4233] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:00 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:02.243563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:02.244162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:02.260420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:02.266422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:02.284969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:02.285769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:03.096021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:03.108280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2578f6e-38bb-40e6-90eb-3909a0256d54 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.867216 Nov 20 21:00:03.111206 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2140/4234] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:02 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:03.121299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6d21c9ca-55c1-4e92-b1d2-fc2db0af21e0 req-7c8e6335-766b-4f66-979d-00acaa29fd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b186c3-e02d-4b49-9299-6f493455e3e3", "tag": "e7fda056-091a-4930-a586-d81ac0255708"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:03.123721 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:03.123721 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:03.147108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6d21c9ca-55c1-4e92-b1d2-fc2db0af21e0 req-7c8e6335-766b-4f66-979d-00acaa29fd80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:03.148912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6d21c9ca-55c1-4e92-b1d2-fc2db0af21e0 req-7c8e6335-766b-4f66-979d-00acaa29fd80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:03.191440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6d21c9ca-55c1-4e92-b1d2-fc2db0af21e0 req-7c8e6335-766b-4f66-979d-00acaa29fd80 service nova] Creating event network-changed:e7fda056-091a-4930-a586-d81ac0255708 for instance 11b186c3-e02d-4b49-9299-6f493455e3e3 on nch1-master-1 Nov 20 21:00:03.204254 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6d21c9ca-55c1-4e92-b1d2-fc2db0af21e0 req-7c8e6335-766b-4f66-979d-00acaa29fd80 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088694 Nov 20 21:00:03.206305 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2141/4235] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:03.234346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:03.240392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:03.265037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:03.267919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:03.269862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:03.275264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:04.291132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:04.303193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:04.304749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:04.325909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62bb8a0c-3e6a-4e2d-9676-a954860c68c0 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 2347 microversion: 2.42 time: 1.116116 Nov 20 21:00:04.326555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2142/4236] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:03 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 2347 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:00:04.346514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:04.347617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:04.376234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:04.377280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:04.378404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:04.379012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:05.300401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:05.313811 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e28d63c8-4ba5-4e5b-9494-29daa2c55b2c tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 0.985498 Nov 20 21:00:05.320373 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2143/4237] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:04 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:05.334690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0e2886a4-fa48-4bf6-8396-e127d0214b32 req-0531b765-a404-4075-9e78-aa9c7d56637e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-deleted", "tag": "a2255729-67f4-48eb-af4e-86e677b04463"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:05.337736 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:05.337736 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:05.377743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0e2886a4-fa48-4bf6-8396-e127d0214b32 req-0531b765-a404-4075-9e78-aa9c7d56637e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:05.382876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0e2886a4-fa48-4bf6-8396-e127d0214b32 req-0531b765-a404-4075-9e78-aa9c7d56637e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:05.415300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0e2886a4-fa48-4bf6-8396-e127d0214b32 req-0531b765-a404-4075-9e78-aa9c7d56637e service nova] Creating event network-vif-deleted:a2255729-67f4-48eb-af4e-86e677b04463 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 21:00:05.435859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0e2886a4-fa48-4bf6-8396-e127d0214b32 req-0531b765-a404-4075-9e78-aa9c7d56637e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113054 Nov 20 21:00:05.437729 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2144/4238] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:05.452358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:05.457013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:05.471384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:05.472067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:05.473985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:05.478888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:05.709370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:05.726720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c336554-5d6c-4cf6-b4d3-cbb972c1f033 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 3.602904 Nov 20 21:00:05.727482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2095/4239] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:02 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 3608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:06.221380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:06.222099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:06.231688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:06.250951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:06.257758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:06.261208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:06.407963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:06.417628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b2ce8707-0b7a-4a1f-b2c8-7525db8ebf68 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.977947 Nov 20 21:00:06.422949 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2145/4240] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:05 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:06.461387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8cfd9702-f838-449f-a3f9-3e5f22f1a233 req-57323eef-d985-4aab-98da-5305abc24c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60d5cd6-1736-4303-8340-35b914be8dce", "tag": "bd984248-d711-49cb-b240-1dae016cbc50"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:06.463070 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:06.463070 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:06.520131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8cfd9702-f838-449f-a3f9-3e5f22f1a233 req-57323eef-d985-4aab-98da-5305abc24c8d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:06.527849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8cfd9702-f838-449f-a3f9-3e5f22f1a233 req-57323eef-d985-4aab-98da-5305abc24c8d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:06.564469 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8cfd9702-f838-449f-a3f9-3e5f22f1a233 req-57323eef-d985-4aab-98da-5305abc24c8d service nova] Creating event network-changed:bd984248-d711-49cb-b240-1dae016cbc50 for instance e60d5cd6-1736-4303-8340-35b914be8dce on nch2-master-1 Nov 20 21:00:06.591937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8cfd9702-f838-449f-a3f9-3e5f22f1a233 req-57323eef-d985-4aab-98da-5305abc24c8d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164296 Nov 20 21:00:06.604722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2146/4241] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:06.623202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:06.630208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:06.667308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:06.667777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:06.668608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:06.669058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.006494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:07.022366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:07.032726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbb40fc2fdc4462bb4abaaf926c7b675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4ec8b62e354149acb1c43558b168e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:07.038445 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07d72fef-84b3-41bf-b555-ab9a9a31c472 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 200 len: 1604 microversion: 2.42 time: 1.309636 Nov 20 21:00:07.042596 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2096/4242] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:05 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 1604 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:00:07.053430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:07.054074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:07.069574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:07.074981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.076129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:07.076749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.316062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:07.339877 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f087dc5c-83bb-4df8-bda8-6329bde3388f tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 0.733494 Nov 20 21:00:07.340727 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2147/4243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:06 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:07.440510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:07.441901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:07.459551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:07.460418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.461769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:07.462474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.784031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:07.800712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f8f7714-9821-4eb1-8349-e2407a84a9c1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.756798 Nov 20 21:00:07.801341 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2097/4244] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:07 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:07.805853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c0bd468c-d6e2-4834-8b82-8aa6e9101d69 req-d41b3a3c-75e2-4ba1-9f9e-aff09af28a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ecac50c-36b0-496e-8301-98973b15c5a6", "name": "network-vif-deleted", "tag": "74631941-cda7-49c4-b33a-f60122f88759"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:07.815828 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:07.815828 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:07.841346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c0bd468c-d6e2-4834-8b82-8aa6e9101d69 req-d41b3a3c-75e2-4ba1-9f9e-aff09af28a31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:07.843914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c0bd468c-d6e2-4834-8b82-8aa6e9101d69 req-d41b3a3c-75e2-4ba1-9f9e-aff09af28a31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:07.885153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c0bd468c-d6e2-4834-8b82-8aa6e9101d69 req-d41b3a3c-75e2-4ba1-9f9e-aff09af28a31 service nova] Creating event network-vif-deleted:74631941-cda7-49c4-b33a-f60122f88759 for instance 4ecac50c-36b0-496e-8301-98973b15c5a6 on nch2-master-1 Nov 20 21:00:07.895735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c0bd468c-d6e2-4834-8b82-8aa6e9101d69 req-d41b3a3c-75e2-4ba1-9f9e-aff09af28a31 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093144 Nov 20 21:00:07.899017 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2098/4245] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:08.000768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:08.009470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d530e01-5a6e-40de-887c-a16b3bf2def8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.573404 Nov 20 21:00:08.022676 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2148/4246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:07 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:08.061205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:08.061995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:08.076665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.078885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:08.079983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.082912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:08.122357 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] HTTP exception thrown: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. Nov 20 21:00:08.123323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Returning 404 to user: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:08.127452 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5663e51e-5a6a-405e-8234-a282fa5585c8 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 404 len: 111 microversion: 2.42 time: 0.068278 Nov 20 21:00:08.137298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56427eee-238d-4c64-9165-0106e230ac45 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '.version_select at 0x7f3f87a8e0d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:08.144610 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2099/4247] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:08 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:00:08.179081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56427eee-238d-4c64-9165-0106e230ac45 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798325691" status: 204 len: 0 microversion: 2.42 time: 0.043654 Nov 20 21:00:08.180080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2149/4248] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 21:00:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798325691 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:00:08.358415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:08.359513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:08.368676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.371885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:08.373388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.375650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:08.821465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:08.822673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:08.835926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.837145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:08.838303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:08.840579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:09.550359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:09.572214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1c5c33e-f41d-4eaa-b2d4-78fc8083e351 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 1.218634 Nov 20 21:00:09.580964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2100/4249] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:08 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:09.602256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3e3bc176-7094-428d-91b8-f740aa5f64ed req-bfb5683e-a822-44ac-9a98-9fde1e242007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "tag": "81d2d57f-3035-4006-a984-49d10147384b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:09.610008 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:09.610008 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:09.635339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3e3bc176-7094-428d-91b8-f740aa5f64ed req-bfb5683e-a822-44ac-9a98-9fde1e242007 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:09.635814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3e3bc176-7094-428d-91b8-f740aa5f64ed req-bfb5683e-a822-44ac-9a98-9fde1e242007 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:09.708061 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3e3bc176-7094-428d-91b8-f740aa5f64ed req-bfb5683e-a822-44ac-9a98-9fde1e242007 service nova] Creating event network-changed:81d2d57f-3035-4006-a984-49d10147384b for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:09.724802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:09.728422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3e3bc176-7094-428d-91b8-f740aa5f64ed req-bfb5683e-a822-44ac-9a98-9fde1e242007 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143245 Nov 20 21:00:09.735284 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2101/4250] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:09.742956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f01baa86-6ecb-49db-b9c4-9ecf5fcf41c0 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.924956 Nov 20 21:00:09.746625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2150/4251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:08 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:09.759290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:09.761262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:09.796652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:09.798360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:09.799399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:09.800471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:10.598010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:10.599383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:10.620106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:10.620962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:10.621994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:10.622676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:11.042706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:11.052272 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b53a10e4-f6b3-4b83-9457-c09265a72fce tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 0.459238 Nov 20 21:00:11.055809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2151/4252] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:10 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:11.070678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1957b7bd-9340-4fd1-a86c-1550bb0d93ff req-c9cc5c36-1874-49c3-af00-e6fc9620506f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b186c3-e02d-4b49-9299-6f493455e3e3", "name": "network-vif-plugged", "status": "completed", "tag": "e7fda056-091a-4930-a586-d81ac0255708"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:11.072995 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:11.072995 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:11.089775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1957b7bd-9340-4fd1-a86c-1550bb0d93ff req-c9cc5c36-1874-49c3-af00-e6fc9620506f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:11.096520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1957b7bd-9340-4fd1-a86c-1550bb0d93ff req-c9cc5c36-1874-49c3-af00-e6fc9620506f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:11.118473 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1957b7bd-9340-4fd1-a86c-1550bb0d93ff req-c9cc5c36-1874-49c3-af00-e6fc9620506f service nova] Creating event network-vif-plugged:e7fda056-091a-4930-a586-d81ac0255708 for instance 11b186c3-e02d-4b49-9299-6f493455e3e3 on nch1-master-1 Nov 20 21:00:11.163479 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1957b7bd-9340-4fd1-a86c-1550bb0d93ff req-c9cc5c36-1874-49c3-af00-e6fc9620506f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102141 Nov 20 21:00:11.167037 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2152/4253] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:11.184949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:11.191524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:11.223036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:11.229862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:11.233520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:11.237571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:11.543623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:11.551823 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d737ac04-73dd-4081-9c98-ccbafb6f7633 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.381592 Nov 20 21:00:11.553031 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2153/4254] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:11 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:12.071446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:12.072702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:12.079836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:12.080511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:12.081471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:12.082083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:12.289790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:12.297852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19d62d80-e49f-4e47-b3f8-2ea8a550c9ee tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 0.230019 Nov 20 21:00:12.303262 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2154/4255] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:12 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:12.552642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:12.562863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-140233cb-0d10-4f3b-8fa6-4db85357346a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 2.825444 Nov 20 21:00:12.564201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2102/4256] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:09 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 2827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:12.579448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:12.580354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:12.596334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:12.597117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:12.599657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:12.600620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:13.069053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:13.087522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f9a4d9bb-1e3b-411f-86ea-e7c6b9639820 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.510737 Nov 20 21:00:13.093014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2155/4257] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:12 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:13.319605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:13.320608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:13.331395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:13.333110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:13.334875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:13.336946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:13.448893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e9db6ab4-999d-4d49-9b1d-2a7d7a309aee req-310d94d4-29ee-43cc-b09f-3464bb10bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26516cdf-b525-4abc-8716-ad60c3b81c35", "name": "network-vif-plugged", "status": "completed", "tag": "f5e13635-ad44-4f1b-8927-600136df3f15"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:13.453487 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:13.453487 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:13.486676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e9db6ab4-999d-4d49-9b1d-2a7d7a309aee req-310d94d4-29ee-43cc-b09f-3464bb10bf84 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:13.488229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e9db6ab4-999d-4d49-9b1d-2a7d7a309aee req-310d94d4-29ee-43cc-b09f-3464bb10bf84 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:13.522293 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e9db6ab4-999d-4d49-9b1d-2a7d7a309aee req-310d94d4-29ee-43cc-b09f-3464bb10bf84 service nova] Creating event network-vif-plugged:f5e13635-ad44-4f1b-8927-600136df3f15 for instance 26516cdf-b525-4abc-8716-ad60c3b81c35 on nch1-master-1 Nov 20 21:00:13.528394 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e9db6ab4-999d-4d49-9b1d-2a7d7a309aee req-310d94d4-29ee-43cc-b09f-3464bb10bf84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086053 Nov 20 21:00:13.529291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2156/4258] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:13.582777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:13.584026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:13.606306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:13.610459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:13.614860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:13.615610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:14.113009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:14.121161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70ef5a0c-cc10-4804-9913-f7d567510839 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 0.805312 Nov 20 21:00:14.128805 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2103/4259] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:13 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:14.134690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:14.141643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:14.155039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:14.155823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:14.157399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:14.158042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:14.405883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:14.420729 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0df40264-4d1b-4e68-85d2-d49cb4bbd6c5 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.840163 Nov 20 21:00:14.422486 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2157/4260] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:13 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:14.438155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2e20dfcf-8ece-491c-8925-d1139ce88700 req-888cacf8-8506-41b1-b199-83028d14c090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "tag": "44f55344-9797-4791-8c1a-27f87cf698a5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:14.453896 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:14.453896 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:14.485247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2e20dfcf-8ece-491c-8925-d1139ce88700 req-888cacf8-8506-41b1-b199-83028d14c090 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:14.496224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2e20dfcf-8ece-491c-8925-d1139ce88700 req-888cacf8-8506-41b1-b199-83028d14c090 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:14.529052 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2e20dfcf-8ece-491c-8925-d1139ce88700 req-888cacf8-8506-41b1-b199-83028d14c090 service nova] Creating event network-changed:44f55344-9797-4791-8c1a-27f87cf698a5 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:14.545697 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2e20dfcf-8ece-491c-8925-d1139ce88700 req-888cacf8-8506-41b1-b199-83028d14c090 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121389 Nov 20 21:00:14.547672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2158/4261] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:15.154567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:15.155538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:15.183493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:15.184067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:15.184994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:15.199878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:15.208865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:15.225228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3529bd5-ba49-40e1-ab41-737fc3efb9bb tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 1.090453 Nov 20 21:00:15.226763 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2104/4262] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:14 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:15.439464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:15.440565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:15.452277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:15.453718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:15.454791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:15.455405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:16.269551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:16.277209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8631f58-1c29-49e0-a9bf-7503b2daf219 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.841935 Nov 20 21:00:16.296517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2105/4263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:15 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:16.305179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:16.313152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:16.337732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:16.345713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:16.346632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:16.347636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:17.174442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:17.189865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-543dd227-f743-4f1f-9a91-8120902b0506 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1323 microversion: 2.1 time: 2.047720 Nov 20 21:00:17.193049 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2159/4264] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:15 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1323 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:17.198510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-45aad206-7a56-4812-aadb-5a8488cd5ec4 req-0af67721-a429-46e2-be4f-d4dee310e5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60d5cd6-1736-4303-8340-35b914be8dce", "name": "network-vif-plugged", "status": "completed", "tag": "bd984248-d711-49cb-b240-1dae016cbc50"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:17.200276 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:17.200276 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:17.216096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-45aad206-7a56-4812-aadb-5a8488cd5ec4 req-0af67721-a429-46e2-be4f-d4dee310e5cf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:17.217378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-45aad206-7a56-4812-aadb-5a8488cd5ec4 req-0af67721-a429-46e2-be4f-d4dee310e5cf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:17.242993 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-45aad206-7a56-4812-aadb-5a8488cd5ec4 req-0af67721-a429-46e2-be4f-d4dee310e5cf service nova] Creating event network-vif-plugged:bd984248-d711-49cb-b240-1dae016cbc50 for instance e60d5cd6-1736-4303-8340-35b914be8dce on nch2-master-1 Nov 20 21:00:17.256077 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-45aad206-7a56-4812-aadb-5a8488cd5ec4 req-0af67721-a429-46e2-be4f-d4dee310e5cf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061376 Nov 20 21:00:17.261630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2160/4265] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:17.308951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:17.310218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:17.327719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:17.328254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:17.329155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:17.329593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:17.497279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:17.510825 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff3e527f-3eec-4fae-a1d5-6f85e0809c8f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 1.212299 Nov 20 21:00:17.527609 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2106/4266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:16 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:17.903169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:17.916360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e208b2e-8a04-4967-9caf-70a3c7387d17 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.615652 Nov 20 21:00:17.927614 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2161/4267] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:17 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:18.211702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:18.212248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:18.224354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.228189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.229366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.229832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.443989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-bdbb181c-cf2d-4b44-bd16-ec4249c9a919 req-40cb8542-4207-4a5b-8d5e-b20574890514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "tag": "46b173fa-03d9-4a65-880e-26f38e2b0498"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:18.452221 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:18.452221 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:18.489180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bdbb181c-cf2d-4b44-bd16-ec4249c9a919 req-40cb8542-4207-4a5b-8d5e-b20574890514 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.491920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bdbb181c-cf2d-4b44-bd16-ec4249c9a919 req-40cb8542-4207-4a5b-8d5e-b20574890514 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.515857 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-bdbb181c-cf2d-4b44-bd16-ec4249c9a919 req-40cb8542-4207-4a5b-8d5e-b20574890514 service nova] Creating event network-changed:46b173fa-03d9-4a65-880e-26f38e2b0498 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:18.522380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-bdbb181c-cf2d-4b44-bd16-ec4249c9a919 req-40cb8542-4207-4a5b-8d5e-b20574890514 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093186 Nov 20 21:00:18.524915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2162/4268] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:18.546407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:18.548120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:18.555571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.556715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.557768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.558430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.852790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:18.865109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c642c5e-adb6-4781-a2e7-08c7288d3f9a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 200 len: 1516 microversion: 2.1 time: 0.658553 Nov 20 21:00:18.889527 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2107/4269] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:18 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 1516 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:18.910755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:18.919487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:18.939647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.948819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:18.949991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:18.953032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:19.193052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:19.206347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54f6352e-2109-4620-986a-5432e01769a7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.666142 Nov 20 21:00:19.211329 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2163/4270] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:18 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:19.228378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:19.232000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:19.248544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:19.249290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:19.250546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:19.251221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:19.974827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:19.984448 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49f80528-7bf1-4127-b88d-049a076afbba tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1511 microversion: 2.1 time: 0.769909 Nov 20 21:00:19.984827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:19.985903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2164/4271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:19 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1511 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:19.997876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e71b5f61-88ba-4509-ab52-c9af3682cc5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 200 len: 1516 microversion: 2.1 time: 1.093613 Nov 20 21:00:20.000129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2108/4272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:18 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 1516 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:20.025576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:20.049048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:20.097406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:20.130508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:20.131800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:20.141761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:20.229647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:20.230729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:20.256858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:20.261127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:20.264208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:20.272032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:20.988325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:21.019153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0d6e314-f1c9-4007-8640-a49671beefaa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.795082 Nov 20 21:00:21.019788 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2109/4273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:20 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:21.047712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:21.053739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:21.074874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:21.075969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.076439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.077256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.078281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.088634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dcce4610-b3ed-4ad0-b315-bae36a2ad2a2 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 200 len: 1517 microversion: 2.1 time: 1.068947 Nov 20 21:00:21.104348 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2165/4274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:20 2021] GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 1517 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:21.128051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:21.130414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:21.151887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.153631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.160873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.162532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.255027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:21.474011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c546705e-b69f-467e-8285-1920ddf11f44 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "DELETE /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 204 len: 0 microversion: 2.1 time: 0.365300 Nov 20 21:00:21.474954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2166/4275] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:21 2021] DELETE /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:00:21.483858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:21.485191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:21.518380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.521077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.524490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.532622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.656443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:21.676483 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47f2b630-2554-47e1-af8f-8ea4d34671d2 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1488 microversion: 2.1 time: 0.641050 Nov 20 21:00:21.677586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2110/4276] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:21 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1488 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:21.698953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1391390015"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:21.700756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:21.713339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.715218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.719084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.720135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.869970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4ed8cbf-aea5-4419-b4c4-fe5941e6a0e0 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "PUT /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1061 microversion: 2.1 time: 0.175335 Nov 20 21:00:21.875531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2111/4277] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 21:00:21 2021] PUT /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1061 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:21.898093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:21.900943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:21.927217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.927855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:21.944013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:21.944688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:22.240688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:22.248652 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-235c2b36-e92e-47fb-91ec-b58e9694c04a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1488 microversion: 2.1 time: 0.359612 Nov 20 21:00:22.252430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2112/4278] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:21 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1488 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:22.256838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:22.259452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:22.277151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:22.277710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:22.278661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:22.279212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:22.624828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:22.657999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a522d23-d7ff-4593-aeb8-1afd851f9b14 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.404538 Nov 20 21:00:22.659467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2113/4279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:22 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:22.665416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:22.666305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:22.684726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:22.685928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:22.686885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:22.687607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:22.854204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:22.862763 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c436dcd-2ab8-4778-8a16-14de827ace5b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 200 len: 1523 microversion: 2.1 time: 1.383637 Nov 20 21:00:22.875600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2167/4280] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:21 2021] GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 1523 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:23.302625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:23.326297 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e2321789-e0b2-4735-8f03-841aa23a0c51 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1488 microversion: 2.1 time: 0.659518 Nov 20 21:00:23.328923 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2114/4281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:22 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1488 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:23.334344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:23.334344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:23.343117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.344382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:23.345205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.345896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:23.349483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:23.350285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:23.362602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.363480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:23.364668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.365405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:23.419772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:23.522153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36e58f8e-eef3-4575-938c-5acaa81b705a tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 204 len: 0 microversion: 2.1 time: 0.180294 Nov 20 21:00:23.523799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2115/4282] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:23 2021] DELETE /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:00:23.538682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:23.540853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:23.547642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.548225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:23.549119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:23.549818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.371168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:24.385807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:24.416377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-efafbded-2eb4-4543-8da9-bc81c100ebcb tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1494 microversion: 2.1 time: 0.886909 Nov 20 21:00:24.417199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd0d1a62-f159-4de4-a782-78eb474e50ee tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 1.091616 Nov 20 21:00:24.419062 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2168/4283] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:23 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:24.422876 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2116/4284] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:23 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1494 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:24.427030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:24.427899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:24.432426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:24.433244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:24.470267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.498742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.500004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.501174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.505490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.506684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.507517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.510627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.550785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] HTTP exception thrown: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. Nov 20 21:00:24.551388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Returning 404 to user: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:24.554878 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d9dc1ba1-73d9-4c4c-9cf9-1caf953e9858 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 404 len: 111 microversion: 2.1 time: 0.130697 Nov 20 21:00:24.555460 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2117/4285] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:24 2021] DELETE /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:24.568061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:24.568696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:24.592915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.596209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.597150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.597606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.760789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:24.774484 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e7e19514-f2bd-4531-aac9-5d63e98ebd7a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 200 len: 1481 microversion: 2.1 time: 0.214738 Nov 20 21:00:24.777807 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2118/4286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:24 2021] GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 1481 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:24.788964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-749561270"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:24.790129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:24.804670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.816581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:24.817592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:24.818066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.245526 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d483b3fe-a049-4d23-88d9-5024c8ae6348 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.464716 Nov 20 21:00:25.255741 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2119/4287] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:00:24 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 20 21:00:25.285164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:25.288836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] [instance: 4ecac50c-36b0-496e-8301-98973b15c5a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:25.325173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.325673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.330099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.334562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.376867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] HTTP exception thrown: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. Nov 20 21:00:25.386269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] Returning 404 to user: Instance 4ecac50c-36b0-496e-8301-98973b15c5a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:25.387977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45b2f6c4-34e2-476e-a51a-79686fd7cd49 tempest-TaggedBootDevicesTest_v242-1749553438 tempest-TaggedBootDevicesTest_v242-1749553438-project] 10.222.0.41 "GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6" status: 404 len: 111 microversion: 2.1 time: 0.120594 Nov 20 21:00:25.389444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2120/4288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:25 2021] GET /compute/v2.1/servers/4ecac50c-36b0-496e-8301-98973b15c5a6 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:25.406243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9b61ea74-2572-49b7-8205-da7813f9fea6 req-c6ec9387-00f7-4e15-8724-58dd0b7bdea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b186c3-e02d-4b49-9299-6f493455e3e3", "name": "network-vif-deleted", "tag": "e7fda056-091a-4930-a586-d81ac0255708"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:25.420035 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:25.420035 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:25.433397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:25.449534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9b61ea74-2572-49b7-8205-da7813f9fea6 req-c6ec9387-00f7-4e15-8724-58dd0b7bdea1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.451203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9b61ea74-2572-49b7-8205-da7813f9fea6 req-c6ec9387-00f7-4e15-8724-58dd0b7bdea1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.455575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a16c687-4e4b-430e-9a03-25e6f07c39e9 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 1.033850 Nov 20 21:00:25.456416 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2169/4289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:24 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:25.471307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:25.472220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:25.489806 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9b61ea74-2572-49b7-8205-da7813f9fea6 req-c6ec9387-00f7-4e15-8724-58dd0b7bdea1 service nova] Creating event network-vif-deleted:e7fda056-091a-4930-a586-d81ac0255708 for instance 11b186c3-e02d-4b49-9299-6f493455e3e3 on nch1-master-1 Nov 20 21:00:25.491024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.491932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.494232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.495675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.510939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9b61ea74-2572-49b7-8205-da7813f9fea6 req-c6ec9387-00f7-4e15-8724-58dd0b7bdea1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118824 Nov 20 21:00:25.527603 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2121/4290] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:25.793564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:25.794312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:25.813726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.814499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.815569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.816213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.853833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] HTTP exception thrown: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. Nov 20 21:00:25.854518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 404 to user: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:25.855394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18b7a71a-4ab9-4b92-95f1-737707161ba5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 404 len: 111 microversion: 2.1 time: 0.067413 Nov 20 21:00:25.860842 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2122/4291] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:25 2021] GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:25.878225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:25.882313 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:25.882313 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:25.886988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:25.888458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:25.902832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.905999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:25.908451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:25.911363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.019482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30ba5282-e342-42d3-9ded-3244e9783597 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.157281 Nov 20 21:00:26.020393 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2123/4292] 10.222.0.41 () {58 vars in 1229 bytes} [Sat Nov 20 21:00:25 2021] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:00:26.033271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31fd4216-0820-4c29-8292-f5c0524f2f02 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.039462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31fd4216-0820-4c29-8292-f5c0524f2f02 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:26.040528 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-31fd4216-0820-4c29-8292-f5c0524f2f02 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011850 Nov 20 21:00:26.041580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2124/4293] 10.222.0.41 () {58 vars in 1181 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:00:26.053122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.058329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.059347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.068351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.069173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.070639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.071453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.108603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:00:26.174866 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fca08e5f-4521-4ed3-88c1-99744248d013 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.125021 Nov 20 21:00:26.183513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.183677 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2125/4294] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers => generated 683 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:00:26.191888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.198373 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:26.198373 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:26.199941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.200302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0649268d-bd0b-4722-a07c-379c7d9a0de8 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 200 len: 1494 microversion: 2.1 time: 0.737793 Nov 20 21:00:26.200701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.servers [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Removing options 'limit' from query {{(pid=140942) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 20 21:00:26.205133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.206584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2170/4295] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:25 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 1494 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:26.212028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.212653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.213710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.215465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.251532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:00:26.325607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4205817-8796-4c65-8287-015ae1ee60b7 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.138963 Nov 20 21:00:26.326680 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2126/4296] 10.222.0.41 () {58 vars in 1143 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:26.340743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49a66296-1f81-4ddb-af70-bcfcc176f3de tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.342413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49a66296-1f81-4ddb-af70-bcfcc176f3de tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:26.343439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49a66296-1f81-4ddb-af70-bcfcc176f3de tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008033 Nov 20 21:00:26.344216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2171/4297] 10.222.0.41 () {58 vars in 1141 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:00:26.353365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f4ceb0f-699b-4c00-9c27-ba544ae0dab5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.355108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f4ceb0f-699b-4c00-9c27-ba544ae0dab5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:26.356228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f4ceb0f-699b-4c00-9c27-ba544ae0dab5 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.006596 Nov 20 21:00:26.357230 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2127/4298] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:00:26.367196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66ffff27-44c3-4999-93bf-61536df10005 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.370703 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:26.370703 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:26.372014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-66ffff27-44c3-4999-93bf-61536df10005 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.373013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66ffff27-44c3-4999-93bf-61536df10005 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.383896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.servers [None req-66ffff27-44c3-4999-93bf-61536df10005 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Flavor 'non_existing_flavor' could not be found {{(pid=140941) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Nov 20 21:00:26.385070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66ffff27-44c3-4999-93bf-61536df10005 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021682 Nov 20 21:00:26.385688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2172/4299] 10.222.0.41 () {58 vars in 1177 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:00:26.397906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.401252 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:26.401252 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:26.402376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.403256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.411341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.412266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.413467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.414194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.473966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.474644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:26.506637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.507090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.521596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b95dabc1-d1ed-4fb8-b4b0-aa35406572b8 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.127632 Nov 20 21:00:26.523520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.524209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.529152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2128/4300] 10.222.0.41 () {58 vars in 1173 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:00:26.535531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.541334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.542544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.548818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.549622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.550744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.551436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.745829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e85b644-700d-4bde-89db-e6d06b8ef7f9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.215295 Nov 20 21:00:26.746717 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2129/4301] 10.222.0.41 () {58 vars in 1183 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:00:26.758170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:26.762467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.763226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:26.779392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.779845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.781248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.781696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:26.838644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:00:26.949363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:26.963872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:26.963872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.060494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:27.076371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02da5169-1af9-4d40-a853-ada2349e7e17 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.607278 Nov 20 21:00:27.088634 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2173/4302] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:27.227561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.228853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.237656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.238588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.240233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.240831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.262529 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. Nov 20 21:00:27.266085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.268005 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed2e25a0-4328-41d3-87ed-aa68b746babc tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 404 len: 111 microversion: 2.1 time: 0.047194 Nov 20 21:00:27.273615 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2174/4303] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:00:27.279452 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-db7fb895-34b4-4f3b-abd1-565fb9a59722 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.517871 Nov 20 21:00:27.281796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2130/4304] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:00:26 2021] GET /compute/v2.1/servers/detail => generated 3025 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:27.294258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.294258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.306792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab82f512-d2e2-41fa-918c-8d4858db8f5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.316988 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:27.316988 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:27.319199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.319704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab82f512-d2e2-41fa-918c-8d4858db8f5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:27.324140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.324537 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab82f512-d2e2-41fa-918c-8d4858db8f5e tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.021258 Nov 20 21:00:27.325070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.325528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.326158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2131/4305] 10.222.0.41 () {58 vars in 1177 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:00:27.344547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.355208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:27.369420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Searching by: {'deleted': False, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:00:27.378639 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. Nov 20 21:00:27.380027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.381681 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cba6b908-ba4b-4493-9a13-34d83cab3489 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 404 len: 111 microversion: 2.1 time: 0.100740 Nov 20 21:00:27.383082 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2175/4306] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.392694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.395482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.397045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.403581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.404542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9ce96a60-aad9-4d6a-a7d1-90617398c29d req-145233eb-21bd-409d-8a01-da6133962eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-unplugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:27.410510 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:27.410510 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:27.427663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9ce96a60-aad9-4d6a-a7d1-90617398c29d req-145233eb-21bd-409d-8a01-da6133962eae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.428576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9ce96a60-aad9-4d6a-a7d1-90617398c29d req-145233eb-21bd-409d-8a01-da6133962eae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.465547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:00:27.470907 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9ce96a60-aad9-4d6a-a7d1-90617398c29d req-145233eb-21bd-409d-8a01-da6133962eae service nova] Creating event network-vif-unplugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:00:27.490302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9ce96a60-aad9-4d6a-a7d1-90617398c29d req-145233eb-21bd-409d-8a01-da6133962eae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098653 Nov 20 21:00:27.492512 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2176/4307] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:27.503726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.507839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 374eedfb-69c7-4878-98ca-3e74106cf023] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.518609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.519226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.520168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.520808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.530495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0cc0a68d-e917-4e8d-9b34-4288d880753b tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.195951 Nov 20 21:00:27.539146 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2132/4308] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers => generated 683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:27.554493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.555751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.560278 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. Nov 20 21:00:27.564011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 374eedfb-69c7-4878-98ca-3e74106cf023 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.565281 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66bc241f-96ea-4559-b295-359b7dd3383f tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023" status: 404 len: 111 microversion: 2.1 time: 0.071473 Nov 20 21:00:27.566323 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2177/4309] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers/374eedfb-69c7-4878-98ca-3e74106cf023 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.581995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.582659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.584921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.585547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.589899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c078daee-42f1-44cd-b69c-4ba83d8cb9f3 req-8fd0814a-62fc-423a-b840-13a8b1142926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374eedfb-69c7-4878-98ca-3e74106cf023", "name": "network-vif-deleted", "tag": "5c849f08-17cc-461e-bc76-e9f2cac336fb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:27.594889 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:27.594889 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:27.606310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c078daee-42f1-44cd-b69c-4ba83d8cb9f3 req-8fd0814a-62fc-423a-b840-13a8b1142926 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.607048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c078daee-42f1-44cd-b69c-4ba83d8cb9f3 req-8fd0814a-62fc-423a-b840-13a8b1142926 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.622770 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c078daee-42f1-44cd-b69c-4ba83d8cb9f3 req-8fd0814a-62fc-423a-b840-13a8b1142926 service nova] Creating event network-vif-deleted:5c849f08-17cc-461e-bc76-e9f2cac336fb for instance 374eedfb-69c7-4878-98ca-3e74106cf023 on nch2-master-1 Nov 20 21:00:27.624558 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] HTTP exception thrown: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. Nov 20 21:00:27.625779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 404 to user: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.629022 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1b8b299-5a5c-479d-9db9-1411c65fef6d tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "DELETE /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 404 len: 111 microversion: 2.1 time: 0.088494 Nov 20 21:00:27.631303 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c078daee-42f1-44cd-b69c-4ba83d8cb9f3 req-8fd0814a-62fc-423a-b840-13a8b1142926 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062207 Nov 20 21:00:27.632577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2178/4310] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:27.633374 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2133/4311] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.641016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.642005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.643166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.651582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.651901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.652548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.653527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.654676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.659745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.661400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.663101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.664979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.678706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. Nov 20 21:00:27.679834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.682750 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-230de2b9-763e-4621-8da2-9413388d9bc4 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 404 len: 111 microversion: 2.1 time: 0.048126 Nov 20 21:00:27.684047 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2179/4312] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.706890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.710764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a64f1609-c8a6-41c0-b66b-b0ade6aca0f4] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.728833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:27.731656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.732335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.733287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.734688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.763064 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. Nov 20 21:00:27.764315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.766478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a05e1e2e-1322-4690-bd33-f3b7e870c3a7 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4" status: 404 len: 111 microversion: 2.1 time: 0.078037 Nov 20 21:00:27.767592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2180/4313] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers/a64f1609-c8a6-41c0-b66b-b0ade6aca0f4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.776128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.776876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.790859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.791621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.792704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.793330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.813398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. Nov 20 21:00:27.815170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.816723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01fe48c3-ddcc-4277-be95-300f59a5a2fd tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 404 len: 111 microversion: 2.1 time: 0.044042 Nov 20 21:00:27.819915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2181/4314] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.829830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.830839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: fca994f7-8d6e-4750-8730-bde156622c5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.857672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.859807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.864889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.866347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.895665 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f40b3605-3110-445e-87d2-f2a0d7fd7b50 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 204 len: 0 microversion: 2.1 time: 0.260759 Nov 20 21:00:27.896274 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2134/4315] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:00:27.909666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.912487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.917454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. Nov 20 21:00:27.918868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance fca994f7-8d6e-4750-8730-bde156622c5a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:27.920135 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f6620213-44b8-41db-b444-2a6fd457a02c tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a" status: 404 len: 111 microversion: 2.1 time: 0.095886 Nov 20 21:00:27.924485 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2182/4316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:27 2021] GET /compute/v2.1/servers/fca994f7-8d6e-4750-8730-bde156622c5a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:27.928937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.929616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.930647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.931252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.932319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:27.934521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:27.949747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.953719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.957666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:27.957666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:27.964673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:28.007436 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. Nov 20 21:00:28.008186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.012184 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02d65fb0-f739-4bb0-b1b6-55c2f29620a9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 404 len: 111 microversion: 2.1 time: 0.084939 Nov 20 21:00:28.016525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2183/4317] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.024437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.025064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 0f740d9f-2e25-44ef-95b1-b05cfb73a79f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.042549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.044191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.045960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.048069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.086246 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. Nov 20 21:00:28.086585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 0f740d9f-2e25-44ef-95b1-b05cfb73a79f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.090995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c9968ff-9590-4c66-8159-99ec09f1f932 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f" status: 404 len: 111 microversion: 2.1 time: 0.069260 Nov 20 21:00:28.093834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2184/4318] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/0f740d9f-2e25-44ef-95b1-b05cfb73a79f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.100602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.101443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.101597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d259694-9118-43a5-9df5-ba0d14ed52b4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "DELETE /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 204 len: 0 microversion: 2.1 time: 0.198639 Nov 20 21:00:28.104466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2135/4319] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:27 2021] DELETE /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:00:28.109768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.110423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.111706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.112245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.129820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.130964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.149272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.149740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.156663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.157151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.191967 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. Nov 20 21:00:28.192736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.193719 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7465570b-c0f0-4ff0-9e5a-6e21d8857a02 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 404 len: 111 microversion: 2.1 time: 0.085467 Nov 20 21:00:28.197934 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2136/4320] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:28 2021] DELETE /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.203231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.204113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 11b186c3-e02d-4b49-9299-6f493455e3e3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.226152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.226914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.227974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.228795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.255187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] HTTP exception thrown: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. Nov 20 21:00:28.256236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 404 to user: Instance 11b186c3-e02d-4b49-9299-6f493455e3e3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.257364 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ab1ee49-04a8-4406-bdeb-e41423e15ae3 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3" status: 404 len: 111 microversion: 2.1 time: 0.058129 Nov 20 21:00:28.259304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2137/4321] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/11b186c3-e02d-4b49-9299-6f493455e3e3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.267191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.268172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 38ec66af-f8b0-4f25-83ae-85f58885a718] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.285409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.285971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.287610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.288826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.311318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. Nov 20 21:00:28.313091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 38ec66af-f8b0-4f25-83ae-85f58885a718 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.314462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f117eb3c-bf01-4f5a-a35e-a0a118b5e09d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718" status: 404 len: 111 microversion: 2.1 time: 0.053928 Nov 20 21:00:28.315322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2138/4322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/38ec66af-f8b0-4f25-83ae-85f58885a718 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.321050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.322728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.339678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.340456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.341547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.344592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.632342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:28.645940 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8cea0289-cc0c-4780-a677-ae9fc28eaa80 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 200 len: 1522 microversion: 2.1 time: 0.329182 Nov 20 21:00:28.647683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2139/4323] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:28.662142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.662142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.672713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.673721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.674699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.675150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.694893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. Nov 20 21:00:28.695863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.697044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ece7abf6-01fb-4033-9b02-34fe710adbf3 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 404 len: 111 microversion: 2.1 time: 0.048414 Nov 20 21:00:28.698907 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2140/4324] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:28 2021] DELETE /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.712438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.713337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 01bb9904-cd08-4768-af33-180dd86ce1b6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.720373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.720825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.721939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.722413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.740468 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. Nov 20 21:00:28.741212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 01bb9904-cd08-4768-af33-180dd86ce1b6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.742329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-129bdc0e-5518-4fea-b876-4746d889f45d tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6" status: 404 len: 111 microversion: 2.1 time: 0.038318 Nov 20 21:00:28.743447 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2141/4325] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/01bb9904-cd08-4768-af33-180dd86ce1b6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.755032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d642a30-dcc3-4fad-807a-685bba0f6182 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.759430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d642a30-dcc3-4fad-807a-685bba0f6182 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.774977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1d642a30-dcc3-4fad-807a-685bba0f6182 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. Nov 20 21:00:28.775891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d642a30-dcc3-4fad-807a-685bba0f6182 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.777136 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d642a30-dcc3-4fad-807a-685bba0f6182 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6" status: 404 len: 111 microversion: 2.1 time: 0.028910 Nov 20 21:00:28.778483 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2142/4326] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:28 2021] DELETE /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.797563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aae0e5ff-58ef-49ce-b422-7d5a0d008169 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.798558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aae0e5ff-58ef-49ce-b422-7d5a0d008169 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.804784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:28.808784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-aae0e5ff-58ef-49ce-b422-7d5a0d008169 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. Nov 20 21:00:28.809893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aae0e5ff-58ef-49ce-b422-7d5a0d008169 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:28.811138 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aae0e5ff-58ef-49ce-b422-7d5a0d008169 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6" status: 404 len: 111 microversion: 2.1 time: 0.018546 Nov 20 21:00:28.813134 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2143/4327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/a7ca2e20-8c9e-42fd-b4bb-6c4e1e54f1a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:28.825212 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed5b7f0d-9da8-4dbd-99f8-d566752dbdf8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.729792 Nov 20 21:00:28.828760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2185/4328] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:28 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:28.840028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:28.841561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:28.861066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.863335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.864586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:28.867581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:28.928139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:29.092054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5976c33c-02fa-4295-b6ab-389897718000 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 204 len: 0 microversion: 2.1 time: 0.261461 Nov 20 21:00:29.095210 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2144/4329] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:28 2021] DELETE /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:00:29.104666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:29.105443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:29.117594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.120285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:29.132136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'create', calling method: .version_select at 0x7f3f86f36670>, body: {"keypair": {"name": "tempest-keypair-1555259458"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:29.133271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.133886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:29.169510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:29.185111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for user 44b2e036131a42309c890afd6c70a34c and project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:29.613723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:29.622674 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c84dc087-bfc4-498c-8bbd-9abc7368f1ff tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1478 microversion: 2.1 time: 0.523439 Nov 20 21:00:29.628117 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2186/4330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:29 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1478 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:29.666263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:29.667139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:29.684684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.686133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:29.692970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.722764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:29.776890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:29.792008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for user 44b2e036131a42309c890afd6c70a34c and project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:29.824992 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed155dea-c4ed-4040-920a-e0c1de51b1fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.697041 Nov 20 21:00:29.831149 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2145/4331] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 21:00:29 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 699 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:00:29.846008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:29.847065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:29.883844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.884314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:29.885125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:29.885570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:30.671986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:30.686753 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab439516-b6df-43c0-a6fd-0ca139c0979b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.845576 Nov 20 21:00:30.690216 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2146/4332] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:29 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:30.704908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:30.709419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:30.724017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:30.728766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:30.730665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:30.731281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:31.018895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:31.028092 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f6bbf54-f77e-4f71-a68f-62ef52af73c4 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 200 len: 1522 microversion: 2.1 time: 1.365745 Nov 20 21:00:31.034075 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2187/4333] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:29 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 1522 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:31.703970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:31.704602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:31.716468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:31.717272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:31.719102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:31.722947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:32.387765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:32.408658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27958878-8377-4974-8e9a-355d7b9a1743 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.705500 Nov 20 21:00:32.410527 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2188/4334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:31 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:32.423818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:32.424713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:32.431525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:32.432223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:32.438673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:32.439512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:32.705411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:32.713304 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f37181b-a42d-4e1a-82ef-c4910603b344 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1478 microversion: 2.1 time: 2.021319 Nov 20 21:00:32.720592 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2147/4335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:30 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1478 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:32.742566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1be5823d-dbc6-4594-b0a4-cc296636fd2d req-924bf706-af29-472a-99da-31b4b71c963f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-plugged", "status": "completed", "tag": "44f55344-9797-4791-8c1a-27f87cf698a5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:32.753786 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:32.753786 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:32.783901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1be5823d-dbc6-4594-b0a4-cc296636fd2d req-924bf706-af29-472a-99da-31b4b71c963f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:32.786385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1be5823d-dbc6-4594-b0a4-cc296636fd2d req-924bf706-af29-472a-99da-31b4b71c963f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:32.808865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1be5823d-dbc6-4594-b0a4-cc296636fd2d req-924bf706-af29-472a-99da-31b4b71c963f service nova] Creating event network-vif-plugged:44f55344-9797-4791-8c1a-27f87cf698a5 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:32.819124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1be5823d-dbc6-4594-b0a4-cc296636fd2d req-924bf706-af29-472a-99da-31b4b71c963f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095930 Nov 20 21:00:32.820468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2148/4336] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:32.821794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:32.826952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d9f2d444-27e5-4b88-8aa8-d6547d1e9469 req-d55d8583-1292-4653-ab78-2dd8dae81691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26516cdf-b525-4abc-8716-ad60c3b81c35", "name": "network-vif-deleted", "tag": "f5e13635-ad44-4f1b-8927-600136df3f15"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:32.828988 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:32.828988 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:32.837129 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f55a641-dcf8-4b11-8b76-8598309dea1a tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 200 len: 1480 microversion: 2.1 time: 0.422320 Nov 20 21:00:32.842466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2189/4337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:32 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 1480 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:32.847240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d9f2d444-27e5-4b88-8aa8-d6547d1e9469 req-d55d8583-1292-4653-ab78-2dd8dae81691 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:32.847706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d9f2d444-27e5-4b88-8aa8-d6547d1e9469 req-d55d8583-1292-4653-ab78-2dd8dae81691 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:32.879194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d9f2d444-27e5-4b88-8aa8-d6547d1e9469 req-d55d8583-1292-4653-ab78-2dd8dae81691 service nova] Creating event network-vif-deleted:f5e13635-ad44-4f1b-8927-600136df3f15 for instance 26516cdf-b525-4abc-8716-ad60c3b81c35 on nch1-master-1 Nov 20 21:00:32.886784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d9f2d444-27e5-4b88-8aa8-d6547d1e9469 req-d55d8583-1292-4653-ab78-2dd8dae81691 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064425 Nov 20 21:00:32.890522 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2149/4338] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:33.427281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:33.427838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:33.434388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:33.434836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:33.457090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:33.458301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:33.739304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:33.740003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:33.760570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:33.761173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:33.762036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:33.762653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:34.118790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:34.130484 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37ad7f48-6139-448b-abda-07f6f3d70424 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 0.705714 Nov 20 21:00:34.143470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2190/4339] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:33 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:34.170741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:34.173437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:34.201444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:34.206316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:34.207427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:34.214201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:34.444726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1252ae31200b44dda39395c98f6153cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71afe10ea2e54e09af1aef5ee9f07261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:34.457068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77d252cb-0f27-43b2-9e82-4b5b1b542fec tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 200 len: 1308 microversion: 2.1 time: 0.312289 Nov 20 21:00:34.460062 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2191/4340] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:34 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:34.523591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:34.553973 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-114f657f-699c-4b8c-a753-3936375b40c9 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1478 microversion: 2.1 time: 0.806505 Nov 20 21:00:34.555365 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2150/4341] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:33 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1478 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:34.989749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6e9c83e6-0ce1-4393-a307-b01fb012afdb req-4b72185c-6f74-464c-85c6-11f709a816fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60d5cd6-1736-4303-8340-35b914be8dce", "name": "network-vif-deleted", "tag": "bd984248-d711-49cb-b240-1dae016cbc50"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:34.997836 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:34.997836 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:35.028628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6e9c83e6-0ce1-4393-a307-b01fb012afdb req-4b72185c-6f74-464c-85c6-11f709a816fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.029525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6e9c83e6-0ce1-4393-a307-b01fb012afdb req-4b72185c-6f74-464c-85c6-11f709a816fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.056630 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6e9c83e6-0ce1-4393-a307-b01fb012afdb req-4b72185c-6f74-464c-85c6-11f709a816fc service nova] Creating event network-vif-deleted:bd984248-d711-49cb-b240-1dae016cbc50 for instance e60d5cd6-1736-4303-8340-35b914be8dce on nch2-master-1 Nov 20 21:00:35.068314 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6e9c83e6-0ce1-4393-a307-b01fb012afdb req-4b72185c-6f74-464c-85c6-11f709a816fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083474 Nov 20 21:00:35.069488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2192/4342] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:35.149479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:35.152222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:35.200461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.201391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.217832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.218611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.245749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e1774bd1-4135-4fd8-9cc2-c786665d0bcb req-bb775517-4482-4c66-ba46-9c11a9d0a59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-plugged", "status": "completed", "tag": "81d2d57f-3035-4006-a984-49d10147384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:35.248002 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:35.248002 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:35.286038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e1774bd1-4135-4fd8-9cc2-c786665d0bcb req-bb775517-4482-4c66-ba46-9c11a9d0a59f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.287281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e1774bd1-4135-4fd8-9cc2-c786665d0bcb req-bb775517-4482-4c66-ba46-9c11a9d0a59f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.351983 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e1774bd1-4135-4fd8-9cc2-c786665d0bcb req-bb775517-4482-4c66-ba46-9c11a9d0a59f service nova] Creating event network-vif-plugged:81d2d57f-3035-4006-a984-49d10147384b for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:35.376992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e1774bd1-4135-4fd8-9cc2-c786665d0bcb req-bb775517-4482-4c66-ba46-9c11a9d0a59f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136367 Nov 20 21:00:35.382999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2193/4343] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:35.481317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:35.482014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: e60d5cd6-1736-4303-8340-35b914be8dce] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:35.496788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.499958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.503408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.504058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.550957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] HTTP exception thrown: Instance e60d5cd6-1736-4303-8340-35b914be8dce could not be found. Nov 20 21:00:35.555226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 404 to user: Instance e60d5cd6-1736-4303-8340-35b914be8dce could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:35.556485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-adc1adc1-8040-4ea3-bf18-6447e3b347e9 tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce" status: 404 len: 111 microversion: 2.1 time: 0.083007 Nov 20 21:00:35.559861 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2194/4344] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:35 2021] GET /compute/v2.1/servers/e60d5cd6-1736-4303-8340-35b914be8dce => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:35.574333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:35.575259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] [instance: 26516cdf-b525-4abc-8716-ad60c3b81c35] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:35.591017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.591493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.592301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.592739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.642963 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] HTTP exception thrown: Instance 26516cdf-b525-4abc-8716-ad60c3b81c35 could not be found. Nov 20 21:00:35.643573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] Returning 404 to user: Instance 26516cdf-b525-4abc-8716-ad60c3b81c35 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:35.644450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9e0c659-d440-474a-94e2-d847c9db76cc tempest-ListServersNegativeTestJSON-1278338634 tempest-ListServersNegativeTestJSON-1278338634-project] 10.222.0.41 "GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35" status: 404 len: 111 microversion: 2.1 time: 0.080259 Nov 20 21:00:35.649152 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2195/4345] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:35 2021] GET /compute/v2.1/servers/26516cdf-b525-4abc-8716-ad60c3b81c35 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:00:35.682206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:35.682825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:35.704878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.705388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.706259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.706698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.799992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:35.800606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:35.801167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lazy-loading 'fault' on Instance uuid 1a3106c1-4741-490e-aa46-7f3e6614fdd1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:00:36.203260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f54427832d4eab90907dcb084d62c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc3f13200ff407ea8e320abdbb3c456', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:36.214395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6b8748aa-153c-4331-8577-29b5d9bf1c30 tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 200 len: 1282 microversion: 2.1 time: 0.561511 Nov 20 21:00:36.214395 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2196/4346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:35 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 1282 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:36.386179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:36.397005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50e179eb-112a-4f0f-92fb-5bafcb4cad41 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 1.252255 Nov 20 21:00:36.410237 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2151/4347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:35 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:37.198084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-be270dc5-bef7-43e6-aeb2-1b623df024cf req-701f48bc-b1e2-44fb-8608-cd18510a93a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a3106c1-4741-490e-aa46-7f3e6614fdd1", "name": "network-vif-deleted", "tag": "f8de97a0-2799-4c39-82a8-566fd2fe46e8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:37.201024 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:37.201024 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:00:37.231034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:37.232075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] [instance: 1a3106c1-4741-490e-aa46-7f3e6614fdd1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:37.238654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-be270dc5-bef7-43e6-aeb2-1b623df024cf req-701f48bc-b1e2-44fb-8608-cd18510a93a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.243472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-be270dc5-bef7-43e6-aeb2-1b623df024cf req-701f48bc-b1e2-44fb-8608-cd18510a93a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.253555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.254443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.257994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.261428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.309952 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-be270dc5-bef7-43e6-aeb2-1b623df024cf req-701f48bc-b1e2-44fb-8608-cd18510a93a0 service nova] Creating event network-vif-deleted:f8de97a0-2799-4c39-82a8-566fd2fe46e8 for instance 1a3106c1-4741-490e-aa46-7f3e6614fdd1 on nch1-master-1 Nov 20 21:00:37.340032 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] HTTP exception thrown: Instance 1a3106c1-4741-490e-aa46-7f3e6614fdd1 could not be found. Nov 20 21:00:37.343965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] Returning 404 to user: Instance 1a3106c1-4741-490e-aa46-7f3e6614fdd1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:37.344977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-159bbdd5-2f29-4fc7-8cd3-0f4a0f2a331b tempest-ServersTestJSON-1712314003 tempest-ServersTestJSON-1712314003-project] 10.222.0.41 "GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1" status: 404 len: 111 microversion: 2.1 time: 0.118484 Nov 20 21:00:37.345819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-be270dc5-bef7-43e6-aeb2-1b623df024cf req-701f48bc-b1e2-44fb-8608-cd18510a93a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154907 Nov 20 21:00:37.348750 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2197/4348] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:00:37.356305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2152/4349] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:37 2021] GET /compute/v2.1/servers/1a3106c1-4741-490e-aa46-7f3e6614fdd1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:00:37.422293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:37.423340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:37.434955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.435549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.436454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.438284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.487919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-plugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}, {"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-plugged", "status": "completed", "tag": "46b173fa-03d9-4a65-880e-26f38e2b0498"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:37.490238 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:37.490238 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:37.515561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:37.518675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:37.566143 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] Creating event network-vif-plugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:00:37.572718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] Creating event network-vif-plugged:46b173fa-03d9-4a65-880e-26f38e2b0498 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:37.601675 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1c043467-3655-4e90-a55c-e76269bbd8e4 req-6f27062d-168c-44aa-b2dd-31aea6fe5b6a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.117760 Nov 20 21:00:37.610151 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2153/4350] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:37 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:38.699955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:38.708832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a986b5da-f294-4d37-8a73-4d51bc8da105 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1355 microversion: 2.1 time: 1.291667 Nov 20 21:00:38.722387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2198/4351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:37 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1355 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:39.741779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:39.752077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:39.769187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:39.774890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:39.776402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:39.777352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:40.440461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:40.452971 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0800103c-f96e-4086-89b8-2498d25cbbac tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1806 microversion: 2.1 time: 0.713832 Nov 20 21:00:40.453757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2154/4352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:39 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1806 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:40.471583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:40.472064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:40.495796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:40.496758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:40.498248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:40.498919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:40.557199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47168908-a55f-4c52-9fd3-ea1280285216 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d/ips" status: 200 len: 219 microversion: 2.1 time: 0.079053 Nov 20 21:00:40.565993 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2199/4353] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:00:40 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d/ips => generated 219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:40.569952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:40.570718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:40.596679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:40.598439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:40.602306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:40.604903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:40.729145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:00:41.072730 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 204 len: 0 microversion: 2.1 time: 0.507055 Nov 20 21:00:41.079056 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2155/4354] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:00:40 2021] DELETE /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:00:41.086362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:41.087092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:41.097627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:41.102460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:41.106234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:41.107236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:42.313212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:42.314278 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002059 Nov 20 21:00:42.314636 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2156/4355] 10.222.0.41 () {56 vars in 885 bytes} [Sat Nov 20 21:00:42 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 20 21:00:42.321296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:42.322716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001904 Nov 20 21:00:42.323577 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2157/4356] 10.222.0.41 () {54 vars in 1034 bytes} [Sat Nov 20 21:00:42 2021] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Nov 20 21:00:42.329939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:42.331360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001932 Nov 20 21:00:42.332162 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2158/4357] 10.222.0.41 () {54 vars in 1040 bytes} [Sat Nov 20 21:00:42 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:42.340636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:42.342017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eabb5378-651c-4c95-9d67-7ead0f712647 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001778 Nov 20 21:00:42.343196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2159/4358] 10.222.0.41 () {56 vars in 885 bytes} [Sat Nov 20 21:00:42 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 20 21:00:42.859392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:42.868300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b06088c9-206c-4ce0-8e8a-a00db13dd3fd tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1812 microversion: 2.1 time: 1.785399 Nov 20 21:00:42.887878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2200/4359] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:41 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1812 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:43.893913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:43.896490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:43.922063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:43.924111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:43.925155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:43.928187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:44.463501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-365527811", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9a4d1c40-4599-43fd-8084-24cc8c85159b"}, {"port": "bd4e7a14-7d21-4548-8472-ba80748bb825", "tag": "port-1"}, {"port": "17593c85-2aba-4b07-b484-60c0a0677ba6", "tag": "port-2"}, {"uuid": "a71914d1-f8db-41aa-b100-1859a3120efd", "tag": "net-1"}, {"uuid": "a71914d1-f8db-41aa-b100-1859a3120efd"}, {"uuid": "d7561cda-0cef-429a-ab48-39d731d77e04", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d7561cda-0cef-429a-ab48-39d731d77e04", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e2e692fe-95a8-4bc3-ad69-91e3949de763", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "864356f0-cae5-4433-8f7d-166f6228c9f6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d49f5634-0b85-4e4f-8945-d02c42b35a9f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1574033707"}], "key_name": "tempest-keypair-1555259458", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:45.121111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] validate_networks() for [('9a4d1c40-4599-43fd-8084-24cc8c85159b', None, None, None, None, None), (None, None, 'bd4e7a14-7d21-4548-8472-ba80748bb825', None, None, None), (None, None, '17593c85-2aba-4b07-b484-60c0a0677ba6', None, None, None), ('a71914d1-f8db-41aa-b100-1859a3120efd', None, None, None, None, None), ('a71914d1-f8db-41aa-b100-1859a3120efd', None, None, None, None, None), ('d7561cda-0cef-429a-ab48-39d731d77e04', '10.2.2.100', None, None, None, None), ('d7561cda-0cef-429a-ab48-39d731d77e04', '10.2.2.200', None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:00:45.155887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:45.169674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-48627a1a-732b-4341-afac-1bcbc356e7e3 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1812 microversion: 2.1 time: 1.282791 Nov 20 21:00:45.170242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2160/4360] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:43 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1812 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:45.232464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1c64a0ba-82f0-4f0d-8aed-bc0466623730 req-a79d5e17-65d0-4bdc-956e-84faa33670b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-deleted", "tag": "81d2d57f-3035-4006-a984-49d10147384b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:45.234811 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:45.234811 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:45.248330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c64a0ba-82f0-4f0d-8aed-bc0466623730 req-a79d5e17-65d0-4bdc-956e-84faa33670b9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:45.248778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c64a0ba-82f0-4f0d-8aed-bc0466623730 req-a79d5e17-65d0-4bdc-956e-84faa33670b9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:45.285893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1c64a0ba-82f0-4f0d-8aed-bc0466623730 req-a79d5e17-65d0-4bdc-956e-84faa33670b9 service nova] Creating event network-vif-deleted:81d2d57f-3035-4006-a984-49d10147384b for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:45.298213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1c64a0ba-82f0-4f0d-8aed-bc0466623730 req-a79d5e17-65d0-4bdc-956e-84faa33670b9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091291 Nov 20 21:00:45.301452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2161/4361] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:46.188812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:46.189818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:46.212423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:46.215752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:46.217374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:46.223792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:47.275033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:47.333277 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-091e2a8d-167b-4d48-b5b8-07ecec3f0518 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1677 microversion: 2.1 time: 1.148387 Nov 20 21:00:47.338110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2162/4362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:46 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1677 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:00:48.380270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:48.381879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:48.425145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:48.432013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:48.439955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:48.440693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:49.622174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:49.634933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da7bdea2-dd35-47a1-834d-5e337bf3f248 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1656 microversion: 2.1 time: 1.272377 Nov 20 21:00:49.635554 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2163/4363] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:48 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1656 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:49.661329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c6b1f9c9-90fe-43ca-98cd-7269ccd37082 req-9a97b5d9-ad8f-4509-9451-b700e8d99282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-deleted", "tag": "44f55344-9797-4791-8c1a-27f87cf698a5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:49.672212 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:49.672212 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:49.701192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6b1f9c9-90fe-43ca-98cd-7269ccd37082 req-9a97b5d9-ad8f-4509-9451-b700e8d99282 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:49.703142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6b1f9c9-90fe-43ca-98cd-7269ccd37082 req-9a97b5d9-ad8f-4509-9451-b700e8d99282 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:49.728052 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c6b1f9c9-90fe-43ca-98cd-7269ccd37082 req-9a97b5d9-ad8f-4509-9451-b700e8d99282 service nova] Creating event network-vif-deleted:44f55344-9797-4791-8c1a-27f87cf698a5 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:49.757678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c6b1f9c9-90fe-43ca-98cd-7269ccd37082 req-9a97b5d9-ad8f-4509-9451-b700e8d99282 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101516 Nov 20 21:00:49.759073 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2164/4364] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:50.399499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: .version_select at 0x7f3f98d95040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-979156582"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:50.445726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:50.470676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:51.242754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:51.294967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:51.365515 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d830179-0409-4d3f-a8bc-31cf60b7efa0 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.971661 Nov 20 21:00:51.373088 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2165/4365] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:00:50 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:51.390267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:51.391636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:51.410490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:51.413355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:51.414420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:51.415033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:51.541949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:51.543636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:51.544132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lazy-loading 'fault' on Instance uuid e10cd167-1c23-4db7-b21c-bb773186754d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:00:51.660005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:51.668857 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c83434b-cb1e-4746-972d-5e6835f35483 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 200 len: 1303 microversion: 2.1 time: 0.294198 Nov 20 21:00:51.672032 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2166/4366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:51 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 1303 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:51.803943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-aaf5a639-411b-4b5e-be90-f89ca9cd6ee7 req-2ecaf670-48df-4010-9692-10391bba029b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10cd167-1c23-4db7-b21c-bb773186754d", "name": "network-vif-deleted", "tag": "46b173fa-03d9-4a65-880e-26f38e2b0498"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:51.805506 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:00:51.805506 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:00:51.818532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aaf5a639-411b-4b5e-be90-f89ca9cd6ee7 req-2ecaf670-48df-4010-9692-10391bba029b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:51.822250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aaf5a639-411b-4b5e-be90-f89ca9cd6ee7 req-2ecaf670-48df-4010-9692-10391bba029b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:51.852185 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-aaf5a639-411b-4b5e-be90-f89ca9cd6ee7 req-2ecaf670-48df-4010-9692-10391bba029b service nova] Creating event network-vif-deleted:46b173fa-03d9-4a65-880e-26f38e2b0498 for instance e10cd167-1c23-4db7-b21c-bb773186754d on nch1-master-1 Nov 20 21:00:51.863155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-aaf5a639-411b-4b5e-be90-f89ca9cd6ee7 req-2ecaf670-48df-4010-9692-10391bba029b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063051 Nov 20 21:00:51.865839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2167/4367] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:00:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:00:52.689151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:52.689859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:52.710998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:52.712053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:52.715547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:52.716175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:52.749428 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. Nov 20 21:00:52.750468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:00:52.751517 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4491d82-b626-4281-8bf6-6aa42947effa tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 404 len: 111 microversion: 2.1 time: 0.068955 Nov 20 21:00:52.753631 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2168/4368] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:52 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:00:53.990836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-290021421", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "874d5862-1978-419b-ab00-ff1c249ca441"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:54.103396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] validate_networks() for [('874d5862-1978-419b-ab00-ff1c249ca441', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:00:55.793706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:00:55.794366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:00:55.794688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:00:55.795139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:00:55.796319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:00:55.825279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:55.825822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:55.828236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:55.828695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:55.892189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Getting quotas for project c36aae4eacda4f76ac551fe613c502f7. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:55.910957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Getting quotas for user be9f5c2f5f93431ea9519e86fe85ec15 and project c36aae4eacda4f76ac551fe613c502f7. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:55.958608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:00:55.962007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:00:56.041454 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-156beea6-19ea-4a34-a47b-40fbef56b24a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.686348 Nov 20 21:00:56.042792 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2169/4369] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:00:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:00:56.058809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1afe019d-909a-40d6-8109-1c83523d464b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:56.059725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1afe019d-909a-40d6-8109-1c83523d464b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:56.261038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1afe019d-909a-40d6-8109-1c83523d464b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:56.281064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1afe019d-909a-40d6-8109-1c83523d464b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1224 microversion: 2.1 time: 0.220439 Nov 20 21:00:56.291480 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2170/4370] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:56 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1224 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:56.771672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:00:56.772601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:00:56.773802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:00:56.774348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:00:56.775085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:00:56.798687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:56.802778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:56.805789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:56.807785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:56.898449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:00:56.926614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Getting quotas for user 44b2e036131a42309c890afd6c70a34c and project ff892c31a4354551b7c9e9c01d5b7b6f. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:00:57.300271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:57.303118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:57.334670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:57.337241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:57.369318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:57.370835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:57.524526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:00:57.528057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e2e692fe-95a8-4bc3-ad69-91e3949de763',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='864356f0-cae5-4433-8f7d-166f6228c9f6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d49f5634-0b85-4e4f-8945-d02c42b35a9f',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:00:57.588414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:57.603048 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d707c188-9b0a-46d5-b201-27391f097b2a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1220 microversion: 2.1 time: 0.301856 Nov 20 21:00:57.607145 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2171/4371] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:57 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1220 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:57.724734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-620697682", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "1285f7b9-19ec-4973-b341-2c247825bb31"}], "key_name": "tempest-TestNetworkBasicOps-979156582", "security_groups": [{"name": "tempest-secgroup-smoke-1222555796"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:00:57.970652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] validate_networks() for [('1285f7b9-19ec-4973-b341-2c247825bb31', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:00:58.262284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf6b5060-178d-47bf-b3f1-4a9d1e3a40a8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 13.806398 Nov 20 21:00:58.262864 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2201/4372] 10.222.0.41 () {62 vars in 1188 bytes} [Sat Nov 20 21:00:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 13808 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 21:00:58.290306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:58.303903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:58.596296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:58.612453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:58.614359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:58.616163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3394f293-f789-41a4-9c1c-f96038d27ea9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1285 microversion: 2.32 time: 0.344832 Nov 20 21:00:58.617217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2202/4373] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:58 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1285 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:00:58.632238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:58.635341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:58.653750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:58.661949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:58.664433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:58.665907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:58.806008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:58.817282 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ea77d2b-9049-4115-b6c3-60e9422adca7 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1282 microversion: 2.1 time: 0.198843 Nov 20 21:00:58.820596 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2203/4374] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:58 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:00:59.640326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:00:59.641890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:00:59.655553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:59.673503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:59.676686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:00:59.678307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:00:59.955642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:59.978725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:59.984910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:00:59.993256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c14d4804-2ce3-4820-bd58-158f9641717c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1519 microversion: 2.32 time: 0.357264 Nov 20 21:00:59.995022 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2204/4375] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:00:59 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1519 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:00.011494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:00.012546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:00.021636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:00.022789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:00.023880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:00.024553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:00.275944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:00.289901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ceee579a-17af-40d1-89f1-407c357f45d5 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1282 microversion: 2.1 time: 0.286994 Nov 20 21:01:00.292167 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2205/4376] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:00:59 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:01.016567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:01.017947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:01.032463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.032924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.033735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.047018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.090602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:01.091705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:01.092224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:01.094087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:01.094087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:01.121012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.121467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.122395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.122738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.203962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:01.214654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:01.240341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:01.246385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:01.328993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b245a10-b04f-411c-bd4a-01313f52ed2e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.607901 Nov 20 21:01:01.330944 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2172/4377] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:00:57 2021] POST /compute/v2.1/servers => generated 406 bytes in 3611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:01:01.338559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:01.343770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:01.371328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.372220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.372610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:01.373061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:01.835196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:01.845939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:01.848237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:01.849651 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5067d81f-78fe-4e5f-80ae-ec58c7555d67 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1593 microversion: 2.32 time: 0.838041 Nov 20 21:01:01.851422 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2206/4378] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:01 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1593 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:01.859731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-800531b9-6ddd-4ed3-8c6d-92ff946b600d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:01.866333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-800531b9-6ddd-4ed3-8c6d-92ff946b600d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:02.190186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-800531b9-6ddd-4ed3-8c6d-92ff946b600d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:02.190757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:02.199382 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1cda0271-1187-4c04-9869-7d0af34a64b3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.866099 Nov 20 21:01:02.201918 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-800531b9-6ddd-4ed3-8c6d-92ff946b600d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1247 microversion: 2.1 time: 0.349165 Nov 20 21:01:02.203327 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2207/4379] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:01 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1247 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:02.203918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2173/4380] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:01 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:02.870448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:02.871098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:02.881847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:02.882330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:02.883565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:02.884214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.088938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:03.111577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:03.115610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:03.116806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5cd0cfd-9975-4e3d-ac47-c5be0694c50a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1593 microversion: 2.32 time: 0.251979 Nov 20 21:01:03.117385 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2208/4381] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:02 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1593 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:03.239269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:03.240701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:03.242140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:03.244496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:03.283476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.284041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.285490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.286005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.294097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.294472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.297987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.299349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.516343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:03.537772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0bfa723-f351-4d04-8029-50ce7c2edb60 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1305 microversion: 2.1 time: 0.314537 Nov 20 21:01:03.541468 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2209/4382] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:03 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:03.626415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:03.627040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:03.637368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.638723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:03.639633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:03.642418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:04.047960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:04.058710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7dc042b9-dc29-4386-8802-e6aa6775d784 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.436865 Nov 20 21:01:04.060041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2210/4383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:03 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:04.086738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-943259511"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:04.090437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:04.109538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:04.110288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:04.112313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:04.115718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:04.866778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00a7cf98-3717-49eb-9aaf-a40d092e6a67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.787053 Nov 20 21:01:04.869744 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2211/4384] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:01:04 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 20 21:01:04.896158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:04.898639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:04.916198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:04.916907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:04.917951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:04.918436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:05.360234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:05.375737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:05.379918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:05.383469 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce73e8ed-60fb-453c-9d8e-3061d40b2c58 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1661 microversion: 2.32 time: 0.500931 Nov 20 21:01:05.384879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2212/4385] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:04 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1661 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:05.406599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:05.407762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:05.415535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:05.416522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:05.417937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:05.418892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:05.567042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:05.575653 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52cd9ab1-4a3d-40cf-b00b-c85e95ad0954 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 2.362592 Nov 20 21:01:05.588549 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2174/4386] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:03 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:05.597782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:05.600288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:05.611027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:05.611481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:05.612281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:05.612716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:05.656399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:05.667039 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a25764c-f14e-4b1f-aa51-3316a6e16885 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1305 microversion: 2.1 time: 0.279948 Nov 20 21:01:05.668203 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2213/4387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:05 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1305 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:06.245394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:06.253130 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-428a080a-13ca-4904-b62b-d82b7f16922d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.663429 Nov 20 21:01:06.262839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2175/4388] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:05 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:06.283682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b56d6f73-ae00-49ed-9610-c1637241033c req-558c939a-d7e4-4077-b254-faa7c0a61326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f008fe68-b64a-4bda-ab3c-42f2c26a1280", "tag": "af9fddac-288d-4af5-b181-dc99829991f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:06.286189 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:06.286189 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:06.303064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b56d6f73-ae00-49ed-9610-c1637241033c req-558c939a-d7e4-4077-b254-faa7c0a61326 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:06.305490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b56d6f73-ae00-49ed-9610-c1637241033c req-558c939a-d7e4-4077-b254-faa7c0a61326 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:06.330800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b56d6f73-ae00-49ed-9610-c1637241033c req-558c939a-d7e4-4077-b254-faa7c0a61326 service nova] Creating event network-changed:af9fddac-288d-4af5-b181-dc99829991f3 for instance f008fe68-b64a-4bda-ab3c-42f2c26a1280 on nch1-master-1 Nov 20 21:01:06.341145 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b56d6f73-ae00-49ed-9610-c1637241033c req-558c939a-d7e4-4077-b254-faa7c0a61326 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062154 Nov 20 21:01:06.347250 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2214/4389] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:06.411715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:06.412476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:06.425944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:06.431323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:06.435134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:06.435612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:06.596579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:06.597399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:06.614261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:06.616462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:06.622027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:06.625553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:07.324062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:07.333726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82a6c9b8-64f0-4467-b357-b95216f8b37d tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.742482 Nov 20 21:01:07.338680 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2215/4390] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:06 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:07.346739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:07.350603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:07.365806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:07.366550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:07.367521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:07.368443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:07.909358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:07.917358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-340790fb-c8ab-4902-bcd6-c083e6645390 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1373 microversion: 2.1 time: 0.577423 Nov 20 21:01:07.922594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2216/4391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:07 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1373 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:07.927896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d4f3f2f9-a7db-4f54-b7b8-da8e4261374a req-17b89c8b-49c1-4452-b9e7-e4400e85d132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-unplugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:07.929456 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:07.929456 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:07.955017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d4f3f2f9-a7db-4f54-b7b8-da8e4261374a req-17b89c8b-49c1-4452-b9e7-e4400e85d132 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:07.955537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d4f3f2f9-a7db-4f54-b7b8-da8e4261374a req-17b89c8b-49c1-4452-b9e7-e4400e85d132 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:07.986200 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d4f3f2f9-a7db-4f54-b7b8-da8e4261374a req-17b89c8b-49c1-4452-b9e7-e4400e85d132 service nova] Creating event network-vif-unplugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:01:08.000448 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d4f3f2f9-a7db-4f54-b7b8-da8e4261374a req-17b89c8b-49c1-4452-b9e7-e4400e85d132 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075961 Nov 20 21:01:08.003168 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2217/4392] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:08.016187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:08.017408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:08.035009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:08.035482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:08.036246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:08.039115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:08.251131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:08.262817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:08.266133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:08.267931 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b387339c-8ebf-42cc-9bc5-3e2aa367f212 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1661 microversion: 2.32 time: 1.862910 Nov 20 21:01:08.296681 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2176/4393] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:06 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1661 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:08.356328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:08.357289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:08.378804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:08.383108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:08.390807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:08.391524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:08.533509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:08.548839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37467282-2686-4ac0-8306-a31a076c5e52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1686 microversion: 2.1 time: 0.543211 Nov 20 21:01:08.552737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2218/4394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:08 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1686 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:08.841535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-706887332", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "5d592188-6e19-4699-a637-786cdf0d36f7"}, {"uuid": "1b885263-72f5-453c-9058-e569be630156"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:08.991252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] validate_networks() for [('5d592188-6e19-4699-a637-786cdf0d36f7', None, None, None, None, None), ('1b885263-72f5-453c-9058-e569be630156', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:01:10.064278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:10.071916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89511532-2af0-46d3-8829-96fdbf71bb62 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 1.720091 Nov 20 21:01:10.089181 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2177/4395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:08 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:10.103655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:10.104586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:10.131221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:10.131679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:10.132662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:10.133105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.405039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:11.416851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cd1bf68-2412-4f68-beb1-3181093da356 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1373 microversion: 2.1 time: 1.326150 Nov 20 21:01:11.417462 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2178/4396] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:10 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1373 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:11.429555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:11.435444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:11.436587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:11.436885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:11.437290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:11.437700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:11.444143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:11.455807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.456497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.457500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.458172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.479645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.479645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.479645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.479645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.560364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Getting quotas for project 4ec4545fe17f4700bc073f25016da683. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:11.589894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Getting quotas for user bd1afe99ea084fea8a86d7d6a8a6057b and project 4ec4545fe17f4700bc073f25016da683. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:11.644747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:11.650834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:11.799670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a92224a5-4469-4f77-86df-5b83354530e4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.962873 Nov 20 21:01:11.807942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2219/4397] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:01:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 2972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:01:11.813306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:11.828195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:11.843370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.857479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:11.859167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:11.862747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.222561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.250898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.255630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.261313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99f57a2d-2a9b-4fae-8d96-95dff881dc06 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1696 microversion: 2.32 time: 1.838086 Nov 20 21:01:13.279042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2179/4398] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:11 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1696 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:13.292070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.295064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:13.296156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:13.309959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.310449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.311405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.311741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.318152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a18be06-6438-4342-be17-75e4d883eb0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 1.508724 Nov 20 21:01:13.320734 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2220/4399] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:11 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:13.331529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:13.333864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:13.353705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.356149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.360646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.362782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.539980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.553214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24845939-382f-485c-9794-e0b384dd09b4 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1208 microversion: 2.1 time: 0.226975 Nov 20 21:01:13.554273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2221/4400] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:13 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1208 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:13.798177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:13.806681 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3e56bf9d-cadb-4489-95da-ef803da96caa tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.525261 Nov 20 21:01:13.810300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2180/4401] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:13 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:13.833597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:13.834257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:13.856468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-186325711", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "a8f2480b-fc80-4ebf-9635-3977528e4714"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:13.860091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.861170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:13.862268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:13.862878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:14.255768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:14.280521 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7800cff8-6708-4d8d-a9a9-d0a40df14016 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1373 microversion: 2.1 time: 0.450607 Nov 20 21:01:14.284753 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2181/4402] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:13 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1373 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:14.313037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ea185220-21e1-4c1a-969f-5097894a7103 req-487adeae-d48d-4d93-8d73-08f38d5b24ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66476154-140d-461c-82e4-a9bf5200d6ba", "tag": "8adc5a88-c2fa-4460-a689-528a2266b1a5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:14.329895 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:14.329895 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:14.404049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ea185220-21e1-4c1a-969f-5097894a7103 req-487adeae-d48d-4d93-8d73-08f38d5b24ed service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:14.411902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] validate_networks() for [('a8f2480b-fc80-4ebf-9635-3977528e4714', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:01:14.413539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ea185220-21e1-4c1a-969f-5097894a7103 req-487adeae-d48d-4d93-8d73-08f38d5b24ed service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:14.457948 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ea185220-21e1-4c1a-969f-5097894a7103 req-487adeae-d48d-4d93-8d73-08f38d5b24ed service nova] Creating event network-changed:8adc5a88-c2fa-4460-a689-528a2266b1a5 for instance 66476154-140d-461c-82e4-a9bf5200d6ba on nch1-master-1 Nov 20 21:01:14.474994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ea185220-21e1-4c1a-969f-5097894a7103 req-487adeae-d48d-4d93-8d73-08f38d5b24ed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174046 Nov 20 21:01:14.476141 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2182/4403] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:14.493664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:14.494707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:14.514547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:14.518390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:14.520489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:14.523517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:16.579374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:16.597110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:16.604103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:16.612953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-349561e3-cb62-4acb-bafc-a5237e3c65f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1743 microversion: 2.32 time: 2.132999 Nov 20 21:01:16.625472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2183/4404] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:14 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1743 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:16.625472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:16.625472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:16.643000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:16.643000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:16.643980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:16.644516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:16.695752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:16.698548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:16.699689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:16.700570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:16.701683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:16.725871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:16.729880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:16.731040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:16.734768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:16.781738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:16.805786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for user f53b3846df3841c3a16cd4142a5f4e98 and project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:16.834004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:16.836623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:16.994949 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df082e4e-956f-4576-a178-d4c78574bf55 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.439236 Nov 20 21:01:17.001046 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2222/4405] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:01:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 3445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:01:17.016052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:17.017894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:17.042754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:17.043840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:17.064508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:17.065394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:17.807851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:17.828414 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59927a82-1ebe-42fa-8b5c-51e55b9acd91 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 1.207728 Nov 20 21:01:17.833193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2184/4406] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:16 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:17.862607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:17.863445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:17.884586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:17.885373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:17.886444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:17.887117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.040292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:18.049208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d58e3a4d-7c14-4423-aeaa-9d21703d4dec tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1312 microversion: 2.1 time: 1.045790 Nov 20 21:01:18.055156 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2223/4407] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:17 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1312 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:18.071190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:18.072474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:18.088359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:18.094984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.096196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:18.097042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.721304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:18.729848 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-706594c8-5c80-43b3-99ce-453fd0e4c2d1 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.893813 Nov 20 21:01:18.742514 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2185/4408] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:17 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:18.753398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:18.759156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4411af37-ce23-40f7-9692-0adb538a615e req-015f0095-a9dc-45b0-bd50-87cc7d68e593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-plugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:18.761172 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0af12130-167f-4ecf-8398-2dab7b8dcd04 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1373 microversion: 2.1 time: 0.704648 Nov 20 21:01:18.765062 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:18.765062 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:18.776828 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2224/4409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:18 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1373 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:18.776828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-798034274", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "a8f2480b-fc80-4ebf-9635-3977528e4714"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:18.805185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4411af37-ce23-40f7-9692-0adb538a615e req-015f0095-a9dc-45b0-bd50-87cc7d68e593 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:18.806482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4411af37-ce23-40f7-9692-0adb538a615e req-015f0095-a9dc-45b0-bd50-87cc7d68e593 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.824422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4411af37-ce23-40f7-9692-0adb538a615e req-015f0095-a9dc-45b0-bd50-87cc7d68e593 service nova] Creating event network-vif-plugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:01:18.842584 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4411af37-ce23-40f7-9692-0adb538a615e req-015f0095-a9dc-45b0-bd50-87cc7d68e593 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096457 Nov 20 21:01:18.845220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2186/4410] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:18.854734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:18.855630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:18.867819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:18.868657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.869625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:18.870266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:18.934757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] validate_networks() for [('a8f2480b-fc80-4ebf-9635-3977528e4714', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:01:19.778569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:19.788633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:19.793961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:19.796072 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0869e847-3126-45dc-96db-f13bd89f7ac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1790 microversion: 2.32 time: 0.948767 Nov 20 21:01:19.797308 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2187/4411] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:18 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1790 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:19.801890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:19.802794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:19.835688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:19.840516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:19.844093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:19.846720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:20.860563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:20.861053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:20.861706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:20.862157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:20.862563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:20.900233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:20.901680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:20.904394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:20.908130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:20.952366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:20.962464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for user f53b3846df3841c3a16cd4142a5f4e98 and project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:20.987075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:20.990206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:21.081548 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-820a63fe-c532-4dc7-b839-ef7e8ed076c0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.309868 Nov 20 21:01:21.093719 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2225/4412] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:01:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:01:21.106656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:21.119445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:21.159993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:21.160887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:21.163556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:21.164206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:21.633572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:21.644331 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93246c53-5fff-47a9-9ced-53775f42b100 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.552552 Nov 20 21:01:21.657924 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2226/4413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:21 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:21.662254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:21.663321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:21.675412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:21.679070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:21.679923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:21.680370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:22.170627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:22.178555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98a3207a-6416-47fe-b616-32bf0a51d6e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 2.379973 Nov 20 21:01:22.194278 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2188/4414] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:19 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:22.199373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:22.204693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:22.217651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:22.218515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:22.219542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:22.224905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:22.596545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:22.610245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98fefdc6-93b8-4d05-b59b-9ce7fbc2e0f8 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.958872 Nov 20 21:01:22.610847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2227/4415] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:21 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:22.628170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:22.632465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:22.645170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:22.646433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:22.647417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:22.648025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:23.071546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:23.085700 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9958e4ee-4b7a-49b2-b83b-cead75f58e6c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1373 microversion: 2.1 time: 0.890095 Nov 20 21:01:23.090626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2189/4416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:22 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1373 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:23.116297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a3ce8c8f-3a6e-41d5-9197-8e77dd356968 req-ff0a64cd-a026-41eb-b100-96777d402515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66476154-140d-461c-82e4-a9bf5200d6ba", "name": "network-vif-plugged", "status": "completed", "tag": "8adc5a88-c2fa-4460-a689-528a2266b1a5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:23.121341 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:23.121341 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:23.140825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a3ce8c8f-3a6e-41d5-9197-8e77dd356968 req-ff0a64cd-a026-41eb-b100-96777d402515 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:23.141652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a3ce8c8f-3a6e-41d5-9197-8e77dd356968 req-ff0a64cd-a026-41eb-b100-96777d402515 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:23.167526 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a3ce8c8f-3a6e-41d5-9197-8e77dd356968 req-ff0a64cd-a026-41eb-b100-96777d402515 service nova] Creating event network-vif-plugged:8adc5a88-c2fa-4460-a689-528a2266b1a5 for instance 66476154-140d-461c-82e4-a9bf5200d6ba on nch1-master-1 Nov 20 21:01:23.190910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a3ce8c8f-3a6e-41d5-9197-8e77dd356968 req-ff0a64cd-a026-41eb-b100-96777d402515 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092584 Nov 20 21:01:23.191985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2190/4417] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:23.202310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-759128621", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "451", "networks": [{"uuid": "a8f2480b-fc80-4ebf-9635-3977528e4714"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:23.344295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] validate_networks() for [('a8f2480b-fc80-4ebf-9635-3977528e4714', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:01:23.512465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:23.531220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:23.533527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:23.543025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b425b4b-a750-4034-851f-2e2146c71c05 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1837 microversion: 2.32 time: 0.919004 Nov 20 21:01:23.543888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2228/4418] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:22 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1837 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:23.565042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:23.565786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:23.587557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:23.588015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:23.588831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:23.594498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:24.090134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:24.104697 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf457b50-3c10-425f-a2ee-786e2bbcd53c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.557025 Nov 20 21:01:24.117987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2229/4419] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:23 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:24.124209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:24.128703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:24.147582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:24.150683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:24.151744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:24.153128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:24.506912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:24.546666 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e27debf-d549-4975-9bc0-9721225aa3fb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 0.427184 Nov 20 21:01:24.547409 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2230/4420] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:24 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:24.567647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:24.569229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:24.589665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:24.590458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:24.592041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:24.592626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:26.019748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:26.039803 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04b8d966-9873-44ce-959e-860ad7cd0b34 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 1.487796 Nov 20 21:01:26.040701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2231/4421] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:24 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:26.053402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:26.058183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:26.075453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:26.080205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:26.084175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:26.085522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:26.843828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:26.844709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:26.845441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:26.846679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:26.847390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:26.873684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:26.876493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:26.880040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:26.882093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:26.953022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:26.968363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Getting quotas for user f53b3846df3841c3a16cd4142a5f4e98 and project 6a7b316a84eb425aabf378a838ec02b3. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:27.017967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:27.018455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:27.022862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:27.031240 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ddcd28b2-2ae0-4cf9-ae38-1a5928cd6b1e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1544 microversion: 2.1 time: 0.983792 Nov 20 21:01:27.031918 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2232/4422] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:26 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1544 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:27.036562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:27.037178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:27.069859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:27.073467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:27.074869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:27.078079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:27.121887 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8876e432-bed1-47fd-bdc2-4d08631b4792 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.928265 Nov 20 21:01:27.124217 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2191/4423] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:01:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 3931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:01:27.132774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b3711544-252e-4fa1-b75d-d7c36b5a40b6 req-5d65e01e-a2e1-48f5-95ee-1f19b733d304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "tag": "5c352741-4197-4cfc-b9f2-69018aa4115f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:27.135015 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:27.135015 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:27.151773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b3711544-252e-4fa1-b75d-d7c36b5a40b6 req-5d65e01e-a2e1-48f5-95ee-1f19b733d304 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:27.153539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b3711544-252e-4fa1-b75d-d7c36b5a40b6 req-5d65e01e-a2e1-48f5-95ee-1f19b733d304 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:27.171578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b3711544-252e-4fa1-b75d-d7c36b5a40b6 req-5d65e01e-a2e1-48f5-95ee-1f19b733d304 service nova] Creating event network-changed:5c352741-4197-4cfc-b9f2-69018aa4115f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:27.179137 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b3711544-252e-4fa1-b75d-d7c36b5a40b6 req-5d65e01e-a2e1-48f5-95ee-1f19b733d304 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053545 Nov 20 21:01:27.180256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2192/4424] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:27.199700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:27.203293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:27.219388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:27.220053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:27.221019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:27.222224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:27.937525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:27.957373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:27.964592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:27.977414 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-309a7df7-2c9d-42dd-8554-03e6bfc7766e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1837 microversion: 2.32 time: 0.943323 Nov 20 21:01:27.980451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2233/4425] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:27 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1837 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:27.994276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7cf9b7a9-7fed-4fc6-8d3e-3ba9a6e268f8 req-e3761938-11ee-4006-8add-2ec740a763e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008fe68-b64a-4bda-ab3c-42f2c26a1280", "name": "network-vif-plugged", "status": "completed", "tag": "af9fddac-288d-4af5-b181-dc99829991f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:28.001597 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:28.001597 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:28.025029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7cf9b7a9-7fed-4fc6-8d3e-3ba9a6e268f8 req-e3761938-11ee-4006-8add-2ec740a763e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:28.027880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7cf9b7a9-7fed-4fc6-8d3e-3ba9a6e268f8 req-e3761938-11ee-4006-8add-2ec740a763e3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:28.063013 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7cf9b7a9-7fed-4fc6-8d3e-3ba9a6e268f8 req-e3761938-11ee-4006-8add-2ec740a763e3 service nova] Creating event network-vif-plugged:af9fddac-288d-4af5-b181-dc99829991f3 for instance f008fe68-b64a-4bda-ab3c-42f2c26a1280 on nch1-master-1 Nov 20 21:01:28.079902 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7cf9b7a9-7fed-4fc6-8d3e-3ba9a6e268f8 req-e3761938-11ee-4006-8add-2ec740a763e3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093971 Nov 20 21:01:28.082139 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2234/4426] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:28.100068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:28.115643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:28.137736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:28.139094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:28.139927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:28.140357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:29.166810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:29.177973 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38b31fce-72f0-4816-aadf-7cefb6d1f03b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 1.092857 Nov 20 21:01:29.180389 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2235/4427] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:28 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:29.209478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:29.238437 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b98438dd-6299-435b-b6a0-8789b51f710d tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 2.050530 Nov 20 21:01:29.242098 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2193/4428] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:27 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:29.272426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:29.273048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:29.313514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:29.314013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:29.317575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:29.318042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:29.557692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9403615d-e388-473f-8136-068e5b6d01c5 req-934483a1-d427-4179-8003-f5d290491b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "5332c620-9136-495b-bd4d-92357990f3a2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:29.559852 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:29.559852 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:29.579410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9403615d-e388-473f-8136-068e5b6d01c5 req-934483a1-d427-4179-8003-f5d290491b0f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:29.579881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9403615d-e388-473f-8136-068e5b6d01c5 req-934483a1-d427-4179-8003-f5d290491b0f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:29.609788 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9403615d-e388-473f-8136-068e5b6d01c5 req-934483a1-d427-4179-8003-f5d290491b0f service nova] Creating event network-changed:5332c620-9136-495b-bd4d-92357990f3a2 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:29.633946 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9403615d-e388-473f-8136-068e5b6d01c5 req-934483a1-d427-4179-8003-f5d290491b0f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450569 Nov 20 21:01:29.654743 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2236/4429] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:29.674424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:29.681420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:29.698576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:29.698576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:29.699204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:29.699646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:30.533417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:30.552637 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1278a85a-d404-4708-bcc9-197acdf5d2b6 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1324 microversion: 2.1 time: 0.887863 Nov 20 21:01:30.554531 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2237/4430] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:29 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1324 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:30.567363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:30.568221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:30.596147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:30.599556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:30.602495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:30.604413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:30.851411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:30.865325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a42212e6-5eb9-4a7b-97e8-0f08b472e3c2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1544 microversion: 2.1 time: 1.609689 Nov 20 21:01:30.884125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2194/4431] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:29 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1544 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:30.893469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:30.897187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:30.914027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:30.915039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:30.917375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:30.919172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:31.395453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:31.408043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a1e70231-9cbd-4dd5-8030-f1a2155c1b0b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1278 microversion: 2.1 time: 0.850413 Nov 20 21:01:31.409688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2238/4432] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:30 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1278 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:31.420541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-100d7bd8-90ba-40fe-a6e6-52836ceb0995 req-c7983785-d9cf-4af4-aa41-c89f7e64dd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "tag": "d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:31.424567 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:31.424567 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:31.448621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-100d7bd8-90ba-40fe-a6e6-52836ceb0995 req-c7983785-d9cf-4af4-aa41-c89f7e64dd00 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:31.451707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-100d7bd8-90ba-40fe-a6e6-52836ceb0995 req-c7983785-d9cf-4af4-aa41-c89f7e64dd00 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:31.484068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-100d7bd8-90ba-40fe-a6e6-52836ceb0995 req-c7983785-d9cf-4af4-aa41-c89f7e64dd00 service nova] Creating event network-changed:d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:31.496731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-100d7bd8-90ba-40fe-a6e6-52836ceb0995 req-c7983785-d9cf-4af4-aa41-c89f7e64dd00 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082407 Nov 20 21:01:31.499468 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2239/4433] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:31.522069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:31.523297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:31.540133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:31.548083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:31.548964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:31.549411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.343192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:32.356366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3727ce7a-5bbb-4908-976a-8fe0886175be tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 0.853765 Nov 20 21:01:32.358955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2240/4434] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:31 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:32.365963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:32.371700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:32.385238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.386089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.387137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.388852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.422945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:32.433833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:32.439317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:32.443374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d9d4e2f-e468-4d68-b49e-c1111dd32c6b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1858 microversion: 2.32 time: 1.557652 Nov 20 21:01:32.457113 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2195/4435] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:30 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1858 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:32.467394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:32.470573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:32.500666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.501579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.502819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.503848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.863347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:32.871099 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a930926-c56e-42f5-995f-0e5e4dead6b7 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.508630 Nov 20 21:01:32.871695 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2241/4436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:32 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:32.888707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "bd4e7a14-7d21-4548-8472-ba80748bb825"}, {"name": "network-changed", "server_uuid": "8fc25086-0d43-4e57-88e4-74951ec706cb", "tag": "30ac0211-8c85-4946-8044-a3d499132c3b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:32.890789 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:32.890789 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:32.899917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.900703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.917930 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] Creating event network-changed:bd4e7a14-7d21-4548-8472-ba80748bb825 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:32.918977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] Creating event network-changed:30ac0211-8c85-4946-8044-a3d499132c3b for instance 8fc25086-0d43-4e57-88e4-74951ec706cb on nch1-master-1 Nov 20 21:01:32.956341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0f42148b-d241-45b3-b7d0-72b616b6ed6d req-c0b8061e-8284-4636-b4b6-17dbe940cfcc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.070983 Nov 20 21:01:32.957701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2242/4437] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:32 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:32.970137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:32.971388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:32.978551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.980217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:32.981559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:32.982965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:33.188271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:33.215091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dc7048b3-ebd1-4393-88be-115c96161d5b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1278 microversion: 2.1 time: 0.254375 Nov 20 21:01:33.215998 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2243/4438] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:32 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:33.379735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:33.380395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:33.396325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:33.396788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:33.399660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:33.400674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:33.449010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:33.461762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f85ba2f7-741d-4e69-a6e8-f2f66a90ed55 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1520 microversion: 2.1 time: 0.998609 Nov 20 21:01:33.474551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2196/4439] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:32 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1520 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:33.480213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:33.481050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:33.488172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:33.488933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:33.490017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:33.490844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.057594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:34.071745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b935da9b-d6dd-4f57-b793-ce36f1be4d34 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 0.699899 Nov 20 21:01:34.072585 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2244/4440] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:33 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:34.093861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:34.095998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:34.104176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.106346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.107751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.109316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.150124 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] HTTP exception thrown: Instance is not a member of specified network Nov 20 21:01:34.151055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:01:34.152111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f55ef8f-18e3-4b13-a58e-780fe32f4344 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.062753 Nov 20 21:01:34.152877 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2245/4441] 10.222.0.41 () {58 vars in 1271 bytes} [Sat Nov 20 21:01:34 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280/ips/invalid => generated 91 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:01:34.167567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:34.169587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:34.177582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.180657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.182437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.183653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.649869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:34.662561 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d408991-bc39-4cda-8fbd-98728d0bdfc8 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.499680 Nov 20 21:01:34.666639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2246/4442] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:34 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:34.680387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ac9e4aa-4939-4420-9bf7-57c20263bc0a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:34.681223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ac9e4aa-4939-4420-9bf7-57c20263bc0a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Failed to fetch instance by id 999 {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 21:01:34.682014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6ac9e4aa-4939-4420-9bf7-57c20263bc0a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] HTTP exception thrown: Instance 999 could not be found. Nov 20 21:01:34.682863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ac9e4aa-4939-4420-9bf7-57c20263bc0a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:01:34.683936 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ac9e4aa-4939-4420-9bf7-57c20263bc0a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015900 Nov 20 21:01:34.684687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2247/4443] 10.222.0.41 () {58 vars in 1148 bytes} [Sat Nov 20 21:01:34 2021] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:01:34.696301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:34.697232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:34.711826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.712987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:34.714316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:34.715490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.045349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:35.057147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0c60bac-b2cc-4f1a-9bd7-4743f613f803 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.366151 Nov 20 21:01:35.058582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2248/4444] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:34 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:35.065523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:35.066267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:35.073886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.074579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.076960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.078779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.139719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:01:35.302427 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3eb82e9-1f35-42c0-9578-bd26f325c49a tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 204 len: 0 microversion: 2.1 time: 0.240591 Nov 20 21:01:35.303390 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2249/4445] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:01:35 2021] DELETE /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:01:35.377755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:35.403408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:35.411098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:35.418740 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47d39686-1c8f-4e5c-981b-d7db54a0108b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.942451 Nov 20 21:01:35.421966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2197/4446] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:33 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:35.432386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a49f505e-a0ea-43ac-af72-64b0b779021c req-4dd344fe-5645-4ea7-bb4b-31485e62dd1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7f9f50-4ba7-462b-8d2d-4b514ccd3301", "tag": "a63523ab-4285-469f-b0a4-206673b76fcc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:35.436421 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:35.436421 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:35.459082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a49f505e-a0ea-43ac-af72-64b0b779021c req-4dd344fe-5645-4ea7-bb4b-31485e62dd1c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.461926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a49f505e-a0ea-43ac-af72-64b0b779021c req-4dd344fe-5645-4ea7-bb4b-31485e62dd1c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.497227 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a49f505e-a0ea-43ac-af72-64b0b779021c req-4dd344fe-5645-4ea7-bb4b-31485e62dd1c service nova] Creating event network-changed:a63523ab-4285-469f-b0a4-206673b76fcc for instance 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 on nch2-master-1 Nov 20 21:01:35.510716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a49f505e-a0ea-43ac-af72-64b0b779021c req-4dd344fe-5645-4ea7-bb4b-31485e62dd1c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082774 Nov 20 21:01:35.511800 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2198/4447] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:35.522428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:35.523207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:35.550234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.550697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.559429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.559984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.760272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Calling method '.version_select at 0x7f3f87716940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:35.761433 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:35.761433 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:35.764717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.765514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.802918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.803478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.830204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.831677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.846894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-462fe950-057c-4eee-923c-43c1078cd9a5 tempest-PortsAdminExtendedAttrsTestJSON-375488371 tempest-PortsAdminExtendedAttrsTestJSON-375488371-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.542128 Nov 20 21:01:35.851997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2250/4448] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:01:35 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:35.861669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:35.862733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:35.884452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.885175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:35.886155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:35.886667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.145042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:36.165073 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0aa93cac-e9d4-484b-9d9e-c13d775f73a3 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1526 microversion: 2.1 time: 0.311795 Nov 20 21:01:36.167840 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2251/4449] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:35 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1526 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:36.176239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:36.176850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:36.207080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.207080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.207080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.207080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.543080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:36.550953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e8f36c4-d29d-4ad2-b5e0-52db9cf96d99 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 1.037926 Nov 20 21:01:36.559393 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2199/4450] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:35 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:36.576475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:36.577369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:36.594347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.595219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.596180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.596773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.904376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:36.913347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cfb93df-3ebe-42d3-bd18-d8d53a3b5785 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.744213 Nov 20 21:01:36.916648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2252/4451] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:36 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:36.931018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:36.940387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:36.946927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.947558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:36.948538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:36.949141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:37.780788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:37.796011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:37.799176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:37.800617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7ec4519-371f-4c64-a88f-6f0b41e241ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.881875 Nov 20 21:01:37.801684 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2253/4452] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:36 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:37.806464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:37.807931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:37.819398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:37.820167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:37.821205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:37.821856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.274155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:38.291950 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8db722f9-9526-4971-be22-5d7c00ea572b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1526 microversion: 2.1 time: 0.488456 Nov 20 21:01:38.294017 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2254/4453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:37 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1526 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:38.301302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:38.309142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:38.321047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.322606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.325250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.328613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.738493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:38.754009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:38.767919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-31262065-0dbc-4127-be58-72e09f3f910d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 2.206434 Nov 20 21:01:38.768508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2200/4454] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:36 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:38.770957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e99b800-0b3a-4189-8327-0de1bda50bf1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1681 microversion: 2.1 time: 0.475070 Nov 20 21:01:38.783341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:38.784552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2255/4455] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:38 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1681 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:38.789610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-85d5a73f-4c80-461c-9dec-157db6d9e588 req-33ddcf7d-ad77-45bd-a74f-1a047498f79d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "17593c85-2aba-4b07-b484-60c0a0677ba6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:38.790561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:38.795623 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:38.795623 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:38.816606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-85d5a73f-4c80-461c-9dec-157db6d9e588 req-33ddcf7d-ad77-45bd-a74f-1a047498f79d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.817054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-85d5a73f-4c80-461c-9dec-157db6d9e588 req-33ddcf7d-ad77-45bd-a74f-1a047498f79d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.817711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.818937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.822223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.823354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.862040 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-85d5a73f-4c80-461c-9dec-157db6d9e588 req-33ddcf7d-ad77-45bd-a74f-1a047498f79d service nova] Creating event network-changed:17593c85-2aba-4b07-b484-60c0a0677ba6 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:38.875067 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-85d5a73f-4c80-461c-9dec-157db6d9e588 req-33ddcf7d-ad77-45bd-a74f-1a047498f79d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088788 Nov 20 21:01:38.877696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2256/4456] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:38.917533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:38.918340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:38.932893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.933342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:38.934171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:38.937895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:39.463421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:39.475091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:39.491495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:39.496370 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e361c7f9-9063-45f2-a6ce-69c83ab71f21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.613118 Nov 20 21:01:39.497228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2257/4457] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:38 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:39.642225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3a8ce0ae-f64f-42cc-8a00-732ca90b6bda req-a69168a5-8612-4f4d-bab3-e41a303b2d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "name": "network-vif-plugged", "status": "completed", "tag": "d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:39.645085 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:39.645085 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:39.662653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a8ce0ae-f64f-42cc-8a00-732ca90b6bda req-a69168a5-8612-4f4d-bab3-e41a303b2d49 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:39.663227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a8ce0ae-f64f-42cc-8a00-732ca90b6bda req-a69168a5-8612-4f4d-bab3-e41a303b2d49 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:39.686572 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3a8ce0ae-f64f-42cc-8a00-732ca90b6bda req-a69168a5-8612-4f4d-bab3-e41a303b2d49 service nova] Creating event network-vif-plugged:d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:39.701237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3a8ce0ae-f64f-42cc-8a00-732ca90b6bda req-a69168a5-8612-4f4d-bab3-e41a303b2d49 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199355 Nov 20 21:01:39.702073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2258/4458] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:39.712184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:39.722380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:39.728615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:39.729080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:39.729877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:39.730341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.090875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:40.101005 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ccb4707-ad16-40f4-a182-1bf91c73f96b tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1526 microversion: 2.1 time: 0.396790 Nov 20 21:01:40.101632 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2259/4459] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:39 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1526 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:40.107894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:40.108684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:40.116056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.116718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.117510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.117942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.282939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:40.290364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4960484-0b9d-46c3-a6d2-3893971e0945 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.187541 Nov 20 21:01:40.292578 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2260/4460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:40 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:40.297509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:40.298357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:40.305090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.305772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.306786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.307382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.317144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:40.327245 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25f9c89d-048b-4ad6-9622-642f48eff90c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 1.545231 Nov 20 21:01:40.328206 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2201/4461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:38 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:40.527071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:40.527917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:40.538780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.539469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.541514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.542269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.664142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:40.677037 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0adfdb41-f7f3-46c7-82ff-80213ca25527 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.383128 Nov 20 21:01:40.692899 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2261/4462] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:40 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:40.755835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:40.756754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:40.763058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.764178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.765244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:40.765762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:40.917604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:40.927457 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d135226a-3196-4718-a08a-396874ab8847 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.175126 Nov 20 21:01:40.928470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2262/4463] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:40 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:41.118890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:41.120391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:41.129438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.130109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.131082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.131688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.371892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9f5c2f5f93431ea9519e86fe85ec15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c36aae4eacda4f76ac551fe613c502f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:41.380312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb94f24e-72b1-4a3a-9511-20e5e3b19c68 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 200 len: 1526 microversion: 2.1 time: 0.266259 Nov 20 21:01:41.384227 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2263/4464] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:41 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:41.400892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:41.402940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:41.414795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.421377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.427644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.428862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.781540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:41.782382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:41.799685 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91f85161-19e7-4220-9ac4-72ffd4c5f25e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.403405 Nov 20 21:01:41.805708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:41.812398 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2264/4465] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:41 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:41.820362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:41.823365 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b23cce53-84af-4f94-a972-b2fac228491c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.311061 Nov 20 21:01:41.826331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:41.827523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:41.830011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2202/4466] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:40 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:01:41.845116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc25086-0d43-4e57-88e4-74951ec706cb", "name": "network-vif-plugged", "status": "completed", "tag": "30ac0211-8c85-4946-8044-a3d499132c3b"}, {"server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "name": "network-vif-plugged", "status": "completed", "tag": "5c352741-4197-4cfc-b9f2-69018aa4115f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:41.853139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.858120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.859470 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:41.859470 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:41.860476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.862863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.878861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:41.882974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:41.921178 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] Creating event network-vif-plugged:30ac0211-8c85-4946-8044-a3d499132c3b for instance 8fc25086-0d43-4e57-88e4-74951ec706cb on nch1-master-1 Nov 20 21:01:41.924573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] Creating event network-vif-plugged:5c352741-4197-4cfc-b9f2-69018aa4115f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:41.949246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c38c6359-16fa-48c6-8411-3dc3a49dc3ff req-9ef72f98-f6d1-4612-9798-7816d17b4c80 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113758 Nov 20 21:01:41.954229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2203/4467] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:41 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:42.117127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f008fe68-b64a-4bda-ab3c-42f2c26a1280", "name": "network-vif-deleted", "tag": "af9fddac-288d-4af5-b181-dc99829991f3"}, {"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "144b0c11-f5e6-471f-8963-411ff27f7777"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:42.119527 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:42.119527 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:42.144234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.145595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.180925 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] Creating event network-vif-deleted:af9fddac-288d-4af5-b181-dc99829991f3 for instance f008fe68-b64a-4bda-ab3c-42f2c26a1280 on nch1-master-1 Nov 20 21:01:42.182847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] Creating event network-changed:144b0c11-f5e6-471f-8963-411ff27f7777 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:42.210530 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-dd1d57ef-d38a-4054-8ca1-dcfa1aa9e3fc req-e7f9c169-fbcc-42ed-b3a4-3b7c68be3e8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.097409 Nov 20 21:01:42.212807 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2204/4468] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:42 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:42.281176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:42.282024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:42.296935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.297859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.305235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.306128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.837358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:42.861066 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5bc5d77-0fef-4125-9ffb-b9d6cb451ff1 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 1.046813 Nov 20 21:01:42.863773 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2265/4469] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:41 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:42.871372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:42.872724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] [instance: f008fe68-b64a-4bda-ab3c-42f2c26a1280] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:42.880280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.881114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.882265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.883081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.939756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:42.941453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] HTTP exception thrown: Instance f008fe68-b64a-4bda-ab3c-42f2c26a1280 could not be found. Nov 20 21:01:42.942607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] Returning 404 to user: Instance f008fe68-b64a-4bda-ab3c-42f2c26a1280 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:01:42.945195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-901c4254-8544-4518-b74f-6794072c75f2 tempest-ServerAddressesNegativeTestJSON-1643572577 tempest-ServerAddressesNegativeTestJSON-1643572577-project] 10.222.0.41 "GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280" status: 404 len: 111 microversion: 2.1 time: 0.079280 Nov 20 21:01:42.952879 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d90321ae-9fe5-4502-a24b-e24173afdc0d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.677338 Nov 20 21:01:42.953644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2266/4470] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:42 2021] GET /compute/v2.1/servers/f008fe68-b64a-4bda-ab3c-42f2c26a1280 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:01:42.963926 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2205/4471] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:42 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:42.976127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:42.976233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:42.976233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:42.976422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:42.982508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.983090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.985993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.986562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.991283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.991753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:42.992782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:42.993233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.411537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:43.421792 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-148ca6b2-7894-4254-9c73-7ce3545b3d83 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.466786 Nov 20 21:01:43.431913 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2267/4472] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:42 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:43.440024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:43.441260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:43.457524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.458546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.459381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.459998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.557280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ae26e71-e780-416c-b1aa-d60e31d9a7dc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.119152 Nov 20 21:01:43.564257 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2268/4473] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:01:43 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:01:43.570912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:43.572258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:43.580849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.581323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.582354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.582813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.955177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:43.970510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d0be4be-2ab5-4706-9201-8f29f697f4cc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1670 microversion: 2.1 time: 0.404831 Nov 20 21:01:43.971798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2269/4474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:43 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1670 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:43.980607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:43.984151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:43.992056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.992816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:43.994087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:43.994794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:44.214636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:44.231169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:44.234143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:44.236243 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d669ebf-db47-4d05-9694-59ba50b21d5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.271039 Nov 20 21:01:44.267722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2206/4475] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:42 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:44.280033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8e33d41a-1690-4ed1-80f2-de07a530d19f req-e03c1bb0-0bdf-417a-86bd-0b6da38f4585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-unplugged", "status": "completed", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:44.285263 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:44.285263 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:44.298812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8e33d41a-1690-4ed1-80f2-de07a530d19f req-e03c1bb0-0bdf-417a-86bd-0b6da38f4585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:44.299838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8e33d41a-1690-4ed1-80f2-de07a530d19f req-e03c1bb0-0bdf-417a-86bd-0b6da38f4585 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:44.333633 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8e33d41a-1690-4ed1-80f2-de07a530d19f req-e03c1bb0-0bdf-417a-86bd-0b6da38f4585 service nova] Creating event network-vif-unplugged:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:01:44.343298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8e33d41a-1690-4ed1-80f2-de07a530d19f req-e03c1bb0-0bdf-417a-86bd-0b6da38f4585 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072758 Nov 20 21:01:44.346537 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2207/4476] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:44.359526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2b007ed8-545f-496f-9b56-9c802d6ef7df req-c2c5d9c4-07f8-4260-9f61-f15e9e7c405b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc5c22e-5a81-482a-898e-703e259cb1a5", "tag": "d9b0e2d6-668a-46d9-91dd-0b40e6525d46"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:44.362626 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:44.362626 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:44.379279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2b007ed8-545f-496f-9b56-9c802d6ef7df req-c2c5d9c4-07f8-4260-9f61-f15e9e7c405b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:44.382446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2b007ed8-545f-496f-9b56-9c802d6ef7df req-c2c5d9c4-07f8-4260-9f61-f15e9e7c405b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:44.399183 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2b007ed8-545f-496f-9b56-9c802d6ef7df req-c2c5d9c4-07f8-4260-9f61-f15e9e7c405b service nova] Creating event network-changed:d9b0e2d6-668a-46d9-91dd-0b40e6525d46 for instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 on nch1-master-1 Nov 20 21:01:44.407907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2b007ed8-545f-496f-9b56-9c802d6ef7df req-c2c5d9c4-07f8-4260-9f61-f15e9e7c405b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057455 Nov 20 21:01:44.408915 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2208/4477] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:44.425663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:44.439029 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce858e5a-9520-4202-b9f0-f93c1802c87a tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1333 microversion: 2.1 time: 0.463144 Nov 20 21:01:44.442293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:44.442719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:44.443223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2270/4478] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:43 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1333 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:44.457625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:44.459474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:44.461828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:44.462560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:44.988728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:44.989909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:44.997008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:44.999174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:45.000281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:45.000984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:45.140838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:45.154872 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26a9106f-37c8-4c91-ab4b-0f80f5359835 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.718633 Nov 20 21:01:45.166830 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2209/4479] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:44 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:45.260395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:45.262479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:45.272151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:45.273138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:45.275013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:45.275754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:45.391612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:45.409516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85fdcc86-22b6-415c-bd88-edbad12a2136 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1670 microversion: 2.1 time: 0.424383 Nov 20 21:01:45.420106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2271/4480] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1670 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:45.456792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:45.457334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:45.464954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:45.465129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:45.482562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:45.485747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.002516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:46.020222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:46.024293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:46.025850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:46.027847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02aabf98-59ac-4855-9d32-e18f41f66b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.774073 Nov 20 21:01:46.029304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2210/4481] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:45 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:46.036101 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-caf67033-0ee0-4108-8559-03386cb9bfde tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1668 microversion: 2.1 time: 0.579891 Nov 20 21:01:46.054761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:46.055564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:46.058191 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2272/4482] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:45 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1668 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:46.068765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.069529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.070672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.071562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.121161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d18c7547-a2ca-40f7-9d4c-01e682c8ca2c tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816/ips" status: 200 len: 179 microversion: 2.1 time: 0.071499 Nov 20 21:01:46.121756 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2211/4483] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:01:46 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816/ips => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:01:46.132802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:46.133341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:46.140439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.141174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.142235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.142834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.171714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:01:46.172074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:46.172692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:46.181171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.181627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.182462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.182905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.278073 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54acb7f9-5278-4c07-920c-440829647093 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 204 len: 0 microversion: 2.1 time: 0.148529 Nov 20 21:01:46.290878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2273/4484] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:01:46 2021] DELETE /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:01:46.299895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:46.300888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:46.312631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.313234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.316381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.316947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.623968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:46.633059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf12d807-0f9d-4b1c-a9b7-4956ad939e81 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1674 microversion: 2.1 time: 0.337435 Nov 20 21:01:46.633665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2274/4485] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:46 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1674 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:46.642204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b3a65b17-d218-451f-8903-a59177116e6e req-3703d942-e89f-4d28-9845-6ce4caa4d653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7f9f50-4ba7-462b-8d2d-4b514ccd3301", "name": "network-vif-plugged", "status": "completed", "tag": "a63523ab-4285-469f-b0a4-206673b76fcc"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:46.643780 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:46.643780 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:46.670616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b3a65b17-d218-451f-8903-a59177116e6e req-3703d942-e89f-4d28-9845-6ce4caa4d653 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.671057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b3a65b17-d218-451f-8903-a59177116e6e req-3703d942-e89f-4d28-9845-6ce4caa4d653 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.694949 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b3a65b17-d218-451f-8903-a59177116e6e req-3703d942-e89f-4d28-9845-6ce4caa4d653 service nova] Creating event network-vif-plugged:a63523ab-4285-469f-b0a4-206673b76fcc for instance 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 on nch2-master-1 Nov 20 21:01:46.702290 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b3a65b17-d218-451f-8903-a59177116e6e req-3703d942-e89f-4d28-9845-6ce4caa4d653 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065636 Nov 20 21:01:46.703276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2275/4486] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:46.715653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:46.720179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:46.735485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.737006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:46.740340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:46.741901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.027067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:47.036851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e919dd15-a89d-405e-af90-22c10e5b25a6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.868700 Nov 20 21:01:47.049729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2212/4487] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:46 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:47.049729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "a1c1d818-4c07-4d09-b360-b1acc5a224b8"}, {"name": "network-changed", "server_uuid": "66476154-140d-461c-82e4-a9bf5200d6ba", "tag": "8adc5a88-c2fa-4460-a689-528a2266b1a5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:47.049729 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:47.049729 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:47.068061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.068510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.089705 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] Creating event network-changed:a1c1d818-4c07-4d09-b360-b1acc5a224b8 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:47.098476 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] Creating event network-changed:8adc5a88-c2fa-4460-a689-528a2266b1a5 for instance 66476154-140d-461c-82e4-a9bf5200d6ba on nch1-master-1 Nov 20 21:01:47.115491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-092d7b7c-ce56-41f1-8335-a12e33f0da81 req-f16cef13-1709-44f2-b853-ae0d1354fbf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072664 Nov 20 21:01:47.116488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2213/4488] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:47 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:47.121329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:47.122029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:47.136759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.139420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.140380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.140834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.793418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:47.801525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72bd10b2-96e1-404d-bb3f-33538061c0b6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 1.096613 Nov 20 21:01:47.804182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2276/4489] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:46 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:47.811070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:47.812388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:47.833026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.834166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.836696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.837588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.948658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:47.959382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:47.961407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:47.962827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01c7fc3d-1571-49ff-83c2-de0219f17ae8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.845257 Nov 20 21:01:47.975794 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2214/4490] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:47 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:47.981793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:47.983083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:47.990804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.991500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:47.992540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:47.993202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.076539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1abea55b-5716-4e7e-bd42-59e4bdf9806c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 322 microversion: 2.1 time: 0.098311 Nov 20 21:01:48.077205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2215/4491] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:01:47 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:48.082398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:48.089355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:48.098132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.105793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.106851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.107367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.437325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:48.446394 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6ac4e57-c435-4d00-a100-99bbe722626f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1674 microversion: 2.1 time: 0.640728 Nov 20 21:01:48.449492 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2277/4492] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:47 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1674 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:48.456893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:48.460674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:48.476054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.476640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.478801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.479446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.738580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:48.750590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a32abad-6234-41db-bd4d-ffb86ade46dd tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.672052 Nov 20 21:01:48.751195 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2216/4493] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:48 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:48.984258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:48.985230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:48.996097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.996955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:48.998227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:48.998905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:49.047778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:49.060584 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40e2e4f5-e36b-448f-9b57-c30219c79d89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.608998 Nov 20 21:01:49.061265 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2278/4494] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:48 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:49.081462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:49.083185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:49.090217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:49.091369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:49.092262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:49.092766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:49.433016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:49.446629 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36774e7e-8b38-4da1-952b-bd8187250c41 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.369447 Nov 20 21:01:49.447392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2279/4495] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:49 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:49.473145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8863ccf4-d09b-481f-99ef-5b4b27b0cce3 req-5cfd385d-f4dd-4a6a-b6bf-473df4c9d8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "fafe012b-fc11-4ebf-90fb-e3698bda3e63"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:49.475529 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:49.475529 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:49.485386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8863ccf4-d09b-481f-99ef-5b4b27b0cce3 req-5cfd385d-f4dd-4a6a-b6bf-473df4c9d8c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:49.486306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8863ccf4-d09b-481f-99ef-5b4b27b0cce3 req-5cfd385d-f4dd-4a6a-b6bf-473df4c9d8c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:49.519310 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8863ccf4-d09b-481f-99ef-5b4b27b0cce3 req-5cfd385d-f4dd-4a6a-b6bf-473df4c9d8c5 service nova] Creating event network-changed:fafe012b-fc11-4ebf-90fb-e3698bda3e63 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:49.532086 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8863ccf4-d09b-481f-99ef-5b4b27b0cce3 req-5cfd385d-f4dd-4a6a-b6bf-473df4c9d8c5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063805 Nov 20 21:01:49.533483 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2280/4496] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:49.545850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:49.546751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:49.565412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:49.567501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:49.568528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:49.570230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:50.194656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:50.202135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:50.210258 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0492a52a-5d7e-4a0d-ba8c-fb5f71b6a25e tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1653 microversion: 2.1 time: 0.675165 Nov 20 21:01:50.210859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2281/4497] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:49 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1653 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:50.220671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:50.223123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:50.224949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3ae4bd4-4bc5-40e9-b7b7-fb9aa5f73985 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.245281 Nov 20 21:01:50.225765 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2217/4498] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:48 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:50.235496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:50.236571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:50.241517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1947484298", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "bafdbd34-4234-401f-abb5-0b7b5a2562ab"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:50.249342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:50.250526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:50.252684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:50.253658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:50.343044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] validate_networks() for [('bafdbd34-4234-401f-abb5-0b7b5a2562ab', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:01:50.810206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:50.824465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-efee0bc7-6fa5-4a6b-a88b-7e48f593933b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.597304 Nov 20 21:01:50.828025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2218/4499] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:50 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:51.031624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-85fdeb03-a329-4f12-9233-04e84a89ab87 req-21d67387-b75e-4776-8ac3-e3d3f14639ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "name": "network-vif-deleted", "tag": "5c352741-4197-4cfc-b9f2-69018aa4115f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:51.033714 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:51.033714 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:51.044453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-85fdeb03-a329-4f12-9233-04e84a89ab87 req-21d67387-b75e-4776-8ac3-e3d3f14639ba service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.044953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-85fdeb03-a329-4f12-9233-04e84a89ab87 req-21d67387-b75e-4776-8ac3-e3d3f14639ba service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.072217 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-85fdeb03-a329-4f12-9233-04e84a89ab87 req-21d67387-b75e-4776-8ac3-e3d3f14639ba service nova] Creating event network-vif-deleted:5c352741-4197-4cfc-b9f2-69018aa4115f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:51.079207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-85fdeb03-a329-4f12-9233-04e84a89ab87 req-21d67387-b75e-4776-8ac3-e3d3f14639ba service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249543 Nov 20 21:01:51.080094 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2219/4500] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:51.098760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-032e17a4-bf17-4e48-994c-2bbe00e4403f req-c132a0f5-7296-4eb7-a5b4-0eb0a1b4e95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc5c22e-5a81-482a-898e-703e259cb1a5", "name": "network-vif-plugged", "status": "completed", "tag": "d9b0e2d6-668a-46d9-91dd-0b40e6525d46"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:51.103509 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:51.103509 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:51.124836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-032e17a4-bf17-4e48-994c-2bbe00e4403f req-c132a0f5-7296-4eb7-a5b4-0eb0a1b4e95f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.125773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-032e17a4-bf17-4e48-994c-2bbe00e4403f req-c132a0f5-7296-4eb7-a5b4-0eb0a1b4e95f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.138999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-032e17a4-bf17-4e48-994c-2bbe00e4403f req-c132a0f5-7296-4eb7-a5b4-0eb0a1b4e95f service nova] Creating event network-vif-plugged:d9b0e2d6-668a-46d9-91dd-0b40e6525d46 for instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 on nch1-master-1 Nov 20 21:01:51.144817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-032e17a4-bf17-4e48-994c-2bbe00e4403f req-c132a0f5-7296-4eb7-a5b4-0eb0a1b4e95f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063132 Nov 20 21:01:51.145469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2220/4501] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:51.159758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:51.165735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:51.185740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.186589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.187608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.188249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.246210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7bb8eaad-7f1f-417f-970f-b85068fcc11c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba/action" status: 200 len: 24561 microversion: 2.1 time: 0.098379 Nov 20 21:01:51.248249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2221/4502] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:01:51 2021] POST /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba/action => generated 24561 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:01:51.256457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:51.257371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:51.266078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.267242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.275068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.275565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.787974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1afe99ea084fea8a86d7d6a8a6057b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec4545fe17f4700bc073f25016da683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:51.835006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9cbb83e0-fb17-4d3c-a5a5-7f711d862c39 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 200 len: 1495 microversion: 2.1 time: 0.584880 Nov 20 21:01:51.850626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2222/4503] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:51 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 1495 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:51.863945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:51.865014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:51.873628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.874441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:51.878665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:51.880042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.209999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:01:52.212822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:01:52.213771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:01:52.215082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:01:52.217296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:01:52.233404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.234318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.237026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.241120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.288512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:01:52.296595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:01:52.317341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:01:52.321556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:01:52.395154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:52.413000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3db5ea45-0d79-497b-a20b-69d5c74e5c1d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.174616 Nov 20 21:01:52.422845 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2282/4504] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:01:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:01:52.429731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:52.431159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f92faa1c-ca12-402b-a0a9-0751082a5123 req-067e03fc-540b-4546-85c7-50b03a0dd9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "1d8adb08-4bb0-45be-8e71-4a53fb65eb7e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:52.436827 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:52.436827 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:52.447269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f92faa1c-ca12-402b-a0a9-0751082a5123 req-067e03fc-540b-4546-85c7-50b03a0dd9aa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.447913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f92faa1c-ca12-402b-a0a9-0751082a5123 req-067e03fc-540b-4546-85c7-50b03a0dd9aa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.452600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:52.454723 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5478dd02-5381-4e07-897a-acc6bc03e58b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.601344 Nov 20 21:01:52.455667 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2223/4505] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:51 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:52.478582 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f92faa1c-ca12-402b-a0a9-0751082a5123 req-067e03fc-540b-4546-85c7-50b03a0dd9aa service nova] Creating event network-changed:1d8adb08-4bb0-45be-8e71-4a53fb65eb7e for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:01:52.479299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:52.480742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:52.491476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.492840 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f92faa1c-ca12-402b-a0a9-0751082a5123 req-067e03fc-540b-4546-85c7-50b03a0dd9aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067980 Nov 20 21:01:52.493478 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2283/4506] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:01:52.496121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.502374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.502872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.510516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc2df2ae-c6f8-4afb-bc2e-1a00f98c07e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:52.511322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc2df2ae-c6f8-4afb-bc2e-1a00f98c07e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:52.751561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fc2df2ae-c6f8-4afb-bc2e-1a00f98c07e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:52.795451 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc2df2ae-c6f8-4afb-bc2e-1a00f98c07e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1215 microversion: 2.1 time: 0.291678 Nov 20 21:01:52.810439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2284/4507] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:52 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:52.857375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:52.858360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:52.877874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.878362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.881674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:52.883523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:52.908528 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. Nov 20 21:01:52.909135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:01:52.911652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65137e2e-617d-46db-b43e-af976df49c05 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 404 len: 111 microversion: 2.1 time: 0.059133 Nov 20 21:01:52.912930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2285/4508] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:52 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:01:53.258348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3a882dd4-d787-471d-9242-0ce229180567 req-14dcee05-4c8b-4f8c-b0d4-2da0e79f88ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e82b2a4-a302-441d-9b65-9c0ad1288816", "name": "network-vif-deleted", "tag": "d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:01:53.260001 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:53.260001 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:53.268912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a882dd4-d787-471d-9242-0ce229180567 req-14dcee05-4c8b-4f8c-b0d4-2da0e79f88ad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:53.269697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3a882dd4-d787-471d-9242-0ce229180567 req-14dcee05-4c8b-4f8c-b0d4-2da0e79f88ad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:53.284068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3a882dd4-d787-471d-9242-0ce229180567 req-14dcee05-4c8b-4f8c-b0d4-2da0e79f88ad service nova] Creating event network-vif-deleted:d71fdd45-59d2-4a17-ad5b-f5bce4b5d47f for instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 on nch2-master-1 Nov 20 21:01:53.289450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3a882dd4-d787-471d-9242-0ce229180567 req-14dcee05-4c8b-4f8c-b0d4-2da0e79f88ad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034815 Nov 20 21:01:53.294455 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2286/4509] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:01:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:01:53.391129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:53.400423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08a663eb-32bf-4cd8-867a-4ab282becfcc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1320 microversion: 2.1 time: 0.943536 Nov 20 21:01:53.401124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2224/4510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:52 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1320 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:53.474488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:53.475100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:53.486889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:53.488107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:53.489770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:53.490318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:53.813979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:53.815079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:53.825947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:53.826663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:53.827855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:53.828546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:54.005480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:54.014812 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3387ef09-0c5e-4ced-a0ea-dfd59e163759 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1275 microversion: 2.1 time: 0.206312 Nov 20 21:01:54.015671 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2225/4511] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:53 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:54.187114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:54.198888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:54.202122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:54.204801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60faaf99-dfa7-4198-ac32-f4ddcb9b2846 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.733385 Nov 20 21:01:54.206395 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2287/4512] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:53 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:54.417992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:54.420084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:54.431791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:54.432933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:54.434863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:54.435557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.039353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:55.042487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:55.044128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:55.064337 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75102537-1018-4cd6-ab52-42435cde9a71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1510 microversion: 2.1 time: 0.650099 Nov 20 21:01:55.069674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2226/4513] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:54 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1510 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:55.070816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.071577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.072777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.073291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.087008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:55.088870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:55.096150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.097828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.098854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.099486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.193920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:55.205978 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17810764-3077-49a7-ad12-67e7648bfb78 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1273 microversion: 2.1 time: 0.177115 Nov 20 21:01:55.208193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2288/4514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:55 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:55.243837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:55.245685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:55.257450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.258809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.260164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:55.260761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:55.929134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:55.941020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:55.943703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:55.947069 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-330a1ad7-42ca-4147-840f-93199863c944 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.714799 Nov 20 21:01:55.948533 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2289/4515] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:55 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:56.157742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:56.167626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4980feac-39f8-4b79-bbc8-a965f7513218 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1510 microversion: 2.1 time: 1.085222 Nov 20 21:01:56.168753 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2227/4516] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:55 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1510 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:56.184204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:56.186226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:56.195141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.195995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.197028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.197677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.228513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:56.229129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:56.241374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.241958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.242807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.243249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.364949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:56.373679 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61e3cd74-752a-47a0-9256-484307371bf6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1273 microversion: 2.1 time: 0.150670 Nov 20 21:01:56.374339 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2228/4517] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:56 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:56.725692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:56.738667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc55f650-630d-43d1-8c06-fa1637577b23 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1510 microversion: 2.1 time: 0.557686 Nov 20 21:01:56.739582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2290/4518] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:56 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:56.758359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:56.763716 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:56.763716 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:01:56.765278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:56.766922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:01:56.785948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.786553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.788103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.788791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.904082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:01:56.968273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:56.968864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:56.974772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.975432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.976365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.976958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:56.989502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:56.996758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:56.997433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:57.543262 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f1a41e0-c4d6-4ff9-8028-a1cd920d48f1 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.791134 Nov 20 21:01:57.555510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2229/4519] 10.222.0.41 () {58 vars in 1166 bytes} [Sat Nov 20 21:01:56 2021] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:57.567667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:57.568241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:57.578622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:57.579074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:57.579874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:57.580309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:57.628232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:57.640121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:57.642215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:57.643614 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2940ed2-0c48-46c4-b11b-fb6a5e35f050 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.680016 Nov 20 21:01:57.644575 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2291/4520] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:56 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:01:57.650748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:57.655056 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:57.655056 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:57.656233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:57.657368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-186325711', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:01:57.663287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:57.663834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:57.664918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:57.665410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:57.770390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:01:57.862670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:57.871385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:57.875867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:58.367605 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59d7acf3-c2f7-4d65-8cf9-6db738b2476f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-186325711" status: 200 len: 1513 microversion: 2.1 time: 0.721569 Nov 20 21:01:58.368238 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2292/4521] 10.222.0.41 () {58 vars in 1260 bytes} [Sat Nov 20 21:01:57 2021] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-186325711 => generated 1513 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:58.385005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:58.388663 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:58.388663 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:58.390110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:58.391110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:01:58.396925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:58.397375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:58.398214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:58.398647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:58.466812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:58.479251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59c62b0d-699f-4256-89ff-b83926ab436d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.917791 Nov 20 21:01:58.491648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2230/4522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:57 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:01:58.562757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:01:58.638970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:58.648327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:58.648969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:58.667907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:58.669208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:58.683841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:58.686721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:58.687975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:58.688623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.262904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.280830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.282370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.283532 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a850c865-3af5-43f1-bd0a-be737a639c45 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.624258 Nov 20 21:01:59.284280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2231/4523] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:01:58 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:01:59.496441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:59.498115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:59.504377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.505049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.506196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.506793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.643837 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e266a4c3-1f07-4ebc-9858-fbdb453dac82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4513 microversion: 2.1 time: 1.262348 Nov 20 21:01:59.661465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2293/4524] 10.222.0.41 () {58 vars in 1172 bytes} [Sat Nov 20 21:01:58 2021] GET /compute/v2.1/servers/detail?status=active => generated 4513 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:59.667593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:59.670866 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:01:59.670866 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:01:59.672845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.673475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.servers [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Removing options 'limit' from query {{(pid=140941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 20 21:01:59.674408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:01:59.679802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.680488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.681454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.682043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.768838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.782318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.782990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.955519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:01:59.962582 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c523b5cc-9cde-404e-9200-077111af7bbb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.469576 Nov 20 21:01:59.963182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2232/4525] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:01:59 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:01:59.971269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:01:59.971767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:01:59.985322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.985778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:01:59.991075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:01:59.992183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.035407 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. Nov 20 21:02:00.040460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:00.042387 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aeda5c34-ce72-448c-b0b4-0518aeb66227 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 404 len: 111 microversion: 2.1 time: 0.078254 Nov 20 21:02:00.044196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2233/4526] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:01:59 2021] DELETE /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:00.050709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1635d3ae-8a36-491e-bbf5-92989c047640 req-24a55d97-74cc-4689-98e5-ed00a3c5601d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea408b76-6111-499e-93d3-91486b7f5ea0", "tag": "060b39d6-eba6-405a-948f-556357f13071"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:00.052487 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:00.052487 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:00.068004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1635d3ae-8a36-491e-bbf5-92989c047640 req-24a55d97-74cc-4689-98e5-ed00a3c5601d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.068978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1635d3ae-8a36-491e-bbf5-92989c047640 req-24a55d97-74cc-4689-98e5-ed00a3c5601d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.092782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1635d3ae-8a36-491e-bbf5-92989c047640 req-24a55d97-74cc-4689-98e5-ed00a3c5601d service nova] Creating event network-changed:060b39d6-eba6-405a-948f-556357f13071 for instance ea408b76-6111-499e-93d3-91486b7f5ea0 on nch2-master-1 Nov 20 21:02:00.098626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1635d3ae-8a36-491e-bbf5-92989c047640 req-24a55d97-74cc-4689-98e5-ed00a3c5601d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052831 Nov 20 21:02:00.109561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2234/4527] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:00.117913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.119025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: 7e82b2a4-a302-441d-9b65-9c0ad1288816] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:00.128620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.129248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.130778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.131385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.152241 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. Nov 20 21:02:00.156648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance 7e82b2a4-a302-441d-9b65-9c0ad1288816 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:00.157700 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8d37854-28c7-42ea-8127-96a8d09c0c4f tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816" status: 404 len: 111 microversion: 2.1 time: 0.046620 Nov 20 21:02:00.158494 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2235/4528] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers/7e82b2a4-a302-441d-9b65-9c0ad1288816 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:00.175396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.175899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:00.183046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.184054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.185998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.186185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.210840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. Nov 20 21:02:00.211790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:00.215199 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20c6a5a6-e5b2-4291-a9f2-8fb651ba2b54 tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 404 len: 111 microversion: 2.1 time: 0.045512 Nov 20 21:02:00.216482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2236/4529] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:00 2021] DELETE /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:00.226484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.227910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] [instance: e10cd167-1c23-4db7-b21c-bb773186754d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:00.235705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.236646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.238032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.238716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.273009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] HTTP exception thrown: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. Nov 20 21:02:00.274748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] Returning 404 to user: Instance e10cd167-1c23-4db7-b21c-bb773186754d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:00.276109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-913f9a42-69fc-477f-9dc3-12ab27f0863b tempest-ServersTestMultiNic-882305418 tempest-ServersTestMultiNic-882305418-project] 10.222.0.41 "GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d" status: 404 len: 111 microversion: 2.1 time: 0.054429 Nov 20 21:02:00.278154 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2237/4530] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers/e10cd167-1c23-4db7-b21c-bb773186754d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:00.305292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.305914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:00.325272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.326072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.330137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.330976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.584618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25a5bc7b-32ae-46e8-a40d-d9e0cbe0cb25 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.920586 Nov 20 21:02:00.585224 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2294/4531] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 21:01:59 2021] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:00.602371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.608623 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:00.608623 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:00.610173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:00.611057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:00.616563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.617201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.618200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.618788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.724777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:00.807580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76319010-4244-4ab0-9a7c-363de3686f0c tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.208490 Nov 20 21:02:00.808932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2295/4532] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:00.821068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.824780 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:00.824780 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:00.826189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:00.826822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.servers [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Removing options 'limit' from query {{(pid=140941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 20 21:02:00.827639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:00.833468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.834232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.835205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.836962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.871595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:00.905350 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-062117d4-fbfc-44e3-8a57-728823c3120d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.088190 Nov 20 21:02:00.906301 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2296/4533] 10.222.0.41 () {58 vars in 1149 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:00.916195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:00.920898 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:00.920898 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:00.921999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:00.922961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:00.928683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.929134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.930134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:00.930573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:00.969459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:01.190967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.205730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.214926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.216855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36ef59fa-075c-46cc-ac61-cfd9fdaf90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.916962 Nov 20 21:02:01.218017 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2238/4534] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:01.228128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:01.230816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:01.253572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.254241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.257424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.258294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.308969 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6f6ed41b-6ffb-4653-8d63-3109b5e411fc tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.396287 Nov 20 21:02:01.311723 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2297/4535] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 21:02:00 2021] GET /compute/v2.1/servers => generated 1009 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:01.321064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:01.332965 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:01.332965 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:01.339373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.341747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:01.367287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.368080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.369075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.369685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.491602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:01.567412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff163ec4-c7ad-476e-aa6c-ab4b2475ff7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.250137 Nov 20 21:02:01.575044 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2298/4536] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:02:01 2021] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:02:01.581686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:01.585700 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:01.585700 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:01.586807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.587264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.servers [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Removing options 'limit' from query {{(pid=140941) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 20 21:02:01.588074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:01.593898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.594664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.595778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.596413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.628060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd6b2934-13ac-4ca1-ab5f-ac4f13888825 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.051645 Nov 20 21:02:01.629007 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2299/4537] 10.222.0.41 () {58 vars in 1139 bytes} [Sat Nov 20 21:02:01 2021] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:01.646156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:01.651612 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:01.651612 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:01.653204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.654219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-186325711', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:01.660233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.660906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.661984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.662593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.687334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:01.706492 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce9cb3e5-a420-4648-80eb-83ededbc14e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.486268 Nov 20 21:02:01.710348 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2239/4538] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:01 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:01.779121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:01.851955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a41d2b5-6681-4b6b-84db-9ee2febf8ac6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-186325711" status: 200 len: 345 microversion: 2.1 time: 0.215363 Nov 20 21:02:01.853352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2300/4539] 10.222.0.41 () {58 vars in 1239 bytes} [Sat Nov 20 21:02:01 2021] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-186325711 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:01.865225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bdc13f78-ee05-4768-b585-d4f162e6d6ff tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:01.872922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdc13f78-ee05-4768-b585-d4f162e6d6ff tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.873718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdc13f78-ee05-4768-b585-d4f162e6d6ff tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.899761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bdc13f78-ee05-4768-b585-d4f162e6d6ff tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Going to try to stop instance {{(pid=140942) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:02:01.954988 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bdc13f78-ee05-4768-b585-d4f162e6d6ff tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "POST /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb/action" status: 202 len: 0 microversion: 2.1 time: 0.093633 Nov 20 21:02:01.956404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2240/4540] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:02:01 2021] POST /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:01.964935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:01.966881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:01.977481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.977925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:01.978763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:01.979200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:02.238248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:02.239873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:02.247563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:02.248064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:02.248872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:02.249470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:02.759383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:02.771800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:02.773398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:02.777446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0adca67c-6619-4f61-a232-4f2030d9c494 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.543558 Nov 20 21:02:02.779670 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2241/4541] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:02 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:02:02.787446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:02.789552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:02.796712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:02.810557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f45295f8-4c44-426b-89db-f3195076cc71 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1520 microversion: 2.1 time: 0.849819 Nov 20 21:02:02.811143 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2301/4542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:01 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1520 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:02.820411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:02.820411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:02.820411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:02.820411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:03.202450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:03.219325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce95cf85-20e9-4465-b7fb-82ebf10c8f7f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.438361 Nov 20 21:02:03.229097 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2242/4543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:02 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:03.797027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:03.797733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:03.805306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:03.806134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:03.807606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:03.808236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:03.829787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:03.830768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:03.840567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:03.842518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:03.844645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:03.845235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:04.444486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:04.455733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:04.457698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:04.463417 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ccd7af7e-93d1-4dfe-99d2-d4d8413f146b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.670479 Nov 20 21:02:04.464453 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2302/4544] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:03 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:04.472289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:04.475268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:04.485128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:04.485934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:04.487570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:04.488229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:04.611746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:04.623377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9afa4a80-fe72-4ac5-b31b-930b07d69788 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1520 microversion: 2.1 time: 0.798130 Nov 20 21:02:04.624742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2243/4545] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:03 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1520 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:04.993321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:05.010307 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f77d4468-a41d-4c3e-ae23-86d4a54302c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.537947 Nov 20 21:02:05.010307 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2303/4546] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:04 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:05.485386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:05.486008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:05.495977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:05.496446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:05.502802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:05.503282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:05.643768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2030523380", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "667d28cd-f9ba-4a5d-a0eb-955c1d25c7d7"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:05.714537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] validate_networks() for [('667d28cd-f9ba-4a5d-a0eb-955c1d25c7d7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:02:06.884244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:06.918286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:06.920112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:06.921588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d167a2f-fd75-41dd-9641-9c6ffe569088 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.440803 Nov 20 21:02:06.922753 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2304/4547] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:05 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:06.929177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:06.934724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:06.943379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:06.944015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:06.944977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:06.945578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:07.734843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:07.747812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d046d8c9-e472-4486-b69c-6c40bc6fdfef tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1520 microversion: 2.1 time: 0.820195 Nov 20 21:02:07.748552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2305/4548] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:06 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1520 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:07.755731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:07.756478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:07.767358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:07.768280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:07.769482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:07.770558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:07.849102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:07.849573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:07.850141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:07.850540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:07.850959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:07.860854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:07.861314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:07.862352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:07.862979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:07.887931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Getting quotas for project 3c79515660014c0bb607fcb10f6f0870. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:07.894622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Getting quotas for user ef7ce5cd53f741ffa5781f96bd869dad and project 3c79515660014c0bb607fcb10f6f0870. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:07.911203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:07.914736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:07.976508 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9e3ee56-bac3-43a1-86c5-ffd99ba0e602 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.520825 Nov 20 21:02:07.978085 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2244/4549] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:02:05 2021] POST /compute/v2.1/servers => generated 383 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:02:07.985652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1e97e8ec-bc43-4e20-b280-23206cc2d63f req-4b4ac3ea-ca35-4626-bf5f-93d63d213d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea408b76-6111-499e-93d3-91486b7f5ea0", "name": "network-vif-plugged", "status": "completed", "tag": "060b39d6-eba6-405a-948f-556357f13071"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:07.987529 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:07.987529 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:07.995926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1e97e8ec-bc43-4e20-b280-23206cc2d63f req-4b4ac3ea-ca35-4626-bf5f-93d63d213d7b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:07.997312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1e97e8ec-bc43-4e20-b280-23206cc2d63f req-4b4ac3ea-ca35-4626-bf5f-93d63d213d7b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:08.031378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1e97e8ec-bc43-4e20-b280-23206cc2d63f req-4b4ac3ea-ca35-4626-bf5f-93d63d213d7b service nova] Creating event network-vif-plugged:060b39d6-eba6-405a-948f-556357f13071 for instance ea408b76-6111-499e-93d3-91486b7f5ea0 on nch2-master-1 Nov 20 21:02:08.038641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1e97e8ec-bc43-4e20-b280-23206cc2d63f req-4b4ac3ea-ca35-4626-bf5f-93d63d213d7b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058452 Nov 20 21:02:08.039270 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2245/4550] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:08.061681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:08.062962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:08.080765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:08.083670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:08.086717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:08.087243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:08.488555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:08.498889 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b4146cf-f8b2-4a56-a918-6710f44ff4e7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.746596 Nov 20 21:02:08.499488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2306/4551] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:07 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:08.517122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8b72d38-842a-4a64-a759-edd007a29c87 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:08.517775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8b72d38-842a-4a64-a759-edd007a29c87 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:08.686707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8b72d38-842a-4a64-a759-edd007a29c87 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:08.701677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8b72d38-842a-4a64-a759-edd007a29c87 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1214 microversion: 2.1 time: 0.194567 Nov 20 21:02:08.708003 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2307/4552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:08 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1214 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:08.765571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:08.767149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:08.782999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:08.784558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:08.785787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:08.793717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:08.884330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:08.908829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:08.920004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:08.921422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f28161c-26ae-429e-8981-f4d6563f98c6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.881064 Nov 20 21:02:08.922146 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2246/4553] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:08 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:09.078083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:09.105367 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b52f7bd-c2bb-4154-ad0a-4257e879ad26 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1497 microversion: 2.1 time: 0.344193 Nov 20 21:02:09.109180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2308/4554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:08 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:09.135402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:09.141061 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:09.141061 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:09.145193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:09.146763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:09.162264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.165211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.166186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.166644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.259131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:09.340901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e6e8051-c98b-488f-8acc-af6ff266a66d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.214666 Nov 20 21:02:09.348661 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2247/4555] 10.222.0.41 () {58 vars in 1153 bytes} [Sat Nov 20 21:02:09 2021] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:09.353472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d76d362-825d-4b24-9f3d-b913fb925d82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:09.367525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d76d362-825d-4b24-9f3d-b913fb925d82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.369434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d76d362-825d-4b24-9f3d-b913fb925d82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.455527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d76d362-825d-4b24-9f3d-b913fb925d82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Going to try to start instance {{(pid=140941) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:02:09.524828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:09.525585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:09.557677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.560991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.576662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.578871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.609903 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d76d362-825d-4b24-9f3d-b913fb925d82 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "POST /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb/action" status: 202 len: 0 microversion: 2.1 time: 0.259363 Nov 20 21:02:09.613106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2309/4556] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:02:09 2021] POST /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:09.635943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:09.636694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:09.653434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.653909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.654777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:09.655198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:09.978521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.000095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a402ef38-a09b-4036-9b1a-58d78fbbffd5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1506 microversion: 2.1 time: 0.378726 Nov 20 21:02:10.013302 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2310/4557] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:09 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:10.024612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:10.027418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:10.046404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:10.048882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:10.051605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:10.053155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:10.137227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.146038 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-544b828d-8c61-48c0-a4ee-16f8f3c7cb9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1272 microversion: 2.1 time: 0.130703 Nov 20 21:02:10.148168 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2311/4558] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:10 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1272 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:10.153425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:10.154573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:10.160896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:10.161609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:10.162731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:10.163267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:10.197154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.205597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-65d44045-1fa1-4b2e-99ea-a8490a61c9df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1315 microversion: 2.1 time: 0.692098 Nov 20 21:02:10.206969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2248/4559] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:09 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:10.211679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: .version_select at 0x7f3f98dc8280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-886646294"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:10.232601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:10.239652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:10.405502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.416355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.417807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:10.420069 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e71e6aaa-a20e-489a-b19f-de3a5b191deb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.270354 Nov 20 21:02:10.431277 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2312/4560] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:10 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:10.736564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:10.742890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:10.764030 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3f2bc78-371e-4405-8698-896731986ebc tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.555794 Nov 20 21:02:10.773121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2249/4561] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:02:10 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:11.031023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:11.031937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:11.041687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.042114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.043164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.045787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.164752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:11.165096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:11.177068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.177799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.178830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.188997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.391015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:11.401298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b822c29-e526-4147-9fac-c1bd120156ac tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1506 microversion: 2.1 time: 0.373188 Nov 20 21:02:11.402328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2313/4562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:11 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:11.421405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:11.430640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:11.445921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.446431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.447234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.447676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.572974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:11.595872 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac92b864-b525-4a8b-9acd-2507f893883d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1272 microversion: 2.1 time: 0.435040 Nov 20 21:02:11.597045 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2250/4563] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:11 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:11.602537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:11.603357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:11.612798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.613518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:11.614709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:11.615309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:12.011439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:12.025179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-959fa9f8-7a9a-4494-908f-19b40a31dbae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1502 microversion: 2.1 time: 0.620298 Nov 20 21:02:12.046944 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2314/4564] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:11 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1502 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:12.061542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d446e35-2f08-4863-982a-a2d25e0f4b12 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:12.104984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d446e35-2f08-4863-982a-a2d25e0f4b12 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:12.123323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d446e35-2f08-4863-982a-a2d25e0f4b12 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:12.202740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d446e35-2f08-4863-982a-a2d25e0f4b12 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:02:12.352951 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d446e35-2f08-4863-982a-a2d25e0f4b12 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0/action" status: 202 len: 0 microversion: 2.1 time: 0.299218 Nov 20 21:02:12.355080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2315/4565] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:02:12 2021] POST /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:12.368752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:12.383160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:12.390274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:12.390996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:12.391806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:12.392433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:12.576929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:12.601394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:12.612335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:12.616752 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ad564bb-5c55-4ddb-9377-1666bbaf0f5b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.018239 Nov 20 21:02:12.625510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2251/4566] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:11 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:12.641431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:12.645084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:12.661917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:12.662853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:12.666725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:12.667620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:13.289046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:13.301520 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-484d26ae-e687-411b-a5d6-ab1d24398685 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.938108 Nov 20 21:02:13.302474 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2316/4567] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:12 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:13.309601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:13.310247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:13.326607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:13.327462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:13.328289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:13.328729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:13.354434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:13.371140 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34cee52c-25dc-4664-a19d-5831f3acf52d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1506 microversion: 2.1 time: 0.742700 Nov 20 21:02:13.383132 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2252/4568] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:12 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1506 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:13.644630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:13.645297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:13.654090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:13.654608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:13.655425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:13.660681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:13.877292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:13.888032 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6e73c09-7672-469f-b374-68c83c3eed1a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.584017 Nov 20 21:02:13.892440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2317/4569] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:13 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:14.309231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:14.318508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:14.320016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:14.321175 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82048600-da7b-4760-8d49-8e8cdf91aa9d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.681645 Nov 20 21:02:14.321750 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2253/4570] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:13 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:02:14.349267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:14.352967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:14.372163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.373026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:14.379353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.380790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:14.388977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:14.389601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:14.402601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.403661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:14.404548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.404929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:14.715746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:14.725484 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-920d8795-08ed-4304-bee3-fc2f58ff52c0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.409457 Nov 20 21:02:14.737195 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2318/4571] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:14 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:14.742977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1175883820", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "8fb7755f-19de-4f03-b01c-d910d1de5681"}], "key_name": "tempest-TestNetworkBasicOps-886646294", "security_groups": [{"name": "tempest-secgroup-smoke-18460386"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:14.877865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:14.898646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cbada9c4-511e-4990-9884-ec5a86eef987 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1510 microversion: 2.1 time: 0.514159 Nov 20 21:02:14.899246 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2254/4572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:14 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1510 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:14.919573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:14.921033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:14.929611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.930604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:14.930748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] validate_networks() for [('8fb7755f-19de-4f03-b01c-d910d1de5681', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:02:14.931887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:14.932435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.391667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:15.403421 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abb2345f-4a13-44ce-a451-84a884b00d9c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.499056 Nov 20 21:02:15.412933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2255/4573] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:14 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:15.417002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:15.420467 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:15.420467 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:15.421604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:15.421965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.servers [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Removing options 'limit' from query {{(pid=140942) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Nov 20 21:02:15.430477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:15.443514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.444501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.449300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.452293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.460306 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e62938e-5cf5-450c-94c0-fbf0faae0455 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.053848 Nov 20 21:02:15.465176 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2256/4574] 10.222.0.41 () {58 vars in 1139 bytes} [Sat Nov 20 21:02:15 2021] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:02:15.480232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:15.481136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:15.525038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.525636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.526810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.527541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.892242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:15.892815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:15.893124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:15.893738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:15.894345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:15.907200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.907927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.908935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:15.909554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:15.929118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:15.935584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:15.953867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:15.956430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:16.014528 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e25028b2-e58b-44fa-b067-5a5ca7fbc23b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.275743 Nov 20 21:02:16.015955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2319/4575] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:02:14 2021] POST /compute/v2.1/servers => generated 404 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:02:16.024259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:16.025203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:16.032335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.033065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.035021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.035827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.569159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:16.585621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fa91b92-a774-4c07-90d9-e1a619e61010 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1510 microversion: 2.1 time: 0.568357 Nov 20 21:02:16.586561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2320/4576] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:16 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:16.606424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:16.607541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:16.631311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.632089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.633233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.633890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.656551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:16.676605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:16.678758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:16.680213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b763f25d-e73d-40d4-a28a-8d75779fdcda tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 1.214044 Nov 20 21:02:16.681335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2257/4577] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:15 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:16.690208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a0d34335-357e-40e2-88e4-fe7fd42e3fa6 req-20e91035-6f0d-4748-8007-7ae748a8b4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9eed9b8-8261-4f91-8997-7d345873726b", "tag": "667f05d2-48b8-4779-814f-21386c146880"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:16.692274 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:16.692274 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:16.705036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0d34335-357e-40e2-88e4-fe7fd42e3fa6 req-20e91035-6f0d-4748-8007-7ae748a8b4b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.706374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a0d34335-357e-40e2-88e4-fe7fd42e3fa6 req-20e91035-6f0d-4748-8007-7ae748a8b4b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.720633 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a0d34335-357e-40e2-88e4-fe7fd42e3fa6 req-20e91035-6f0d-4748-8007-7ae748a8b4b5 service nova] Creating event network-changed:667f05d2-48b8-4779-814f-21386c146880 for instance c9eed9b8-8261-4f91-8997-7d345873726b on nch1-master-1 Nov 20 21:02:16.726125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a0d34335-357e-40e2-88e4-fe7fd42e3fa6 req-20e91035-6f0d-4748-8007-7ae748a8b4b5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043242 Nov 20 21:02:16.727392 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2258/4578] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:16.733783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:16.734758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:16.742262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.743086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.744131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.744783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.888064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:16.898221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ceeebb2f-4f4f-41ea-b03d-07e865c4aaaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1244 microversion: 2.1 time: 0.167173 Nov 20 21:02:16.904198 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2259/4579] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:16 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1244 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:16.908907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:16.911874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:16.925640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.926219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:16.927672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:16.928319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.024512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:17.032911 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c514d595-041b-468d-a87d-852fc7ded092 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.444036 Nov 20 21:02:17.043341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2321/4580] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:16 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:17.048553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:17.049435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:17.057386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.058239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.059941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.060803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.506424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:17.531997 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74684431-2893-473b-9a0c-406c93639fed tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1510 microversion: 2.1 time: 0.486992 Nov 20 21:02:17.532980 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2322/4581] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:17 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1510 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:17.622838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:17.632327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2c2a2e0-fdfc-4b5d-89a7-afa7b4ce1689 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.726908 Nov 20 21:02:17.632913 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2260/4582] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:16 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:17.648835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:17.649446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:17.657909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.659079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.660080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.660713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.737782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: .version_select at 0x7f3f8702ed30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-66436047", "policies": ["affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:17.757365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:17.763734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:17.820144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:17.826407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:17.852453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a46ccb1b-3439-4caa-b860-aa6fc08012f1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.306303 Nov 20 21:02:17.853831 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2323/4583] 10.222.0.41 () {60 vars in 1173 bytes} [Sat Nov 20 21:02:17 2021] POST /compute/v2.1/os-server-groups => generated 182 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:17.860427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:17.861583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:17.868584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.869396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:17.870470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:17.871174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.132495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.151588 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11e0f956-2a4d-4e3c-abbb-7b84ddd813a9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1510 microversion: 2.1 time: 0.505531 Nov 20 21:02:18.155145 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2261/4584] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:17 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1510 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:18.164515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: .version_select at 0x7f3f85fa2b80>, body: {"server_group": {"name": "tempest-server-group-694074238", "policies": ["affinity"]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:18.187575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:18.197181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:18.272203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:18.277362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:18.292022 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7595e4fe-6ce9-46f1-b566-37bbe2a785d7 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.135461 Nov 20 21:02:18.292964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2262/4585] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 21:02:18 2021] POST /compute/v2.1/os-server-groups => generated 163 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:18.298320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:18.299175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:18.307692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.308413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.310440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.311081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.445292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.455525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.457173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.458628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f22f2a61-bf7a-459f-af18-a65dbd84d6ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.603696 Nov 20 21:02:18.459523 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2324/4586] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:17 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:18.462791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.464350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:18.465641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:18.474691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.474691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.474691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.475776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.479713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ce491c2-863e-48be-8085-d6fb534eeca8 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1306 microversion: 2.1 time: 0.185221 Nov 20 21:02:18.483776 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2263/4587] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:18 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:18.489195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:18.495530 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:18.495530 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:18.497999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.499446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:18.718346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:18.726016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a475dcd5-7d73-4d8b-b83e-cbc56a2a8c45 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.265419 Nov 20 21:02:18.726555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2325/4588] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:18 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:18.731399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: .version_select at 0x7f3f87817ee0>, body: {"server_group": {"name": "tempest-server-group-694074238", "policies": ["affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:18.749122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:18.756170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:18.789444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.791709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.793315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.794122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.810192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:18.826406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:18.845401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c251d6a5-51ba-42ec-abe5-cdf71843c2e0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.117604 Nov 20 21:02:18.846273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2326/4589] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 21:02:18 2021] POST /compute/v2.1/os-server-groups => generated 163 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:18.853700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:18.854569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:18.861369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.863751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.865001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:18.865617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:18.924414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:18.997291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6a5511e-1600-4850-970a-ff6fe09c224e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.511413 Nov 20 21:02:18.998870 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2264/4590] 10.222.0.41 () {58 vars in 1153 bytes} [Sat Nov 20 21:02:18 2021] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:19.004684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ebfc1b16-e9ce-42dd-be9e-1ff16156de16 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.034122 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ebfc1b16-e9ce-42dd-be9e-1ff16156de16 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/8ac14d0f-6da9-4485-8880-b3d6529dffd6" status: 204 len: 0 microversion: 2.1 time: 0.033762 Nov 20 21:02:19.038475 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2265/4591] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:18 2021] DELETE /compute/v2.1/os-server-groups/8ac14d0f-6da9-4485-8880-b3d6529dffd6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:19.044124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.045312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:19.053424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.053934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.055078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.055631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.218501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:19.227922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e903198-abdb-4a89-9f9b-23109edeb5bd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.380411 Nov 20 21:02:19.233582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2327/4592] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:18 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:19.233982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a028bdd0-5ee6-434a-b52b-b41d820117b6 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.252176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a028bdd0-5ee6-434a-b52b-b41d820117b6 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups" status: 200 len: 332 microversion: 2.1 time: 0.022483 Nov 20 21:02:19.253635 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2328/4593] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/os-server-groups => generated 332 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:19.269455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d005c7b-9fe0-474f-8954-0807df96bf40 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.299530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d005c7b-9fe0-474f-8954-0807df96bf40 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/4e657493-1695-4c0e-9918-a10bbdfa5b99" status: 204 len: 0 microversion: 2.1 time: 0.035755 Nov 20 21:02:19.300566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2329/4594] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:19 2021] DELETE /compute/v2.1/os-server-groups/4e657493-1695-4c0e-9918-a10bbdfa5b99 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:19.309042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ae490ee1-95ca-4c1a-98dc-8445d59d0cd0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.323521 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ae490ee1-95ca-4c1a-98dc-8445d59d0cd0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.017607 Nov 20 21:02:19.331303 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2330/4595] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/os-server-groups => generated 185 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:19.336553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: .version_select at 0x7f3f87819b80>, body: {"server_group": {"name": "tempest-server-group-1830110657", "policies": ["affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:19.353197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:19.359739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:19.397983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:19.403399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:19.409368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:19.413841 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fe7aa87-a2ab-4b4f-bc28-6cb24fd854bf tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1510 microversion: 2.1 time: 0.373103 Nov 20 21:02:19.417236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2266/4596] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:19.435121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.439703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:19.448512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.451393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.452846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.453522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.467497 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89959ba7-3467-4271-a54f-e5d432f0f3dd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.134394 Nov 20 21:02:19.471009 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2331/4597] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 21:02:19 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:02:19.485754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.486329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:19.495326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.495764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.496696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.497126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.756368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:19.764898 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be302781-44a1-475f-90e9-d2d6dbd12e63 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1510 microversion: 2.1 time: 0.336103 Nov 20 21:02:19.765499 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2267/4598] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:19.781646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27a62a78-43b5-464b-99e1-2ef169cdaac8 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.828093 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27a62a78-43b5-464b-99e1-2ef169cdaac8 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/771cecc8-6b31-418d-a9b2-7622984e9823" status: 204 len: 0 microversion: 2.1 time: 0.050187 Nov 20 21:02:19.833064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2268/4599] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:19 2021] DELETE /compute/v2.1/os-server-groups/771cecc8-6b31-418d-a9b2-7622984e9823 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:19.838904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:19.839775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:19.849558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.850889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:19.852152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:19.852861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.037776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.048957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.050076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.051233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0601a5f-eb1f-4587-9e3c-6af9c52d7056 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.577315 Nov 20 21:02:20.062788 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2332/4600] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:20.075278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:20.077354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:20.087181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.087672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.089310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.089770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.123591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.133371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da3416d3-cb3e-41f0-87a3-9288519c7423 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.298883 Nov 20 21:02:20.133969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2269/4601] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:19 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:20.145906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:20.146810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:20.157303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.158098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.160726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.161288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.459805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.472648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80fe7030-3835-4884-b8ad-1e2fcbe90434 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1510 microversion: 2.1 time: 0.334877 Nov 20 21:02:20.474432 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2270/4602] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:20 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:20.480147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d71ce809-d285-40fe-bf07-3aa5e2be782f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:20.503179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d71ce809-d285-40fe-bf07-3aa5e2be782f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.027367 Nov 20 21:02:20.509209 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2271/4603] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:20 2021] GET /compute/v2.1/os-server-groups => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:20.510022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-372aff45-8a67-4acf-952a-5ace79c6ffbf req-df18c386-ecad-480e-9ad7-cb1c85ab73af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "a1c1d818-4c07-4d09-b360-b1acc5a224b8"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:20.525622 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:20.525622 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:20.545900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-372aff45-8a67-4acf-952a-5ace79c6ffbf req-df18c386-ecad-480e-9ad7-cb1c85ab73af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.546364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-372aff45-8a67-4acf-952a-5ace79c6ffbf req-df18c386-ecad-480e-9ad7-cb1c85ab73af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.573866 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-372aff45-8a67-4acf-952a-5ace79c6ffbf req-df18c386-ecad-480e-9ad7-cb1c85ab73af service nova] Creating event network-vif-plugged:a1c1d818-4c07-4d09-b360-b1acc5a224b8 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:20.580293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-372aff45-8a67-4acf-952a-5ace79c6ffbf req-df18c386-ecad-480e-9ad7-cb1c85ab73af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075018 Nov 20 21:02:20.581320 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2272/4604] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:20.594948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:20.596358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:20.603849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.604403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.605440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:20.606536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:20.972656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.977609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:20.985217 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5bb69d25-9d2c-4b15-9bba-a3c3afc26e6f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.401775 Nov 20 21:02:20.988233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-090f68c9-5698-4a52-b948-7b527482dbd6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.924251 Nov 20 21:02:20.989114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2273/4605] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:20 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:20.999597 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2333/4606] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:20 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:21.003580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:21.004494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: .version_select at 0x7f3f87017670>, body: {"server_group": {"name": "tempest-server-group-1320071390", "policies": ["anti-affinity"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:21.007360 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:21.007360 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:21.008721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.010287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140942) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:21.019136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.020166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.021200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.021848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.025625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:21.034159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:21.060580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.multi_cell_list [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140942) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:21.108976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:21.116671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_groups'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:21.135363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-034211ed-9d08-43f2-90da-a837593e9eed tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.134309 Nov 20 21:02:21.141616 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2334/4607] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 21:02:20 2021] POST /compute/v2.1/os-server-groups => generated 169 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:21.147289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-dd2980ba-38bb-45fd-a763-f3c5ea309454 req-706f2f22-619a-4b42-bda1-4ae093266804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d887f393-fa16-4eb3-8539-7d8d82d31cf5", "tag": "56cf6d80-8b57-4905-b463-2e9ae52a0565"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:21.148799 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:21.148799 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:21.153791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.160755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dd2980ba-38bb-45fd-a763-f3c5ea309454 req-706f2f22-619a-4b42-bda1-4ae093266804 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.161219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dd2980ba-38bb-45fd-a763-f3c5ea309454 req-706f2f22-619a-4b42-bda1-4ae093266804 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.178954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.178954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.203956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-dd2980ba-38bb-45fd-a763-f3c5ea309454 req-706f2f22-619a-4b42-bda1-4ae093266804 service nova] Creating event network-changed:56cf6d80-8b57-4905-b463-2e9ae52a0565 for instance d887f393-fa16-4eb3-8539-7d8d82d31cf5 on nch1-master-1 Nov 20 21:02:21.216270 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-dd2980ba-38bb-45fd-a763-f3c5ea309454 req-706f2f22-619a-4b42-bda1-4ae093266804 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070527 Nov 20 21:02:21.218121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2335/4608] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:21.227759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:21.228452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:21.239075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.240078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.241124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.241838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.451405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-24ade263-5904-4e3d-aae5-80c83bff8bc0 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 4513 microversion: 2.1 time: 0.451342 Nov 20 21:02:21.452340 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2274/4609] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:02:20 2021] GET /compute/v2.1/servers/detail => generated 4513 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:21.457469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-365313f7-88e1-473f-b337-e5cbd09f1516 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:21.523239 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-365313f7-88e1-473f-b337-e5cbd09f1516 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/03423d60-1a0f-4373-b2da-5a3a422e8295" status: 204 len: 0 microversion: 2.1 time: 0.069673 Nov 20 21:02:21.524460 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2275/4610] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:21 2021] DELETE /compute/v2.1/os-server-groups/03423d60-1a0f-4373-b2da-5a3a422e8295 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:21.535951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:21.537013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:21.554569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.555360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.556383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.557043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.723674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.733933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.743998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.745242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e96d90ef-d8b9-42b7-aaee-935a59450a5e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.525713 Nov 20 21:02:21.745825 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2336/4611] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:21 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:21.754835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:21.758644 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:21.758644 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:21.771540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:21.772816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'ip': '172.20.0.1', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:21.990537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.991150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:21.993828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:21.994472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.247315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:22.336909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a9f5b06-e8b7-41f0-a7b3-76ed6009860b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?ip=172.20.0.1" status: 200 len: 1009 microversion: 2.1 time: 0.589470 Nov 20 21:02:22.337991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2337/4612] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:21 2021] GET /compute/v2.1/servers?ip=172.20.0.1 => generated 1009 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:22.356088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aecf29cf-60f5-40a3-92e0-5a64241f7f91 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:22.369461 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aecf29cf-60f5-40a3-92e0-5a64241f7f91 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.019082 Nov 20 21:02:22.382377 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2338/4613] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:22 2021] GET /compute/v2.1/os-server-groups => generated 185 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:22.387813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:22.388435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:22.399675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.400675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.402099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.404588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.453003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:22.478629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59b79da3-5b94-4349-a174-8f687ef8bd6a tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.951815 Nov 20 21:02:22.494131 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2276/4614] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:21 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:22.503831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:22.504447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:22.545508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.549457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.550591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.551256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.763428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:22.773237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fcf499f-c5cd-468e-a110-b508cd03e4b1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.389631 Nov 20 21:02:22.783154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:22.784826 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2339/4615] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:22 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:22.790571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:22.795953 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:22.795953 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:22.796701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74d06c2e-c546-4e19-b0f4-80707bdc6410 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.301172 Nov 20 21:02:22.797287 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2277/4616] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:22 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:22.797844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:22.798797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:22.804148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1252689537", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "d6fdb4a0-b5ae-4b3e-8a3f-f915385127e9"}]}, "os:scheduler_hints": {"group": "c2697007-90c1-48cc-a844-820f73c5f67f"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:22.805369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.806129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.807178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:22.808001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:22.883208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] validate_networks() for [('d6fdb4a0-b5ae-4b3e-8a3f-f915385127e9', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:02:22.924433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:23.004243 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb22af03-b8a4-4224-9722-7be8f0f9ec7f tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.218018 Nov 20 21:02:23.005008 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2340/4617] 10.222.0.41 () {58 vars in 1211 bytes} [Sat Nov 20 21:02:22 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:23.010965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "5332c620-9136-495b-bd4d-92357990f3a2"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "144b0c11-f5e6-471f-8963-411ff27f7777"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "fafe012b-fc11-4ebf-90fb-e3698bda3e63"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "1d8adb08-4bb0-45be-8e71-4a53fb65eb7e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:23.014105 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:23.014105 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:23.025004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.026326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.041589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Creating event network-vif-plugged:5332c620-9136-495b-bd4d-92357990f3a2 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:23.042534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Creating event network-vif-plugged:144b0c11-f5e6-471f-8963-411ff27f7777 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:23.043942 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Creating event network-vif-plugged:fafe012b-fc11-4ebf-90fb-e3698bda3e63 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:23.045011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] Creating event network-vif-plugged:1d8adb08-4bb0-45be-8e71-4a53fb65eb7e for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:23.052256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-55bc82e0-5578-4f79-8794-bc0a83cdb717 req-f71693e4-bc2c-4613-a9f6-f787bd48e9e0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045781 Nov 20 21:02:23.053274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2341/4618] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:23.060067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:23.061459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:23.068567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.069413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.071167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.071860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.403068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.415591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.417289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.418667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3fdd9062-f48a-40c2-b6b4-219b7b2a50c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.363811 Nov 20 21:02:23.419470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2342/4619] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:23 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:23.423622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:23.427121 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:23.427121 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:23.428102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.428843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:23.434352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.434799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.435599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.436231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.548958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:23.671772 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8ec642e-0ef4-4454-aa39-365ffbc80a1e tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.250897 Nov 20 21:02:23.675134 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2343/4620] 10.222.0.41 () {58 vars in 1195 bytes} [Sat Nov 20 21:02:23 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:23.686883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:23.687530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:23.701798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.702873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.707981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.708774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.891713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:23.892201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:23.892683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:23.893097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:23.893510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:23.920823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.921526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.922620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.923321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.924585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.932798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34aad456-f341-4afc-8ef5-9a5a94a4a59e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.256568 Nov 20 21:02:23.935092 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2344/4621] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:23 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:23.945130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:23.955672 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:23.955672 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:23.956785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:23.957461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': '-186325711', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:23.966469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.966915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.967718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:23.968145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:23.971061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:23.981962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:24.010631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:24.013322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:24.075066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:24.140252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:24.149748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:24.152859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85c06f15-2a7a-4aa9-85ff-fc5e45f92ce9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=-186325711" status: 200 len: 345 microversion: 2.1 time: 0.216120 Nov 20 21:02:24.153776 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2345/4622] 10.222.0.41 () {58 vars in 1155 bytes} [Sat Nov 20 21:02:23 2021] GET /compute/v2.1/servers?name=-186325711 => generated 345 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:24.164278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.164889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:24.171858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.172234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.173020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.173457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.218284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:24.224945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Getting quotas for user 8aeae7a5625f4067b79ea0ebcc638efe and project 80a1eb46e47b43ea916c35d5747f21d5. Resources: {'server_group_members'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:24.271317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b6ead45-d2f1-4069-9ef2-5f1d4989505e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472836 Nov 20 21:02:24.272412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2278/4623] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:02:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:02:24.280963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.286588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:24.299153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.299997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.302391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.304214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.484627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:24.492030 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-310bee0c-383c-40aa-bea0-03655c60e353 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.331165 Nov 20 21:02:24.501953 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2346/4624] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:24.501953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.501953 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:24.501953 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:24.502940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:24.502940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:24.507847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.508291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.509099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.509534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.596329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:24.606400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffe2af72-195e-40b5-a344-57560ea68104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.332385 Nov 20 21:02:24.607016 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2279/4625] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:24.620805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3ed0fda-a77f-4ff7-bdb8-0bc0cab5a077 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.621947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3ed0fda-a77f-4ff7-bdb8-0bc0cab5a077 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:24.668859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:24.721363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a3ed0fda-a77f-4ff7-bdb8-0bc0cab5a077 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:24.732041 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3ed0fda-a77f-4ff7-bdb8-0bc0cab5a077 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1213 microversion: 2.1 time: 0.115341 Nov 20 21:02:24.744540 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca63d085-1753-46d4-944e-f4eddac72391 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.250467 Nov 20 21:02:24.748859 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2280/4626] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1213 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:24.751957 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2347/4627] 10.222.0.41 () {58 vars in 1153 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:24.754390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.755014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:24.756710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:24.760374 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:24.760374 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:24.761562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:24.763129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-18632571', 'deleted': False, 'project_id': '6a7b316a84eb425aabf378a838ec02b3'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:02:24.770514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.771214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.772133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.772704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.772835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.773562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.773777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:24.774036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:24.943301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:02:25.049401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c96e955d-a223-4616-841d-8cf8217c52ca tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-18632571" status: 200 len: 345 microversion: 2.1 time: 0.296209 Nov 20 21:02:25.050154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2348/4628] 10.222.0.41 () {58 vars in 1225 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-18632571 => generated 345 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:25.068125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:25.068933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:25.087361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.089432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.094195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.095550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.174880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:25.187177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:25.189026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:25.190660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21c37038-ae4c-4aa0-b787-1d1402ce4fcf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.440568 Nov 20 21:02:25.191663 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2281/4629] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:24 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:25.196547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:25.197295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:25.205322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.206330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.207354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.209100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.246652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:02:25.379785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3c30deb-ca32-4816-9ffb-3f48d15452be tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 204 len: 0 microversion: 2.1 time: 0.186753 Nov 20 21:02:25.380940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2282/4630] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:25 2021] DELETE /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:25.388613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "17593c85-2aba-4b07-b484-60c0a0677ba6"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-plugged", "status": "completed", "tag": "bd4e7a14-7d21-4548-8472-ba80748bb825"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:25.391009 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:25.391009 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:25.398760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.399418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.413426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] Creating event network-vif-plugged:17593c85-2aba-4b07-b484-60c0a0677ba6 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:25.414237 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] Creating event network-vif-plugged:bd4e7a14-7d21-4548-8472-ba80748bb825 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:25.414474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:25.422086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7622d85c-17c1-4bd8-a610-9a8109bfa0f6 req-0c8d57ab-6bcc-48e6-af9d-12095a1ea0a9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038777 Nov 20 21:02:25.423679 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2283/4631] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:25 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:25.430768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:25.430974 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05f7bbd7-37f3-41ff-8646-885e77675381 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.379166 Nov 20 21:02:25.431853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:25.432111 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2349/4632] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:25 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:25.452343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.452835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.454308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.454806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.508989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:25.509656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:25.524831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.525302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.526134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.526580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.851551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:25.863821 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-884c6955-b462-4a9b-9b55-bb4fc934d452 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.358226 Nov 20 21:02:25.865248 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2350/4633] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:25 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:25.872559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:25.873254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:25.905007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.905805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:25.907644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:25.909084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.014697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.023094 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a80f17f1-b3f8-44a6-a549-8cc211cfd6b3 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1516 microversion: 2.1 time: 0.598028 Nov 20 21:02:26.024448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2284/4634] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:25 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1516 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:26.050226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:26.051037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:26.061667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.062502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.063322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.063769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.083848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.103887 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be045710-9458-477a-b1b7-4f76545bebe4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.232315 Nov 20 21:02:26.118454 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2351/4635] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:25 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:26.193750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.209109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0daf16ed-68e7-40ff-a7b6-da9b23c93e80 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1283 microversion: 2.1 time: 0.182107 Nov 20 21:02:26.210374 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2285/4636] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:26 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1283 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:26.213209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:26.214035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:26.224883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.225353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.227038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.227799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.475160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:26.475788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:26.530351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.530741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.531719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.532158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.703385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.712686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.714469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:26.715667 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe5e2c3a-1bfa-4855-a085-0f5902e7f0ab tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1879 microversion: 2.32 time: 0.507664 Nov 20 21:02:26.716332 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2352/4637] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:26 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1879 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:26.882523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:26.883346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:26.896136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.896793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:26.898585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:26.899392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.145479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:27.146770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:27.154806 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3bef7463-e095-4ad1-bd4e-838d4c4b19da tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.707233 Nov 20 21:02:27.155401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2286/4638] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:26 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:27.164026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d695782-a103-4524-aaf2-a24e0ce98bdc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.283742 Nov 20 21:02:27.166573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2353/4639] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:26 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:27.169323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:27.169946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:27.175989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.176660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.177633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.178279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.186687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:27.187696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:27.198082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.198702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.200826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.216921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.467154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:27.477244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-819a6ed1-483d-42c3-a9b2-4f279e4c8be7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.296506 Nov 20 21:02:27.488500 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2354/4640] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:27 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:27.493833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:27.494565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:27.503241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.503932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.504976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.505615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.680128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:27.694750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ab67e04-7ad9-47d8-9285-715288f75db6 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1516 microversion: 2.1 time: 0.529467 Nov 20 21:02:27.695843 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2287/4641] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:27 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1516 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:27.703028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4ac5c24d-c73b-492c-9d27-15b7ea2dc0e6 req-8d2cd4f4-7f0e-4f03-a9ae-9568f476307d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eed9b8-8261-4f91-8997-7d345873726b", "name": "network-vif-plugged", "status": "completed", "tag": "667f05d2-48b8-4779-814f-21386c146880"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:27.704598 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:27.704598 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:27.711991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ac5c24d-c73b-492c-9d27-15b7ea2dc0e6 req-8d2cd4f4-7f0e-4f03-a9ae-9568f476307d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.712744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4ac5c24d-c73b-492c-9d27-15b7ea2dc0e6 req-8d2cd4f4-7f0e-4f03-a9ae-9568f476307d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.724521 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4ac5c24d-c73b-492c-9d27-15b7ea2dc0e6 req-8d2cd4f4-7f0e-4f03-a9ae-9568f476307d service nova] Creating event network-vif-plugged:667f05d2-48b8-4779-814f-21386c146880 for instance c9eed9b8-8261-4f91-8997-7d345873726b on nch1-master-1 Nov 20 21:02:27.730242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4ac5c24d-c73b-492c-9d27-15b7ea2dc0e6 req-8d2cd4f4-7f0e-4f03-a9ae-9568f476307d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031359 Nov 20 21:02:27.731839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2288/4642] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:27.752882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:27.753068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:27.753220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:27.773002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0595ed51-60b5-4094-b79b-f4867ce7cdc0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.282923 Nov 20 21:02:27.773845 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2355/4643] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:27 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:27.791919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.793977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:27.795240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:27.795864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.172206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:28.173536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:28.181143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.181923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.182805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.183309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.768644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:28.779229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:28.782370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:28.787375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:28.788669 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8899d877-343a-44ad-afa7-9762764c17b8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2832 microversion: 2.32 time: 1.055562 Nov 20 21:02:28.803688 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2289/4644] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:27 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2832 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:28.809767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:28.811092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:28.815016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61faa3ff-66b1-4f49-9ac4-e49b51b4c8f9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.642250 Nov 20 21:02:28.817857 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2356/4645] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:28 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:28.823005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.823488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.825923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.827547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:28.828151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:28.828504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.847901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.848814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:28.851126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:28.852066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.104645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:29.142600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-477c5e57-58c0-4fbe-a930-6caf25adb158 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.323082 Nov 20 21:02:29.144628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2357/4646] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:28 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:29.166614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:29.167497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:29.179752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.180894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.181902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.182515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.283003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:29.290761 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bee6f560-2fa4-4955-80fd-73a57fb9e9d8 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 200 len: 1305 microversion: 2.1 time: 0.143650 Nov 20 21:02:29.291794 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2358/4647] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:29 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:29.297376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:29.298232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:29.304479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.304929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.305721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.306187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.348038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:29.361411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-967286f5-be8d-4016-a5c8-9d6f39d3d3d4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1314 microversion: 2.1 time: 0.556492 Nov 20 21:02:29.362581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2290/4648] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:28 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:29.368209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:29.368963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:29.378863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.379397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.380281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.380797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.518123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:29.540168 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4de856b3-4dea-491d-a180-b14a5c0c958b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.246926 Nov 20 21:02:29.541347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2359/4649] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:29 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:29.561476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d67742ae-c866-4a13-bda3-aae8b0ff3902 req-75d6e98d-8d12-4252-91d5-66711196a577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc5c22e-5a81-482a-898e-703e259cb1a5", "name": "network-vif-deleted", "tag": "d9b0e2d6-668a-46d9-91dd-0b40e6525d46"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:29.563268 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:29.563268 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:29.572917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d67742ae-c866-4a13-bda3-aae8b0ff3902 req-75d6e98d-8d12-4252-91d5-66711196a577 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.573527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d67742ae-c866-4a13-bda3-aae8b0ff3902 req-75d6e98d-8d12-4252-91d5-66711196a577 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.588057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d67742ae-c866-4a13-bda3-aae8b0ff3902 req-75d6e98d-8d12-4252-91d5-66711196a577 service nova] Creating event network-vif-deleted:d9b0e2d6-668a-46d9-91dd-0b40e6525d46 for instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 on nch1-master-1 Nov 20 21:02:29.599758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d67742ae-c866-4a13-bda3-aae8b0ff3902 req-75d6e98d-8d12-4252-91d5-66711196a577 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042560 Nov 20 21:02:29.601176 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2360/4650] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:29.692957 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8e7a4ae-3f16-454f-8c11-525af1a3e808 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.328015 Nov 20 21:02:29.702164 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2291/4651] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 21:02:29 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/os-interface => generated 1831 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:29.755026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d887f393-fa16-4eb3-8539-7d8d82d31cf5", "name": "network-vif-plugged", "status": "completed", "tag": "56cf6d80-8b57-4905-b463-2e9ae52a0565"}, {"server_uuid": "7cc5c22e-5a81-482a-898e-703e259cb1a5", "name": "network-vif-unplugged", "status": "completed", "tag": "d9b0e2d6-668a-46d9-91dd-0b40e6525d46"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:29.757461 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:29.757461 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:29.770565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.771171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.801985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] Creating event network-vif-plugged:56cf6d80-8b57-4905-b463-2e9ae52a0565 for instance d887f393-fa16-4eb3-8539-7d8d82d31cf5 on nch1-master-1 Nov 20 21:02:29.804140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] Creating event network-vif-unplugged:d9b0e2d6-668a-46d9-91dd-0b40e6525d46 for instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 on nch1-master-1 Nov 20 21:02:29.814363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a1058612-b997-4470-b61a-ecf88bc13033 req-fafbb167-ee5e-4108-a263-07fbef1a0a16 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.063866 Nov 20 21:02:29.824220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2361/4652] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:29.836601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:29.838005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:29.846000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.846920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:29.847952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:29.848703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.161146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:30.161829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:30.168740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.169269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.170075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.170548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.385123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:30.394766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3cc39b78-de62-457c-b5fd-71e03213119b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.563735 Nov 20 21:02:30.395634 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2292/4653] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:29 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:30.411035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:30.415913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 7cc5c22e-5a81-482a-898e-703e259cb1a5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:30.419236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.419834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.420750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.421294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.436833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] HTTP exception thrown: Instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 could not be found. Nov 20 21:02:30.437541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Returning 404 to user: Instance 7cc5c22e-5a81-482a-898e-703e259cb1a5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:30.438520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f24c484-89a8-42dd-83b7-4fd83be91fa5 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5" status: 404 len: 111 microversion: 2.1 time: 0.031080 Nov 20 21:02:30.442317 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2293/4654] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:30 2021] GET /compute/v2.1/servers/7cc5c22e-5a81-482a-898e-703e259cb1a5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:30.447351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:30.448109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:30.454429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.455016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.455956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.456505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.682517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:30.691985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32a3d7fe-9eb0-4089-8fd5-98f4e24919ce tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.534832 Nov 20 21:02:30.692774 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2362/4655] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:30 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:30.697951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:30.698906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:30.709094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.709807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.710963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.711807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.744797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:02:30.839470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe732233-f4d6-4389-a65c-174e8499820a tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 204 len: 0 microversion: 2.1 time: 0.144648 Nov 20 21:02:30.841880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2363/4656] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:30 2021] DELETE /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:30.848837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:30.849980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:30.858209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.858775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:30.859931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:30.860766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.165337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:31.171907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:31.175981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-723f622a-9f80-41bc-af1f-e3c5150fc134 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1501 microversion: 2.1 time: 0.732323 Nov 20 21:02:31.187914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f2926cf-6845-4805-89bd-82b9253ce724 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.338829 Nov 20 21:02:31.187914 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2364/4657] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:30 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:31.189178 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2294/4658] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:30 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1501 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:31.192477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:31.193609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.205541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.206422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.208365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.208642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:31.209496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.210444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.220953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.221708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.222913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.223531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.256661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lazy-loading 'flavor' on Instance uuid c9eed9b8-8261-4f91-8997-7d345873726b {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:02:31.352210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3250505-fe4d-41c5-bc5d-8047addf1029 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "POST /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b/action" status: 200 len: 32 microversion: 2.1 time: 0.146820 Nov 20 21:02:31.353249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2295/4659] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:02:31 2021] POST /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:02:31.374247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:31.375081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.387344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.387960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.403494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.406266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.499846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:31.508032 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-753542b8-2d2c-4fa4-ad0e-0a09b5ec984d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1516 microversion: 2.1 time: 0.321230 Nov 20 21:02:31.508696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2365/4660] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:31 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:31.524206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:31.524932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.538343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.538869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.539787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.540286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.708725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:31.719512 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5db47625-daf5-4851-a689-4ba249a33da1 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1372 microversion: 2.1 time: 0.208677 Nov 20 21:02:31.730690 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2366/4661] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:31 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:31.736073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:31.737212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.743685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.744241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.745839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.745839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.799390 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f85338f5-5365-4b70-9fa1-d98aae7e939f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.067038 Nov 20 21:02:31.800687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2367/4662] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:31.807044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-20f27dea-ae35-473b-8728-eedbaaadd56e req-14905d4e-8122-4671-b87c-245866ca2f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "tag": "5332c620-9136-495b-bd4d-92357990f3a2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:31.810145 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:31.810145 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:31.823944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-20f27dea-ae35-473b-8728-eedbaaadd56e req-14905d4e-8122-4671-b87c-245866ca2f31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.824991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-20f27dea-ae35-473b-8728-eedbaaadd56e req-14905d4e-8122-4671-b87c-245866ca2f31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.839782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-20f27dea-ae35-473b-8728-eedbaaadd56e req-14905d4e-8122-4671-b87c-245866ca2f31 service nova] Creating event network-changed:5332c620-9136-495b-bd4d-92357990f3a2 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:02:31.848339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-20f27dea-ae35-473b-8728-eedbaaadd56e req-14905d4e-8122-4671-b87c-245866ca2f31 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045018 Nov 20 21:02:31.851102 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2368/4663] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:31.877151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6711b0dd-5764-46a0-b3e9-55b2f07a3d97 req-ba0ab05f-5261-4005-8fc7-910fe304099d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4219088e-ce1d-4f2f-8fc7-d2cfdeb14511", "tag": "079bdb9d-b496-4bf4-8785-ac0364396223"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:31.880237 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:31.880237 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:31.899175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6711b0dd-5764-46a0-b3e9-55b2f07a3d97 req-ba0ab05f-5261-4005-8fc7-910fe304099d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.901416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6711b0dd-5764-46a0-b3e9-55b2f07a3d97 req-ba0ab05f-5261-4005-8fc7-910fe304099d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.929752 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6711b0dd-5764-46a0-b3e9-55b2f07a3d97 req-ba0ab05f-5261-4005-8fc7-910fe304099d service nova] Creating event network-changed:079bdb9d-b496-4bf4-8785-ac0364396223 for instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 on nch2-master-1 Nov 20 21:02:31.938035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:31.940865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6711b0dd-5764-46a0-b3e9-55b2f07a3d97 req-ba0ab05f-5261-4005-8fc7-910fe304099d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084943 Nov 20 21:02:31.942751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2369/4664] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:31.951259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-394e3fec-9f5a-48ee-b267-80ebc494ae32 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.588185 Nov 20 21:02:31.952355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2296/4665] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:31 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:31.959351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:31.960767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:31.991411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.992061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:31.993485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:31.994410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.208496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:32.209122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:32.224671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.225176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.226003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.226661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.374207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:32.397502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa1fdb13-e224-4870-853e-3e264ef04aab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.452775 Nov 20 21:02:32.411070 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2370/4666] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:31 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:32.526898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:32.529433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:32.541114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.542582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.545411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.546348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.766682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:32.778370 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4140d943-4e58-4431-b07b-1bb3d4825d8b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.572057 Nov 20 21:02:32.784172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2297/4667] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:32 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:32.790757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:32.791625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:32.800292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.800866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:32.801796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:32.802511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.284080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:33.294713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc21a4d6-d760-473d-95dd-fc69ed698be4 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1544 microversion: 2.1 time: 0.509128 Nov 20 21:02:33.296192 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2298/4668] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:32 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1544 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:33.301124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:33.302366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:33.310524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.311021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.316129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.316129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.358595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b0e8fb90-a47e-4c9a-b704-8a0215c19b42 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.060888 Nov 20 21:02:33.359459 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2299/4669] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:33.364665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:33.365727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:33.373876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.374370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.375399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.376020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.438952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:33.447625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b9a2b9d5-7767-4a24-8c29-c2c9b958ef35 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1516 microversion: 2.1 time: 0.925248 Nov 20 21:02:33.448403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2371/4670] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:32 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1516 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:33.454370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:33.455330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:33.462486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.462942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.463743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.464182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.818357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:33.829670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f4f68b3-179c-447a-9e24-5a2212b15050 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1544 microversion: 2.1 time: 0.379397 Nov 20 21:02:33.830385 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2372/4671] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:33 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1544 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:33.840891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:33.842006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:33.866563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.871344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.874201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.875652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.924613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:33.936040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d755d0df-a4b6-4522-981a-59e70340bd8f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.575178 Nov 20 21:02:33.936627 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2300/4672] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:33 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:33.950560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:33.951182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:33.957138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.957843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:33.958738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:33.959178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.191177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:34.206710 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7358d182-49f2-4e33-b1b0-804779f7b8bc tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.259968 Nov 20 21:02:34.208302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2301/4673] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:33 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:34.214365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ef8ec65a-675e-4af1-b622-69bc35eb8d87 req-dbf86f84-1e1d-4c2c-96da-9bfd15b51e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7f9f50-4ba7-462b-8d2d-4b514ccd3301", "name": "network-vif-deleted", "tag": "a63523ab-4285-469f-b0a4-206673b76fcc"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:34.217768 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:34.217768 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:34.231260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef8ec65a-675e-4af1-b622-69bc35eb8d87 req-dbf86f84-1e1d-4c2c-96da-9bfd15b51e61 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.234910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef8ec65a-675e-4af1-b622-69bc35eb8d87 req-dbf86f84-1e1d-4c2c-96da-9bfd15b51e61 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.238483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:34.248625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c7b4df8-b938-42bb-b387-5e9ca3ffb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.416821 Nov 20 21:02:34.249232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2373/4674] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:33 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:34.260405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ef8ec65a-675e-4af1-b622-69bc35eb8d87 req-dbf86f84-1e1d-4c2c-96da-9bfd15b51e61 service nova] Creating event network-vif-deleted:a63523ab-4285-469f-b0a4-206673b76fcc for instance 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 on nch2-master-1 Nov 20 21:02:34.266740 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ef8ec65a-675e-4af1-b622-69bc35eb8d87 req-dbf86f84-1e1d-4c2c-96da-9bfd15b51e61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056755 Nov 20 21:02:34.267452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2302/4675] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:34.368830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:34.369822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:34.376342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.376794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.377569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.378004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.424756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-019860cf-55a4-4300-86eb-0e2cfc1b886a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.056654 Nov 20 21:02:34.429722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2374/4676] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:34.466800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:34.467520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:34.474604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.475067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.475885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.476333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.525560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.526027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.527807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lazy-loading 'fault' on Instance uuid 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:02:34.590422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:34.604214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71143f38-4adb-482c-945b-8cf2619b6592 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 200 len: 1310 microversion: 2.1 time: 0.142051 Nov 20 21:02:34.606674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2303/4677] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:34 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 1310 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:34.953709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:34.955570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:34.963093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.963539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:34.964333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:34.965274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.153577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:35.161294 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0164596b-e39f-4449-9164-575050adaf83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.212069 Nov 20 21:02:35.162232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2375/4678] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:34 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:35.228015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:35.228934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.235995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.236443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.237234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.237852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.265677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:35.266519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.277814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.278286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.279246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.284657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.434300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:35.441630 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d08c7889-edec-4f56-adba-1f522fffb220 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.180770 Nov 20 21:02:35.450190 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2376/4679] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:35 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:35.457865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:35.457865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.465830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.466942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.467902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.469187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.522834 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea212348-7ae2-4d3e-8306-1677945015b6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.071048 Nov 20 21:02:35.527623 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2377/4680] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:35 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:35.530358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:35.541175 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9225f00-9b22-4485-a067-a1aa626946f4 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.319512 Nov 20 21:02:35.543711 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2304/4681] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:35 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:35.624725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:35.625521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.633142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.633828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.634650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.635174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.651264 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] HTTP exception thrown: Instance 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 could not be found. Nov 20 21:02:35.652159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Returning 404 to user: Instance 3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:35.652985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbef6ab3-2f1e-493b-88fc-db7234013561 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301" status: 404 len: 111 microversion: 2.1 time: 0.033090 Nov 20 21:02:35.653700 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2378/4682] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:35 2021] GET /compute/v2.1/servers/3c7f9f50-4ba7-462b-8d2d-4b514ccd3301 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:35.661644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:35.662380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.668910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.669298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.670131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.670576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.700178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:02:35.811138 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b1e1e1d-c20c-47a1-bf58-1d52981b800b tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 204 len: 0 microversion: 2.1 time: 0.152618 Nov 20 21:02:35.813814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2305/4683] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:35 2021] DELETE /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:02:35.821337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:35.822316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:35.837918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.838405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:35.839207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:35.839683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.179557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:36.180266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:36.200873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:36.216168 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1688231-1584-443b-936c-d778ef4de43d tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1516 microversion: 2.1 time: 0.398320 Nov 20 21:02:36.219353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2379/4684] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:35 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:36.220438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.221422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.223560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.224635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.462098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:36.463548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:36.472288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.473408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.474609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.475366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.494981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:36.508681 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccc524ee-9375-401f-a13c-c831d11c39a3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.331335 Nov 20 21:02:36.509704 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2306/4685] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:36 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:36.534730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:36.537580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:36.546843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.547295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.548343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.549030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.595577 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-394ccae9-9cb0-403a-a889-df1bdb983352 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.064906 Nov 20 21:02:36.598862 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2307/4686] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:36 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:36.614505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:36.615257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:36.629758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.632091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.633137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:36.633637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:36.762739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:36.771781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3eae4a42-8409-4aa6-b08d-f7c0a249300a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.316454 Nov 20 21:02:36.773642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2380/4687] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:36 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:36.884061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:36.899877 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8191e910-7574-4b2a-bc70-aa147f33029c tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.296615 Nov 20 21:02:36.901223 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2308/4688] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:36 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:37.239454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:37.241458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:37.251609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.252229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.253575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.254275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.525926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:37.526817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:37.540700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.541234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.541982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.542620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.886266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:37.897191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a809fee1-f3d1-4c35-aa9b-695e3d6cbaeb tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1516 microversion: 2.1 time: 0.663463 Nov 20 21:02:37.899027 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2381/4689] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:37 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1516 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:37.905729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:37.908584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:37.909772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:37.924018 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b141b9a-ef91-43c0-a618-a2503ed49f16 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.400092 Nov 20 21:02:37.926263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.926837 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2309/4690] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:37 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:37.927215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.930807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.931513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.944020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:37.944920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:37.955581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.956620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:37.958601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:37.959299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:38.004208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7accef83-1b31-402c-af01-610a8a51bac4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.101748 Nov 20 21:02:38.004906 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2382/4691] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:37 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:38.010321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:38.011020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:38.023840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:38.025745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:38.026606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:38.027913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:38.402166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:38.411530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ef16cce-d93e-4985-9d0c-9779b5831f9e tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.405053 Nov 20 21:02:38.415496 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2383/4692] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:38 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:38.421770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-054fa703-53f5-4784-97c8-7b0b154bd672 req-08e9bb94-3a72-43a5-9317-595a6590716b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4219088e-ce1d-4f2f-8fc7-d2cfdeb14511", "name": "network-vif-plugged", "status": "completed", "tag": "079bdb9d-b496-4bf4-8785-ac0364396223"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:38.423559 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:38.423559 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:38.450470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-054fa703-53f5-4784-97c8-7b0b154bd672 req-08e9bb94-3a72-43a5-9317-595a6590716b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:38.451263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-054fa703-53f5-4784-97c8-7b0b154bd672 req-08e9bb94-3a72-43a5-9317-595a6590716b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:38.484079 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-054fa703-53f5-4784-97c8-7b0b154bd672 req-08e9bb94-3a72-43a5-9317-595a6590716b service nova] Creating event network-vif-plugged:079bdb9d-b496-4bf4-8785-ac0364396223 for instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 on nch2-master-1 Nov 20 21:02:38.500076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-054fa703-53f5-4784-97c8-7b0b154bd672 req-08e9bb94-3a72-43a5-9317-595a6590716b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081702 Nov 20 21:02:38.501427 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2384/4693] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:38.917295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:38.918082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:38.931176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:38.936338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:38.937502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:38.938332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.032733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:39.041606 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14c0aad0-44d3-4b66-8c22-47afb0292199 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 1.113686 Nov 20 21:02:39.046240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2310/4694] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:37 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:39.050821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:39.057833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:39.076411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.077154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.078205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.078815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.193668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:39.201518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3308426-f51e-4c3b-a4cf-fce0e3957ce4 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1516 microversion: 2.1 time: 0.289952 Nov 20 21:02:39.202395 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2385/4695] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:38 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:39.216222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:39.217445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:39.224750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.225487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.226463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.227595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.274711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-378c6f22-613d-4952-8bff-bcc3c7658900 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.061939 Nov 20 21:02:39.275981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2386/4696] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:39 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:39.435467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:39.439701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:39.462023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:39.471666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.473774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.474774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.478199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.484301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c24f1c15-32bb-476b-8813-db5a78d4fbaf tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.436102 Nov 20 21:02:39.487290 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2311/4697] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:39 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:39.664274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-af320a0b-5ee0-4fcd-9d01-0ea3bed91e3a req-16272360-a2bc-4958-8712-0214d86f8fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc25086-0d43-4e57-88e4-74951ec706cb", "name": "network-vif-deleted", "tag": "30ac0211-8c85-4946-8044-a3d499132c3b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:39.670068 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:39.670068 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:39.700264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-af320a0b-5ee0-4fcd-9d01-0ea3bed91e3a req-16272360-a2bc-4958-8712-0214d86f8fd6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:39.700740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-af320a0b-5ee0-4fcd-9d01-0ea3bed91e3a req-16272360-a2bc-4958-8712-0214d86f8fd6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:39.734873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-af320a0b-5ee0-4fcd-9d01-0ea3bed91e3a req-16272360-a2bc-4958-8712-0214d86f8fd6 service nova] Creating event network-vif-deleted:30ac0211-8c85-4946-8044-a3d499132c3b for instance 8fc25086-0d43-4e57-88e4-74951ec706cb on nch1-master-1 Nov 20 21:02:39.742351 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-af320a0b-5ee0-4fcd-9d01-0ea3bed91e3a req-16272360-a2bc-4958-8712-0214d86f8fd6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089634 Nov 20 21:02:39.743456 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2312/4698] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:39.846322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:39.857125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0060e5f0-92e1-461f-b949-ae4ab49313a1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1313 microversion: 2.1 time: 0.430509 Nov 20 21:02:39.857725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2387/4699] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:39 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:40.061839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:40.063303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:40.077779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.078658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.081700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.085390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.219620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:40.220738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:40.232566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.234643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.235641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.236111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.352849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.353908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.354865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lazy-loading 'fault' on Instance uuid 8fc25086-0d43-4e57-88e4-74951ec706cb {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:02:40.461656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53b3846df3841c3a16cd4142a5f4e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a7b316a84eb425aabf378a838ec02b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:40.478618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e849568-ab4f-48e3-92d5-1db3c83836c9 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 200 len: 1310 microversion: 2.1 time: 0.262686 Nov 20 21:02:40.481084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2388/4700] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:40 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 1310 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:40.488033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:40.489301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:40.499898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.502617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.504437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.505784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.662625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81b4b3ca-2690-4719-a920-fbb4effe5a87 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.166128 Nov 20 21:02:40.665909 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2389/4701] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:40.687949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:40.689953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:40.700626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.701866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.704706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.705575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.728727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:40.744380 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fb580df-02b2-4629-af10-164d87eabd2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.688892 Nov 20 21:02:40.755027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2313/4702] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:40 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:40.874412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:40.875481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:40.889775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.890389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:40.891324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:40.891990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.080367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:41.090709 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-564091c2-ecbb-44e0-bce4-aed1f50ce926 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.423158 Nov 20 21:02:41.104150 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2390/4703] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:40 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:41.270219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:41.280436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a00cb1f-9cf0-4cf1-b9b5-e5b24faa9f09 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1498 microversion: 2.1 time: 0.409612 Nov 20 21:02:41.281485 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2314/4704] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:40 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1498 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:41.304424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18e9c47a-de69-4573-aed5-8102eb0d1ac1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:41.328435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.server_groups [None req-18e9c47a-de69-4573-aed5-8102eb0d1ac1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Querying cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) for 1 instances {{(pid=140941) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 20 21:02:41.329331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18e9c47a-de69-4573-aed5-8102eb0d1ac1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.329865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18e9c47a-de69-4573-aed5-8102eb0d1ac1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.381344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18e9c47a-de69-4573-aed5-8102eb0d1ac1 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f" status: 200 len: 220 microversion: 2.1 time: 0.083488 Nov 20 21:02:41.382269 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2391/4705] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 21:02:41 2021] GET /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f => generated 220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:41.393166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:41.393669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:41.400612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.401140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.401897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.402488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.442746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:02:41.545259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:41.545882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] [instance: 8fc25086-0d43-4e57-88e4-74951ec706cb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:41.559465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.559857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.561006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.561611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.587138 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] HTTP exception thrown: Instance 8fc25086-0d43-4e57-88e4-74951ec706cb could not be found. Nov 20 21:02:41.587668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] Returning 404 to user: Instance 8fc25086-0d43-4e57-88e4-74951ec706cb could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:41.588508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3314786-6479-4d6f-a84b-90374e69f597 tempest-ListServerFiltersTestJSON-631652527 tempest-ListServerFiltersTestJSON-631652527-project] 10.222.0.41 "GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb" status: 404 len: 111 microversion: 2.1 time: 0.095064 Nov 20 21:02:41.593736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2392/4706] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:41 2021] GET /compute/v2.1/servers/8fc25086-0d43-4e57-88e4-74951ec706cb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:41.656225 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f01f7934-63ef-4512-be8e-426a8728cd0f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 204 len: 0 microversion: 2.1 time: 0.266564 Nov 20 21:02:41.660528 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2315/4707] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:41 2021] DELETE /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:41.671559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:41.672171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:41.696340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.696918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.699811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:41.701386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.701948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.707163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:41.725465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.727259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.729409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:41.732358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:41.794981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6b650fb-cb3d-4e6f-8456-3b0976c21679 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.118137 Nov 20 21:02:41.796412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2316/4708] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:41.976707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:41.989916 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-827ecab4-9321-4b89-bc58-1c25bec7aed0 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1504 microversion: 2.1 time: 0.325497 Nov 20 21:02:41.990937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2393/4709] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:41 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:42.128522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:42.129159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:42.140817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.141654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.143230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.143838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.248288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:42.248999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:42.279767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.286332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.289029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.289750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.377390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:42.390794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1282702-b55b-4167-98e9-bcfbab68b724 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.272730 Nov 20 21:02:42.399755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2394/4710] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:42 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:42.667527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:42.685967 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-340476c6-c75c-4eac-b58b-a6a8f6901dd8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1512 microversion: 2.1 time: 0.879261 Nov 20 21:02:42.687349 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2317/4711] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:41 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:42.805628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:42.806636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:42.817608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.818075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.818915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:42.819348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:42.901217 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61029811-6f18-4b2d-b3ef-ee88d96b4cc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 14 microversion: 2.32 time: 0.098980 Nov 20 21:02:42.902748 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2395/4712] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:43.008930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:43.009535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:43.024630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.025103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.025923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.027893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.371471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:43.382827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74a473a6-9e62-4bbb-8c66-2491a5e19803 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1504 microversion: 2.1 time: 0.377546 Nov 20 21:02:43.389653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2318/4713] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:43 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:43.410498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:43.411129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:43.425885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.426373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.427737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.428450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.705785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:43.706904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:43.715470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.717368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.718417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.719309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.943071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:43.950976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6d21676-6639-4e50-8f41-8fc8b334e962 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.545511 Nov 20 21:02:43.953804 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2396/4714] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:43 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:43.962183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:43.966043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:43.978859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.982454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:43.984769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:43.985392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.042995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-610a797d-6180-4e74-b266-65cd47b5355c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 8206 microversion: 2.32 time: 0.086896 Nov 20 21:02:44.044999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2397/4715] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:43 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 8206 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:44.317605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-45cd45dc-28c3-456e-bede-b22658d35b16 req-dc8a7dff-b5de-4f3f-8c6d-3a25ff25e35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4219088e-ce1d-4f2f-8fc7-d2cfdeb14511", "name": "network-vif-deleted", "tag": "079bdb9d-b496-4bf4-8785-ac0364396223"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:44.320549 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:44.320549 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:02:44.333627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-45cd45dc-28c3-456e-bede-b22658d35b16 req-dc8a7dff-b5de-4f3f-8c6d-3a25ff25e35c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.334653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-45cd45dc-28c3-456e-bede-b22658d35b16 req-dc8a7dff-b5de-4f3f-8c6d-3a25ff25e35c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.359902 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-45cd45dc-28c3-456e-bede-b22658d35b16 req-dc8a7dff-b5de-4f3f-8c6d-3a25ff25e35c service nova] Creating event network-vif-deleted:079bdb9d-b496-4bf4-8785-ac0364396223 for instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 on nch2-master-1 Nov 20 21:02:44.365875 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-45cd45dc-28c3-456e-bede-b22658d35b16 req-dc8a7dff-b5de-4f3f-8c6d-3a25ff25e35c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052853 Nov 20 21:02:44.367161 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2398/4716] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:02:44.408765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:44.411929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:44.423431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.424261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.426760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.427444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.480785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.482204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.482800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lazy-loading 'fault' on Instance uuid 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:02:44.535561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:44.544121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed192489-ec06-4d0e-831f-4aa7f68e48e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1489 microversion: 2.1 time: 0.842669 Nov 20 21:02:44.544716 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2319/4717] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:43 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1489 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:44.561257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:44.562337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:44.569454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.569924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.570811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.571259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.580826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeae7a5625f4067b79ea0ebcc638efe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a1eb46e47b43ea916c35d5747f21d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:44.594448 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6f13caa-6d14-48f5-a3ba-f46b76a92e89 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 200 len: 1303 microversion: 2.1 time: 0.190851 Nov 20 21:02:44.596156 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2399/4718] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:44 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 1303 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:44.635254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b7983b63-3186-4e38-aea7-22ccc7f04e7c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 200 len: 158 microversion: 2.1 time: 0.077903 Nov 20 21:02:44.635855 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2320/4719] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:02:44 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 158 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:44.647280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:44.650374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:44.660236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.666358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.668204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.669473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.842230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:44.851402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ed005da-3958-4649-8303-77117f0b36eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.209301 Nov 20 21:02:44.852258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2400/4720] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:44.875424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:44.876334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:44.896466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.898722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.900709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.901281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.973046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:44.973694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:44.984581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.987181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:44.989063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:44.989851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.194735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:45.202582 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91bc0a33-8050-4efd-ad3b-d4685ad49a50 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.332672 Nov 20 21:02:45.204783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:45.205890 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2321/4721] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:45.214662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:45.216090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-251b29c3-74cb-456f-b6c7-e34d4a3612c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.246913 Nov 20 21:02:45.217161 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2401/4722] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:44 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:45.217829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:45.235258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.236079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.237116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.237843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.323727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91418f1f-3280-48dd-b0b0-f8bd8b225000 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 16398 microversion: 2.32 time: 0.116130 Nov 20 21:02:45.325766 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2322/4723] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 16398 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:45.554316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1386350999", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "bafdbd34-4234-401f-abb5-0b7b5a2562ab"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:45.615022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.616488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:45.628513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.630866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.635451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.635901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.676527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] validate_networks() for [('bafdbd34-4234-401f-abb5-0b7b5a2562ab', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:02:45.686887 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. Nov 20 21:02:45.687990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.689007 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b757b53f-2d88-434c-ba43-9f47e5b0253b tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 404 len: 111 microversion: 2.1 time: 0.079406 Nov 20 21:02:45.701576 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2323/4724] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:45 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:02:45.716391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9dda0f4b-2d50-4886-89f8-b165b9fa7a53 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.736811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_groups [None req-9dda0f4b-2d50-4886-89f8-b165b9fa7a53 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Querying cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) for 1 instances {{(pid=140942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 20 21:02:45.737947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dda0f4b-2d50-4886-89f8-b165b9fa7a53 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.742368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dda0f4b-2d50-4886-89f8-b165b9fa7a53 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.759842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9dda0f4b-2d50-4886-89f8-b165b9fa7a53 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.056754 Nov 20 21:02:45.762461 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2324/4725] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:02:45 2021] GET /compute/v2.1/os-server-groups => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:45.776089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d71e6083-b4e1-4191-80a9-5b630b61fe7f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.803026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_groups [None req-d71e6083-b4e1-4191-80a9-5b630b61fe7f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Querying cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) for 1 instances {{(pid=140942) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Nov 20 21:02:45.805097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d71e6083-b4e1-4191-80a9-5b630b61fe7f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.805791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d71e6083-b4e1-4191-80a9-5b630b61fe7f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.835772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d71e6083-b4e1-4191-80a9-5b630b61fe7f tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f" status: 200 len: 182 microversion: 2.1 time: 0.063812 Nov 20 21:02:45.837408 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2325/4726] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 21:02:45 2021] GET /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f => generated 182 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:45.851024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.851720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:45.860650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.861738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.862777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.863220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.877559 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. Nov 20 21:02:45.878186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.879015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a52f525-6082-429a-80ce-8035b0387999 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 404 len: 111 microversion: 2.1 time: 0.035351 Nov 20 21:02:45.879803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2326/4727] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:02:45 2021] DELETE /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:45.888685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.889332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] [instance: 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:45.895487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.896013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.896889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:45.897337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:45.913971 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. Nov 20 21:02:45.914934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance 4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.915782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-157d4c95-a23e-42a1-8356-d99c178ea9af tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511" status: 404 len: 111 microversion: 2.1 time: 0.031786 Nov 20 21:02:45.916354 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2327/4728] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:45 2021] GET /compute/v2.1/servers/4219088e-ce1d-4f2f-8fc7-d2cfdeb14511 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:02:45.924871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-885010a0-a53d-4783-b385-1ef2e7917217 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.930969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-885010a0-a53d-4783-b385-1ef2e7917217 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance group 03423d60-1a0f-4373-b2da-5a3a422e8295 could not be found. Nov 20 21:02:45.931711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-885010a0-a53d-4783-b385-1ef2e7917217 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance group 03423d60-1a0f-4373-b2da-5a3a422e8295 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.932371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-885010a0-a53d-4783-b385-1ef2e7917217 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/03423d60-1a0f-4373-b2da-5a3a422e8295" status: 404 len: 117 microversion: 2.1 time: 0.011330 Nov 20 21:02:45.934116 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2328/4729] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:45 2021] DELETE /compute/v2.1/os-server-groups/03423d60-1a0f-4373-b2da-5a3a422e8295 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:02:45.944642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a421754-569c-4a68-83fb-8ea3c1bdc7fd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.953773 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3a421754-569c-4a68-83fb-8ea3c1bdc7fd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance group 771cecc8-6b31-418d-a9b2-7622984e9823 could not be found. Nov 20 21:02:45.954416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a421754-569c-4a68-83fb-8ea3c1bdc7fd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance group 771cecc8-6b31-418d-a9b2-7622984e9823 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.956123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a421754-569c-4a68-83fb-8ea3c1bdc7fd tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/771cecc8-6b31-418d-a9b2-7622984e9823" status: 404 len: 117 microversion: 2.1 time: 0.018188 Nov 20 21:02:45.956683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2329/4730] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:45 2021] DELETE /compute/v2.1/os-server-groups/771cecc8-6b31-418d-a9b2-7622984e9823 => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:45.964731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2c581bf-c7a9-4733-9617-4ac6c192f968 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.971225 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f2c581bf-c7a9-4733-9617-4ac6c192f968 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance group 4e657493-1695-4c0e-9918-a10bbdfa5b99 could not be found. Nov 20 21:02:45.971886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2c581bf-c7a9-4733-9617-4ac6c192f968 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance group 4e657493-1695-4c0e-9918-a10bbdfa5b99 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.972755 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2c581bf-c7a9-4733-9617-4ac6c192f968 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/4e657493-1695-4c0e-9918-a10bbdfa5b99" status: 404 len: 117 microversion: 2.1 time: 0.011773 Nov 20 21:02:45.973351 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2330/4731] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:45 2021] DELETE /compute/v2.1/os-server-groups/4e657493-1695-4c0e-9918-a10bbdfa5b99 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:45.983409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c31b2f25-829d-4db4-8c2c-08d5881fd144 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:45.990436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c31b2f25-829d-4db4-8c2c-08d5881fd144 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] HTTP exception thrown: Instance group 8ac14d0f-6da9-4485-8880-b3d6529dffd6 could not be found. Nov 20 21:02:45.991032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c31b2f25-829d-4db4-8c2c-08d5881fd144 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Returning 404 to user: Instance group 8ac14d0f-6da9-4485-8880-b3d6529dffd6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:02:45.991929 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c31b2f25-829d-4db4-8c2c-08d5881fd144 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/8ac14d0f-6da9-4485-8880-b3d6529dffd6" status: 404 len: 117 microversion: 2.1 time: 0.012797 Nov 20 21:02:45.992406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2331/4732] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:45 2021] DELETE /compute/v2.1/os-server-groups/8ac14d0f-6da9-4485-8880-b3d6529dffd6 => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:02:46.125983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-303630128", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": "none"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:46.200688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:46.201132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:46.201603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:46.202206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:46.202776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:46.215714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.216760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.217984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.218631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.241608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Getting quotas for project 3ad38a853c584bcabdd708213a299a7b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:46.247065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Getting quotas for user aff831b6c90541feb23c5902e8ef9ab7 and project 3ad38a853c584bcabdd708213a299a7b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:46.260544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:46.263136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:46.317701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef6ebb17-e906-4893-a4cc-d578ae831a9a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.324074 Nov 20 21:02:46.318551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2332/4733] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:02:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 21:02:46.324772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44c99758-6f85-4c3f-b366-f7a6232c2373 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:46.356149 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44c99758-6f85-4c3f-b366-f7a6232c2373 tempest-ServerGroupTestJSON-2034354336 tempest-ServerGroupTestJSON-2034354336-project] 10.222.0.41 "DELETE /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f" status: 204 len: 0 microversion: 2.1 time: 0.035502 Nov 20 21:02:46.357208 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2333/4734] 10.222.0.41 () {58 vars in 1265 bytes} [Sat Nov 20 21:02:46 2021] DELETE /compute/v2.1/os-server-groups/c2697007-90c1-48cc-a844-820f73c5f67f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:02:46.362185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:46.362923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:46.369688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.370175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.371358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.371838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.649817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:46.686182 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9757db53-1333-4291-a864-736751990d1e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.325877 Nov 20 21:02:46.688186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2334/4735] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:46 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:46.699492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:46.703138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:46.770976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:46.772112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:46.773190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:46.774087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:46.774707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:46.785400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.786854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.787848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.788663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.811098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:46.817588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:46.858723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:46.861681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:46.863157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:46.889045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:46.895293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:46.901076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-65c3493d-b7a3-4186-8599-2825751afd0e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 200 len: 1277 microversion: 2.47 time: 0.206124 Nov 20 21:02:46.918086 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2335/4736] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:46 2021] GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:46.918676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:46.923512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:46.956488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.959757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.960846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:46.961361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:46.962076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7dd82b4b-1f40-4b1d-9bb5-98aa9d912829 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411231 Nov 20 21:02:46.966866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2402/4737] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:02:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:02:46.990915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a22488f9-5653-4310-b66b-b90cba6489cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:46.996131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a22488f9-5653-4310-b66b-b90cba6489cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:47.075610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb3d08f2-c88b-45eb-bd37-ef2c6e39238b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 16398 microversion: 2.32 time: 0.166699 Nov 20 21:02:47.078277 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2336/4738] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:46 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 16398 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:47.164031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1773384024", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": "none"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:47.166516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a22488f9-5653-4310-b66b-b90cba6489cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:47.181395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a22488f9-5653-4310-b66b-b90cba6489cf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1215 microversion: 2.1 time: 0.204070 Nov 20 21:02:47.193832 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2403/4739] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:46 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:47.281251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:47.281978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:47.282631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:47.283272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:47.283839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:47.293867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:47.294740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:47.307273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:47.308262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:47.334882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Getting quotas for project 3ad38a853c584bcabdd708213a299a7b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:47.341704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Getting quotas for user aff831b6c90541feb23c5902e8ef9ab7 and project 3ad38a853c584bcabdd708213a299a7b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:47.357320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:47.360547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:47.489781 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b16c31c8-96a6-40fd-85b5-d62c1752afdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.330740 Nov 20 21:02:47.510147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b528b534-c175-4745-a028-2d186a70362b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:47.512338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b528b534-c175-4745-a028-2d186a70362b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:47.519448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2337/4740] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:02:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 20 21:02:47.636671 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b528b534-c175-4745-a028-2d186a70362b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "PUT /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 992 microversion: 2.47 time: 0.129876 Nov 20 21:02:47.640865 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2404/4741] 10.222.0.41 () {62 vars in 1296 bytes} [Sat Nov 20 21:02:47 2021] PUT /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 992 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:02:47.655929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:47.657242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:47.705397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:47.706217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:47.714888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:47.715671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:47.720137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:47.725321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:47.772116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:47.784408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:47.786001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:47.789905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35a340e7-77be-4e14-8dc9-199acd36052a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1278 microversion: 2.47 time: 0.135489 Nov 20 21:02:47.790543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2338/4742] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:47 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:48.089809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:48.091700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:48.104348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.104872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.113625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.114621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.181572 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d049613-3e0d-4461-b12f-556363767a78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 16398 microversion: 2.32 time: 0.096104 Nov 20 21:02:48.183670 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2339/4743] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:48 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 16398 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:48.215363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:48.218963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:48.250918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.252658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.254891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.256526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.397039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:48.418676 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92d31b18-8504-4990-8913-10a410141a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1211 microversion: 2.1 time: 0.217325 Nov 20 21:02:48.419402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2340/4744] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:48 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:48.535413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:48.540204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1bead7f8-56cc-4670-a92f-cd18f5303b12 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.837142 Nov 20 21:02:48.558439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2405/4745] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:47 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:48.811947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:48.813359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:48.830444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.831148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.832431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:48.833073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:48.911913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:48.922867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:48.925377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:48.926854 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ac01cf0-d5fb-4227-a05c-44fbea5e44f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1330 microversion: 2.47 time: 0.121179 Nov 20 21:02:48.927988 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2341/4746] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:48 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1330 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:49.194461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:49.196573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:49.207382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.208150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.209204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.209654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.275363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a115857-4de7-46f8-a60f-c6c9efa8ef46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.083374 Nov 20 21:02:49.277236 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2406/4747] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:49 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:49.439604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:49.440848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:49.460055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.460624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.461514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.462130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.567414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:49.568119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:49.578309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:49.580327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.581440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.582845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.583428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.589276 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54dc09b2-e011-4b47-a358-3038f802151d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1273 microversion: 2.1 time: 0.154178 Nov 20 21:02:49.590424 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2342/4748] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:49 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:49.948285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:49.948285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:49.966541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.967005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:49.967818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:49.968266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:50.085721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:50.090515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:50.095665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:50.097244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:50.098426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0578ee8-e0b3-4de3-b70c-59e24f6f4cdd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1336 microversion: 2.47 time: 0.155796 Nov 20 21:02:50.098997 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2343/4749] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:49 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:02:50.106030 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f21cbfa5-b83e-47da-a7ed-5372d080ade1 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.543000 Nov 20 21:02:50.120768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2407/4750] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:49 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:50.292039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:50.293528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:50.300765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:50.301361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:50.302409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:50.302942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:50.374209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff2f1bad-7379-4d45-b255-8b5abb764b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.087714 Nov 20 21:02:50.375019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2344/4751] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:50.608986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:50.611209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:50.621724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:50.622363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:50.623280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:50.623946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.102824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:51.113696 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7669608f-7e85-4701-9e12-c6bc09c4206e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.508826 Nov 20 21:02:51.113696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2408/4752] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:50 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:51.130013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:51.130597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:51.130898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:51.131488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:51.139068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.139543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.140729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.141465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.141626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.142522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.155074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.156461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.244060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:51.253871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:51.255347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:51.256713 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e21415a6-51ba-4f5e-afdc-0b72c67313a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1336 microversion: 2.47 time: 0.139839 Nov 20 21:02:51.257281 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2345/4753] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:51 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1336 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:51.387174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:51.388359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:51.395241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.395699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.396559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:51.397010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:51.441333 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-85a2886f-2640-4179-ad86-517f7a1029c0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.058664 Nov 20 21:02:51.442007 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2346/4754] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:02:51.926001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:51.935445 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8120d67d-ce38-41f1-82dc-8a2a413b5c08 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.811060 Nov 20 21:02:51.936118 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2409/4755] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:51 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:52.131341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:52.132055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:52.154034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.154034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.154034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.154034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.350184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-210036426", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:52.407961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:52.421959 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1347d09c-5f37-4f35-8d7a-d3b02c368597 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.294349 Nov 20 21:02:52.423181 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2347/4756] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:52 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:52.430609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:52.431572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:52.440206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.440729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.441997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.442648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.445658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] validate_networks() for [('7652536f-b93f-4f95-b9ae-3fa277d2f430', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:02:52.533240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:52.545427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:52.547945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:52.549603 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00925917-25ba-4c7d-bcfc-7f6cc72a5640 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1357 microversion: 2.47 time: 0.124602 Nov 20 21:02:52.566550 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2348/4757] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:52 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:52.573458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:52.574931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:52.587723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.588402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.591407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.592129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.675749 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-008c71c6-c332-4785-93ba-94ae054d2019 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.106507 Nov 20 21:02:52.679043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2349/4758] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:52.689991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:52.692120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:52.701110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.702265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.704011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.704664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.883001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:52.883464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:52.883962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:52.884533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:52.884953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:52.983284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:52.992846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.993852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:52.994418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:52.996923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.040914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fef3f0fa-0c3c-4824-8b99-12b1733f238d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "POST /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58/action" status: 202 len: 1079 microversion: 2.47 time: 0.356632 Nov 20 21:02:53.050230 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2350/4759] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:52 2021] POST /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58/action => generated 1079 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 20 21:02:53.057169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-98ffc2f1-5573-427d-ab85-315c46c8520b req-4661c4d1-f408-4f40-8b86-d301443a859c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67eb997-9ace-4561-a2e9-959c7bf3252b", "tag": "ef1ededa-73ec-4b63-8c91-5d3cfac10c0d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:53.060305 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:53.060305 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:53.068577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-98ffc2f1-5573-427d-ab85-315c46c8520b req-4661c4d1-f408-4f40-8b86-d301443a859c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.069061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-98ffc2f1-5573-427d-ab85-315c46c8520b req-4661c4d1-f408-4f40-8b86-d301443a859c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.082582 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-98ffc2f1-5573-427d-ab85-315c46c8520b req-4661c4d1-f408-4f40-8b86-d301443a859c service nova] Creating event network-changed:ef1ededa-73ec-4b63-8c91-5d3cfac10c0d for instance a67eb997-9ace-4561-a2e9-959c7bf3252b on nch2-master-1 Nov 20 21:02:53.087362 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-98ffc2f1-5573-427d-ab85-315c46c8520b req-4661c4d1-f408-4f40-8b86-d301443a859c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034453 Nov 20 21:02:53.088409 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2351/4760] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:02:53.094214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:53.094846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:53.101482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.102159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.103292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.103422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.287646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.299391 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d97ed30e-51e5-48fa-a041-5d14585bcedb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.209683 Nov 20 21:02:53.299989 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2352/4761] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:53 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:53.317377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:53.319254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:53.330251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.331068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.332036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.335190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.424011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.435199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.436068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.437571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42de8539-57eb-4868-b12b-9493b8951d17 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.126793 Nov 20 21:02:53.438313 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2353/4762] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:53 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:53.442923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:53.443564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:53.450225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.450686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.451502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.451951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.505575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:02:53.506156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:02:53.507134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:02:53.507692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:02:53.508203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:02:53.520997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.522531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.523615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.524161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.546667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Getting quotas for project 6df9b387c748458fb8119674e7463c3e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:02:53.552161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Getting quotas for user 05c283db7ca74944ba8f7cd718b6d08c and project 6df9b387c748458fb8119674e7463c3e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:02:53.570176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:02:53.572987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:02:53.630352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.641191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-331b534d-2bfd-4211-8bd6-c55fb45a30c8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485763 Nov 20 21:02:53.642532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2410/4763] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:02:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:02:53.653906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25bfdbd3-d706-4ed1-b1a0-5166e03fdf64 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:53.654762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25bfdbd3-d706-4ed1-b1a0-5166e03fdf64 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:53.659491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61e2b198-e080-4a82-a368-61205f456fa1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.219971 Nov 20 21:02:53.662167 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2354/4764] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:53 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:53.697133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:53.700917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:53.714448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.715112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.716409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:53.716704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:53.757681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25bfdbd3-d706-4ed1-b1a0-5166e03fdf64 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:53.767083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25bfdbd3-d706-4ed1-b1a0-5166e03fdf64 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1223 microversion: 2.1 time: 0.117791 Nov 20 21:02:53.775546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a301c4f9-d41c-46a0-b32f-5ec55a4e3220 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.081594 Nov 20 21:02:53.778083 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2355/4765] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:53 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:53.782344 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2411/4766] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:53 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:54.317470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:54.319068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:54.328911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.329625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.330853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.331723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.459829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:54.460462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:54.474407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.475077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.476121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.476594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.483645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:54.493643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e4bd96e-a226-4431-b8c0-4d6b274398f0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.180375 Nov 20 21:02:54.495458 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2356/4767] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:54 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:54.677923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:54.678469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:54.686666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.687119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.687986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.688568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.899247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:54.920160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:54.922349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:54.924059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-940b5f9b-4119-4578-af07-0e9cd1ec01f9 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.471482 Nov 20 21:02:54.936637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2412/4768] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:54 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:02:54.943079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:54.944280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:54.954995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.956057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:54.958458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:54.959126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.028339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b2cb5c63-5b6b-4302-9aeb-f03570b52431 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.089948 Nov 20 21:02:55.032957 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2413/4769] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:55.038365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:55.039549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:55.047297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.047835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.048944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.049426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.083794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:55.093808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e9db076-20b2-473c-948c-01bc2058dc47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.420314 Nov 20 21:02:55.099856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2357/4770] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:54 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:55.193204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:55.203515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67bc6261-d00c-4c1e-a1e6-a9e28a60556e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1281 microversion: 2.1 time: 0.169065 Nov 20 21:02:55.205754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2414/4771] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:55 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:55.513833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:55.515286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:55.525183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.525836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.528165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.528860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.767303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:55.780419 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cabd27e4-d8fb-4419-8f13-a128f500fe3c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.273019 Nov 20 21:02:55.781501 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2358/4772] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:55 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:55.943726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:55.945070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:55.954460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.954915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:55.955749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:55.956279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.040514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:56.041329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:56.049480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.050414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.051455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.052176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:56.052465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.067459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:56.069114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:56.070801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05a30621-5691-4316-8a75-6d3dfbbede75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.131198 Nov 20 21:02:56.082811 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2415/4773] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:55 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:56.112155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b756f435-a3f2-4515-9d28-9a9ff8c59b14 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.075307 Nov 20 21:02:56.113078 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2359/4774] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:56 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:02:56.113871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:56.114869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:56.123966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.124680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.126385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.127020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.228811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:56.231957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:56.245208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.246550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.247991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.248705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.340066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:56.350957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01d05fcb-4339-4a91-aab1-88f6285312ae tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.241020 Nov 20 21:02:56.351636 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2416/4775] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:56 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:56.624529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:56.637069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa3e9321-2668-48cf-b123-355c08c79ce6 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.416276 Nov 20 21:02:56.638462 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2360/4776] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:56 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:56.798882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:56.799733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:56.806228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.807003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.808221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.808983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.873472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-365dc1ac-cc91-4aee-8e38-8a2f77a08741 req-2d360052-1c8e-48d6-bec9-23abd8062022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8f215b-683e-4c22-a383-939476dbc05c", "tag": "659e7819-8eb1-4918-a6b8-563de764690f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:56.885754 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:02:56.885754 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:02:56.900136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-365dc1ac-cc91-4aee-8e38-8a2f77a08741 req-2d360052-1c8e-48d6-bec9-23abd8062022 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:56.900545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-365dc1ac-cc91-4aee-8e38-8a2f77a08741 req-2d360052-1c8e-48d6-bec9-23abd8062022 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:56.913440 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-365dc1ac-cc91-4aee-8e38-8a2f77a08741 req-2d360052-1c8e-48d6-bec9-23abd8062022 service nova] Creating event network-changed:659e7819-8eb1-4918-a6b8-563de764690f for instance aa8f215b-683e-4c22-a383-939476dbc05c on nch2-master-1 Nov 20 21:02:56.921405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-365dc1ac-cc91-4aee-8e38-8a2f77a08741 req-2d360052-1c8e-48d6-bec9-23abd8062022 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052085 Nov 20 21:02:56.922152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2361/4777] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:02:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:02:57.080912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:57.096950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:57.098219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:57.105969 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79c4f743-fcfc-4103-889d-fada75a9c66c tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.309974 Nov 20 21:02:57.108991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2417/4778] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:56 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:57.111064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.111862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.112671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.113112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.124212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:57.125265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:57.131614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.132361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.133368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.134437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.186899 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2665b710-0eca-4a76-b58f-508e13d4fe8f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.066486 Nov 20 21:02:57.192071 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2418/4779] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:57 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:02:57.233824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:57.255154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:57.258528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:57.261299 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-458226d0-b9e8-493e-9c8b-49767a35aefe tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.173031 Nov 20 21:02:57.262746 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2362/4780] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:57 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:57.372512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:57.373615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:57.383423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.384226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.385055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.386657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.578022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:57.585948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-946662b5-971f-4e0c-b33f-bf1bab44fd8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.220168 Nov 20 21:02:57.586659 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2419/4781] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:57 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:57.655987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:57.656723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:57.666041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.666646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:57.669271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:57.669780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.127125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:58.128883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:58.149319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.149983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.153630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.154759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.163565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.175068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72057b2a-bf0f-4c2f-a468-ea7557606480 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.520467 Nov 20 21:02:58.185880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2363/4782] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:57 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:58.203911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:58.205208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:58.212221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.212979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.214083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.214734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.287042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87994245-e65a-4422-bd31-5288e735e78b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.088304 Nov 20 21:02:58.291612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2364/4783] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:58 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:02:58.297575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:58.298578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:58.309800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.310626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.311635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.312308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.424667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.436368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.437899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.447810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70c787c8-bdcd-47fb-ab54-82429c52a025 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.153090 Nov 20 21:02:58.449482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2365/4784] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:58 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:02:58.525369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.535341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14295071-5952-4bea-aa83-04bb0ecd6365 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.413229 Nov 20 21:02:58.545793 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2420/4785] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:58 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:58.604223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:58.605460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:58.615202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.615900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.616818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:58.617427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:58.864554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:58.875710 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c34001b-7754-4a84-ac32-9ddcf1cdd286 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.275679 Nov 20 21:02:58.876786 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2366/4786] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:58 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:59.195713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:59.196546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:59.208251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.210931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.213356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.213852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.301915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:02:59.303531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:59.313140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.314242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.315886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.316482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.382205 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9720be16-724b-4ad4-8c58-0e827ff06a8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.086072 Nov 20 21:02:59.383578 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2367/4787] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:02:59 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:02:59.468833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:59.470507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:59.477563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:59.481884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.482951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.484882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.485487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.491851 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf7f1962-4d6d-491f-8c4a-dc0cb4d44b53 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.300470 Nov 20 21:02:59.493830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2421/4788] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:59 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:02:59.551690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:59.552596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:59.561184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.561843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.562803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.563856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.575600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:59.589585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:59.591692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:59.593375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5799197e-1c9d-4c7d-ad8c-e29c697772dc tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.129507 Nov 20 21:02:59.594359 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2368/4789] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:02:59 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:02:59.820401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:02:59.834319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b06d3047-de53-4f4f-a0b5-91284e0ee1c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.286340 Nov 20 21:02:59.844648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2422/4790] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:59 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:02:59.894037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:02:59.894741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:02:59.902139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.902581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:02:59.903390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:02:59.903842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.168030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c317d2c0-5cf9-4306-adb7-28fd3400caa3 req-55fcf370-d733-4e53-ad3f-572308a3cbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67eb997-9ace-4561-a2e9-959c7bf3252b", "name": "network-vif-plugged", "status": "completed", "tag": "ef1ededa-73ec-4b63-8c91-5d3cfac10c0d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:00.169979 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:00.169979 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:00.187177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c317d2c0-5cf9-4306-adb7-28fd3400caa3 req-55fcf370-d733-4e53-ad3f-572308a3cbc1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.189395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c317d2c0-5cf9-4306-adb7-28fd3400caa3 req-55fcf370-d733-4e53-ad3f-572308a3cbc1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.220164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c317d2c0-5cf9-4306-adb7-28fd3400caa3 req-55fcf370-d733-4e53-ad3f-572308a3cbc1 service nova] Creating event network-vif-plugged:ef1ededa-73ec-4b63-8c91-5d3cfac10c0d for instance a67eb997-9ace-4561-a2e9-959c7bf3252b on nch2-master-1 Nov 20 21:03:00.234651 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c317d2c0-5cf9-4306-adb7-28fd3400caa3 req-55fcf370-d733-4e53-ad3f-572308a3cbc1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070911 Nov 20 21:03:00.237235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2423/4791] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:03:00.396590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:00.397919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:00.410033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.410991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.412008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.412793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.449122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:00.463618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f9301de-047d-4927-b969-44209b16dc60 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.572883 Nov 20 21:03:00.466658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2369/4792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:02:59 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:00.492602 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72518394-2c6c-4bfd-be69-6950d84c0fa0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.101187 Nov 20 21:03:00.499515 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2424/4793] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:00.513667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:00.514885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:00.526995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.528868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.530629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.531660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.617584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:00.618596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:00.630601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.631734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.633147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.633813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.766737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:00.780324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:00.785924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:00.788007 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba3a1ae5-73b2-4ce2-baae-4a4459add706 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.174736 Nov 20 21:03:00.789698 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2425/4794] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:00 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:03:00.853810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:00.854709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:00.863202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.863707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.864705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:00.866471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:00.919326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:00.928934 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a54860ba-86af-4624-8142-5863746f2d36 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.423318 Nov 20 21:03:00.934590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2370/4795] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:00 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:01.228179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:01.242149 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2fd88897-d25c-49e5-990c-5ede08f80123 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.392186 Nov 20 21:03:01.243403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2426/4796] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:00 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:01.483613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:01.484567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:01.493268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.493268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.493916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.494808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.508161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:01.509277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:01.543593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.546154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.547214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.549855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.606913 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0ddadc3-4770-4e76-a1cb-c2d714211f16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.102452 Nov 20 21:03:01.625722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2427/4797] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:01.812200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:01.813498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:01.823854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.824647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.825753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.826726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.942026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:01.942392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:01.961724 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aeff39cb-61f7-48c0-b947-33a63e72cf3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1315 microversion: 2.1 time: 0.474001 Nov 20 21:03:01.962759 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2371/4798] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:01 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:01.968747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:01.969055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:01.970742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:01.971588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:01.972590 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3bc8c306-e589-418b-8b7d-8379e72ee76a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.165512 Nov 20 21:03:01.973771 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2428/4799] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:01 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:01.986875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.987690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:01.988751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:01.991184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.265128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:02.267038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:02.286249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.287145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.288823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.289512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.310540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:02.319294 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f2bea5f-f7e4-45ad-b330-49c98823fc05 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.355253 Nov 20 21:03:02.322745 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2372/4800] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:01 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:02.626486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:02.637100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:02.639272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:02.652741 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-331ac36d-f076-42eb-b700-c7bab2b205ac tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.392487 Nov 20 21:03:02.655320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.655894 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2429/4801] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:02 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:02.668736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.673360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.675925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.775936 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99922ddd-5ca6-4615-a3ea-288bf4cbfe5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.145278 Nov 20 21:03:02.778618 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2373/4802] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:02.982109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:02.982996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:02.993612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.994116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.995657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:02.996106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:02.999327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:03.001901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.012293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.013214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.014283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.015387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.129522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.143133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.145056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.147711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f5fc0a0-7e4a-4af3-b0b5-3195b7057eca tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.155178 Nov 20 21:03:03.148809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2374/4803] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:02 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:03:03.233019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:03.233272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.243830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.244836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.247389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.249028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.259997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.273056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e088850c-b263-457d-8dda-a206e83f46ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1501 microversion: 2.1 time: 0.296095 Nov 20 21:03:03.279144 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2430/4804] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:02 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:03.284971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:03.302841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:03.304420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.321925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.322611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.327740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.330014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.384598 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3221e3d5-f8c7-47fb-813f-92bc26dd0455 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.092122 Nov 20 21:03:03.386303 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2431/4805] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:03 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:03.393362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:03.394436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.400456 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1c5c068-3c35-4596-a74e-5ecc56bc4976 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 204 len: 0 microversion: 2.1 time: 0.174352 Nov 20 21:03:03.401990 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2375/4806] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:03 2021] DELETE /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:03:03.406787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.407246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.408173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.408586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.418627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:03.419465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.426538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.427226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.428902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.429527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.623977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.633070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28b06f96-d80c-4f41-94d9-589798c0372a tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.244955 Nov 20 21:03:03.634071 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2432/4807] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:03 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:03.674792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:03.675456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.685671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.686541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.687531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.687955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.907103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:03.920887 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfee5257-5e1e-4bfb-bbf0-ce56a3a70c05 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.251224 Nov 20 21:03:03.930479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2433/4808] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:03 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:03.930479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:03.930479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:03.937711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.939039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:03.939545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:03.940297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.027126 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b172031-da1a-4ba6-863d-59ac1aaa061a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.098072 Nov 20 21:03:04.028183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2434/4809] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:03 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:04.092786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:04.105589 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca1f915f-3755-4ffb-a816-316c01332598 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1550 microversion: 2.1 time: 0.694758 Nov 20 21:03:04.110641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2376/4810] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:03 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1550 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:04.170992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:04.188996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:04.204000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.204510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.208873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.210598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.314286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f31c3df5-08f7-4765-a14b-b77bcd339f34 req-a0f216f1-02d5-4223-b80e-d777050e1571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8f215b-683e-4c22-a383-939476dbc05c", "name": "network-vif-plugged", "status": "completed", "tag": "659e7819-8eb1-4918-a6b8-563de764690f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:04.318159 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:04.318159 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:04.353246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f31c3df5-08f7-4765-a14b-b77bcd339f34 req-a0f216f1-02d5-4223-b80e-d777050e1571 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.358267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f31c3df5-08f7-4765-a14b-b77bcd339f34 req-a0f216f1-02d5-4223-b80e-d777050e1571 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.408134 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f31c3df5-08f7-4765-a14b-b77bcd339f34 req-a0f216f1-02d5-4223-b80e-d777050e1571 service nova] Creating event network-vif-plugged:659e7819-8eb1-4918-a6b8-563de764690f for instance aa8f215b-683e-4c22-a383-939476dbc05c on nch2-master-1 Nov 20 21:03:04.419784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f31c3df5-08f7-4765-a14b-b77bcd339f34 req-a0f216f1-02d5-4223-b80e-d777050e1571 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109936 Nov 20 21:03:04.424993 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2377/4811] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:03:04.437714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:04.441485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:04.452398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.455896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.457144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.458066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.493177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:04.505951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:04.507987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:04.509636 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8b32d52-d342-470d-b057-0d35b99f1594 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.344743 Nov 20 21:03:04.512765 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2435/4812] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:04 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:04.569164 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-daf4ba57-fd85-4d81-a594-7553a5db4f3d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.142054 Nov 20 21:03:04.570522 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2378/4813] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:04 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:04.665073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:04.665739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:04.700420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.702225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.703488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.704156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.940247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:04.941333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:04.949470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.949979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.951005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:04.951657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:04.964074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:04.974180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7a71291-769f-4d2b-9f00-3699a2c334f7 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.322992 Nov 20 21:03:04.974736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2436/4814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:04 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:05.039720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:05.040775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:05.049236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.050022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.050905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.051353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.097446 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ece551e-3e0b-40a7-a0fb-7ef5035dcf75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.061511 Nov 20 21:03:05.101476 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2437/4815] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:05 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:05.128417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:05.129176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:05.137986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.139209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.139872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.140369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.326721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:05.339871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a36b8c7-15f8-4552-bc20-214fb22a6003 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1550 microversion: 2.1 time: 0.215293 Nov 20 21:03:05.354030 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2438/4816] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:05 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1550 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:05.380797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:05.391590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9364eeda-6ef8-4081-9b20-e6b943143875 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1507 microversion: 2.1 time: 0.456050 Nov 20 21:03:05.392168 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2379/4817] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:04 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:05.534875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:05.535593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:05.546147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.546895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.548369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.549008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.582693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:05.584265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:05.593217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.593805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.594716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:05.596020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:05.632680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:05.643536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:05.645039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:05.646650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8bf0db8d-caad-4ab9-a808-fd928ce102ce tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.115226 Nov 20 21:03:05.646971 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c56f78fe-9c08-4909-aedb-1b79c69e5a8a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.068570 Nov 20 21:03:05.647672 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2380/4818] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:05 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:03:05.654203 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2439/4819] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:05 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:05.994692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:05.996585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.010137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.011875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.013376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.014032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.115023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:06.116499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.128620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.130356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.131671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.133880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.194970 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12f6a67f-2519-4e94-8963-e394601ca6fc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.087940 Nov 20 21:03:06.196012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2440/4820] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:06 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:06.330571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7b15c199-789d-426f-8328-6f5eac5dac74 req-a7e8b31a-96e6-4bd2-b092-3774241ef139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d887f393-fa16-4eb3-8539-7d8d82d31cf5", "name": "network-vif-deleted", "tag": "56cf6d80-8b57-4905-b463-2e9ae52a0565"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:06.332449 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:06.332449 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:06.342721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b15c199-789d-426f-8328-6f5eac5dac74 req-a7e8b31a-96e6-4bd2-b092-3774241ef139 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.344424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7b15c199-789d-426f-8328-6f5eac5dac74 req-a7e8b31a-96e6-4bd2-b092-3774241ef139 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.370431 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7b15c199-789d-426f-8328-6f5eac5dac74 req-a7e8b31a-96e6-4bd2-b092-3774241ef139 service nova] Creating event network-vif-deleted:56cf6d80-8b57-4905-b463-2e9ae52a0565 for instance d887f393-fa16-4eb3-8539-7d8d82d31cf5 on nch1-master-1 Nov 20 21:03:06.377057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7b15c199-789d-426f-8328-6f5eac5dac74 req-a7e8b31a-96e6-4bd2-b092-3774241ef139 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051845 Nov 20 21:03:06.378177 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2441/4821] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:03:06.384385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:06.385710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.395620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.396359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.398312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.399035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.420275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.442683 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4700d482-4e19-4ba6-8ac3-235c3f52a0af tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1323 microversion: 2.1 time: 0.452873 Nov 20 21:03:06.444802 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2381/4822] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:05 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1323 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:06.463093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:06.466124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.476136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.476982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.478027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.479276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.504666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.517441 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3269d564-389a-4e11-b77c-08dfc9c25f7b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 200 len: 1333 microversion: 2.1 time: 0.137750 Nov 20 21:03:06.520701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2442/4823] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:06 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:06.660309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:06.661247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.669763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.670328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.671383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.671833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.719079 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04661bf0-2389-44da-bcb0-105add724dbd tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.062319 Nov 20 21:03:06.720180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2443/4824] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:06 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:06.738167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:06.739243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:06.748182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.748892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.749908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:06.750958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:06.870420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.871926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.888507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11e781b0-1fc6-4412-98eb-2cdbd09c2a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1487 microversion: 2.1 time: 0.438477 Nov 20 21:03:06.890010 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2382/4825] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:06 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1487 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:06.895143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.896719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:06.897935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b243c978-98ac-445f-a37d-bff4cd5b7748 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.176583 Nov 20 21:03:06.898621 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2444/4826] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:06 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:07.072098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-826973667", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "667d28cd-f9ba-4a5d-a0eb-955c1d25c7d7"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:07.135330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] validate_networks() for [('667d28cd-f9ba-4a5d-a0eb-955c1d25c7d7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:03:07.207158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:07.208424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.216720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.217416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.218963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.219461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.270579 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9088ffb1-4dc4-4d16-917f-ed6d2800ff3e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.066890 Nov 20 21:03:07.272005 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2445/4827] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:07.461332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:07.462353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.470481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.471077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.471978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.472554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.671136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:07.679600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c81e9298-702f-4d17-982c-b5866551b600 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1518 microversion: 2.1 time: 0.222433 Nov 20 21:03:07.680471 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2446/4828] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:07 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:07.685005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:07.685945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: d887f393-fa16-4eb3-8539-7d8d82d31cf5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.694678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.695461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.696526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.696939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.719200 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] HTTP exception thrown: Instance d887f393-fa16-4eb3-8539-7d8d82d31cf5 could not be found. Nov 20 21:03:07.720097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Returning 404 to user: Instance d887f393-fa16-4eb3-8539-7d8d82d31cf5 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:07.721102 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ad24258-e155-4f02-9e2d-8e91f6bf9375 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5" status: 404 len: 111 microversion: 2.1 time: 0.039711 Nov 20 21:03:07.726283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2447/4829] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:07 2021] GET /compute/v2.1/servers/d887f393-fa16-4eb3-8539-7d8d82d31cf5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:07.733448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:07.735105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.742584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.743337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.744357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.745684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.806911 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7487a371-9010-4e18-865d-a7ea65be1a0e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.077994 Nov 20 21:03:07.808436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2448/4830] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:07 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:07.890524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5f15f91-8534-48a8-846c-e1b42ada08ec tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-735169127", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:07.892675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5f15f91-8534-48a8-846c-e1b42ada08ec tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:07.894113 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5f15f91-8534-48a8-846c-e1b42ada08ec tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.008129 Nov 20 21:03:07.900824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2449/4831] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:07 2021] POST /compute/v2.1/servers => generated 175 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:03:07.906755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b84c375f-6315-4926-92a0-40de849a4629 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:07.907544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b84c375f-6315-4926-92a0-40de849a4629 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: b459fbba-baed-46b7-98ee-0472b253ec05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.915451 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b84c375f-6315-4926-92a0-40de849a4629 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] HTTP exception thrown: Instance b459fbba-baed-46b7-98ee-0472b253ec05 could not be found. Nov 20 21:03:07.916381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b84c375f-6315-4926-92a0-40de849a4629 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 404 to user: Instance b459fbba-baed-46b7-98ee-0472b253ec05 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:07.918514 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b84c375f-6315-4926-92a0-40de849a4629 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/b459fbba-baed-46b7-98ee-0472b253ec05/metadata" status: 404 len: 111 microversion: 2.1 time: 0.015369 Nov 20 21:03:07.919340 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2450/4832] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 21:03:07 2021] GET /compute/v2.1/servers/b459fbba-baed-46b7-98ee-0472b253ec05/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:07.936148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:07.937149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:07.946533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.947173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:07.949235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:07.950932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.052450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:08.064303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:08.066730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:08.068233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96843fe9-d276-452f-be34-47b9ed3b19a2 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.137104 Nov 20 21:03:08.080573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2451/4833] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:07 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:08.086639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f4fdd911-b899-4e55-b72e-71c42a373142 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '.version_select at 0x7f3f877b8d30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:08.109754 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f4fdd911-b899-4e55-b72e-71c42a373142 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-886646294" status: 202 len: 0 microversion: 2.1 time: 0.027304 Nov 20 21:03:08.110537 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2452/4834] 10.222.0.41 () {58 vars in 1253 bytes} [Sat Nov 20 21:03:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-886646294 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:08.131589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07084325-c489-41a0-9f70-85129b276cf8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-764201836", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.133524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07084325-c489-41a0-9f70-85129b276cf8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:08.134581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07084325-c489-41a0-9f70-85129b276cf8 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.007571 Nov 20 21:03:08.135558 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2453/4835] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers => generated 687 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:03:08.186534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5afd87e-0160-4596-a67a-b2d312ef8b90 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1729333288", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.192448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5afd87e-0160-4596-a67a-b2d312ef8b90 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:08.193802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5afd87e-0160-4596-a67a-b2d312ef8b90 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010839 Nov 20 21:03:08.194491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2454/4836] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:03:08.265950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11e67d8f-6a71-4fea-8dd5-a0bf76084dac tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2129280687", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.267928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11e67d8f-6a71-4fea-8dd5-a0bf76084dac tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:08.268937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11e67d8f-6a71-4fea-8dd5-a0bf76084dac tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009511 Nov 20 21:03:08.270091 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2455/4837] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers => generated 1197 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Nov 20 21:03:08.290007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.294101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.301878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.305724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.308304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.308639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.362409 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fecd515b-76c3-4581-8b0a-15cd427bd8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.082039 Nov 20 21:03:08.386252 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2456/4838] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:08.444864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-944686f5-2c62-47a6-9d42-c3062c46a85e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-334118318", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "7652536f-b93f-4f95-b9ae-3fa277d2f430"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.446399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-944686f5-2c62-47a6-9d42-c3062c46a85e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:08.447677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-944686f5-2c62-47a6-9d42-c3062c46a85e tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.007184 Nov 20 21:03:08.449454 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2457/4839] 10.222.0.41 () {60 vars in 1147 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers => generated 2221 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Nov 20 21:03:08.457357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:03:08.459173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:03:08.459922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:03:08.461126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:03:08.461820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:03:08.462877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7121b1bd-6ecf-4b4e-a68b-897cfae35aab tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:08.464305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7121b1bd-6ecf-4b4e-a68b-897cfae35aab tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: 43c32bcc-2775-4295-858f-a519d1e32ac7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.472036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7121b1bd-6ecf-4b4e-a68b-897cfae35aab tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] HTTP exception thrown: Instance 43c32bcc-2775-4295-858f-a519d1e32ac7 could not be found. Nov 20 21:03:08.472883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7121b1bd-6ecf-4b4e-a68b-897cfae35aab tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 404 to user: Instance 43c32bcc-2775-4295-858f-a519d1e32ac7 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:08.473937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7121b1bd-6ecf-4b4e-a68b-897cfae35aab tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/43c32bcc-2775-4295-858f-a519d1e32ac7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015566 Nov 20 21:03:08.475058 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2458/4840] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:03:08 2021] GET /compute/v2.1/servers/43c32bcc-2775-4295-858f-a519d1e32ac7/metadata/test2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:08.489632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.490417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.493121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.493943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.495643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:08.496692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.518373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.518979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.519884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.520417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.532871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Getting quotas for project 3c79515660014c0bb607fcb10f6f0870. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:08.545076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Getting quotas for user ef7ce5cd53f741ffa5781f96bd869dad and project 3c79515660014c0bb607fcb10f6f0870. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:08.566757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:03:08.570746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:03:08.576064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:08.646330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03233a63-8e2c-45f6-bc4d-14071125d2ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.578767 Nov 20 21:03:08.649166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2383/4841] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:07 2021] POST /compute/v2.1/servers => generated 383 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:03:08.662857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f51a443c-64ef-423a-b975-098694bdb5ca tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:08.666707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f51a443c-64ef-423a-b975-098694bdb5ca tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.692362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6caff8dd-869e-4961-bdfc-7c162cfdbf47 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "DELETE /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 204 len: 0 microversion: 2.1 time: 0.202242 Nov 20 21:03:08.693077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2459/4842] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:08 2021] DELETE /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:03:08.712278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:08.715010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.734540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.737253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.738123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.738612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.830124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f51a443c-64ef-423a-b975-098694bdb5ca tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:08.842470 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f51a443c-64ef-423a-b975-098694bdb5ca tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1213 microversion: 2.1 time: 0.187011 Nov 20 21:03:08.843423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2384/4843] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:08 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:08.851082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:08.852056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:08.868252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.868973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.870774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:08.871426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:08.978716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ae921fb7-0d26-4350-bcba-641f8d485d67 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.133532 Nov 20 21:03:08.980518 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2385/4844] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:08 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:09.100479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:09.101797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:09.115215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:09.121698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.126127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14953b8b-2227-44a8-8614-17d4464c2932 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1524 microversion: 2.1 time: 0.424972 Nov 20 21:03:09.127652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.135252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.136457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.144760 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2460/4845] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:08 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1524 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:09.286284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:09.303518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:09.309200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:09.312618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7470e9e9-0dd0-4f29-a0ad-70d9124626db tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.227449 Nov 20 21:03:09.313643 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2386/4846] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:09 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:09.375696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:09.376681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:09.409508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.410026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.412020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.412467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.497050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5dfd2d73-5192-4186-8163-cb8aceeadda1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.125289 Nov 20 21:03:09.498768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2461/4847] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:09 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:09.860882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:09.861785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:09.871362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.872242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.873415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:09.874201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:09.993242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:09.994480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:09.994631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:10.005435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b63c0d7-a037-479a-9e0f-52272df1b0ae tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1265 microversion: 2.1 time: 0.147941 Nov 20 21:03:10.006733 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2387/4848] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:09 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:10.020208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.020649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.021477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.021915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.070274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17127d24-af29-44af-9724-3cb66f1007ba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.082659 Nov 20 21:03:10.075353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2462/4849] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:09 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:10.149617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:10.150892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:10.173490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.176347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.177594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.178315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.335209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:10.335999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:10.345791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.346394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.348136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.348837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.446310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:10.456970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:10.459462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:10.461228 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a94e21f-caa6-4a2b-b113-b29aeb01530a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.133096 Nov 20 21:03:10.462020 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2463/4850] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:10 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:10.511120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:10.512442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:10.519281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.520049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.520945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:10.521512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:10.566832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aaa93541-0ebc-460d-b97c-d3de42902095 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.060163 Nov 20 21:03:10.571573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2464/4851] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:10 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:11.009584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:11.020541 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee02043b-95cd-468c-ada4-248ea1b3a36d tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1524 microversion: 2.1 time: 0.873919 Nov 20 21:03:11.033875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:11.034770 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2388/4852] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:10 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1524 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:11.035725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:11.047122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.047853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.049759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.050611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.095001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:11.097486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:11.110270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.111149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.112822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.113911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.185294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:11.196090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff3e74e0-509a-4136-adb4-6a140ba70e83 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1271 microversion: 2.1 time: 0.173623 Nov 20 21:03:11.197140 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2465/4853] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:11 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:11.207669 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80a6b227-a833-4601-a8e9-535cd11e56c3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.126646 Nov 20 21:03:11.209723 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2389/4854] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:11 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:11.481555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:11.482226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:11.501759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.502245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.503046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.503484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.580851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:11.582469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:11.592551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.593329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.594280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.595022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.652641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98bea62a-87b0-4da6-85b2-e6a7a67179e7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.076230 Nov 20 21:03:11.654066 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2390/4855] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:11 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:11.723712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:11.736540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:11.741232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:11.742555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8bf928e-4ba1-4873-89e9-1be99f9044da tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.265627 Nov 20 21:03:11.743294 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2466/4856] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:11 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:03:11.809427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a7e54833-0627-4add-bdc4-e871e4d02542 req-7286d029-aac2-46f6-8721-18870badf60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8f215b-683e-4c22-a383-939476dbc05c", "name": "network-vif-deleted", "tag": "659e7819-8eb1-4918-a6b8-563de764690f"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:11.811395 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:11.811395 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:11.820674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a7e54833-0627-4add-bdc4-e871e4d02542 req-7286d029-aac2-46f6-8721-18870badf60e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:11.821560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a7e54833-0627-4add-bdc4-e871e4d02542 req-7286d029-aac2-46f6-8721-18870badf60e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:11.834890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a7e54833-0627-4add-bdc4-e871e4d02542 req-7286d029-aac2-46f6-8721-18870badf60e service nova] Creating event network-vif-deleted:659e7819-8eb1-4918-a6b8-563de764690f for instance aa8f215b-683e-4c22-a383-939476dbc05c on nch2-master-1 Nov 20 21:03:11.840935 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a7e54833-0627-4add-bdc4-e871e4d02542 req-7286d029-aac2-46f6-8721-18870badf60e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Nov 20 21:03:11.842185 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2391/4857] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:12.043111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:12.043739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.062735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.063879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.065718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.069316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.132537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.133451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.134106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lazy-loading 'fault' on Instance uuid aa8f215b-683e-4c22-a383-939476dbc05c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:03:12.222583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:12.224412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.234369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.235222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.236286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.237879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.243497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c283db7ca74944ba8f7cd718b6d08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df9b387c748458fb8119674e7463c3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:12.252432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03c164f1-7788-4f47-b6bf-06ff21613030 tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 200 len: 1313 microversion: 2.1 time: 0.214977 Nov 20 21:03:12.253036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2467/4858] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:12 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:12.275095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:12.284663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.302516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.304669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.305784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.308435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.334865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a23d5a7b-6f0c-4071-8504-73d872f0d698 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.116573 Nov 20 21:03:12.336833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2392/4859] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:12 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:12.668629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:12.671480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.728416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.731095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.733005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.734448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.768600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:12.776216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34192664-6e4c-4677-810c-6aaeaacdc0cd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.513801 Nov 20 21:03:12.778491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2468/4860] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:12 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:12.797650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:12.803287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.805976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76fc7e40-2ff6-4156-808b-aea446b50e37 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.144675 Nov 20 21:03:12.809508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2393/4861] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:12.817918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.818598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.819587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.820419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.875079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:12.875969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:12.894034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.894539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.895383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:12.895837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:12.955102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:12.964084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:12.978833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:12.980508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:12.985229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f17d803-e09f-48a7-b109-5778ff40b09a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.193992 Nov 20 21:03:12.989028 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2469/4862] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:12 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:12.999663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-054ad627-5012-4478-ae39-edf4d56be077 req-fbbf60f5-ded2-405c-93de-17a860f29592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66476154-140d-461c-82e4-a9bf5200d6ba", "tag": "8adc5a88-c2fa-4460-a689-528a2266b1a5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:13.006426 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:13.006426 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:13.020425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-054ad627-5012-4478-ae39-edf4d56be077 req-fbbf60f5-ded2-405c-93de-17a860f29592 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.024559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-054ad627-5012-4478-ae39-edf4d56be077 req-fbbf60f5-ded2-405c-93de-17a860f29592 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.051212 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-054ad627-5012-4478-ae39-edf4d56be077 req-fbbf60f5-ded2-405c-93de-17a860f29592 service nova] Creating event network-changed:8adc5a88-c2fa-4460-a689-528a2266b1a5 for instance 66476154-140d-461c-82e4-a9bf5200d6ba on nch1-master-1 Nov 20 21:03:13.068360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-054ad627-5012-4478-ae39-edf4d56be077 req-fbbf60f5-ded2-405c-93de-17a860f29592 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077611 Nov 20 21:03:13.071479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2470/4863] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:13.143852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-172cd585-ee68-4c4e-9106-6756d716fe66 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 204 len: 0 microversion: 2.1 time: 0.274490 Nov 20 21:03:13.145221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2394/4864] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:12 2021] DELETE /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:03:13.153643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:13.155352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:13.161401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.162135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.163188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.163798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.275260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:13.277554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] [instance: aa8f215b-683e-4c22-a383-939476dbc05c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:13.297181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.297957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.298822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.299824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.315578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] HTTP exception thrown: Instance aa8f215b-683e-4c22-a383-939476dbc05c could not be found. Nov 20 21:03:13.316416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] Returning 404 to user: Instance aa8f215b-683e-4c22-a383-939476dbc05c could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:13.317272 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a535458-47f2-40be-825c-f68b7566a6ea tempest-ServerMetadataNegativeTestJSON-895151008 tempest-ServerMetadataNegativeTestJSON-895151008-project] 10.222.0.41 "GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c" status: 404 len: 111 microversion: 2.1 time: 0.048351 Nov 20 21:03:13.317849 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2395/4865] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:13 2021] GET /compute/v2.1/servers/aa8f215b-683e-4c22-a383-939476dbc05c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:13.347663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:13.349032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:13.357962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.359128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.360185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.360809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.407632 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e20e2a9-d252-48e5-ab60-24df539e7d86 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.063592 Nov 20 21:03:13.408731 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2396/4866] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:13 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:03:13.652433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:13.669226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e787d9a1-cd18-41c3-b543-962c180d0f69 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1669 microversion: 2.1 time: 0.517730 Nov 20 21:03:13.671467 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2471/4867] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:13 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1669 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:13.797120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:13.798070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:13.812799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.813256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.820784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:13.821756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:13.833751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.834238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.835035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.835466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.839617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:13.840343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:13.923010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a57cdecb-c967-46dd-939b-0b736955d1f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.105355 Nov 20 21:03:13.924671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2472/4868] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:14.009199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:14.010356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:14.021192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.021635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.022481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.022923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.317766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:14.334849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:14.339386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:14.342981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-373e79f8-719d-4b99-bedd-a95318869f91 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.338473 Nov 20 21:03:14.357758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2473/4869] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:14 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:14.420213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:14.421639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:14.431057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.431978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.433910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.434893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.452115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:14.462868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c8acd27-5d33-44af-82e8-5edd054eb994 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.671764 Nov 20 21:03:14.464515 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2397/4870] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:13 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:14.504930 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17c712f1-b9fe-4234-b76e-b30762497dc1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.088300 Nov 20 21:03:14.508051 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2474/4871] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:14 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:14.688415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8a095a59-ab29-4a5e-b7a9-89db310d5b18 req-b31bbb08-6a26-4468-81cf-cb40b49f0cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d", "tag": "bd2842a2-28bd-48b3-8da3-fa139162637d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:14.691137 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:14.691137 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:14.693141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:14.694124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:14.712142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.713905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.714774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a095a59-ab29-4a5e-b7a9-89db310d5b18 req-b31bbb08-6a26-4468-81cf-cb40b49f0cc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.714918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.715547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a095a59-ab29-4a5e-b7a9-89db310d5b18 req-b31bbb08-6a26-4468-81cf-cb40b49f0cc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.716257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.734771 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8a095a59-ab29-4a5e-b7a9-89db310d5b18 req-b31bbb08-6a26-4468-81cf-cb40b49f0cc7 service nova] Creating event network-changed:bd2842a2-28bd-48b3-8da3-fa139162637d for instance ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d on nch1-master-1 Nov 20 21:03:14.742333 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8a095a59-ab29-4a5e-b7a9-89db310d5b18 req-b31bbb08-6a26-4468-81cf-cb40b49f0cc7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056550 Nov 20 21:03:14.743709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2398/4872] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:14.938185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:14.939502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:14.947201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.948447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:14.949588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:14.950235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.005190 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c15f62d7-2975-4692-9173-5f2cf92a0286 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.072644 Nov 20 21:03:15.007538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2399/4873] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:14 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:15.059108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:15.069974 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3b7b2de-8bf8-49c9-ba79-7b0cca9ad043 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1669 microversion: 2.1 time: 0.383662 Nov 20 21:03:15.085356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2475/4874] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:14 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:15.378327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:15.379134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:15.388877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.389337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.390167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.390774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.480990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:15.481597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:15.484426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:15.497494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.497943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.498761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.499196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.501278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:15.503224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:15.504576 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f58d0da-62ee-430c-be14-bf5d179566bd tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.131301 Nov 20 21:03:15.516737 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2400/4875] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:15 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:15.518357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:15.519591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:15.532182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.533053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.534022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:15.535346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:15.613950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12fdcea9-a0cd-4bbe-a3b2-b26e6ba7f13a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 14 microversion: 2.1 time: 0.100210 Nov 20 21:03:15.618510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2401/4876] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:15 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:15.870544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:15.877935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c1a9df5-9fb0-4343-9526-6895508272f4 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.401041 Nov 20 21:03:15.882119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2476/4877] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:15 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:16.019960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:16.022661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:16.032338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.033477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.035063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.035835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.105074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86aabbb1-6f48-4aec-b546-21fa66ddb275 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.088813 Nov 20 21:03:16.110859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2477/4878] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:16.116482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:16.117464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:16.127541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.128823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.130235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.131048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.273762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:16.285437 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08366ae7-a60c-4001-ae73-bf35cf313669 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 200 len: 1332 microversion: 2.1 time: 0.170696 Nov 20 21:03:16.286626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2478/4879] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:16 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 1332 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:16.406667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-770164352", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7baff06a-6399-4920-a877-7539627d9c2d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:16.471677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] validate_networks() for [('7baff06a-6399-4920-a877-7539627d9c2d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:03:16.525413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:16.526995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:16.563517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.564432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.565476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.566160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.677343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:16.690896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:16.693727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:16.703845 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d8d6cf3-ce62-4611-8629-25bf803a0211 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.174902 Nov 20 21:03:16.724146 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2479/4880] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:16 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:03:16.745676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:16.747149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:16.771355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.772249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.774078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.774693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.836308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-179a8791-f72a-4058-b164-c8b9d2b6f1c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action" status: 200 len: 8201 microversion: 2.1 time: 0.106013 Nov 20 21:03:16.837130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2480/4881] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:16 2021] POST /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b/action => generated 8201 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:16.843335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-12c72a61-566c-4687-a925-abc932cca3ba req-68afede8-7383-4b1f-bf10-b2f3649bd786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66476154-140d-461c-82e4-a9bf5200d6ba", "name": "network-vif-deleted", "tag": "8adc5a88-c2fa-4460-a689-528a2266b1a5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:16.844896 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:16.844896 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:16.857338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-12c72a61-566c-4687-a925-abc932cca3ba req-68afede8-7383-4b1f-bf10-b2f3649bd786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.859309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-12c72a61-566c-4687-a925-abc932cca3ba req-68afede8-7383-4b1f-bf10-b2f3649bd786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.881076 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-12c72a61-566c-4687-a925-abc932cca3ba req-68afede8-7383-4b1f-bf10-b2f3649bd786 service nova] Creating event network-vif-deleted:8adc5a88-c2fa-4460-a689-528a2266b1a5 for instance 66476154-140d-461c-82e4-a9bf5200d6ba on nch1-master-1 Nov 20 21:03:16.887562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-12c72a61-566c-4687-a925-abc932cca3ba req-68afede8-7383-4b1f-bf10-b2f3649bd786 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048409 Nov 20 21:03:16.888735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2481/4882] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:16.894497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:16.895456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:16.906019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.906943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:16.908124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:16.909325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.103511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:03:17.104049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:03:17.105018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:03:17.105436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:03:17.105962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:03:17.116218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.116801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.117798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.118323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.140810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Getting quotas for project 2dd90d53ed124eb98716ef6f31410ef5. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:17.147402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Getting quotas for user d2802921638c405b97d556ae94c48cca and project 2dd90d53ed124eb98716ef6f31410ef5. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:17.161419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:03:17.164234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:03:17.211881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8ec4387-d9c5-4e15-a1ab-a5092f98478b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256343 Nov 20 21:03:17.212542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2402/4883] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:03:17.221555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:17.222209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.228743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.229731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.230569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.231206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.233221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:17.245882 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c0fc77a-d5fe-446c-a77e-5197e4d532b3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.353491 Nov 20 21:03:17.246823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2482/4884] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:16 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:17.480579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a15f8c5-d57d-4d30-81c7-8016637463d9 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Action: 'create', calling method: .version_select at 0x7f3f98e35700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1673095239", "metadata": {"Type": "work"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:17.511033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:17.540227 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fc9bb46-ced5-431d-8b71-0bf852e9506d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.326036 Nov 20 21:03:17.541249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2403/4885] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:17 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:17.549295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:17.550411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.558368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.559758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.561181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.561872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.635750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20833ed1-76a2-440d-9ea3-c3675894750c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.092485 Nov 20 21:03:17.636910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2404/4886] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:17 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:17.641910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe87b5d4-1198-4c6e-b98e-5bb3bda8972d tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:17.642836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fe87b5d4-1198-4c6e-b98e-5bb3bda8972d tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.754286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fe87b5d4-1198-4c6e-b98e-5bb3bda8972d tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:17.765804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe87b5d4-1198-4c6e-b98e-5bb3bda8972d tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1213 microversion: 2.1 time: 0.127585 Nov 20 21:03:17.767007 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2405/4887] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:17 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:17.772863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:17.773866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.786183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.786724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.788169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.789660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.902812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a15f8c5-d57d-4d30-81c7-8016637463d9 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.654185 Nov 20 21:03:17.905564 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2483/4888] 10.222.0.41 () {60 vars in 1155 bytes} [Sat Nov 20 21:03:17 2021] POST /compute/v2.1/os-volumes => generated 346 bytes in 658 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 20 21:03:17.911774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:17.913442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: 66476154-140d-461c-82e4-a9bf5200d6ba] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.924699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.925462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.927515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.928822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.946519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] HTTP exception thrown: Instance 66476154-140d-461c-82e4-a9bf5200d6ba could not be found. Nov 20 21:03:17.947306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Returning 404 to user: Instance 66476154-140d-461c-82e4-a9bf5200d6ba could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:17.949210 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0957da72-f041-4886-bc59-504a36ebfbe6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba" status: 404 len: 111 microversion: 2.1 time: 0.041778 Nov 20 21:03:17.949949 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2484/4889] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:17 2021] GET /compute/v2.1/servers/66476154-140d-461c-82e4-a9bf5200d6ba => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:17.955641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:17.956283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:17.966158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.966757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:17.968529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:17.968949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.079881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:18.095985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:18.100822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:18.103069 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a3a5f80-35dc-48e9-98c0-679bed533053 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.151657 Nov 20 21:03:18.105203 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2485/4890] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:17 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:18.116803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27d00da1-69b1-4bdf-8bf7-4c8a862848c7 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f98e35310>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:18.209331 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27d00da1-69b1-4bdf-8bf7-4c8a862848c7 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 200 len: 346 microversion: 2.1 time: 0.101216 Nov 20 21:03:18.210540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2486/4891] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:03:18 2021] GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:18.253226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b012d519-b42d-4f93-80f4-40bc0602c561 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '.version_select at 0x7f3f87784700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:18.279850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b012d519-b42d-4f93-80f4-40bc0602c561 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-979156582" status: 202 len: 0 microversion: 2.1 time: 0.030468 Nov 20 21:03:18.280814 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2487/4892] 10.222.0.41 () {58 vars in 1253 bytes} [Sat Nov 20 21:03:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-979156582 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:18.462368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:18.473160 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00c8440f-bd77-426c-847e-5a11900ccbef tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.704695 Nov 20 21:03:18.475355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2406/4893] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:17 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:18.492804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:18.493380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:18.506690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.507919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.513008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.513573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.559574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:18.560527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:18.586477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.588024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.591952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.593218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.617436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Locking {{(pid=140941) lock /opt/stack/nova/nova/compute/api.py:4624}} Nov 20 21:03:18.781849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca471790-4006-44d2-81e4-b03447078552 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.293569 Nov 20 21:03:18.783412 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2488/4894] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:18 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:18.790945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:18.793560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:18.804722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.805243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.806282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.806729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.891802 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a71154d0-b6d6-4654-b6f2-0ae246b4a1bf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.106880 Nov 20 21:03:18.892682 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2489/4895] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:18.899868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:18.902420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:18.911360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.912110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.912711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.913175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.962324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:18.972068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b499baa1-6e5a-4095-a9c7-8370b400d22e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.417857 Nov 20 21:03:18.973301 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2407/4896] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:18 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:18.979362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:18.980261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:18.987833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.988821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:18.990674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:18.991329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.024362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:19.047517 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a084a32a-830e-4e63-8637-cb25451ec974 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1271 microversion: 2.1 time: 0.149588 Nov 20 21:03:19.048182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2490/4897] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:18 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:19.125196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:19.126175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:19.136193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.137205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.138219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.138960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.441273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:19.456827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63b14002-3010-4dc8-ba0a-3af0d844b7a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.482085 Nov 20 21:03:19.459179 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2408/4898] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:18 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:19.469019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-db1cb645-f2fb-4c3c-9c59-4f0667578e94 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f871158b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:19.542502 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-db1cb645-f2fb-4c3c-9c59-4f0667578e94 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 200 len: 347 microversion: 2.1 time: 0.080787 Nov 20 21:03:19.543139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2409/4899] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:03:19 2021] GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 347 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:19.548523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:19.558742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.559267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.595686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 is locked Nov 20 21:03:19.596779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 409 to user: Instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 is locked {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:19.597899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ef1cc3d-aa23-4e26-977b-e304f95faa29 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 409 len: 107 microversion: 2.1 time: 0.053671 Nov 20 21:03:19.599357 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2410/4900] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:19 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 107 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:03:19.605833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ebfa3c6-6580-41b2-8936-24c9cc53b403 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f98d35430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:19.629557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:19.646141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:19.647685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:19.648900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbbb054f-5878-46be-b211-e39da2ed061e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.528215 Nov 20 21:03:19.655917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2491/4901] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:19 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:19.667538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:19.671295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:19.684003 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ebfa3c6-6580-41b2-8936-24c9cc53b403 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 200 len: 347 microversion: 2.1 time: 0.082704 Nov 20 21:03:19.684712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.685878 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2411/4902] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:03:19 2021] GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 347 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:19.686340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.688810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.690752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.699658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d45e5249-6a0d-4599-9253-d4bdbb071df2 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f87206430>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:19.764422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Unlocking {{(pid=140941) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 20 21:03:19.792906 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d45e5249-6a0d-4599-9253-d4bdbb071df2 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 202 len: 0 microversion: 2.1 time: 0.098467 Nov 20 21:03:19.797704 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2412/4903] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:03:19 2021] DELETE /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:19.802572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea6290f8-19e8-4697-8ed3-a43e772972c4 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f86f0c940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:19.858166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2847b11-f878-4993-91c8-9ac8f12c7a89 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.200641 Nov 20 21:03:19.859562 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2492/4904] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:19 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:19.871474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c013df9-9269-4f50-8631-833507be7b7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:19.880228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c013df9-9269-4f50-8631-833507be7b7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.880739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c013df9-9269-4f50-8631-833507be7b7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.920401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c013df9-9269-4f50-8631-833507be7b7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:03:19.940760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea6290f8-19e8-4697-8ed3-a43e772972c4 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 200 len: 346 microversion: 2.1 time: 0.141906 Nov 20 21:03:19.941707 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2413/4905] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:03:19 2021] GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:19.948946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:19.950386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:19.968609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.972081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.973169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:19.973793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:19.988982 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c013df9-9269-4f50-8631-833507be7b7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.123710 Nov 20 21:03:19.990498 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2493/4906] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:19 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:20.005434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:20.006536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:20.017131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.018593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.020409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.021101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.064564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7f0584ab-fc05-42c2-87f3-b655d63513a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.119972 Nov 20 21:03:20.065604 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2414/4907] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:19 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:20.076331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:20.077064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:20.090910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.092340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.093523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.094463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.431942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.440578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7cd3dcb-5c48-4e4c-bfc6-58d06d240620 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.441257 Nov 20 21:03:20.449431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2494/4908] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:19 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:20.454666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:20.455620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:20.466430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.471956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.472423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.473291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.473745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.478074 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74971dff-494c-457e-b045-2964d58debe6 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.410072 Nov 20 21:03:20.482549 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2415/4909] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:20 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:20.644625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2dc0f41c-6841-49f1-b7c2-2feead5c9468 req-bdbae940-bfc1-42e3-ba71-e229ed0f1c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d", "name": "network-vif-plugged", "status": "completed", "tag": "bd2842a2-28bd-48b3-8da3-fa139162637d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:20.647838 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:20.647838 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:20.664710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2dc0f41c-6841-49f1-b7c2-2feead5c9468 req-bdbae940-bfc1-42e3-ba71-e229ed0f1c15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.665799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2dc0f41c-6841-49f1-b7c2-2feead5c9468 req-bdbae940-bfc1-42e3-ba71-e229ed0f1c15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.693471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2dc0f41c-6841-49f1-b7c2-2feead5c9468 req-bdbae940-bfc1-42e3-ba71-e229ed0f1c15 service nova] Creating event network-vif-plugged:bd2842a2-28bd-48b3-8da3-fa139162637d for instance ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d on nch1-master-1 Nov 20 21:03:20.705509 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2dc0f41c-6841-49f1-b7c2-2feead5c9468 req-bdbae940-bfc1-42e3-ba71-e229ed0f1c15 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066762 Nov 20 21:03:20.706177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2416/4910] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:03:20.719250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:20.720162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:20.732840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.733311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.747552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:20.748152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:20.916113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.932398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.935425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dbfc091-ab19-4981-ab18-083a0c57535a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.484435 Nov 20 21:03:20.945102 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2495/4911] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:20 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:20.947103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.949589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:20.951091 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a911fec2-48a3-4247-a97e-873eba51b6d5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.243279 Nov 20 21:03:20.952418 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2417/4912] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:20 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:20.955158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2e15def-ad9a-49c5-991b-9e4c851ab443 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Calling method '.version_select at 0x7f3f87697160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:20.994200 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e2e15def-ad9a-49c5-991b-9e4c851ab443 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] HTTP exception thrown: Volume b97bb1b8-981c-4ef9-bba7-5746035b7c09 could not be found. Nov 20 21:03:20.996112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2e15def-ad9a-49c5-991b-9e4c851ab443 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] Returning 404 to user: Volume b97bb1b8-981c-4ef9-bba7-5746035b7c09 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:20.997206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2e15def-ad9a-49c5-991b-9e4c851ab443 tempest-VolumesGetTestJSON-117686070 tempest-VolumesGetTestJSON-117686070-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09" status: 404 len: 109 microversion: 2.1 time: 0.047198 Nov 20 21:03:20.998083 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2496/4913] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:03:20 2021] GET /compute/v2.1/os-volumes/b97bb1b8-981c-4ef9-bba7-5746035b7c09 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:21.078438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:21.079960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:21.098127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.099120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.100172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.100792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.188260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a595a5ea-4b31-49ee-aaff-4647090de5d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.114562 Nov 20 21:03:21.192390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2418/4914] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:21 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:21.227845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-bf4ab023-1863-4486-8dc5-bc60125e3eb1 req-7ee78021-f721-4951-af31-ef617669f1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2928aad-24a3-4ddc-bf95-ead1468989fc", "tag": "54b6e7c9-5484-446f-a370-1b9e21e68db0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:21.234818 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:21.234818 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:21.261021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bf4ab023-1863-4486-8dc5-bc60125e3eb1 req-7ee78021-f721-4951-af31-ef617669f1c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.263721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bf4ab023-1863-4486-8dc5-bc60125e3eb1 req-7ee78021-f721-4951-af31-ef617669f1c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.289937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-bf4ab023-1863-4486-8dc5-bc60125e3eb1 req-7ee78021-f721-4951-af31-ef617669f1c5 service nova] Creating event network-changed:54b6e7c9-5484-446f-a370-1b9e21e68db0 for instance a2928aad-24a3-4ddc-bf95-ead1468989fc on nch2-master-1 Nov 20 21:03:21.302028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-bf4ab023-1863-4486-8dc5-bc60125e3eb1 req-7ee78021-f721-4951-af31-ef617669f1c5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079747 Nov 20 21:03:21.302813 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2497/4915] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:21.468615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:21.470353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:21.486873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.489971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.491164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.499003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.500665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:21.501694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:21.510998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.513932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.518487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.520015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:21.836774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:21.848717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4637ba22-f36c-42f0-94a4-1ca60f6cf00e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.353693 Nov 20 21:03:21.849809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2498/4916] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:21 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:21.953914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:21.965491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-479feb18-dd71-4e3c-b367-003cc59e97b0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1313 microversion: 2.1 time: 0.499910 Nov 20 21:03:21.978095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2419/4917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:21 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:21.983106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:21.984851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:21.989431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:21.991145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:21.997652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:21.999213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.001186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.001633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.008485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.009427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.013066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.013805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.174932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:22.184532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:22.186262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:22.187732 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bbd1d8e9-c3b2-45b6-8d8f-7c37666c1b75 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.208021 Nov 20 21:03:22.198612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2420/4918] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:21 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:22.206162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:22.207167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:22.215430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.216897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.217116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.217672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.291148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4491aeb2-0a2e-46bc-995a-1e90e4a93efa tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.089273 Nov 20 21:03:22.291148 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2421/4919] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:22.393424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:22.406081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ae2b02f-0b75-4250-acb7-605b8645c21a tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.444898 Nov 20 21:03:22.407273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2499/4920] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:21 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:22.889141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:22.901599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:22.935997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.936368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.937251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:22.938764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:22.992606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:22.994156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.023711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.024484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.025524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.029753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.398637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.409184 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1fc8bbf3-94ca-4f7b-b3b1-90a3bf678753 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.545863 Nov 20 21:03:23.409789 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2422/4921] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:22 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:23.430376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:23.431270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.439254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.440073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.441338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.442142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.489020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.498507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-527436bf-ee38-4d38-9533-75ecb59056bc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1499 microversion: 2.1 time: 0.512561 Nov 20 21:03:23.507019 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2500/4922] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:22 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1499 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:23.532296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:23.533357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.545844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.564308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.568080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.568919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.575400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.583393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.587660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.592213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3573983-6224-48b3-bb5e-bafb9e309380 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.171549 Nov 20 21:03:23.597487 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2423/4923] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:23 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:23.605024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:23.605706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.625969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.626877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.628403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.629315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.665210 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-862eab04-683d-4245-9de0-9291ba28604e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.138206 Nov 20 21:03:23.665954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2501/4924] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:23 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:23.680941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:23.682118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.705940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.706430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.707306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:23.707754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:23.764601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lazy-loading 'flavor' on Instance uuid ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:03:23.961788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:23.968267 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11b6ea1d-d2a7-4417-945a-3d3f97a15d4d tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "POST /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d/action" status: 200 len: 32 microversion: 2.1 time: 0.297808 Nov 20 21:03:23.969380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2502/4925] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:23 2021] POST /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:03:23.981594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:23.982319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:23.986275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07cb1523-83b2-4889-b11a-eb4fb2afc8d2 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.386706 Nov 20 21:03:23.990484 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2424/4926] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:23 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:24.009669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.011928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.012994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.013506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.280930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:24.289279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d89e816-8b47-429a-b2b8-ff6dbb083cf0 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.313290 Nov 20 21:03:24.293099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2503/4927] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:23 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:24.427474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:24.428686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:24.442165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.442802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.445271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.445888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.621692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:24.622731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:24.629624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.630409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.631522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.632400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.765162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:24.777367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:24.781575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:24.783347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50f01a25-45b7-4aab-9e13-49f89042c22a tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1366 microversion: 2.47 time: 0.166043 Nov 20 21:03:24.787063 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2504/4928] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:24 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:24.798831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:24.802886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:24.810418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.810908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.812050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:24.812556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:24.857751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f05dcfdb-645c-408f-ada0-19cd227ad734 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.069038 Nov 20 21:03:24.862951 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2505/4929] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:24 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:25.004485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:25.005188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:25.017921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.020065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.021670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.022689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.424405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:25.439095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:25.443338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-460532b4-4fde-4a87-8e6c-299dcd72bafc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 1.019504 Nov 20 21:03:25.443931 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2425/4930] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:24 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:25.446945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b04777b-a7e8-4ac2-a331-b6ecbc07d13c tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.446557 Nov 20 21:03:25.452901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2506/4931] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:24 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:25.455168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:25.455846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:25.467351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.467808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.469014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.469459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.806615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:25.807879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:25.813367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:25.820146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.820917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.822381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.823819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.824505 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92e9d0c9-6da5-4fd6-9218-752e46b44a8b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.375258 Nov 20 21:03:25.825137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2426/4932] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:25 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:25.872639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:25.874041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:25.889365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.890773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.892935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:25.894605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:25.971966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:25.991277 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-643b4040-9c0e-42f3-af12-b46628770977 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.124275 Nov 20 21:03:25.996274 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2427/4933] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:25 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:25.996461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:26.006494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:26.007940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ab2e4c5-4790-4589-898f-89565b18e08f tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1372 microversion: 2.47 time: 0.206294 Nov 20 21:03:26.008917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2507/4934] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:25 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:03:26.470988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:26.475170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:26.476087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:26.479541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:26.493491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.495145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:26.496446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.497009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:26.505495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.506185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:26.508516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.509002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:26.720897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:26.730787 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9fc3fcf5-ebb9-412d-9d3a-a320b4ae6572 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.271583 Nov 20 21:03:26.734757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2428/4935] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:26 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:26.844917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:26.845711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:26.861429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.861895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:26.863014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:26.863441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.049017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.059471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c24e8aab-16c8-484a-922b-95d32ec20dce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.218473 Nov 20 21:03:27.060890 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2429/4936] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:26 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:27.066842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:27.067994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:27.076723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.078285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.079416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.080120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.138795 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f2bc471-d601-4144-927d-f65a9d77122c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.076166 Nov 20 21:03:27.144022 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2430/4937] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:27 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:27.154812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:27.159936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:27.172244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.180983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.181709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.185147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.187514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.190439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cb0d32e-bf30-4939-ae9b-cd30fa007fa0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.725380 Nov 20 21:03:27.194463 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2508/4938] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:26 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:27.331129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.340033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.341891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.343801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e1f9009-caf4-40f6-8df5-0a300fa3836b tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1357 microversion: 2.47 time: 0.198177 Nov 20 21:03:27.355361 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2431/4939] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:03:27 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:27.366504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:27.376762 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:27.376762 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:27.380345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.383104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Searching by: {'deleted': False, 'project_id': '3ad38a853c584bcabdd708213a299a7b'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:03:27.396220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.397392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.401363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.402384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.580371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:03:27.701037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.711083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.713004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.726267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.728757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:27.755246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:27.757209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:27.770627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.771499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.772535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.772984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.788027 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ef159f9-bbc2-41d0-b408-36f17a6b09e6 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.427330 Nov 20 21:03:27.789436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2509/4940] 10.222.0.41 () {60 vars in 1186 bytes} [Sat Nov 20 21:03:27 2021] GET /compute/v2.1/servers/detail => generated 2706 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:03:27.818141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:27.819138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:27.831021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.831844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.832905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:27.833568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:27.866980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:27.966860 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f92d9dbb-35b1-47eb-a813-82e736053e5e tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 204 len: 0 microversion: 2.1 time: 0.154566 Nov 20 21:03:27.968530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2510/4941] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:27 2021] DELETE /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:03:27.989202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:27.991675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:28.001649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.002178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.002984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.003581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.114692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:28.126464 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d41b90b-7005-4b81-a46e-941010e16d2d tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1297 microversion: 2.1 time: 0.153475 Nov 20 21:03:28.127274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2511/4942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:27 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1297 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:28.145394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:28.147875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:28.159505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.161143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.164413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.165092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.423446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:28.451347 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e89b226-1d8f-4dfe-8cb7-8c61b501bc75 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.706256 Nov 20 21:03:28.464792 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2432/4943] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:27 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:28.471505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:28.473118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:28.488959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.490443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.492237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.493108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.572090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80e86306-6c7e-44ce-820c-ef03217b106d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.105551 Nov 20 21:03:28.572873 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2433/4944] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:28.578463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:28.579245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:28.586354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.586974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.587963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.588553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.646270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:28.658711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-853d9aef-685e-4a75-a997-c018a94eddf9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.525434 Nov 20 21:03:28.660087 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2512/4945] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:28 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:28.674378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-08b64711-41de-40b9-b59c-0aec4a2568cd req-0f17fabf-b467-4484-aba1-579a849d00d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2928aad-24a3-4ddc-bf95-ead1468989fc", "name": "network-vif-plugged", "status": "completed", "tag": "54b6e7c9-5484-446f-a370-1b9e21e68db0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:28.676769 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:28.676769 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:28.687407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-08b64711-41de-40b9-b59c-0aec4a2568cd req-0f17fabf-b467-4484-aba1-579a849d00d5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:28.688302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-08b64711-41de-40b9-b59c-0aec4a2568cd req-0f17fabf-b467-4484-aba1-579a849d00d5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:28.705472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-08b64711-41de-40b9-b59c-0aec4a2568cd req-0f17fabf-b467-4484-aba1-579a849d00d5 service nova] Creating event network-vif-plugged:54b6e7c9-5484-446f-a370-1b9e21e68db0 for instance a2928aad-24a3-4ddc-bf95-ead1468989fc on nch2-master-1 Nov 20 21:03:28.712481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-08b64711-41de-40b9-b59c-0aec4a2568cd req-0f17fabf-b467-4484-aba1-579a849d00d5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050316 Nov 20 21:03:28.713703 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2513/4946] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:28.771724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:28.782500 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a990c004-bc60-4c0c-9e9a-77ae9853aeaa tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.207911 Nov 20 21:03:28.783760 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2434/4947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:28 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:29.145719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:29.146618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:29.157559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.158730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.159803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.160339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.275131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:29.288180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb3b598f-f0c6-4e03-ab13-39bbb67ec2f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1297 microversion: 2.1 time: 0.146829 Nov 20 21:03:29.292407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2514/4948] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:29 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:29.472001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:29.472679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:29.483060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.483512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.484327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.484767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.583795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:29.585130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:29.599680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.600552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.601700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.605777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.684264 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c937d2ff-78bf-4060-9710-4e8a20ca88a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.103976 Nov 20 21:03:29.687751 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2515/4949] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:29.698207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:29.711119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:29.721028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.722652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.723816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.724508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.917869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:29.932618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a28eccc-6c21-4765-8225-e987dcca50b8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.463971 Nov 20 21:03:29.938200 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2435/4950] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:29 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:29.950039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:29.950681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:29.981852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.984162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:29.986140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:29.988388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.158704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:30.169133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6aba31cf-da64-4553-8f87-c653d6ddb4d9 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.479855 Nov 20 21:03:30.170431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2516/4951] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:29 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:30.310822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:30.312268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:30.369770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.371799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.377275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.380059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.424801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:30.453890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abc6a342-08dd-4ada-96b7-1e9e2132b312 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1313 microversion: 2.1 time: 0.512459 Nov 20 21:03:30.455089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2436/4952] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:29 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:30.485362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.485809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.486293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lazy-loading 'fault' on Instance uuid f61b8697-938c-4a66-8ec8-40e908fefe58 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:03:30.579482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:30.592723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7834914-371f-4557-a0f3-3bcb1301feea tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 200 len: 1302 microversion: 2.1 time: 0.286827 Nov 20 21:03:30.593344 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2517/4953] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:30 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 1302 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:30.707056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:30.712468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:30.755319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.759300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.764357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.768875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.839910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-392a3235-b4b1-4a83-9c9e-0514d2b50b1a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.146749 Nov 20 21:03:30.840658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2437/4954] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:30.951532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:30.953046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:30.970398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.971577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:30.974914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:30.975380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.189281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:31.190019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:31.208016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.208477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.209502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.210310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.422178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:31.430831 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62b02d1b-d2e9-40c8-9063-9f8da278a104 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.484203 Nov 20 21:03:31.432573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2518/4955] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:30 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:31.472887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:31.473885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:31.486754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.487569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.491198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.491953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.717732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:31.734607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7490c22-768e-47ab-9e96-8d6ba439abfc tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.546888 Nov 20 21:03:31.737383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2438/4956] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:31 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:31.748999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:31.773663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: f61b8697-938c-4a66-8ec8-40e908fefe58] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:31.813924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.814496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.815633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.816483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.841345 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] HTTP exception thrown: Instance f61b8697-938c-4a66-8ec8-40e908fefe58 could not be found. Nov 20 21:03:31.842778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Returning 404 to user: Instance f61b8697-938c-4a66-8ec8-40e908fefe58 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:31.844648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-097759b4-5e19-40ed-8b1f-d3b1f502d048 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58" status: 404 len: 111 microversion: 2.1 time: 0.105193 Nov 20 21:03:31.852242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2439/4957] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:31 2021] GET /compute/v2.1/servers/f61b8697-938c-4a66-8ec8-40e908fefe58 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:31.868437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:31.871224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:31.880190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.881047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.883748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.884461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.888539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:31.906781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f00bfe01-cc03-48db-b0b3-d7d2d546a3bf tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1497 microversion: 2.1 time: 0.432881 Nov 20 21:03:31.910290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2519/4958] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:31 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1497 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:31.935040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:31.938596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:31.967273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.968766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.969845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:31.970583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:31.993679 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb10a5fe-0d56-4c51-b573-9150d9ceacf8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.138167 Nov 20 21:03:31.996060 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2440/4959] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:32.031004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:32.261701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94de2564-4c98-41c9-afcd-ae126127e9f8 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "DELETE /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 204 len: 0 microversion: 2.1 time: 0.350433 Nov 20 21:03:32.265155 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2520/4960] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:31 2021] DELETE /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:03:32.281842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:32.284722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:32.317446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.317941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:32.326109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.327247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:32.450404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:32.451096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:32.473411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.473836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:32.482861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.483319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:32.637007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:32.648738 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-109c3541-9a36-4f8a-bbb6-4b7b03948313 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 200 len: 1296 microversion: 2.1 time: 0.378714 Nov 20 21:03:32.655038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2441/4961] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:32 2021] GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 1296 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:32.757982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:32.766409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:32.793772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.800166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:32.801053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:32.811864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:33.333407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:33.348760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f41a6a5e-24d3-42f2-9f55-276af9f31975 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.598075 Nov 20 21:03:33.353661 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2442/4962] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:32 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:33.366285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:33.375023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:33.392077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:33.396000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:33.398260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:33.399810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:33.474860 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-421aae05-caa1-418c-98f4-71a3085dbb4d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.118379 Nov 20 21:03:33.476628 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2443/4963] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:33.678451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:33.679879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:33.702646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:33.703346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:33.704333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:33.705593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:33.862023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:33.884185 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83524dd0-3b7d-4226-8b01-d790133880ab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 1.438780 Nov 20 21:03:33.887191 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2521/4964] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:32 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:34.004132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:34.026912 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ce0dbf4-4544-4159-b36e-3f685c161fbf tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 200 len: 1296 microversion: 2.1 time: 0.356368 Nov 20 21:03:34.030767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2444/4965] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:33 2021] GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 1296 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:34.373786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:34.376658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:34.396348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.397517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:34.398385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.401140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:34.492982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:34.494660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:34.532375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.535043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:34.536115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.538460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:34.682151 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f7670e5-3afe-4adb-ac44-ff35f16234ad tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.197236 Nov 20 21:03:34.687917 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2445/4966] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:34.903013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:34.904082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:34.918757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.919805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:34.921144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:34.921900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.081004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:35.097175 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a24ec3da-035d-4ef9-b111-4061d601f7ce tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.734500 Nov 20 21:03:35.108083 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2522/4967] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:34 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:35.159431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:35.162371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:35.187704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:35.191515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.194491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:35.195243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.279614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:35.281162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.284427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lazy-loading 'fault' on Instance uuid 19f715fc-c10c-4614-81cb-275bac16a0f8 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:03:35.378373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:35.406399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8bb7d05d-e2f2-4f74-8c77-9d29010eb28b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.507525 Nov 20 21:03:35.411928 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2446/4968] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:34 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:35.508319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff831b6c90541feb23c5902e8ef9ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad38a853c584bcabdd708213a299a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:35.540950 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d29f5bb8-778d-4c7b-b199-9869767dc02c tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 200 len: 1301 microversion: 2.1 time: 0.406355 Nov 20 21:03:35.555547 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2523/4969] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:35 2021] GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 1301 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:35.698387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:35.700408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:35.716531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:35.717445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.718759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:35.719393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:35.861117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dafa6b01-cf5b-4e7f-a93b-2634832b460b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.167893 Nov 20 21:03:35.867513 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2447/4970] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:35 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:36.117079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:36.118465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.127716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.128534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.130276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.130996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.440912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:36.442664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.477638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.478236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.482863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.483601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.557048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:36.578173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fae6a133-4042-4fe9-b172-cd03ccea5752 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.466664 Nov 20 21:03:36.578845 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2524/4971] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:36 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:36.592749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:36.593370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] [instance: 19f715fc-c10c-4614-81cb-275bac16a0f8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.608870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.609370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.610267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.625731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.655328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] HTTP exception thrown: Instance 19f715fc-c10c-4614-81cb-275bac16a0f8 could not be found. Nov 20 21:03:36.656270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] Returning 404 to user: Instance 19f715fc-c10c-4614-81cb-275bac16a0f8 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:36.657897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4dd05e1e-b046-4d35-850f-391c1fdfa8f5 tempest-ServerShowV247Test-95377454 tempest-ServerShowV247Test-95377454-project] 10.222.0.41 "GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8" status: 404 len: 111 microversion: 2.1 time: 0.074630 Nov 20 21:03:36.659132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2525/4972] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:36 2021] GET /compute/v2.1/servers/19f715fc-c10c-4614-81cb-275bac16a0f8 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:36.669785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:36.671644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.685696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.686921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.689771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.701688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.748194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:36.874661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:36.905955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be492cd2-48f6-446f-8064-77968661459b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 204 len: 0 microversion: 2.1 time: 0.242012 Nov 20 21:03:36.910840 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2526/4973] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:36 2021] DELETE /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:03:36.911192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ced67247-d573-4842-b788-2f28bfd264e0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1655 microversion: 2.1 time: 0.482379 Nov 20 21:03:36.911192 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2448/4974] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:36 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1655 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:36.928421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:36.928894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:36.929571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.929835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:36.937990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.938575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.939981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.940419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.948604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.949665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:36.950721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:36.951373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.016388 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cdfcb4b-b4c9-4775-a30b-af91ac8dbb1e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.107077 Nov 20 21:03:37.017207 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2527/4975] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:36 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:37.025906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12237f60-ea40-4fb5-8d82-c30bc5ff3621 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:37.033140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12237f60-ea40-4fb5-8d82-c30bc5ff3621 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:37.033589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12237f60-ea40-4fb5-8d82-c30bc5ff3621 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.081436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12237f60-ea40-4fb5-8d82-c30bc5ff3621 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Going to try to start instance {{(pid=140941) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:03:37.174869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12237f60-ea40-4fb5-8d82-c30bc5ff3621 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.152499 Nov 20 21:03:37.178995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2528/4976] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:37 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:37.188664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:37.189428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:37.210684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:37.211758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.213337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:37.218363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.247012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:37.258076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62d0d132-2ffc-41b1-84d2-238e15bec61b tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1503 microversion: 2.1 time: 0.341798 Nov 20 21:03:37.265286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2449/4977] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:36 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1503 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:37.597553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:37.598216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:37.616712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:37.617963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.618844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:37.619429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:37.702325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:37.717245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1428b69b-3109-4e83-808f-d0448a6d7d33 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1664 microversion: 2.1 time: 0.536914 Nov 20 21:03:37.717891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2529/4978] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:37 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1664 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:37.946483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:37.966594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c7de85e-8725-400d-b1bb-6fe62da1bbcd tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.373976 Nov 20 21:03:37.978728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2450/4979] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:37 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:38.032651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:38.033671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:38.059846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:38.060358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:38.064642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:38.068060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:38.149493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: .version_select at 0x7f3f98e71d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1141664027"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:38.172311 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c61d3919-52ae-4cfb-87e2-6e1992bdc17e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.148093 Nov 20 21:03:38.173740 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2530/4980] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:38 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:38.212327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:38.224457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:38.286465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:38.287080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:38.304635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:38.305408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:38.306926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:38.308910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:39.021829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:39.039047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-019ca309-abe5-4dce-9f3d-cb60b34cb05f tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1503 microversion: 2.1 time: 0.758310 Nov 20 21:03:39.039950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2531/4981] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:38 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1503 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:39.049819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:39.064664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:39.088087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:39.091205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:39.100518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:39.101119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:39.868193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:39.881937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:39.923684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f5a36d4-6094-4e52-8985-e479e51a954e tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 1.784129 Nov 20 21:03:39.926016 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2451/4982] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:03:38 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:39.936309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:39.937328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:39.953593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:39.954490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:39.956119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:39.956889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.036989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:40.080689 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-923b68ab-ead1-40fe-83c5-bd46c4a818ad tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1664 microversion: 2.1 time: 1.034916 Nov 20 21:03:40.083770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2532/4983] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:39 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1664 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:40.105784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:40.110118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:40.172895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:40.182857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.184360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:40.207207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.362171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-abdaa801-ca61-473f-914d-4a0fcd42ceb5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 24586 microversion: 2.32 time: 0.274048 Nov 20 21:03:40.364688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2533/4984] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 24586 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:40.375422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:40.377289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:40.410877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:40.412637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.415324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:40.416737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.465976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:40.491481 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-104aaafe-1606-410c-9b66-af85707d5882 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.559580 Nov 20 21:03:40.492525 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2452/4985] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:39 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:40.635425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2802921638c405b97d556ae94c48cca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dd90d53ed124eb98716ef6f31410ef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:40.657949 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-430c4afa-82ce-4767-83f7-b8add7d8eff6 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 200 len: 1461 microversion: 2.1 time: 0.290862 Nov 20 21:03:40.659048 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2534/4986] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:40 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 1461 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:40.706769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-737e41e2-cb3f-4171-ac54-d6b74b43e37a req-e14709ef-b2e2-4d04-b1f4-f60b8986a7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2928aad-24a3-4ddc-bf95-ead1468989fc", "name": "network-vif-deleted", "tag": "54b6e7c9-5484-446f-a370-1b9e21e68db0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:40.711615 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:40.711615 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:40.740923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-737e41e2-cb3f-4171-ac54-d6b74b43e37a req-e14709ef-b2e2-4d04-b1f4-f60b8986a7c3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:40.741670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-737e41e2-cb3f-4171-ac54-d6b74b43e37a req-e14709ef-b2e2-4d04-b1f4-f60b8986a7c3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:40.778668 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-737e41e2-cb3f-4171-ac54-d6b74b43e37a req-e14709ef-b2e2-4d04-b1f4-f60b8986a7c3 service nova] Creating event network-vif-deleted:54b6e7c9-5484-446f-a370-1b9e21e68db0 for instance a2928aad-24a3-4ddc-bf95-ead1468989fc on nch2-master-1 Nov 20 21:03:40.793020 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-737e41e2-cb3f-4171-ac54-d6b74b43e37a req-e14709ef-b2e2-4d04-b1f4-f60b8986a7c3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095380 Nov 20 21:03:40.795365 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2453/4987] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:41.106547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:41.108036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.119894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.123428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.124468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.126446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.378444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:41.381324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.383129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:41.393325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-101bd2a2-673f-4ab3-87d1-602a6588bbba tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.290102 Nov 20 21:03:41.394200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2535/4988] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:41 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:41.405094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.405094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.405094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.405094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.413493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:41.419210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.429639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.430509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.432345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.433126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.497478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99d5242c-3a5d-442b-8563-009b85f7efec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 32621 microversion: 2.32 time: 0.123684 Nov 20 21:03:41.498257 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2454/4989] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 32621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:41.524233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:41.525369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.538885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.542858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.554096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.555043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.836607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:41.851134 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca3d7da8-06d5-4729-a5e4-8d082626af52 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.440473 Nov 20 21:03:41.864521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2536/4990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:41 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:41.887107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:41.887336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:41.887924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] [instance: a2928aad-24a3-4ddc-bf95-ead1468989fc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.901727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8dfd155a-550c-4e77-a29d-2a35e48623f3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.379500 Nov 20 21:03:41.904344 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2455/4991] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:41 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:41.907435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.907884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.914254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:41.914509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:41.914829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.916345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.933573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.935077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:41.939410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:41.941737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.043882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Unlocking {{(pid=140942) unlock /opt/stack/nova/nova/compute/api.py:4653}} Nov 20 21:03:42.163525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95eedefa-1ecd-4a5f-82d0-856f109c1e64 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.258014 Nov 20 21:03:42.165030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2456/4992] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:41 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:42.182217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:42.183113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:42.191851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.193480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.195612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.196451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.336264 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] HTTP exception thrown: Instance a2928aad-24a3-4ddc-bf95-ead1468989fc could not be found. Nov 20 21:03:42.336871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] Returning 404 to user: Instance a2928aad-24a3-4ddc-bf95-ead1468989fc could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:03:42.339413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ede4d51d-cd6f-4737-9dfc-04969a29f2d0 tempest-VolumesActionsTest-290021599 tempest-VolumesActionsTest-290021599-project] 10.222.0.41 "GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc" status: 404 len: 111 microversion: 2.1 time: 0.473684 Nov 20 21:03:42.340509 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2537/4993] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:41 2021] GET /compute/v2.1/servers/a2928aad-24a3-4ddc-bf95-ead1468989fc => generated 111 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:03:42.503595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:42.511662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:42.523025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:42.543879 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99e571a1-8e78-4763-b847-2ac98add19a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.371942 Nov 20 21:03:42.549747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.550108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2457/4994] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:42 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:42.550835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.551874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.552572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.562551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:42.563104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:42.570395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.570862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.571679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.572161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.602689 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1dd3ced-e4ce-46c5-a1b4-b5910d40a540 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 32621 microversion: 2.32 time: 0.094917 Nov 20 21:03:42.605173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2538/4995] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 32621 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:42.676383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ce3babf-e4e3-4fb9-805b-ba27e276a93a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.118940 Nov 20 21:03:42.681833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2458/4996] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:42 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:42.687902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:42.695113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:42.710186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.710751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.721639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.722162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.920940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:42.922677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:42.945703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.946357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:42.947418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:42.948834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:43.062342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:43.074929 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8e1e66f-86b4-4e92-a215-0c601dad2969 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1673 microversion: 2.1 time: 0.391179 Nov 20 21:03:43.076041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2539/4997] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:42 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1673 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:43.162309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:43.173595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50a1bed8-d6c7-49b0-a9e7-867a5ecf8e6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.258660 Nov 20 21:03:43.174662 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2459/4998] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:42 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:43.179345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1991326700", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "44d4f9c0-cceb-42f9-9546-61fcbc3cc88b"}], "key_name": "tempest-TestNetworkBasicOps-1141664027", "security_groups": [{"name": "tempest-secgroup-smoke-1190000944"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:43.332880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] validate_networks() for [('44d4f9c0-cceb-42f9-9546-61fcbc3cc88b', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:03:43.405056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e696739-fbca-4d9d-95e5-22388a9c0442 tempest-ComputeTenantNetworksTest-880985591 tempest-ComputeTenantNetworksTest-880985591-project] Calling method '.version_select at 0x7f3f86e06160>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:43.676819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e696739-fbca-4d9d-95e5-22388a9c0442 tempest-ComputeTenantNetworksTest-880985591 tempest-ComputeTenantNetworksTest-880985591-project] 10.222.0.41 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.599290 Nov 20 21:03:43.677536 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2540/4999] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 21:03:43 2021] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:43.688828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:43.690208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:43.697694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:43.698541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:43.699413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:43.700113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:43.750574 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f4ef38f2-440a-4501-8bf9-c41a4d7300d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 32621 microversion: 2.32 time: 0.065266 Nov 20 21:03:43.751583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2541/5000] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:43 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 32621 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:43.761430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7db6ab04-1e23-46e9-a757-1e560cdcbccc tempest-ComputeTenantNetworksTest-880985591 tempest-ComputeTenantNetworksTest-880985591-project] Calling method '.version_select at 0x7f3f877841f0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:43.888166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7db6ab04-1e23-46e9-a757-1e560cdcbccc tempest-ComputeTenantNetworksTest-880985591 tempest-ComputeTenantNetworksTest-880985591-project] 10.222.0.41 "GET /compute/v2.1/os-tenant-networks/44c7468e-6706-4062-b613-74e62739a34b" status: 200 len: 139 microversion: 2.1 time: 0.134963 Nov 20 21:03:43.888865 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2542/5001] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 21:03:43 2021] GET /compute/v2.1/os-tenant-networks/44c7468e-6706-4062-b613-74e62739a34b => generated 139 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:44.099200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:44.099200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.112218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.112218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.112218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.112607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.249149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:03:44.249721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:03:44.250030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:03:44.250459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:03:44.250868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:03:44.265169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.266079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.267448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.268098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.287915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:44.295368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Getting quotas for user b5a29a5e851948efbecdb43fa79ccbf0 and project 3d0636503ac5406792f6a872f4f9c10d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:44.308942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:03:44.311541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:03:44.401729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0df66e1d-fafe-42bb-bfd4-e050c11cab8b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.225695 Nov 20 21:03:44.404302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2460/5002] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:03:43 2021] POST /compute/v2.1/servers => generated 406 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:03:44.411993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:44.412740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.423535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.424513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.426161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.427002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.457553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:44.469125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c94f40f-b23e-4ecd-beff-5d4c509c76e8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1653 microversion: 2.1 time: 0.379623 Nov 20 21:03:44.470579 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2543/5003] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1653 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:44.475669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0a5de1f-b3fb-4820-a3b0-26a6a63ea580 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:44.476585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0a5de1f-b3fb-4820-a3b0-26a6a63ea580 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.587220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0a5de1f-b3fb-4820-a3b0-26a6a63ea580 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:44.599314 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0a5de1f-b3fb-4820-a3b0-26a6a63ea580 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1249 microversion: 2.1 time: 0.125909 Nov 20 21:03:44.614358 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2544/5004] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:44 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1249 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:44.629576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:44.631283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.647963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.649577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.651918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.653218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.755009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:44.774622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b098f79a-6158-4300-8eae-19a1e2a46b6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.368882 Nov 20 21:03:44.775823 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2461/5005] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:44 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:44.783601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:44.785689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.794622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.795726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.797834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.799112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.850011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a35a004-85b7-475f-9afe-9f306aee5141 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.233588 Nov 20 21:03:44.851128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2545/5006] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:44 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:44.863411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:44.865247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:44.883420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.885997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.887125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:44.887571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:44.910407 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18731817-f8b7-441e-ae6a-e2692967cc55 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 32621 microversion: 2.32 time: 0.129338 Nov 20 21:03:44.913390 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2462/5007] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:44 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 32621 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:45.147673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:45.158867 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-244ec1a0-677e-4ecb-af0a-e36cbf4ee6e1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1660 microversion: 2.1 time: 0.303034 Nov 20 21:03:45.159995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2546/5008] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1660 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:45.630162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:45.633032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:45.657837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.659754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:45.662163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.665520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:45.782662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:45.794256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:45.795239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:45.816926 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1003e449-a7a1-4142-b695-4dc9ff774add tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1301 microversion: 2.1 time: 0.197618 Nov 20 21:03:45.820695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2463/5009] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:45 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1301 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:45.821069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.825361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:45.826364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.829479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:45.929161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:45.931121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:45.961656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.963368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:45.964205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:45.964651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.089394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1a5957f7-0937-44eb-9975-71761809e61e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 32621 microversion: 2.32 time: 0.167013 Nov 20 21:03:46.094673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2464/5010] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 32621 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:46.155671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:46.170318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0f92f0b-0333-48b4-8241-d3214661431f tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.380908 Nov 20 21:03:46.180795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2547/5011] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:45 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:46.180961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:46.180961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:46.191680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.193832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.195218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.199242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.395935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:46.405617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-652c97fb-bca9-42df-82c3-fce35b483d90 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.231874 Nov 20 21:03:46.406952 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2465/5012] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:46 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:46.425740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:46.426431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:46.436434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.436909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.438281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.438712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.838778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:46.840626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:46.856328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.858248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:46.863379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:46.864133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.011910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:47.031731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-46a9957f-1ed6-4561-9f9d-1755f048bbaa tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1307 microversion: 2.1 time: 0.186996 Nov 20 21:03:47.032436 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2466/5013] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:46 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:47.100807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:47.101796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:47.112811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.113269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.114162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.114544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.211794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01d0fce5-8ebf-4b60-80e2-63ae39aecbba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.114489 Nov 20 21:03:47.213125 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2467/5014] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:47 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:47.221264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:47.221954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:47.240372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:47.244630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.245498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.248982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.251211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.253015 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-482ae568-11e1-4811-8b31-be021c3c8083 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.831126 Nov 20 21:03:47.253954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2548/5015] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:46 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:47.273244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:47.273853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:47.298522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.298983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.299792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.300258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.594100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:47.603367 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-adc0ec43-3b4c-46b9-8ae7-31f496c13032 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.388852 Nov 20 21:03:47.604027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2468/5016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:47 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:47.649501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:47.659755 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa46d893-1c71-44b5-bc46-65171762349f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.388942 Nov 20 21:03:47.663507 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2549/5017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:47 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:47.682352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:47.683514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:47.690869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.691735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.693706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:47.694406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:47.962197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:47.971222 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf814cbe-b66e-46d2-9e4f-1466a12e25df tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.294237 Nov 20 21:03:47.973384 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2469/5018] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:47 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:48.050064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:48.050968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:48.093699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.107970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:48.113739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.114620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:48.226606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:48.228589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:48.252522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.254005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:48.255712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.257388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:48.368892 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b90e735d-78ae-4e23-ac33-13d0be706aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.146945 Nov 20 21:03:48.372839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2470/5019] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:48 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:48.629116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:48.632079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:48.642460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:48.654919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-de84c465-7554-4c9c-83aa-82ea2824a1ec tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.608869 Nov 20 21:03:48.656949 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2550/5020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:48 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:48.658247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.658858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:48.659826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:48.660392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:49.167448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:49.205174 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9343f59-75b5-4347-958a-528c0d6dc9e8 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.583808 Nov 20 21:03:49.208236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2471/5021] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:48 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:49.390929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:49.393898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:49.420434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:49.421325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:49.427611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:49.429352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:49.512482 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f7e562d-b595-47c2-8a3c-7ce625ccee75 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.132113 Nov 20 21:03:49.519307 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2551/5022] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:49 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:49.673418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:49.674274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:49.699044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:49.700051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:49.701412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:49.702181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.017308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-71186f55-b4e5-41b5-963a-317f9448c47c req-f59f6979-cd63-4e03-8c69-50a075b96a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53d5c0d-fd96-4986-b720-da7f4969d052", "tag": "1b695079-97f8-4824-aa79-b176e875fa4a"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:50.033293 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:50.033293 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:03:50.085717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-71186f55-b4e5-41b5-963a-317f9448c47c req-f59f6979-cd63-4e03-8c69-50a075b96a1b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:50.088235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-71186f55-b4e5-41b5-963a-317f9448c47c req-f59f6979-cd63-4e03-8c69-50a075b96a1b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.133770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:50.148390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a064b34-784f-4388-8da2-7c6bb6dd508d tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.479033 Nov 20 21:03:50.155967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2472/5023] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:49 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:50.158713 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-71186f55-b4e5-41b5-963a-317f9448c47c req-f59f6979-cd63-4e03-8c69-50a075b96a1b service nova] Creating event network-changed:1b695079-97f8-4824-aa79-b176e875fa4a for instance e53d5c0d-fd96-4986-b720-da7f4969d052 on nch2-master-1 Nov 20 21:03:50.185391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-71186f55-b4e5-41b5-963a-317f9448c47c req-f59f6979-cd63-4e03-8c69-50a075b96a1b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174955 Nov 20 21:03:50.186353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2552/5024] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:50.226827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:50.227742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:50.254631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:50.259141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.265595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:50.272703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.553848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:50.560157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:50.585111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:50.589382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.592810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:50.594371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:50.769634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5a5d42e-ae8f-42f1-ab58-19b626bf06b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.228925 Nov 20 21:03:50.779546 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2553/5025] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:50.891248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:50.917566 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-692d89dd-7cf0-43a0-ba5c-f8b303a85e24 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.691137 Nov 20 21:03:50.919629 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2473/5026] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:50 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:51.172562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:51.174749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:51.198694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.200818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:51.203443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.206620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:51.547546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:51.565203 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-696789af-acac-41dc-ba84-e44b0447241b tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.401779 Nov 20 21:03:51.568899 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2554/5027] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:51 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:51.786278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:51.787713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:51.807183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.807990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:51.814993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.817105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:51.938862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:51.939488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:51.951708 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b789004e-e702-4e5a-9bbf-afb59855e168 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.168705 Nov 20 21:03:51.952878 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2474/5028] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:51.964092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.964709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:51.974205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:51.974744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:52.441135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:52.451328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7a1b17e-f07f-4362-b655-972a2b0a0f6a tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.517468 Nov 20 21:03:52.457953 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2555/5029] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:51 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:52.589680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:52.590868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:52.607580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:52.608199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:52.609621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:52.611256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:52.890568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:52.920807 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c99e4445-e774-48ef-90d3-33d5eebcd384 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.336935 Nov 20 21:03:52.930785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2475/5030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:52 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:52.966196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:52.967131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:52.974128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:52.974586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:52.975749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:52.976189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.036257 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c4bc4b6-b950-4b12-b905-351e1644412a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.075401 Nov 20 21:03:53.040869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2556/5031] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:53.474763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:53.475390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:53.487790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.488261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.489122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.489570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.894757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:53.905635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e1bd6b73-ca9a-48bb-b3cc-fca2f3d3477e tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1485 microversion: 2.1 time: 0.434538 Nov 20 21:03:53.917615 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2476/5032] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:53 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1485 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:53.925412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:53.927271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:53.935296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.936029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.937759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.937997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:53.938536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:53.938874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.959961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.964690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:53.966312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:53.966666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:54.082801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2a0e42b1-8028-4d01-98da-3e52e962ad77 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "POST /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d/action" status: 202 len: 0 microversion: 2.1 time: 0.160423 Nov 20 21:03:54.088730 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2557/5033] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:03:53 2021] POST /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:54.099067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:54.100863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:54.120323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:54.121078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:54.122360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:54.125382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:54.211108 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aab7736b-afe7-498d-887c-3f7eb18ab17f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.121332 Nov 20 21:03:54.213584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2558/5034] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:54.228369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:54.231322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:54.257795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:54.260209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:54.263213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:54.265484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:54.325485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:54.333984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2090612c-520b-486d-b35e-1be9c884d0bf tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.400008 Nov 20 21:03:54.350040 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2477/5035] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:53 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:54.771289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:54.779967 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-edb67f82-6370-49e9-b266-35e5b198de06 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1493 microversion: 2.1 time: 0.564325 Nov 20 21:03:54.780560 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2559/5036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:54 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1493 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:55.225895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:55.227220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:55.242740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.243321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.244548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.245258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.303456 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-646ea967-bab8-460f-a417-13fda7912232 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.082252 Nov 20 21:03:55.312242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2478/5037] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:55 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:55.366302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:55.367506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:55.381993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.383493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.387235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.388004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.804393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:55.805544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:55.820162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.821583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.827950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:55.827950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:55.841398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:55.850377 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0e17e6a0-111b-490a-82a3-c59f93cb9da9 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.489424 Nov 20 21:03:55.877697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2560/5038] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:55 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:56.156377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:56.168942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39d95d99-5fbf-4fae-a7c6-4a2e5284b497 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1493 microversion: 2.1 time: 0.369294 Nov 20 21:03:56.180622 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2479/5039] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:55 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1493 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:56.329479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:56.331818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:56.342039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:56.342526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:56.343570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:56.344186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:56.405928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-561455b5-a364-4c17-997b-6f7e9a7aa8a9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.085627 Nov 20 21:03:56.411718 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2561/5040] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:56 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:56.870661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:56.871460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:56.881260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:56.882784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:56.884009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:56.885881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.174966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:57.188762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c68b2a1c-081d-4aa3-aedc-bac55dbccfdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.323394 Nov 20 21:03:57.190229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2480/5041] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:56 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:57.192265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:57.192969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:57.220685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.221151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.221956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.225901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.419952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:57.421328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:57.445065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.447658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.449382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.450176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.516107 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5de6f397-3eca-451a-839a-f465350d7323 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.100951 Nov 20 21:03:57.517479 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2481/5042] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:57 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:03:57.888632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:57.899536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-593b6be1-abcb-4519-a042-69547626d3cb tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1499 microversion: 2.1 time: 0.714978 Nov 20 21:03:57.901084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2562/5043] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:57 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1499 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:03:57.923340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:57.924090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:57.986218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.990620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:57.995851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:57.996353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.073293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:03:58.210420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:58.211689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:58.222793 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d535bb4d-1177-46be-a51d-718beac469c3 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 204 len: 0 microversion: 2.1 time: 0.302315 Nov 20 21:03:58.223615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.224203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.228091 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2482/5044] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:03:57 2021] DELETE /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:03:58.231086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.231898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.244369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:58.245793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:58.269200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.269865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.270862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.271309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.603842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:58.625635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b50e22bd-8492-483c-b594-a8e63f95d744 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.422102 Nov 20 21:03:58.638785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2563/5045] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:58 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:58.800909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:03:58.826751 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-006dbb5e-6124-406e-8492-93484c24deb5 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.596779 Nov 20 21:03:58.830679 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2483/5046] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:58 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:03:58.847898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:58.861330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:58.890830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.895911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:58.896804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:58.897260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.032170 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0298a45-26a8-4158-969d-d3cb33bd3ae4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.199756 Nov 20 21:03:59.033556 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2484/5047] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:03:58 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:03:59.051565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ce0d0172-3b84-47ab-9dfb-9d9bcfdc9382 req-055d59b3-b53c-4e67-932d-ba7e718ec697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53d5c0d-fd96-4986-b720-da7f4969d052", "name": "network-vif-plugged", "status": "completed", "tag": "1b695079-97f8-4824-aa79-b176e875fa4a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:59.059115 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:03:59.059115 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:03:59.073525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ce0d0172-3b84-47ab-9dfb-9d9bcfdc9382 req-055d59b3-b53c-4e67-932d-ba7e718ec697 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:59.074399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ce0d0172-3b84-47ab-9dfb-9d9bcfdc9382 req-055d59b3-b53c-4e67-932d-ba7e718ec697 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.100371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ce0d0172-3b84-47ab-9dfb-9d9bcfdc9382 req-055d59b3-b53c-4e67-932d-ba7e718ec697 service nova] Creating event network-vif-plugged:1b695079-97f8-4824-aa79-b176e875fa4a for instance e53d5c0d-fd96-4986-b720-da7f4969d052 on nch2-master-1 Nov 20 21:03:59.110294 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ce0d0172-3b84-47ab-9dfb-9d9bcfdc9382 req-055d59b3-b53c-4e67-932d-ba7e718ec697 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072816 Nov 20 21:03:59.114011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2485/5048] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:03:59.153838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: .version_select at 0x7f3f877b8b80>, body: {"keypair": {"name": "tempest-keypair-281131937"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:03:59.196391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:59.207130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:59.400789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:03:59.411069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:03:59.445941 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62db127e-b30d-41c4-b569-d6ff1e975ebd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.805078 Nov 20 21:03:59.448381 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2564/5049] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 21:03:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 809 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:03:59.646547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:59.647492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:59.662630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:59.663595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.664607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:59.666570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.847902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:03:59.848972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:03:59.859247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:59.859723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.862378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:03:59.862833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:03:59.991347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:00.002274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f404247a-39cf-4f81-8892-9d0c3e688c23 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1375 microversion: 2.1 time: 0.360633 Nov 20 21:04:00.007978 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2486/5050] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:59 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1375 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:00.045564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:00.051233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:00.065267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:00.065736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:00.066896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:00.067414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:00.165111 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed3ca36b-d3f4-4060-8af6-ce33051028c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.123071 Nov 20 21:04:00.176890 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2487/5051] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:00.278025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:00.288379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e295252-a5aa-4b3d-88fa-88fc7eee4209 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.442845 Nov 20 21:04:00.289006 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2565/5052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:03:59 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:01.025359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:01.025952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:01.036396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.036822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.037617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.038087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.185532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:01.186495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:01.193714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.194473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.195778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.200732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.264759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19534218-10bf-465a-8a6f-eb92582e14d1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.083510 Nov 20 21:04:01.269334 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2566/5053] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:01.307919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:01.308719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:01.328180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.328798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.329724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:01.330324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:01.730912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:01.742386 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b0e45ad-eb6f-4cb3-80bb-c319d753bf81 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1505 microversion: 2.1 time: 0.439789 Nov 20 21:04:01.747575 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2567/5054] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:01 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:01.983947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:01.995343 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8b790c1-3c30-47d4-ab22-8135042cebdd tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1546 microversion: 2.1 time: 0.971287 Nov 20 21:04:01.996385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2488/5055] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:01 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1546 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:02.015922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:02.016537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:02.024776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.025457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:02.026876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.027496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:02.279335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:02.280764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:02.299184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.299893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:02.302037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.304845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:02.323701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:02.339728 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-46ed89bd-9aad-463d-9680-32caf1dfc1ee tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1546 microversion: 2.1 time: 0.327735 Nov 20 21:04:02.341012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2568/5056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:02 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1546 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:02.405856 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-93c54838-efb3-4e9c-9d4c-61d9b5312ec3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.131565 Nov 20 21:04:02.407126 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2489/5057] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:02.765308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:02.765941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:02.785234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.785703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:02.786550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:02.786998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:03.392086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ab128e41-a79c-466d-876f-16e19bee5b8e req-390acf05-310a-491d-bcd4-caced3bc876b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d", "name": "network-vif-deleted", "tag": "bd2842a2-28bd-48b3-8da3-fa139162637d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:03.394081 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:03.394081 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:04:03.443140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ab128e41-a79c-466d-876f-16e19bee5b8e req-390acf05-310a-491d-bcd4-caced3bc876b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:03.451301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ab128e41-a79c-466d-876f-16e19bee5b8e req-390acf05-310a-491d-bcd4-caced3bc876b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:03.518400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ab128e41-a79c-466d-876f-16e19bee5b8e req-390acf05-310a-491d-bcd4-caced3bc876b service nova] Creating event network-vif-deleted:bd2842a2-28bd-48b3-8da3-fa139162637d for instance ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d on nch1-master-1 Nov 20 21:04:03.565599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ab128e41-a79c-466d-876f-16e19bee5b8e req-390acf05-310a-491d-bcd4-caced3bc876b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158441 Nov 20 21:04:03.573036 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2490/5058] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:03.616383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:03.620810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:03.658291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:03.661592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:03.669797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:03.672117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:03.812108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27b51581-a8cb-4011-9e98-3c63956b6247 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.237548 Nov 20 21:04:03.813284 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2491/5059] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:03 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:04.004461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:04.031318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3ff14c5-7ee4-4845-a56b-d1c2d4dd5a37 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 200 len: 1463 microversion: 2.1 time: 1.269809 Nov 20 21:04:04.032211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2569/5060] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:02 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 1463 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:04.660186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1197860403", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b0462fe-9d19-4cda-815b-86a91b87f9c7"}], "security_groups": [{"name": "tempest-securitygroup--110489351"}], "key_name": "tempest-keypair-281131937", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:04.825493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:04.826587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:04.839852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:04.840346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:04.841187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:04.841653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:04.908951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] validate_networks() for [('2b0462fe-9d19-4cda-815b-86a91b87f9c7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:04:04.971209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b66c27ed-5fbe-4a99-aa13-a86a6a70cd19 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.150089 Nov 20 21:04:04.972626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2570/5061] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:04 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:05.048718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:05.049682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:05.070018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.072157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.076044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.077513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.116363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] HTTP exception thrown: Instance ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d could not be found. Nov 20 21:04:05.117076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Returning 404 to user: Instance ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:04:05.119995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36d3f28f-bcc3-48e0-b125-febefa524d18 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d" status: 404 len: 111 microversion: 2.1 time: 0.075397 Nov 20 21:04:05.127430 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2571/5062] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:05 2021] GET /compute/v2.1/servers/ce0cb66a-0ccb-4eb4-8fbe-8cc263d7a96d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:04:05.137594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:05.141456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:05.173104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.173830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.174858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.178389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.224301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:04:05.372059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8caaf82-e830-4e01-9bf1-ff93ec058e43 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 204 len: 0 microversion: 2.1 time: 0.237621 Nov 20 21:04:05.373644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2572/5063] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:04:05 2021] DELETE /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:04:05.389677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:05.395379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:05.407935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.414933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.421345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.422188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.639772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:04:05.640337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:04:05.641076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:04:05.641873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:04:05.642543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:04:05.659378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.660122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.661390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:05.662760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:05.687433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:05.694308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:05.712439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:04:05.715697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:04:05.772312 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3de2b741-d3dd-4f8d-8127-44011956bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.118518 Nov 20 21:04:05.773665 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2492/5064] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:04:04 2021] POST /compute/v2.1/servers => generated 401 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 21:04:05.784468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:05.785370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:05.859822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:05.875107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:05.882398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:05.886471 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27dedb72-953c-42fa-a2f3-603e93de472f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1281 microversion: 2.20 time: 0.106460 Nov 20 21:04:05.895984 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2493/5065] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:05 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:05.986603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:05.988446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:06.004734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:06.006074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:06.007787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:06.010327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:06.089740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:06.118672 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aba57637-99c5-4c76-b398-c70e04ece29b tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1493 microversion: 2.1 time: 0.738210 Nov 20 21:04:06.124895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2573/5066] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:05 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1493 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:06.126997 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d91a55e6-b532-4dd4-ba38-902d27485097 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.143514 Nov 20 21:04:06.128250 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2494/5067] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:05 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:06.911001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:06.917169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:06.932888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:06.933605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:06.934648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:06.935102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.035946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:07.057698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6ca386ee-3ace-41b5-8d48-f5179e61fd2e req-62ca938b-1351-4534-bb84-6cc1fc7b64bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53d5c0d-fd96-4986-b720-da7f4969d052", "tag": "1b695079-97f8-4824-aa79-b176e875fa4a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:07.058332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:07.060256 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:07.060256 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:04:07.060494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:07.065534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d540ac14-0cda-498b-9226-14a62bc637c4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1333 microversion: 2.20 time: 0.161898 Nov 20 21:04:07.069293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2574/5068] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:06 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1333 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:07.092616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6ca386ee-3ace-41b5-8d48-f5179e61fd2e req-62ca938b-1351-4534-bb84-6cc1fc7b64bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:07.102353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6ca386ee-3ace-41b5-8d48-f5179e61fd2e req-62ca938b-1351-4534-bb84-6cc1fc7b64bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.134238 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6ca386ee-3ace-41b5-8d48-f5179e61fd2e req-62ca938b-1351-4534-bb84-6cc1fc7b64bc service nova] Creating event network-changed:1b695079-97f8-4824-aa79-b176e875fa4a for instance e53d5c0d-fd96-4986-b720-da7f4969d052 on nch2-master-1 Nov 20 21:04:07.143088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:07.144085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:07.155369 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6ca386ee-3ace-41b5-8d48-f5179e61fd2e req-62ca938b-1351-4534-bb84-6cc1fc7b64bc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096862 Nov 20 21:04:07.156682 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2495/5069] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:04:07.167085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:07.169865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:07.170357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.171449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:07.177999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:07.178475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.191764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:07.197543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.198831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:07.201125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:07.309546 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea7ec737-8735-408c-b911-0f59deb7d3a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.171850 Nov 20 21:04:07.310958 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2575/5070] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:07.626332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:07.638958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8efd75eb-d527-45ca-9b96-0b4e404c8977 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1493 microversion: 2.1 time: 0.480807 Nov 20 21:04:07.653667 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2496/5071] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:07 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1493 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:08.089053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:08.089762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:08.107167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.108961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.113209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.113863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.266930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:08.275675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:08.277237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:08.280648 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-29078b70-d2d5-4e1b-98be-9d2f7f666c6c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1339 microversion: 2.20 time: 0.196960 Nov 20 21:04:08.283263 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2576/5072] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:08 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:08.323329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:08.324878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:08.350972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.351439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.352554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.353004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.424425 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-062dddc1-ca82-4f0f-b3bf-3f9cc8e531c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.106392 Nov 20 21:04:08.425893 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2497/5073] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:08.658206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:08.658935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:08.669952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.670938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.672028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.673999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.820059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7ce5cd53f741ffa5781f96bd869dad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c79515660014c0bb607fcb10f6f0870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:08.846268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7858e1d8-b0c7-4bdb-b157-3adab8237578 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 200 len: 1451 microversion: 2.1 time: 0.192075 Nov 20 21:04:08.847304 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2577/5074] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:08 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 1451 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:08.903495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ccf039d6-5aa1-456e-8a45-0f791521db52 req-83b8b242-b3fb-41fe-9857-e6d683861ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9eed9b8-8261-4f91-8997-7d345873726b", "name": "network-vif-deleted", "tag": "667f05d2-48b8-4779-814f-21386c146880"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:08.905358 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:08.905358 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:04:08.913692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ccf039d6-5aa1-456e-8a45-0f791521db52 req-83b8b242-b3fb-41fe-9857-e6d683861ba4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:08.914132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ccf039d6-5aa1-456e-8a45-0f791521db52 req-83b8b242-b3fb-41fe-9857-e6d683861ba4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:08.934762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ccf039d6-5aa1-456e-8a45-0f791521db52 req-83b8b242-b3fb-41fe-9857-e6d683861ba4 service nova] Creating event network-vif-deleted:667f05d2-48b8-4779-814f-21386c146880 for instance c9eed9b8-8261-4f91-8997-7d345873726b on nch1-master-1 Nov 20 21:04:08.940197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ccf039d6-5aa1-456e-8a45-0f791521db52 req-83b8b242-b3fb-41fe-9857-e6d683861ba4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041762 Nov 20 21:04:08.941350 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2498/5075] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:09.301730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:09.303188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:09.313041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.313764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.314934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.315661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.445157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:09.454965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:09.479844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.480318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.482403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.483396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.586341 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a1e3f38-7a33-4e87-9e55-430892a7c12d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.147441 Nov 20 21:04:09.590284 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2499/5076] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:09 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:09.734000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:09.746077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:09.751863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:09.753289 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f5e455d-3671-47d8-996f-551a569282b4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.457417 Nov 20 21:04:09.754037 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2578/5077] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:09 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:09.865350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:09.866504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] [instance: c9eed9b8-8261-4f91-8997-7d345873726b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:09.879054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.884415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.888940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:09.889482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:09.944933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] HTTP exception thrown: Instance c9eed9b8-8261-4f91-8997-7d345873726b could not be found. Nov 20 21:04:09.951683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] Returning 404 to user: Instance c9eed9b8-8261-4f91-8997-7d345873726b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:04:09.967768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be73789f-f161-4596-9ef1-a67937320871 tempest-ServerRescueTestJSON-1823883826 tempest-ServerRescueTestJSON-1823883826-project] 10.222.0.41 "GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b" status: 404 len: 111 microversion: 2.1 time: 0.094665 Nov 20 21:04:09.972681 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2500/5078] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:09 2021] GET /compute/v2.1/servers/c9eed9b8-8261-4f91-8997-7d345873726b => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:04:10.604946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:10.606975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:10.628215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:10.629266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:10.630587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:10.635047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:10.711859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90884a10-7747-4f9b-8687-576db32565f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.113148 Nov 20 21:04:10.712921 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2579/5079] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:10 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:10.773185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:10.774968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:10.788003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:10.788462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:10.789256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:10.795790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:11.185604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8abe6549-44c0-48b4-8065-92d653128331 req-90a56ffb-1c8e-44cb-a3cd-da9c9d5b0369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:11.187209 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:11.187209 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:04:11.206237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8abe6549-44c0-48b4-8065-92d653128331 req-90a56ffb-1c8e-44cb-a3cd-da9c9d5b0369 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:11.210699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8abe6549-44c0-48b4-8065-92d653128331 req-90a56ffb-1c8e-44cb-a3cd-da9c9d5b0369 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:11.251760 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8abe6549-44c0-48b4-8065-92d653128331 req-90a56ffb-1c8e-44cb-a3cd-da9c9d5b0369 service nova] Creating event network-changed:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:04:11.259600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8abe6549-44c0-48b4-8065-92d653128331 req-90a56ffb-1c8e-44cb-a3cd-da9c9d5b0369 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080742 Nov 20 21:04:11.260479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2580/5080] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:04:11.426725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:11.439035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:11.444839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:11.448465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e86b0541-73e5-4739-ab0e-263cd45d9129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.680372 Nov 20 21:04:11.450782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2501/5081] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:10 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:11.724954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:11.725952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:11.742539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:11.743830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:11.744948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:11.745620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:11.817602 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f8fabcb-418f-481f-8aa1-e0ad9393218b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.096418 Nov 20 21:04:11.818754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2581/5082] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:11 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:12.472388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:12.473168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:12.481332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:12.481868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:12.482768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:12.483288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:12.780596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:12.789195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:12.793988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:12.795166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7db76125-b4ce-4488-88c7-fe3857328f2e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.329341 Nov 20 21:04:12.795745 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2502/5083] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:12 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:12.848263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:12.851122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:12.860836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:12.862257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:12.864019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:12.864628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:12.933747 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b1290e24-b583-450f-95eb-0bda86271f5d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.107092 Nov 20 21:04:12.935377 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2582/5084] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:13.824126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:13.824805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:13.831808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:13.832376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:13.833230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:13.833686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:13.947446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:13.951300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:13.960216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:13.960683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:13.961478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:13.962089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:14.040956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:14.042333 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e27d9bc-0c44-4493-b2f6-fbadbdc24a6c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.099510 Nov 20 21:04:14.043283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2583/5085] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:14.056524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:14.060684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:14.063009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e75d7ab-1d3d-4372-abbd-a892cc2bb06a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.251566 Nov 20 21:04:14.064982 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2503/5086] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:13 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:15.058259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:15.061864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:15.081987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:15.082924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:15.111552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:15.113233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:15.113711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:15.114174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:15.115082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:15.116821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:15.117427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:15.120036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:15.250235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43c9f4ec-182b-4f6f-99b2-eb36dde182d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.198954 Nov 20 21:04:15.256046 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2584/5087] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:15 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:15.389238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:15.398879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:15.401855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:15.409279 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cfaa8928-d11d-4e5d-bc7e-1f23ca8efe18 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.330226 Nov 20 21:04:15.412110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2504/5088] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:15 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:16.129688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:16.130889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:16.139543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.140227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.141027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.141469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.233592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04796962-63bc-42c9-826a-2d64cf2fbbc5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.108467 Nov 20 21:04:16.234656 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2585/5089] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:04:16 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:16.243569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:16.244948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:16.252991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.253255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.255089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.255801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.265172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:16.267542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:16.285583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.287648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.288455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.289078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.408720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24869314-22a0-4525-9127-b7ae38da6690 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.147656 Nov 20 21:04:16.412605 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2586/5090] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:16.430424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:16.433326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:16.459725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.465191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.466215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.466604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.515025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:16.522919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-891305c2-cccf-4295-8311-c75f78b943d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1670 microversion: 2.1 time: 0.283664 Nov 20 21:04:16.526764 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2505/5091] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:16 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1670 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:16.797669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:16.807855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:16.814723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:16.818609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-46995438-730b-41ed-a574-29d219a5b6f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.394543 Nov 20 21:04:16.819460 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2587/5092] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:16 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:16.928553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9863da56-ea77-417c-994a-c1c34a3bccb0 req-5f55fc5e-b62b-4df2-8f6e-68a86e2b522f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "name": "network-vif-plugged", "status": "completed", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:16.930642 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:16.930642 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:04:16.946914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9863da56-ea77-417c-994a-c1c34a3bccb0 req-5f55fc5e-b62b-4df2-8f6e-68a86e2b522f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:16.947450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9863da56-ea77-417c-994a-c1c34a3bccb0 req-5f55fc5e-b62b-4df2-8f6e-68a86e2b522f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:16.984807 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9863da56-ea77-417c-994a-c1c34a3bccb0 req-5f55fc5e-b62b-4df2-8f6e-68a86e2b522f service nova] Creating event network-vif-plugged:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:04:16.994934 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9863da56-ea77-417c-994a-c1c34a3bccb0 req-5f55fc5e-b62b-4df2-8f6e-68a86e2b522f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070469 Nov 20 21:04:16.998110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2506/5093] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:17.424738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:17.425991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:17.434794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.435543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:17.437850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.438525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:17.490513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-58adb39a-2ced-4af7-b105-013e1bd911e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.069573 Nov 20 21:04:17.491204 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2588/5094] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:17 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:17.545293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:17.546020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:17.553430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.554361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:17.557020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.557810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:17.858098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:17.872213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f59f91f-106c-47b0-8b5e-edbac007a2da tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1675 microversion: 2.1 time: 0.330690 Nov 20 21:04:17.872986 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2507/5095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:17 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1675 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:17.879169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:17.880312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:17.889473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.890400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:17.892590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:17.893338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.058731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1446764952", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": "none"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:18.086226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.096231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.098532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.099980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92aa785d-01a2-49aa-8542-33ad5fdda0ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1406 microversion: 2.20 time: 0.225656 Nov 20 21:04:18.100936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2508/5096] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:17 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:18.132183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:04:18.132935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:04:18.134183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:04:18.135006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:04:18.135430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:04:18.144928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.145393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.146252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.146695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.181316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:18.187372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for user de9649cf7c6e4d8383f226c1cff1cf4e and project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:18.214090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:04:18.219522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:04:18.279027 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-457d81a2-ff67-4df8-bd98-3d763475e933 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.581616 Nov 20 21:04:18.280649 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2589/5097] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:04:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 21:04:18.295091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:18.295717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:18.386477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.400689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.403473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:18.404726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-147d722a-5394-4d17-99db-baa658782cbd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1278 microversion: 2.54 time: 0.118455 Nov 20 21:04:18.405314 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2509/5098] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:18 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:18.503613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:18.504827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:18.515751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.516518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.517567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.518256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.583223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1264947a-8aab-4721-bb75-f62f52026236 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.082836 Nov 20 21:04:18.584601 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2590/5099] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:18.895247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:18.895954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:18.915574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.917236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:18.922496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:18.922974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.126441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:19.127225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:19.135402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.136119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.137201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.137750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.214438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.223081 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1235fb25-f9f0-4653-8af3-968f461bdc40 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.332447 Nov 20 21:04:19.224245 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2510/5100] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:18 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:19.328742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.338412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.339945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.341169 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4f0e7b9-6d64-4dc6-b703-3e8b2ea7e9cb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1598 microversion: 2.20 time: 0.221637 Nov 20 21:04:19.342206 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2591/5101] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:19 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1598 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:19.359805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:19.360510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:19.367440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.368240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.369224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.369734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.423872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:19.424858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:19.432033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.432482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.433284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.433726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.513897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.517684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67859257-83ec-423d-a893-18a0161d4b76 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.155645 Nov 20 21:04:19.518383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2511/5102] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 21:04:19 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:04:19.523789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.526544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:19.530511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f044af93-f0c2-4192-a91a-3b3d18f87408 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1330 microversion: 2.54 time: 0.110287 Nov 20 21:04:19.531540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2592/5103] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:19 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:19.596382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:19.597246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:19.606129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.606991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.609060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:19.609698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:19.674492 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d60ccc2-1f7b-4e3f-be3b-a1be6493284c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.081197 Nov 20 21:04:19.676239 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2512/5104] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:19 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:20.550800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:20.552071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:20.562386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:20.566715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:20.572281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:20.573204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:20.691793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:20.694168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:20.706313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:20.707032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:20.708807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:20.709523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:20.761719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:20.764593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c4d8459-3084-45f2-adb5-ed532d2e80f4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.081410 Nov 20 21:04:20.768764 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2513/5105] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:20 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:20.777769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:20.782699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:20.787633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-028aff45-04a6-4c87-985c-755f09524c2f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1336 microversion: 2.54 time: 0.240744 Nov 20 21:04:20.788239 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2593/5106] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:20 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1336 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:21.232405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:21.233368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:21.241388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.241833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.246781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a7685a9d-4410-42ea-b07c-d1f4a3fae879 req-fe92ae8a-dc0d-4549-ba41-4bf6f7317f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:21.249757 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:21.249757 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:04:21.259746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.259746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.269039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a7685a9d-4410-42ea-b07c-d1f4a3fae879 req-fe92ae8a-dc0d-4549-ba41-4bf6f7317f70 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.269767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a7685a9d-4410-42ea-b07c-d1f4a3fae879 req-fe92ae8a-dc0d-4549-ba41-4bf6f7317f70 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.310498 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a7685a9d-4410-42ea-b07c-d1f4a3fae879 req-fe92ae8a-dc0d-4549-ba41-4bf6f7317f70 service nova] Creating event network-changed:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:04:21.331016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a7685a9d-4410-42ea-b07c-d1f4a3fae879 req-fe92ae8a-dc0d-4549-ba41-4bf6f7317f70 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090282 Nov 20 21:04:21.333099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2594/5107] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:21.379990 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7903948-a463-4472-833e-173d0a273bb8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.149115 Nov 20 21:04:21.381489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2514/5108] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:21 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:21.779226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:21.780444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:21.796091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.797297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.798275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.808860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:21.809809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:21.813084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.828469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.833479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.834520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:21.835043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:21.904047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98f3c462-7a68-41ad-88af-3a9b95b69f28 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.130344 Nov 20 21:04:21.904519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2595/5109] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:21 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:21.986993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:21.997181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:21.998823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:22.000356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec5203d3-997c-4354-b4a1-553d268f883a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1357 microversion: 2.54 time: 0.196769 Nov 20 21:04:22.001207 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2515/5110] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:21 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:22.025674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Action: 'create', calling method: .version_select at 0x7f3f87a378b0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1657351432"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:22.066827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:22.084307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for user de9649cf7c6e4d8383f226c1cff1cf4e and project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:22.393289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:22.394611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:22.404201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.405095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.406162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.406911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.466859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9002bdb2-e83f-439c-b789-c103dc8ba5b9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.078122 Nov 20 21:04:22.470542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2516/5111] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:22 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:22.771004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:22.778712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Getting quotas for user de9649cf7c6e4d8383f226c1cff1cf4e and project 0c526affd2ec462c9ceb4523dfa7bc75. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:22.812333 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf9aecd6-730a-4645-959e-4d8aea28884e tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.792968 Nov 20 21:04:22.812943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2596/5112] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 21:04:22 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 795 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:04:22.824674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1657351432", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:22.826414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:22.843898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.844590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.846265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.846890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.918034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:22.919197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:22.933405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.933879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.934743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:22.935180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:22.943927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:04:22.944541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:04:22.945190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:04:22.946493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:04:22.947181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:04:23.016351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa5dd940-a4e1-4c6d-b9e5-bf8b19aee167 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.103263 Nov 20 21:04:23.021849 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2597/5113] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:23.093666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:23.107823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.111984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.114671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.115495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.157451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-752893e9-9452-4c6e-8bc5-fbbdabda926b tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "POST /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb/action" status: 202 len: 1140 microversion: 2.54 time: 0.337910 Nov 20 21:04:23.159014 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2517/5114] 10.222.0.41 () {62 vars in 1319 bytes} [Sat Nov 20 21:04:22 2021] POST /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb/action => generated 1140 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 20 21:04:23.174515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:23.175760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:23.187577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.188299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.190571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.191204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.300452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:23.311289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:23.313461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:23.314686 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb1d0a4f-ff0b-4a06-9d35-f3c2a044cda5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.144309 Nov 20 21:04:23.326664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2598/5115] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:23 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:23.479011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:23.480107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:23.489781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.491110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.495027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:23.495759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:23.571800 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce9a3d3b-317b-4c73-a603-7c1d58932938 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.096426 Nov 20 21:04:23.572811 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2518/5116] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:23 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:24.029826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:24.030794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:24.037802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.038299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.039094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.039669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.086302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d96a58f2-44a3-40cf-bcbf-93e01bfb24c2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.060601 Nov 20 21:04:24.087803 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2599/5117] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:24 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:24.334556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:24.335251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:24.343691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.344304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.345513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.345991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.416943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:24.424175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:24.425774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:24.428164 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de7a4890-cecf-4b37-b0fd-b2944559e480 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.096973 Nov 20 21:04:24.428894 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2519/5118] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:24 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:24.583897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:24.584931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:24.592869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.593324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.594149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:24.594588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:24.640956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a31c6a05-79fd-4b1a-ab15-b198ba910be5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.060853 Nov 20 21:04:24.649801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2600/5119] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:24 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:25.099543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:25.100825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:25.117370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.118837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.120061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.130108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.188034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29b80735-fae7-4d0c-9e91-fc8de7b52711 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093038 Nov 20 21:04:25.189206 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2520/5120] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:25 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:25.449657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:25.451089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:25.463044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.463714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.464909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.465581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.574041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:25.583739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:25.585313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:25.587237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f44e2ff6-7ce4-48fb-8a07-96bec6b7ea56 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.142720 Nov 20 21:04:25.599221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2601/5121] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:25 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:25.657466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:25.658582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:25.667345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.667866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.668921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:25.669366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:25.709687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa69cb26-2976-4fec-bd75-1b3be6c53b53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.056324 Nov 20 21:04:25.710375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2521/5122] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:25 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:26.201399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:26.202376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:26.210565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.211035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.212456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.212899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.259600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c6affad5-8594-453c-8502-c7940cc79cc4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.061654 Nov 20 21:04:26.260942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2602/5123] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:26 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:26.607388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:26.608551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:26.619516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.620089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.621091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.621931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.719825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:26.722263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:26.723267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:26.731075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:26.732088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.732545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.733412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:26.733642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:26.733924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:26.735313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91a1e2e7-e0c2-4d2e-b953-28ea86ce255a tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.132354 Nov 20 21:04:26.736891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2522/5124] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:26 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:26.779782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ff85e1b-5acb-4845-bd2d-7e70dcf44031 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.061780 Nov 20 21:04:26.780622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2603/5125] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:26 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:27.271888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:27.272815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:27.280057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.280902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.281913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.282418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.350965 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-594d7a68-a7dc-4032-bfc1-711f57314744 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.082686 Nov 20 21:04:27.354134 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2523/5126] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:27 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:27.762721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:27.763427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:27.770871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.771325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.772125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.772568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.792361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:27.794350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:27.803705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.808915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.810312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.811117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.844550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:27.854369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:27.855932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:27.857468 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87f8524b-7c05-4d5a-8556-82d565e9db2d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.100238 Nov 20 21:04:27.858248 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2604/5127] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:27 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:27.858910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-258c3392-d9d0-49d4-9bf7-35a6478a8e19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.071526 Nov 20 21:04:27.860295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2524/5128] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:27 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:27.887245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:27.888161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:27.894298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.894750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.895638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:27.896290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:27.953692 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c6a4cfa-091e-4976-bf33-7bd8e783eeb2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052/action" status: 200 len: 24563 microversion: 2.1 time: 0.070687 Nov 20 21:04:27.954625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2605/5129] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:04:27 2021] POST /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052/action => generated 24563 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:04:28.365982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:28.367019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:28.375157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.375612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.376410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.376856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.427905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-698739ea-c980-4d5c-944e-0735c5af9e0a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066741 Nov 20 21:04:28.428576 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2525/5130] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:28.873800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:28.876642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:28.877343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:28.883524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:28.884718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.885177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.886262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.886701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.901408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.902504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.904046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:28.904738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:28.950478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-176759cc-67a6-4c24-8d66-992bb1015f3d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.083832 Nov 20 21:04:28.951747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2606/5131] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:28 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:28.972729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:28.982490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:28.984244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:28.985871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47c00f5a-90dd-4fcd-b7a4-a566608fc386 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.113640 Nov 20 21:04:28.986732 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2526/5132] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:28 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:29.440789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:29.441797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:29.451429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:29.451872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:29.452690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:29.453122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:29.513757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b847767c-5e29-43e0-80f4-c010813f628b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.077071 Nov 20 21:04:29.514960 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2607/5133] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:29.962719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:29.963852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:29.976620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:29.976620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:29.976620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:29.977057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:30.005005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:30.006572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:30.015628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:30.016168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:30.017238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:30.017861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6be15b6d-8f84-4056-a33b-43afdfa75eb2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 14 microversion: 2.20 time: 0.059491 Nov 20 21:04:30.017987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:30.021322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2527/5134] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:29 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:30.093636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:30.102036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:30.103651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:30.104980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0aced298-f2f4-410e-9de3-00be8f975f30 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.104115 Nov 20 21:04:30.105905 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2608/5135] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:29 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:30.526302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:30.527850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:30.547419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:30.547872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:30.548664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:30.549103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:30.601156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e76bcfff-6710-4646-a0c0-62d5e02103ae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.078878 Nov 20 21:04:30.602837 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2528/5136] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:31.029584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:31.030632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:31.037511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.038537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.039883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.040811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.110518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4430b7a3-500b-4990-b283-4cf30ef3ff69 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 8206 microversion: 2.20 time: 0.080674 Nov 20 21:04:31.114023 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2609/5137] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:31 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 8206 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:31.124225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:31.124924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:31.132460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.132917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.135307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.136016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.214218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:31.222854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:31.224420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:31.226234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a110fc69-ac98-4ffe-8a40-09235027c256 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.105838 Nov 20 21:04:31.238076 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2529/5138] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:31 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:31.614302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:31.615897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:31.623365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.623910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.624774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:31.625217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:31.670816 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-368dd167-ce23-41ab-ba8b-945d6fc7f81a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.060189 Nov 20 21:04:31.671497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2610/5139] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:32.120946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:32.121799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:32.131609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.132523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.139355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.139821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.195296 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9984cf27-d317-45e5-8ab4-406e0e3aa664 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 16398 microversion: 2.20 time: 0.077681 Nov 20 21:04:32.201299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2530/5140] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:32 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 16398 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:32.254644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:32.255869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:32.268365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.269256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.270448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.271031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.383867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:32.397649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:32.400361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:32.401797 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a577acdd-88cb-4b4c-84f7-5b2fc4a91e15 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.158310 Nov 20 21:04:32.402573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2611/5141] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:32 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:32.684051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:32.685055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:32.692808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.693394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.694226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:32.694667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:32.767223 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd54d166-2e04-4dcd-b447-d309211ab39e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.087669 Nov 20 21:04:32.768611 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2531/5142] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:32 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:33.215812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:33.216559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:33.227838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.228517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.229525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.230805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.279475 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1ec8f84-aea1-402b-a78c-9f6582fcecce tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 16398 microversion: 2.20 time: 0.074959 Nov 20 21:04:33.280722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2612/5143] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:33 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 16398 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:33.425429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:33.427276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:33.436823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.437619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.439025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.439848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.533106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:33.544608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:33.547236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:33.549007 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91a563ea-42b3-4a1a-9223-e4ea07b0427f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.128212 Nov 20 21:04:33.554803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2532/5144] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:33 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:33.806739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:33.808318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:33.824046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.826641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.830756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:33.831550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:33.932765 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7616b9a4-4a24-4c09-baa5-f3240c3226d2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.153573 Nov 20 21:04:33.939493 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2613/5145] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:34.293622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:34.293622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:34.299516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.300205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:34.301198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.301637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:34.348894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a8125930-dea1-4b54-b0ec-f199a1550067 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 16398 microversion: 2.20 time: 0.059686 Nov 20 21:04:34.351913 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2533/5146] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:34 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 16398 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:34.567920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:34.568621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:34.575823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.576279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:34.577081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.577524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:34.677584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:34.686639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:34.688134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:34.689297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac03ab10-0252-4d58-874f-99bc653490f5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.125461 Nov 20 21:04:34.690183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2614/5147] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:34 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:34.948421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:34.949425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:34.963820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.964673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:34.965416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:34.966384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:35.050665 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02e18dc4-fbb4-43b6-ae43-3a5722d06f8e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.106175 Nov 20 21:04:35.056964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2534/5148] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:35.361860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:35.363098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:35.371551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:35.372457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:35.373427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:35.374025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:35.429707 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1efb314a-b81b-45b1-9a95-b7a109a8ed97 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 16398 microversion: 2.20 time: 0.071813 Nov 20 21:04:35.433336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2615/5149] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:35 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 16398 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:35.708649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:35.709348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:35.717000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:35.717462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:35.718283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:35.718726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:35.787798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:35.797216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:35.798872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:35.800041 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-436b7ee4-adf3-47e8-aef2-0ac98dc6c1e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.095470 Nov 20 21:04:35.800604 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2535/5150] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:35 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:36.064253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:36.065249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:36.073205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.073649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.074459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.074895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.119424 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05466bb6-8074-4dba-bd43-fcb091b748ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.058864 Nov 20 21:04:36.120479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2616/5151] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:36 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:36.444207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:36.451470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:36.465782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.466371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.467481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.468300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.522758 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-138c3e26-5eb0-4170-8fe5-14c77989af46 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 16398 microversion: 2.20 time: 0.083633 Nov 20 21:04:36.524428 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2536/5152] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:36 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 16398 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:36.819386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:36.820652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:36.827865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.828551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.829413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:36.829977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:36.901923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:36.912977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:36.916041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:36.918827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cabbe8e9-378c-4d4a-8a43-30fd85d6805d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.103834 Nov 20 21:04:36.919670 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2617/5153] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:36 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:37.132053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:37.133527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:37.143085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.144081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:37.145054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.145571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:37.199600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6ceb71d-0702-4c65-aa38-4f080e819dc7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.071573 Nov 20 21:04:37.204061 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2537/5154] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:37 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:37.535481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:37.536584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:37.543677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.544352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:37.545589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.546060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:37.604214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89b86efd-9ebf-4d2a-a481-5df70db29d8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.072869 Nov 20 21:04:37.609721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2618/5155] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:37 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:37.939837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:37.941205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:37.952009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.952952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:37.954191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:37.954791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.037726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:38.060141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:38.062198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:38.063982 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f8cadd80-3b77-4796-b7f7-2029bbe11a83 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.128614 Nov 20 21:04:38.064721 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2538/5156] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:37 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:38.214555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:38.215568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:38.222481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.222938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.223740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.224185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.279095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7dde17c1-7d59-4d48-91c4-effcfaabd7b4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.070219 Nov 20 21:04:38.279892 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2619/5157] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:38 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:38.616686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:38.619035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:38.625480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.626555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.627422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.628082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.682701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a6b3e45d-47cf-4435-b0c0-af6ab903d1f9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.070010 Nov 20 21:04:38.683744 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2539/5158] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:38 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:38.794296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Calling method '.version_select at 0x7f3f87ac44c0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:38.795394 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:38.795394 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:04:38.797714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.798209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.812365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.812817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.835887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.836867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.845502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d6aafc1-9e4b-465a-a944-eb12f714ee94 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1159658009-project-admin] 10.222.0.41 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.199407 Nov 20 21:04:38.846121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2620/5159] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:04:38 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:38.952574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:38.954229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:38.965270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.965921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:38.967690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:38.968016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.032945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d30ee49f-3bf2-44c9-b05f-01e21b1744c6 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "POST /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052/action" status: 200 len: 32636 microversion: 2.1 time: 0.085684 Nov 20 21:04:39.033842 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2540/5160] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:04:38 2021] POST /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052/action => generated 32636 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:04:39.085959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:39.087939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:39.095612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.096194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.097442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.097899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.192285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:39.222202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:39.223795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:39.225270 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6eda9847-9809-4931-ad06-d18150e3ab85 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.145120 Nov 20 21:04:39.226966 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2621/5161] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:39 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:39.291600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:39.292488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:39.299688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.300475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.301341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.301858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.350324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2db5f4ff-4edc-448d-acbd-ddb17312107b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062654 Nov 20 21:04:39.351004 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2541/5162] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:39 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:39.697927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:39.699556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:39.708857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.709421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.710350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:39.710862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:39.761122 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a4ae411-b3f2-48ab-9711-735b7519a553 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.069278 Nov 20 21:04:39.762031 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2622/5163] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:39 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:40.247377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:40.249305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:40.295303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.341241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.341241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.341241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.342267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:40.346394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:40.365227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.366467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.368130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.369611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.432708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:04:40.508691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:40.531972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:40.533465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:40.545202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94f3fb53-8f5d-4896-9210-08fca078aaae tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.300621 Nov 20 21:04:40.546079 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2542/5164] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:40 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:40.558666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ef7f4602-9b28-4f94-afe0-99fce7839322 req-70b30734-3eb0-4a6b-a69c-e9eb63f46571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e53d5c0d-fd96-4986-b720-da7f4969d052", "tag": "1b695079-97f8-4824-aa79-b176e875fa4a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:40.562925 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:40.562925 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:04:40.563111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4fead28-9fb3-4ff2-87ef-2928b5f7f89f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 204 len: 0 microversion: 2.1 time: 0.241882 Nov 20 21:04:40.567823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2623/5165] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:04:40 2021] DELETE /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:04:40.576466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:40.577747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:40.583619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef7f4602-9b28-4f94-afe0-99fce7839322 req-70b30734-3eb0-4a6b-a69c-e9eb63f46571 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.586856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ef7f4602-9b28-4f94-afe0-99fce7839322 req-70b30734-3eb0-4a6b-a69c-e9eb63f46571 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.587546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.588357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.590411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.591038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.613211 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ef7f4602-9b28-4f94-afe0-99fce7839322 req-70b30734-3eb0-4a6b-a69c-e9eb63f46571 service nova] Creating event network-changed:1b695079-97f8-4824-aa79-b176e875fa4a for instance e53d5c0d-fd96-4986-b720-da7f4969d052 on nch2-master-1 Nov 20 21:04:40.638480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ef7f4602-9b28-4f94-afe0-99fce7839322 req-70b30734-3eb0-4a6b-a69c-e9eb63f46571 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089047 Nov 20 21:04:40.641269 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2543/5166] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:40.652485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-081257d9-3a6c-483b-814b-c47fbed0796d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.080884 Nov 20 21:04:40.653456 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2624/5167] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:40.663313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:40.665459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:40.676104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.676837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.677768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.678377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.773302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:40.774917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:40.790482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.790933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.791752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:40.792188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:40.851316 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e54f5645-fd0e-488e-92a8-d674e3973c8b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.081943 Nov 20 21:04:40.858769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2625/5168] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:40 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:41.015480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:41.028644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72a23490-7787-48de-b723-9033fb98bc76 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1670 microversion: 2.1 time: 0.384941 Nov 20 21:04:41.030621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2544/5169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:40 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1670 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:41.565883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:41.567291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:41.575150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.575893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.577564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.578235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.648014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:41.657454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:41.661106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:41.664443 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8af0ac2d-e6a6-4f38-aa72-eea48a5f60e5 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.103013 Nov 20 21:04:41.664844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:41.665777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2626/5170] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:41 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:41.666750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:41.673705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.675059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.676025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.676596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.723265 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17c330a7-bef0-4c6f-9e91-4f526b0e4e65 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062131 Nov 20 21:04:41.724047 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2545/5171] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:41.865517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:41.866667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:41.879906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.880530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.882527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:41.883376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:41.958231 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6736cceb-64da-4a28-bf4d-4306d64c4f8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.097082 Nov 20 21:04:41.960710 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2627/5172] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:41 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:42.054820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:42.056144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:42.064221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.064821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.066386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.067014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.250212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:42.259942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56895869-686a-4fab-a436-fcdf4bde1079 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1552 microversion: 2.1 time: 0.214555 Nov 20 21:04:42.261917 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2546/5173] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:42 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1552 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:42.684837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:42.686168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:42.696271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.697019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.698029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.698606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.735338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:42.736865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:42.751640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.752228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.753149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.753597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.806760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a89fac60-107c-4fcd-b86a-02b8cd014b02 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.074566 Nov 20 21:04:42.810096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2547/5174] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:42.830509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:42.846769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:42.848353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:42.849653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5792de57-2ede-4a4d-a3c6-a795c591f8e9 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.169809 Nov 20 21:04:42.850570 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2628/5175] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:42 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:42.970724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:42.971763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:42.979232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.979898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:42.980708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:42.981160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.024326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-914a67c1-4c35-47e5-8fd9-e38c051436a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.057159 Nov 20 21:04:43.028253 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2548/5176] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:42 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:43.033366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-eddfc9f5-acfa-4fbf-9e7d-1a590d9ea0d3 req-2e7b4418-4271-4b52-b0fb-a9cf0e2020d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e53d5c0d-fd96-4986-b720-da7f4969d052", "name": "network-vif-deleted", "tag": "1b695079-97f8-4824-aa79-b176e875fa4a"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:43.035174 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:43.035174 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:04:43.045272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eddfc9f5-acfa-4fbf-9e7d-1a590d9ea0d3 req-2e7b4418-4271-4b52-b0fb-a9cf0e2020d8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.046019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eddfc9f5-acfa-4fbf-9e7d-1a590d9ea0d3 req-2e7b4418-4271-4b52-b0fb-a9cf0e2020d8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.065742 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-eddfc9f5-acfa-4fbf-9e7d-1a590d9ea0d3 req-2e7b4418-4271-4b52-b0fb-a9cf0e2020d8 service nova] Creating event network-vif-deleted:1b695079-97f8-4824-aa79-b176e875fa4a for instance e53d5c0d-fd96-4986-b720-da7f4969d052 on nch2-master-1 Nov 20 21:04:43.075003 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-eddfc9f5-acfa-4fbf-9e7d-1a590d9ea0d3 req-2e7b4418-4271-4b52-b0fb-a9cf0e2020d8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045742 Nov 20 21:04:43.076173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2629/5177] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:04:43.282962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:43.283910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:43.299886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.300353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.301336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.306074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.360575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.361545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.362219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lazy-loading 'fault' on Instance uuid e53d5c0d-fd96-4986-b720-da7f4969d052 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:04:43.431285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5a29a5e851948efbecdb43fa79ccbf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d0636503ac5406792f6a872f4f9c10d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:43.441755 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-101c1210-bfc1-4649-bbef-aece31a6c56c tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 200 len: 1339 microversion: 2.1 time: 0.166620 Nov 20 21:04:43.442727 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2549/5178] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:43 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 1339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:43.819977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:43.821185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:43.827637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.828099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.829079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.829759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.868979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:43.869634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:43.881623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.882106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.882346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00a6f906-8ee5-4fda-8bf1-0028527c90a4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062333 Nov 20 21:04:43.883492 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2630/5179] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:43 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:43.884992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:43.885901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:43.974811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:43.984062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:43.985763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:43.987156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5664fef9-27f1-4196-a4b3-0748d1138a55 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.122381 Nov 20 21:04:43.987731 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2550/5180] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:43 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:44.036261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:44.037256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:44.045411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.045859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.046675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.047107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.092451 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7437db98-d8dd-4f7a-a5b1-704ccde58a30 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.060017 Nov 20 21:04:44.096593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2631/5181] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:44 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:44.464356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:44.464982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] [instance: e53d5c0d-fd96-4986-b720-da7f4969d052] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:44.474857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.475741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.478028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.478719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.500525 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] HTTP exception thrown: Instance e53d5c0d-fd96-4986-b720-da7f4969d052 could not be found. Nov 20 21:04:44.501484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Returning 404 to user: Instance e53d5c0d-fd96-4986-b720-da7f4969d052 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:04:44.502827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-816f73c3-6d4f-465d-80e9-3f3dbb2ecc9f tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052" status: 404 len: 111 microversion: 2.1 time: 0.045015 Nov 20 21:04:44.503700 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2551/5182] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:44 2021] GET /compute/v2.1/servers/e53d5c0d-fd96-4986-b720-da7f4969d052 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:04:44.747453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e06d800-1c99-415e-baf4-d2f56e731fa2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] Calling method '.version_select at 0x7f3f87bad550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:44.788945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e06d800-1c99-415e-baf4-d2f56e731fa2 tempest-TestNetworkBasicOps-1048723029 tempest-TestNetworkBasicOps-1048723029-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1141664027" status: 202 len: 0 microversion: 2.1 time: 0.048790 Nov 20 21:04:44.789536 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2632/5183] 10.222.0.41 () {58 vars in 1256 bytes} [Sat Nov 20 21:04:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1141664027 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:44.894418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:44.895600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:44.903673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.904128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.904925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:44.906595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:44.964473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07001cf2-e52d-44df-97cd-b6f6d4857a60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.073527 Nov 20 21:04:44.965147 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2552/5184] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:44 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:45.008478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:45.009855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:45.020108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:45.020764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:45.021998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:45.022610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:45.105888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:45.107361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:45.116446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:45.116900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:45.118119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:45.120330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:45.124029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:45.133414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:45.134959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:45.141474 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6624437d-1f22-4ac0-b534-c60ea0b7c447 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.138675 Nov 20 21:04:45.142354 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2633/5185] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:45 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:45.196147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a593fd9-4473-4b88-8075-612f05103f2c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.094253 Nov 20 21:04:45.197581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2553/5186] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:45 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:45.979646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:45.980610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:45.991804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:45.992891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.000312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:46.000852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.051769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c34477aa-594b-47c9-89b1-1f2f31dc1978 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.078600 Nov 20 21:04:46.056126 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2634/5187] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:46.163015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:46.163793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:46.187737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:46.188280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.189106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:46.189550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.209960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:46.211925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:46.220615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:46.221077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.221878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:46.222586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:46.279865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2af218df-3224-4fc4-a487-f7e80eacb1a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.074190 Nov 20 21:04:46.281109 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2635/5188] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:46 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:46.347213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:46.358515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:46.360014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:46.361192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-90e119ac-c6ff-49a3-a15b-d7d4a5f9606d tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.203721 Nov 20 21:04:46.361756 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2554/5189] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:46 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:47.070220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:47.071920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:47.082780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.083458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.084436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.085080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.139311 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc3b7016-73ff-47fe-a18e-3d855de22659 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.074551 Nov 20 21:04:47.141772 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2636/5190] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:47 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:47.293914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:47.295119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:47.305039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.305848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.306872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.307626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.381113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:47.382169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:47.393159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e778e9a6-0894-4029-ab44-282fe7780fdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.104656 Nov 20 21:04:47.397260 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2555/5191] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:47 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:47.403736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.404675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.408845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:47.409520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:47.653125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:47.665600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:47.667757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:47.669261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5480ad7-0a7b-41d2-965b-40c6e94865cd tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.292424 Nov 20 21:04:47.670383 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2637/5192] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:47 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:48.153474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:48.154593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:48.171738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.172301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.173355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.174011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.240726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffa71d58-1617-4bcc-b6b7-45e454eb56c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.092688 Nov 20 21:04:48.242649 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2556/5193] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:48 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:48.406398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:48.408473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:48.425616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.428350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.430772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.432805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.495231 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-479eeda7-c35e-4969-8f63-877c436f5482 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 24571 microversion: 2.20 time: 0.092786 Nov 20 21:04:48.496718 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2638/5194] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:48 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:48.691918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:48.693878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:48.703357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.704142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.705015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:48.705657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:48.805114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:48.815830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:48.817192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:48.818669 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40be2f10-de34-496f-b5c1-3c8c81fc0dbc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.132617 Nov 20 21:04:48.819319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2557/5195] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:48 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:49.257338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:49.258970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:49.272461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.273836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.275091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.275683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.343762 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1227c456-6755-40f1-b2c4-20c020ddccd2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.091956 Nov 20 21:04:49.344909 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2639/5196] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:49 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:49.507121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:49.508105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:49.515027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.515476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.516296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.516735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.592970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c6b888c-f48f-440a-8c3c-fde82839c403 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.089170 Nov 20 21:04:49.593644 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2558/5197] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:49 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:49.839896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:49.841293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:49.850106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.850849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.853173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:49.854190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:49.952382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:49.972915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:49.979145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:49.983937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-addfeff6-a5cf-46b3-b9ae-5c7a2b64e577 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.150073 Nov 20 21:04:49.986755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2640/5198] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:49 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:50.358909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:50.360581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:50.370971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:50.372373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:50.373672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:50.374407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:50.438539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2fe8b89f-e9f6-42ca-b1fb-36691d809e70 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.084481 Nov 20 21:04:50.440318 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2559/5199] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:50.605718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:50.606849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:50.613343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:50.613975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:50.615135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:50.615719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:50.661915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56996c51-47aa-4809-b0bd-2b7df2549cda tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.060636 Nov 20 21:04:50.663159 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2641/5200] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:50 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:51.011189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:51.011984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:51.019036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.019770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.021048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.021565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.092707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:51.101455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:51.103218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:51.104798 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2b6c0b42-702d-44bd-8e9d-df9179655de8 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.099070 Nov 20 21:04:51.105256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2560/5201] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:51 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:51.451939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:51.453583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:51.461872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.462559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.463537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.463967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.513588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96f61775-6645-47eb-8985-2d1c8344477c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066246 Nov 20 21:04:51.514375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2642/5202] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:51.626859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:51.627503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:51.638206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.639157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.640691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.641734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.674883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:51.675996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:51.688784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.689404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.691631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.692243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.749980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78022abb-1aa8-464a-aaa2-ecafd69cae85 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.079230 Nov 20 21:04:51.752499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2643/5203] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:51 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:51.839174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:51.848124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c54b54a-b827-45d9-a0f2-2ff842db42e3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.224857 Nov 20 21:04:51.849012 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2561/5204] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:51 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:51.868830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:51.869882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:51.878337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.878784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:51.879740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:51.880321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.101554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:52.120757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a40ba817-62a1-449d-ac06-ccf8204ea290 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.257495 Nov 20 21:04:52.121640 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2644/5205] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:51 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:04:52.127581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:52.128659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:52.136762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.137429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.138807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.139400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.235891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:52.255769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:52.258687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:52.266785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c28adb9-5da7-4583-8b27-c5aeef3907d2 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.143768 Nov 20 21:04:52.268199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2562/5206] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:52 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:52.274310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-133237354", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "bafdbd34-4234-401f-abb5-0b7b5a2562ab"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:52.468717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] validate_networks() for [('bafdbd34-4234-401f-abb5-0b7b5a2562ab', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:04:52.541456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:52.543300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:52.551159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.551995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.553087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.553838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.627432 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09183ad3-d86b-43fe-b1a2-e8d26078bde4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.098829 Nov 20 21:04:52.631427 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2563/5207] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:52.764738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:52.765871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:52.785771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.787395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.791124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:52.792569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:52.860360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e2f211b2-2466-47d2-b925-b43463ab5970 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.100098 Nov 20 21:04:52.861386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2564/5208] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:52 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:53.088783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:04:53.089698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:04:53.090523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:04:53.091270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:04:53.091856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:04:53.105763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.106277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.107249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.107922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.133639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:53.140406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:53.162489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:04:53.165610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:04:53.235119 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a2c18e9-227f-4f3d-8f17-a3e9ccf195eb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964385 Nov 20 21:04:53.236167 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2645/5209] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:04:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:04:53.251249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-acd5de41-bdd8-42d1-91e1-2bb3f1ab15c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:53.265071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-acd5de41-bdd8-42d1-91e1-2bb3f1ab15c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:53.287696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:53.288406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:53.312590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.313358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.314590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.315337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.401849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-acd5de41-bdd8-42d1-91e1-2bb3f1ab15c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:53.415664 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-acd5de41-bdd8-42d1-91e1-2bb3f1ab15c7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1214 microversion: 2.1 time: 0.168889 Nov 20 21:04:53.416892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2565/5210] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:53 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:53.425681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:53.445068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:53.447138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:53.449430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be710db0-1f15-4972-9795-b683831d3a76 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.167109 Nov 20 21:04:53.450933 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2646/5211] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:53 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:53.642204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:53.644386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:53.662679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.666025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.672178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.675266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.751190 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0fbaa8c8-e34f-4366-84c1-2e6be9ed35b9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.114043 Nov 20 21:04:53.753442 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2566/5212] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:53 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:53.875253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:53.876364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:53.886817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.888200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.891737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:53.893066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:53.941900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-268e2e2f-4c3d-4ef3-8af7-6dc2d54fe550 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.070780 Nov 20 21:04:53.943574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2647/5213] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:53 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:54.435112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:54.436061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:54.447559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.452234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.453096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.454533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.595634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:54.610064 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-027b0777-bc67-48ae-ae90-f3d84112c889 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1274 microversion: 2.1 time: 0.179272 Nov 20 21:04:54.611951 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2648/5214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:54 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:54.627118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:54.627740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:54.640332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.641171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.642491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.643176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.694442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Action: 'create', calling method: .version_select at 0x7f3f86ae45e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-541437412"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:54.726016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for project 83a551019ab140bba8ec377d05167a62. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:54.735613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for user 42c838a4d9574ad9ae0d581484cb36a7 and project 83a551019ab140bba8ec377d05167a62. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:54.756585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:54.782214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:54.786644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:54.793036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a9f4e42-ea5f-4d55-b779-54fda08772ec tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1409 microversion: 2.54 time: 0.179490 Nov 20 21:04:54.795479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2649/5215] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:54 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1409 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:54.802128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:54.804016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:54.816940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.818160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.821801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:54.823006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:54.938559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for project 83a551019ab140bba8ec377d05167a62. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:04:54.962609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for user 42c838a4d9574ad9ae0d581484cb36a7 and project 83a551019ab140bba8ec377d05167a62. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:04:54.973574 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8633eeb-3339-47ac-9af8-9d1a1ddde3e3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.171893 Nov 20 21:04:54.976192 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2650/5216] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:54.987848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:54.989927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:54.999299 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8b92dd9-a5ad-4492-b33c-f9507ca0abfa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.651907 Nov 20 21:04:55.000063 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2567/5217] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:04:54 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:55.009636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.011075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.012229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.012883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.095336 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce446fac-159c-4163-b74c-2c071e53c912 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.115656 Nov 20 21:04:55.100269 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2651/5218] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:54 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:55.634643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:55.635676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:55.649752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.650684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.651682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.652440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.743483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:55.756375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c78e5815-b643-4ead-a504-fb4fffaf18d1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1272 microversion: 2.1 time: 0.127799 Nov 20 21:04:55.759026 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2568/5219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:55 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:55.817600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:55.818699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:55.841836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.843999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.846817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:55.849574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:55.988063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:55.989983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:56.012524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.013516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:56.014698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.015310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:56.127686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4389b80-0091-441d-9388-dacc85457635 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.144221 Nov 20 21:04:56.133723 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2569/5220] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:55 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:56.144681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:56.145510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:56.145993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:56.163506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.165365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:56.166296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.166741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:56.172049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:56.180366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:56.197364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81787cab-5365-49e9-b98f-b634ecc66832 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1415 microversion: 2.54 time: 0.384769 Nov 20 21:04:56.200246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2652/5221] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:55 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1415 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:56.491694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ce2f49b-1b49-4289-a43a-ef89e0a6c4c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.356328 Nov 20 21:04:56.493580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2570/5222] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:56 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:56.776383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:56.777513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:56.797948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.800023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:56.802937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:56.803664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.083310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:57.093375 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3652687d-226a-40a7-a46b-f889e0fe0567 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.321575 Nov 20 21:04:57.093938 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2653/5223] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:56 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:57.148902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:57.150791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:57.201562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.202306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.210240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.211203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.223198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:57.223809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:57.241445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.244405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.248389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.249571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.371448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc7cd9ee-677b-4a89-b153-887ec25133b2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.232162 Nov 20 21:04:57.374199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2571/5224] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:57 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:57.508597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:57.509916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:57.571016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:57.592191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.592436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:57.592661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.593475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.597869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:57.600838 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb9b55c8-baca-453d-bf9b-10f000618313 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1415 microversion: 2.54 time: 0.381502 Nov 20 21:04:57.603032 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2654/5225] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:57 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1415 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:04:57.624604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:57.758268 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-acae413b-3d5f-485e-bb68-57c0d3d063e5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.255128 Nov 20 21:04:57.763667 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2572/5226] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:57 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:57.938907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f9f1c9ff-874d-4f67-9953-26373061c5f5 req-bd1371dc-c77b-4685-aed1-a6fa8f11397b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f390f8d7-738a-4054-995b-3c2a44debc3f", "tag": "2b058afc-10cf-4cd9-bbbc-13ea1bcc46be"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:57.941615 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:04:57.941615 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:04:57.973339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f9f1c9ff-874d-4f67-9953-26373061c5f5 req-bd1371dc-c77b-4685-aed1-a6fa8f11397b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:57.974840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f9f1c9ff-874d-4f67-9953-26373061c5f5 req-bd1371dc-c77b-4685-aed1-a6fa8f11397b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.014856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f9f1c9ff-874d-4f67-9953-26373061c5f5 req-bd1371dc-c77b-4685-aed1-a6fa8f11397b service nova] Creating event network-changed:2b058afc-10cf-4cd9-bbbc-13ea1bcc46be for instance f390f8d7-738a-4054-995b-3c2a44debc3f on nch2-master-1 Nov 20 21:04:58.038233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f9f1c9ff-874d-4f67-9953-26373061c5f5 req-bd1371dc-c77b-4685-aed1-a6fa8f11397b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105706 Nov 20 21:04:58.043080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2655/5227] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:04:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:04:58.112300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:58.113043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:58.135774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.136230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.137043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.137487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.389024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:58.392669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:58.403582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.404350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.405964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.406711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.503133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-923eb388-9904-4f25-b08d-145d2bbde055 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.121831 Nov 20 21:04:58.510570 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2656/5228] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:58 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:58.623373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:58.624298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:58.641974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.647835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.650066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.651001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.819352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:58.840417 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c1ba9861-fc7f-4360-8c14-31bef31c7ffc tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.732277 Nov 20 21:04:58.843317 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2573/5229] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:58 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:58.870780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:58.875036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:58.895597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.896116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.903145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:58.903934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:58.939250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:58.963311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:58.978866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:58.986208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ecc8ff0-1e8c-4f2e-9326-669334948a7f tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1400 microversion: 2.54 time: 0.367324 Nov 20 21:04:58.992513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e74c3adf-ba5c-45cf-a35e-caf87c400877 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.146368 Nov 20 21:04:58.994443 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2657/5230] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:04:58 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1400 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:04:58.999497 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2574/5231] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:58 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:04:59.018897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-daef514c-a99d-45e0-810f-5fba63f9f0c6 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '.version_select at 0x7f3f8702e040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:59.051214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-daef514c-a99d-45e0-810f-5fba63f9f0c6 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1657351432" status: 204 len: 0 microversion: 2.54 time: 0.038097 Nov 20 21:04:59.057547 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2658/5232] 10.222.0.41 () {60 vars in 1318 bytes} [Sat Nov 20 21:04:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1657351432 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:04:59.070508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:59.072514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:59.096109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.097661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.105473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.105945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.173520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:04:59.395594 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9324ea61-3a90-4d00-a1bb-a319ef4b0b27 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 204 len: 0 microversion: 2.1 time: 0.331358 Nov 20 21:04:59.396622 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2575/5233] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:04:59 2021] DELETE /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:04:59.409107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:59.410529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:59.428396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.429135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.433687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.435219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.518205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:04:59.519482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:59.528137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.542111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.544221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.546339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.585703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:04:59.596221 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-84d0a247-b21f-4ca2-85b3-6c46c13ba2cc tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1340 microversion: 2.1 time: 0.194369 Nov 20 21:04:59.598765 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2659/5234] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:59 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:04:59.653026 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fd5f73a-99b3-4f9e-8c6a-e5678985be57 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.139032 Nov 20 21:04:59.654640 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2576/5235] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:04:59 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:04:59.861855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:04:59.863471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:04:59.873610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.874309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:04:59.874643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:04:59.875223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.008689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:00.010639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:00.030648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.031683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.032547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.035485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.113580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7752e062-bdbf-40b7-9fc4-0963517003ec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.111035 Nov 20 21:05:00.114368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2577/5236] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:00 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:00.314135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:00.326815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c1216e1-e2ed-4665-ba42-74d78dcbc07b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.470980 Nov 20 21:05:00.329180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2660/5237] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:04:59 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:00.623203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:00.623949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:00.639705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.640238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.641036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.641574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.665397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:00.666387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:00.686413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.686972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.687783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:00.688390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:00.759465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5aadf283-5aa8-448f-9531-239ee1c50444 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.098115 Nov 20 21:05:00.760151 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2661/5238] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:01.032517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de9649cf7c6e4d8383f226c1cff1cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c526affd2ec462c9ceb4523dfa7bc75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:01.052943 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c7bbec9e-cd84-4f69-8f1b-9084c39c43b4 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 200 len: 1340 microversion: 2.1 time: 0.433838 Nov 20 21:05:01.054172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2578/5239] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:00 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 1340 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:01.126475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:01.127731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:01.145093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.145781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.146781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.148440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.237064 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb44c6f6-a0f7-444f-b543-938ded444aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.115396 Nov 20 21:05:01.238239 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2662/5240] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:01 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:01.352304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:01.352304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:01.363021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.363467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.364269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.364704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.775110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:01.777065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:01.800140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.828339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.829421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:01.830958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:01.916190 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec5829cb-b89f-46c7-a953-7d67ef8f2b98 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.147113 Nov 20 21:05:01.921699 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2663/5241] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:02.073922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:02.075515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] [instance: e314d62d-676c-4f79-aaa7-0d135b169ccb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:02.092751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.093511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:02.096842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.097568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:02.128958 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] HTTP exception thrown: Instance e314d62d-676c-4f79-aaa7-0d135b169ccb could not be found. Nov 20 21:05:02.129868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] Returning 404 to user: Instance e314d62d-676c-4f79-aaa7-0d135b169ccb could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:02.130968 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7934d9e-26dc-46d4-b3c4-0443c7b53f46 tempest-ServerShowV254Test-188273695 tempest-ServerShowV254Test-188273695-project] 10.222.0.41 "GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb" status: 404 len: 111 microversion: 2.1 time: 0.063249 Nov 20 21:05:02.132584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2664/5242] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:02 2021] GET /compute/v2.1/servers/e314d62d-676c-4f79-aaa7-0d135b169ccb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:05:02.250788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:02.251940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:02.266297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.266891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:02.267777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.271320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:02.296411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:02.305432 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-477752f7-b18a-4cef-97b1-30bd91dd0474 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.960929 Nov 20 21:05:02.316364 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2579/5243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:01 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:02.391050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a1786dff-ffc4-4feb-8e64-c3448359c54e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.132187 Nov 20 21:05:02.395057 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2665/5244] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:02 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:02.928932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:02.930438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:02.941452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.943373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:02.946689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:02.947361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:03.046711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b05e7659-c2a0-4596-bef3-c545beb19adf tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.120885 Nov 20 21:05:03.048328 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2580/5245] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:03.326204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:03.328027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:03.346477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:03.347279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:03.348315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:03.348950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:03.419303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:03.421203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:03.438094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:03.438801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:03.442262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:03.444693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:03.528328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73af7b4a-e63d-4219-bf3f-2257cdb7871b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.125654 Nov 20 21:05:03.530069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2581/5246] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:03 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:03.827345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:03.840853 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71ab6505-6361-431e-a7b5-e9944f353627 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.519112 Nov 20 21:05:03.840853 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2666/5247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:03 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:04.062432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:04.063507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:04.111020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.113023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:04.115787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.117331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:04.187502 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de354f89-22aa-42e7-b20d-51b6bb17f7d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.129165 Nov 20 21:05:04.189808 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2582/5248] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:04 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:04.541468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:04.542619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:04.552580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.558060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:04.579609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.580149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:04.656618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-043bc813-4f03-4b05-8b4d-0a63eb2ba8c0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.119777 Nov 20 21:05:04.657894 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2667/5249] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:04 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:04.857957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:04.858677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:04.875655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.877283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:04.878449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:04.881579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:05.202818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:05.204506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:05.215873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:05.217797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:05.219831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:05.222308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:05.353272 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3310553-a921-47b4-8d0f-c3365860be69 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.154438 Nov 20 21:05:05.354647 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2668/5250] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:05 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:05.432347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:05.445423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cff87b0-1e39-41f6-a88e-8d9e37e5b50d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.591599 Nov 20 21:05:05.454601 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2583/5251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:04 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:05.670502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:05.672416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:05.683206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:05.684126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:05.685131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:05.685754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:05.741279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-071f2a9c-8e19-4ddf-ac85-e778af00a16b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.076372 Nov 20 21:05:05.746454 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2669/5252] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:05 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:06.368878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:06.369843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:06.394517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.396174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.399176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.403296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.502204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61c142e4-cb46-42f9-8a95-03370e2f2d91 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.140226 Nov 20 21:05:06.503186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2584/5253] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:06 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:06.512494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:06.513304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:06.521605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.522615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.524386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.525025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.687761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cffe6e26-b24e-43cb-8e51-1ddb1bfa8abe tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Action: 'create', calling method: .version_select at 0x7f3f87a14ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2013849858", "metadata": {"Type": "work"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:06.701419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cffe6e26-b24e-43cb-8e51-1ddb1bfa8abe tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:06.706592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cffe6e26-b24e-43cb-8e51-1ddb1bfa8abe tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.281627 Nov 20 21:05:06.707365 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2670/5254] 10.222.0.41 () {60 vars in 1155 bytes} [Sat Nov 20 21:05:06 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:05:06.722892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51e62246-a642-416b-a275-64a4bcc265f3 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Action: 'create', calling method: .version_select at 0x7f3f98dfbee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-455643901", "metadata": {"Type": "work"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:06.724584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51e62246-a642-416b-a275-64a4bcc265f3 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:06.726159 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51e62246-a642-416b-a275-64a4bcc265f3 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009690 Nov 20 21:05:06.729633 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2671/5255] 10.222.0.41 () {60 vars in 1155 bytes} [Sat Nov 20 21:05:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:05:06.739128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9edf78a2-fb86-4ff7-8bef-e72820d0e267 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Action: 'create', calling method: .version_select at 0x7f3f86fab160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1203925476", "metadata": {"Type": "work"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:06.740691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9edf78a2-fb86-4ff7-8bef-e72820d0e267 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:06.741684 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9edf78a2-fb86-4ff7-8bef-e72820d0e267 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006863 Nov 20 21:05:06.750843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2672/5256] 10.222.0.41 () {60 vars in 1155 bytes} [Sat Nov 20 21:05:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:05:06.760022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:06.761386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:06.773490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.774017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.780851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:06.781718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:06.858309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-212dc151-e86e-45e9-9b20-b669ffe62ead tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.092143 Nov 20 21:05:06.860253 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2673/5257] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:06 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:06.876326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57b3e682-ef1e-4c35-aaa3-ccf23a5ab14c tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Calling method '.version_select at 0x7f3f878b9a60>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:06.931259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:06.945779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6dea17f4-1d1e-4382-89e7-bbf0b69f0bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.441108 Nov 20 21:05:06.946672 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2585/5258] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:06 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:06.966377 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-57b3e682-ef1e-4c35-aaa3-ccf23a5ab14c tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] HTTP exception thrown: Volume tempest-invalid-516463570 could not be found. Nov 20 21:05:06.967147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57b3e682-ef1e-4c35-aaa3-ccf23a5ab14c tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 404 to user: Volume tempest-invalid-516463570 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:06.969276 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57b3e682-ef1e-4c35-aaa3-ccf23a5ab14c tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-516463570" status: 404 len: 98 microversion: 2.1 time: 0.098061 Nov 20 21:05:06.972713 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2674/5259] 10.222.0.41 () {58 vars in 1214 bytes} [Sat Nov 20 21:05:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-516463570 => generated 98 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:05:06.987064 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05602d14-b50f-470b-8500-a7c3f774e1d8 tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009281 Nov 20 21:05:06.989026 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2586/5260] 10.222.0.41 () {58 vars in 1139 bytes} [Sat Nov 20 21:05:06 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 21:05:07.000830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf168be8-66e8-4cb0-865e-b49e5c9e34af tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004542 Nov 20 21:05:07.008179 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2675/5261] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 21:05:06 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 20 21:05:07.013060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-897daa0d-becf-4c91-8c5b-457e12a4937d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Calling method '.version_select at 0x7f3f86ad08b0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:07.047412 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-897daa0d-becf-4c91-8c5b-457e12a4937d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] HTTP exception thrown: Volume a1e1e5d7-fff0-44c8-9712-9d8faf1ae5c1 could not be found. Nov 20 21:05:07.049373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-897daa0d-becf-4c91-8c5b-457e12a4937d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 404 to user: Volume a1e1e5d7-fff0-44c8-9712-9d8faf1ae5c1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:07.050513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-897daa0d-becf-4c91-8c5b-457e12a4937d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/a1e1e5d7-fff0-44c8-9712-9d8faf1ae5c1" status: 404 len: 109 microversion: 2.1 time: 0.041787 Nov 20 21:05:07.058036 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2587/5262] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:05:07 2021] DELETE /compute/v2.1/os-volumes/a1e1e5d7-fff0-44c8-9712-9d8faf1ae5c1 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:05:07.062895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e09d79f7-b30b-4420-8959-9c9bb793939d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Calling method '.version_select at 0x7f3f98e2b550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:07.112593 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e09d79f7-b30b-4420-8959-9c9bb793939d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] HTTP exception thrown: Volume bcb5e1bc-d126-4948-9422-507b54ef16ae could not be found. Nov 20 21:05:07.113202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e09d79f7-b30b-4420-8959-9c9bb793939d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] Returning 404 to user: Volume bcb5e1bc-d126-4948-9422-507b54ef16ae could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:05:07.114036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e09d79f7-b30b-4420-8959-9c9bb793939d tempest-VolumesNegativeTest-1853430642 tempest-VolumesNegativeTest-1853430642-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bcb5e1bc-d126-4948-9422-507b54ef16ae" status: 404 len: 109 microversion: 2.1 time: 0.055514 Nov 20 21:05:07.114637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2676/5263] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:05:07 2021] GET /compute/v2.1/os-volumes/bcb5e1bc-d126-4948-9422-507b54ef16ae => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:05:07.516226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:07.519569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:07.543512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.544035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:07.544895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.550098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:07.659212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7657e720-41fd-48ef-9697-5b7c866337f9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.148547 Nov 20 21:05:07.660586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2588/5264] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:07.873443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:07.875903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:07.886358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.887037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:07.887994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.888593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:07.944635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76959116-e883-4189-b4e4-118a527e3817 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.077973 Nov 20 21:05:07.954731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2677/5265] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:07 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:07.963884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:07.965248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:07.985486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.987416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:07.998283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:07.999176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:08.278625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c3d815a1-046e-4ea2-886d-d2b0fbef6392 req-eba53e85-ac1a-4a34-b90c-e7423f91e1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f390f8d7-738a-4054-995b-3c2a44debc3f", "name": "network-vif-plugged", "status": "completed", "tag": "2b058afc-10cf-4cd9-bbbc-13ea1bcc46be"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:08.280911 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:08.280911 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:05:08.292498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c3d815a1-046e-4ea2-886d-d2b0fbef6392 req-eba53e85-ac1a-4a34-b90c-e7423f91e1a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:08.293184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c3d815a1-046e-4ea2-886d-d2b0fbef6392 req-eba53e85-ac1a-4a34-b90c-e7423f91e1a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:08.317132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c3d815a1-046e-4ea2-886d-d2b0fbef6392 req-eba53e85-ac1a-4a34-b90c-e7423f91e1a8 service nova] Creating event network-vif-plugged:2b058afc-10cf-4cd9-bbbc-13ea1bcc46be for instance f390f8d7-738a-4054-995b-3c2a44debc3f on nch2-master-1 Nov 20 21:05:08.327000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c3d815a1-046e-4ea2-886d-d2b0fbef6392 req-eba53e85-ac1a-4a34-b90c-e7423f91e1a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067701 Nov 20 21:05:08.328644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2678/5266] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:05:08.623211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:08.638757 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a328be86-daf1-46d5-8175-ca9e08b1cbaa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.679747 Nov 20 21:05:08.655451 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2589/5267] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:07 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:08.674520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:08.685961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:08.705305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:08.710604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:08.713639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:08.717040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:08.912706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-303a610e-6dc4-43ee-a5e1-2a302f454d21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.243637 Nov 20 21:05:08.920448 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2679/5268] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:08.961842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:08.963566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:08.992449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:08.994316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:08.999333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:09.002715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:09.093663 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-202b60e8-aa4d-4d0d-ae39-ebecb216465b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.140327 Nov 20 21:05:09.095041 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2590/5269] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:08 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:09.657568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:09.658818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:09.684798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:09.685503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:09.687414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:09.689793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:10.552886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:10.554026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:10.567098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:10.567560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:10.572847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:10.573311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:10.604201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:10.624567 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1320fa79-93f1-4649-be0d-6e34883893c8 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1314 microversion: 2.1 time: 0.971333 Nov 20 21:05:10.627681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2680/5270] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:09 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:10.659496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:10.677988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:10.681633 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-381d90dd-cda0-4eb6-b7d5-6a5dc460301e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.753977 Nov 20 21:05:10.687358 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2591/5271] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:09 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:10.693524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1433820409-access_point-1147907799", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "2bef316a-94ed-44e3-8dfa-520c0d36d93a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-541437412", "security_groups": [{"name": "tempest-secgroup_access--1731890520"}, {"name": "tempest-secgroup_general--1842334651"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:10.694236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:10.694993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:10.696091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:10.698668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:10.765297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a6b516a-fee3-4333-8eda-8fe5b252bb98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.136011 Nov 20 21:05:10.766341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2681/5272] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:10 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:11.178222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] validate_networks() for [('2bef316a-94ed-44e3-8dfa-520c0d36d93a', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:05:11.645510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:11.646993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:11.662478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:11.665270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:11.666338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:11.667332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:11.972154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:05:11.972919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:05:11.973337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:05:11.974317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:05:11.975210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:05:12.006554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.010722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.011897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.027261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.108843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for project 83a551019ab140bba8ec377d05167a62. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:05:12.115300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for user 42c838a4d9574ad9ae0d581484cb36a7 and project 83a551019ab140bba8ec377d05167a62. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:05:12.118376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:12.131121 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66b6ae2b-47b4-428b-a108-aad4604a672a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1501 microversion: 2.1 time: 0.489793 Nov 20 21:05:12.131790 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2682/5273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:11 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:12.137006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:05:12.140146 ncdv-master-1 devstack@n-api.service[140942]: WARNING nova.utils [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1433820409-access_point-1147907799 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1433820409-ac Nov 20 21:05:12.141131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:05:12.146606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:12.150634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:12.166735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.167392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.172224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.173631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.252115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33222f8a-737c-4640-b387-f2270cbb3d86 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.118805 Nov 20 21:05:12.253137 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2683/5274] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:12.261888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:12.264564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:12.284083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.284462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.285272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.286746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.293733 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7127d9fa-6d7e-492b-8357-951085e37d38 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.604164 Nov 20 21:05:12.321236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2592/5275] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:05:10 2021] POST /compute/v2.1/servers => generated 458 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:05:12.333674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:12.334324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:12.386641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a630697-71e1-4938-bf59-d0e998295424 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.131538 Nov 20 21:05:12.386856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.388743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.388986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2684/5276] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:12 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:12.389604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:12.395629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:12.400534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7dfce5bc-14a1-47c6-bf5d-218b424ce1e7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:12.401530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dfce5bc-14a1-47c6-bf5d-218b424ce1e7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:12.608167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7dfce5bc-14a1-47c6-bf5d-218b424ce1e7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:12.621442 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7dfce5bc-14a1-47c6-bf5d-218b424ce1e7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1294 microversion: 2.1 time: 0.229285 Nov 20 21:05:12.633994 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2685/5277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:12 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1294 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:12.821711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.network.security_group_api [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Removing security group 4aa6a7aa-3bac-4d1b-b80d-0d7e32007c29 from port 2b058afc-10cf-4cd9-bbbc-13ea1bcc46be Nov 20 21:05:13.268598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:13.269724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:13.300454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.303318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.304812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.323429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.460164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1d04455-cd7e-48a4-9632-b813d67177f8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.195343 Nov 20 21:05:13.463910 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2686/5278] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:13.477304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:13.479929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:13.496263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.501382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.503617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.504242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.629940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f33a7a5-0c7d-44ab-a35a-2a9211c592a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.164354 Nov 20 21:05:13.640380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2687/5279] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:13 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:13.646207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:13.646915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:13.680202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.681015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.685038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.689007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.859632 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b209d4ed-6775-487b-8dea-8a82ea5bdc2a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f/action" status: 202 len: 0 microversion: 2.1 time: 1.541434 Nov 20 21:05:13.861308 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2593/5280] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:05:12 2021] POST /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f/action => generated 0 bytes in 1544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:13.871660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:13.872552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:13.900125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.901758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.903022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:13.903717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:13.994010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:14.006653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aaedb14a-3132-4c09-b58b-d6a6d77230bd tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1346 microversion: 2.1 time: 0.362813 Nov 20 21:05:14.007779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2688/5281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:13 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1346 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:14.031275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d1f19b58-fc0f-4aff-bd71-17f77a21fea4 req-c4341d41-55f4-485f-ab88-139cae817810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f390f8d7-738a-4054-995b-3c2a44debc3f", "tag": "2b058afc-10cf-4cd9-bbbc-13ea1bcc46be"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:14.038632 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:14.038632 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:05:14.080758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d1f19b58-fc0f-4aff-bd71-17f77a21fea4 req-c4341d41-55f4-485f-ab88-139cae817810 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.082781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d1f19b58-fc0f-4aff-bd71-17f77a21fea4 req-c4341d41-55f4-485f-ab88-139cae817810 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.114865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:14.126794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b0c9103-e7ec-4287-aa9b-ee6d2dfd47fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1459 microversion: 2.1 time: 0.260840 Nov 20 21:05:14.130196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2594/5282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:13 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1459 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:14.140209 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d1f19b58-fc0f-4aff-bd71-17f77a21fea4 req-c4341d41-55f4-485f-ab88-139cae817810 service nova] Creating event network-changed:2b058afc-10cf-4cd9-bbbc-13ea1bcc46be for instance f390f8d7-738a-4054-995b-3c2a44debc3f on nch2-master-1 Nov 20 21:05:14.157951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:14.159447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:14.173386 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d1f19b58-fc0f-4aff-bd71-17f77a21fea4 req-c4341d41-55f4-485f-ab88-139cae817810 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140714 Nov 20 21:05:14.175515 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2689/5283] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:05:14.185280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.185859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.186764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.187568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.477437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:14.478663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:14.511918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.514280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.515864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.518725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.606312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0670e4d3-554a-441d-8d91-d9654cd88398 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.134958 Nov 20 21:05:14.610555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2690/5284] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:14 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:14.653200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:14.654372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:14.670763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.671369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.672350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:14.674942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:14.755670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20825e7b-2d04-4127-82f7-b6c4c4a9713e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.106594 Nov 20 21:05:14.762115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2691/5285] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:14 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:15.026867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:15.027572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:15.041406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.041918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.042795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.045222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.307811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:15.320716 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe43d247-4217-4ac9-8493-fdabc83b6543 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1352 microversion: 2.1 time: 0.299463 Nov 20 21:05:15.321549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2692/5286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:15 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1352 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:15.380564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:15.396231 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3f2f278-a548-4d0e-afaa-a064e0132631 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 1.243246 Nov 20 21:05:15.396934 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2595/5287] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:14 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:15.415805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:15.416642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:15.432759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.433368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.434678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.435216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.621141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:15.622315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:15.637049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.640701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.641663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.642142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.712318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-425c8d24-b93a-43ac-9492-c633a7f88781 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.097471 Nov 20 21:05:15.719643 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2596/5288] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:15 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:15.770271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:15.771838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:15.785290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.790882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.792350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:15.794603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:15.884361 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b068f892-6f71-4530-91ed-dd44bca75c66 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.117973 Nov 20 21:05:15.889337 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2597/5289] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:15 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:15.894955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:15.904037 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7d83b23-1481-46e7-bbce-305ba7a1be7e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.492690 Nov 20 21:05:15.908088 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2693/5290] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:15 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:16.042483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-301486056", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "bafdbd34-4234-401f-abb5-0b7b5a2562ab"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:16.179001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] validate_networks() for [('bafdbd34-4234-401f-abb5-0b7b5a2562ab', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:05:16.338961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:16.340002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:16.364053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.388687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:16.392735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.393792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:16.582461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:16.593867 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b72dd57-4923-44dc-b1bd-26fc75a7f986 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1352 microversion: 2.1 time: 0.258125 Nov 20 21:05:16.606989 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2694/5291] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:16 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1352 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:16.735347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:16.739169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:16.753022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.754175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:16.755585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.756310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:16.843387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b1dc517-803a-4f4a-88c9-c200f6557a9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.112196 Nov 20 21:05:16.848012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2695/5292] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:16.899072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:16.901524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:16.913135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.924139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:16.926527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:16.927400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:17.018035 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac77d627-573c-49b2-8b53-58a678e368fb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.124146 Nov 20 21:05:17.018737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2696/5293] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:16 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:17.613698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:17.614757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:17.631385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:17.633012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:17.637410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:17.638086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:17.776425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:05:17.777425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:05:17.778136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:05:17.778659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:05:17.779205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:05:17.803493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:17.805077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:17.806431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:17.816714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:17.841990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:05:17.861923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Getting quotas for user 0a234e3eb60044c593ed012693fda496 and project e51856fcb6a14eb6a78ce767f46c8472. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:05:17.901805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:05:17.909539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:05:18.043647 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d229c294-b642-467e-a510-bd76f872db9a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006724 Nov 20 21:05:18.046368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2598/5294] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:05:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:05:18.064611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:18.065852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:18.083268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:18.083823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:18.084816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:18.085961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:18.178389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0fcd053-8e60-46d8-8a6d-05f14047fff9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.124718 Nov 20 21:05:18.183489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2599/5295] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:18.200328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:18.201350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:18.209079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:18.209605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:18.211171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:18.211949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:18.275375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:18.284419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ddda905-6583-4f62-aa72-758fa2e37fcf tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.675310 Nov 20 21:05:18.291154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2697/5296] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:17 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:18.306190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5777ae08-e77e-4460-9b97-7ba4374f97f7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:18.307647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5777ae08-e77e-4460-9b97-7ba4374f97f7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:18.308564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b5cbbc7-c5f5-4429-b75e-62354f2fb9d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.121002 Nov 20 21:05:18.309555 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2600/5297] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:18 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:18.433816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5777ae08-e77e-4460-9b97-7ba4374f97f7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:18.443864 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5777ae08-e77e-4460-9b97-7ba4374f97f7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1214 microversion: 2.1 time: 0.151108 Nov 20 21:05:18.458244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2698/5298] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:18 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:19.208570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:19.211624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:19.243647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.246959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.252852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.253440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.310004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:19.310686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:19.321821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.331809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.334976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.335861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.365477 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f8a6518a-5d71-4856-8f73-664d50bcd4dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.174255 Nov 20 21:05:19.367757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2601/5299] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:19 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:19.379105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:19.383131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:19.407121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.407578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.408417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.408852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.487864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f673dec5-bfd7-4ba1-9418-cfff033e8615 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.118287 Nov 20 21:05:19.494514 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2602/5300] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:19 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:19.500868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:19.501927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:19.512277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.513115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.514484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.515164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:19.701438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:19.712930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8911f100-0022-4a62-8991-f19953e5cfcf tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1266 microversion: 2.1 time: 0.216808 Nov 20 21:05:19.714088 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2603/5301] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:19 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:19.745680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:19.754834 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99c1901e-029a-4a6d-970a-31e92488f403 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.450001 Nov 20 21:05:19.771576 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2699/5302] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:19 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:19.945941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-370961af-3138-4ab5-b0eb-9d50327d0d2c req-8a7eb304-e910-486b-8139-ef027a2ffcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ba7955-5181-4b9d-8046-1ebc20efd258", "tag": "985be6fd-eb24-486a-842e-0c2a592276ef"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:19.947754 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:19.947754 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:19.968792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-370961af-3138-4ab5-b0eb-9d50327d0d2c req-8a7eb304-e910-486b-8139-ef027a2ffcd0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:19.969246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-370961af-3138-4ab5-b0eb-9d50327d0d2c req-8a7eb304-e910-486b-8139-ef027a2ffcd0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.001496 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-370961af-3138-4ab5-b0eb-9d50327d0d2c req-8a7eb304-e910-486b-8139-ef027a2ffcd0 service nova] Creating event network-changed:985be6fd-eb24-486a-842e-0c2a592276ef for instance 45ba7955-5181-4b9d-8046-1ebc20efd258 on nch1-master-1 Nov 20 21:05:20.029890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-370961af-3138-4ab5-b0eb-9d50327d0d2c req-8a7eb304-e910-486b-8139-ef027a2ffcd0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089304 Nov 20 21:05:20.033734 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2604/5303] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:05:20.379677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:20.380664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:20.402367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.405857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.406876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.407335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.498427 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e64b3153-e51e-4c6e-8dc4-244073a080bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.122039 Nov 20 21:05:20.500672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2700/5304] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:20 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:20.503290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:20.504760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:20.528736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.531370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.532401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.533991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.602862 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-878893d3-6a68-4ca2-84dd-c8f4ae0dc7aa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.105074 Nov 20 21:05:20.603883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2605/5305] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:20 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:20.733969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:20.734704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:20.784189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:20.785125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:20.797203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.799736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.800923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.802373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.803375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.804682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:20.809259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:20.811104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:21.044535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:21.070959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e5c28cb-37ef-47c9-ad00-0f14ab6abec9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1272 microversion: 2.1 time: 0.341663 Nov 20 21:05:21.073295 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2701/5306] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:20 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1272 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:21.231623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:21.243562 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d75ea6f7-7923-49bf-bf17-8d0c0ed65033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.469201 Nov 20 21:05:21.245422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2606/5307] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:20 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:21.513735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:21.514826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:21.527417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:21.528813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:21.529867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:21.530696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:21.615136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:21.617463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:21.619781 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b81ca6de-a315-49b1-86f8-75404fddaeae tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.110611 Nov 20 21:05:21.621079 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2702/5308] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:21 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:21.634186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:21.635383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:21.636896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:21.637505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:21.697775 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a5bfcbe-edf0-4646-84c4-2ba112e2315e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.082565 Nov 20 21:05:21.699180 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2607/5309] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:21 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:22.093654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:22.094732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:22.103120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.103580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.104539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.104983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.254957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:22.269249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:22.270113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:22.279694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c21c36c3-1aa5-45a7-b4ee-b443c6c785d9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.190819 Nov 20 21:05:22.282597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.293451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2703/5310] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:22 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:22.294368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.295503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.296710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.633319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:22.635362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:22.643839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.644558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.645514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.646119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.699481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54b1ec3d-26d1-4048-a396-715c4dc608de tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.070422 Nov 20 21:05:22.704165 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2704/5311] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:22.710742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:22.712005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:22.719613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.720368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.721316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:22.721756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:22.774171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-349e371e-768c-47d7-9225-2f581c6f562e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.067366 Nov 20 21:05:22.778780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2705/5312] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:22 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:22.887855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:22.903118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71cf2b8c-6e3c-4e7d-a852-541a25bda8aa tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.642393 Nov 20 21:05:22.904108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2608/5313] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:22 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:23.301623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:23.302884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:23.311917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.313283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.314421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.315046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.459485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cfaefd8f-ffd4-4f18-9768-18bb69c981d6 req-82456ce3-0db1-4cef-b871-6c01a5213663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f2a7d6-51f3-4089-b760-0874e2e19f5f", "tag": "e27aebd4-294a-4f67-9404-737e55478135"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:23.461847 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:23.461847 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:23.473504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cfaefd8f-ffd4-4f18-9768-18bb69c981d6 req-82456ce3-0db1-4cef-b871-6c01a5213663 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.474928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cfaefd8f-ffd4-4f18-9768-18bb69c981d6 req-82456ce3-0db1-4cef-b871-6c01a5213663 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.489089 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cfaefd8f-ffd4-4f18-9768-18bb69c981d6 req-82456ce3-0db1-4cef-b871-6c01a5213663 service nova] Creating event network-changed:e27aebd4-294a-4f67-9404-737e55478135 for instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f on nch1-master-1 Nov 20 21:05:23.499903 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cfaefd8f-ffd4-4f18-9768-18bb69c981d6 req-82456ce3-0db1-4cef-b871-6c01a5213663 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045310 Nov 20 21:05:23.503685 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2609/5314] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:05:23.689032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:23.700466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e965b134-575a-4c01-9589-df4fa2ad9760 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.403068 Nov 20 21:05:23.701054 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2706/5315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:23 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:23.720146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:23.721384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:23.734841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.735596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.736769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.738471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.787062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:23.788316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:23.808042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.816424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.820428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.821173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.839143 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ab76dc4-7c94-4104-a882-f7accd1665a7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.124981 Nov 20 21:05:23.846234 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2610/5316] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:23 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:23.907452 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f9a5b90-2436-4ff8-b62f-b28011819462 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.125198 Nov 20 21:05:23.908668 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2707/5317] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:23 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:23.925001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:23.929280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:23.942226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.945288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:23.946645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:23.948035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.194371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:24.205782 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c8f73c0-bd03-4d43-810d-39817931ae11 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.288692 Nov 20 21:05:24.206674 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2611/5318] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:23 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:24.720460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:24.721214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:24.735268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.735715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.736511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.740643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.873468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:24.877252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:24.889969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.890756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.891766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.892847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.970092 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c7d418e-3a9f-4f79-939d-37f6aee987c1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.111400 Nov 20 21:05:24.978448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2612/5319] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:24 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:24.983609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:24.984617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:24.993858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.994345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:24.995349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:24.995946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:25.042124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa812bff-a668-4c15-8945-79ce627f8a13 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.065012 Nov 20 21:05:25.048355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2613/5320] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:24 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:25.139537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:25.147645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a674c5d-2d9c-47c9-a65d-08d4271a4030 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.431769 Nov 20 21:05:25.153040 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2708/5321] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:24 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:25.224989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:25.225741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:25.246382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:25.246835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:25.247642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:25.248079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:25.504836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:25.514797 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-693b9d34-b768-4814-88bb-825da0c6fe30 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.294665 Nov 20 21:05:25.525129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2614/5322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:25 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:25.987504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:25.988977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:25.999568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.000030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.000895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.001684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.055008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:26.056595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:26.068474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.069787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.074813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.075696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.076555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2c6a8f4-fdac-47fe-b59b-3660e9ee6697 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.094599 Nov 20 21:05:26.082036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2709/5323] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:25 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:26.134254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29f07b84-5033-4300-9376-7bc0d8a7e602 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.083093 Nov 20 21:05:26.135749 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2615/5324] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:26 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:26.172263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:26.173365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:26.192691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.195062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.197725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.199287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.538402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:26.538905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:26.552353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.555874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.557188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:26.561443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:26.812285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:26.823076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eac405bd-2d33-416c-88f0-78a95939ce07 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.293692 Nov 20 21:05:26.824244 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2616/5325] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:26 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:27.021994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:27.031625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61c8d45e-704a-4f82-9cbe-844547a5cb6c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.865926 Nov 20 21:05:27.034862 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2710/5326] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:26 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:27.094177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:27.095897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:27.110440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.112276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.113319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.116364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.150884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:27.152391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:27.164644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.165904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.167224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.170117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.207369 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37260ade-5eb5-4850-bda1-28c72bbc6837 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.117826 Nov 20 21:05:27.208557 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2617/5327] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:27 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:27.259179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4ebcc19-ed1f-4984-b1fd-58f5d72daa5c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.116177 Nov 20 21:05:27.267436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2711/5328] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:27 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:27.689435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0764277a-043c-42bc-98ea-081843a6453d req-bf98eda4-ff1b-4c90-9f4d-7ad47bb64e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ba7955-5181-4b9d-8046-1ebc20efd258", "name": "network-vif-plugged", "status": "completed", "tag": "985be6fd-eb24-486a-842e-0c2a592276ef"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:27.691363 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:27.691363 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:27.711546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0764277a-043c-42bc-98ea-081843a6453d req-bf98eda4-ff1b-4c90-9f4d-7ad47bb64e57 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.711928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0764277a-043c-42bc-98ea-081843a6453d req-bf98eda4-ff1b-4c90-9f4d-7ad47bb64e57 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.742249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0764277a-043c-42bc-98ea-081843a6453d req-bf98eda4-ff1b-4c90-9f4d-7ad47bb64e57 service nova] Creating event network-vif-plugged:985be6fd-eb24-486a-842e-0c2a592276ef for instance 45ba7955-5181-4b9d-8046-1ebc20efd258 on nch1-master-1 Nov 20 21:05:27.755153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0764277a-043c-42bc-98ea-081843a6453d req-bf98eda4-ff1b-4c90-9f4d-7ad47bb64e57 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069425 Nov 20 21:05:27.760166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2618/5329] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:05:27.841519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:27.843080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:27.857016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.861257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:27.862686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:27.865481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.054256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:28.054882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:28.070608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.082137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.086388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.086856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.177051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:28.184662 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a43b8a0b-10e9-47d1-a54d-7b1c8b218272 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.347591 Nov 20 21:05:28.186507 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2712/5330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:27 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:28.221366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:28.222359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:28.237526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.238119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.238948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.239398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.341511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ed45a5b-63bf-4c26-aa9f-15762037166a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.124041 Nov 20 21:05:28.346613 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2713/5331] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:28.364919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:28.366840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:28.388276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.391106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.394943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:28.395418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:28.504628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:28.516297 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28bc9da8-e8f6-4d03-a3d6-2f50e314887a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.467805 Nov 20 21:05:28.529229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2619/5332] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:28 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:28.627908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd5dbe95-5375-4382-86b9-edbf16c5c157 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.278867 Nov 20 21:05:28.628581 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2714/5333] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:28 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:29.201536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:29.202412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:29.211786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.212797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.213833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.214609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.360059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:29.363671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:29.377612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.378100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.378905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.379738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.438085 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7cf17a3c-c8b7-4ac6-bde1-98c3af832ff0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.083210 Nov 20 21:05:29.442589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2715/5334] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:29.536921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:29.540670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:29.560575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.561174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.569595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:29.573282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.573899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.582231 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c89eb01e-21ad-49fd-8f98-939e2bc92672 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1472 microversion: 2.1 time: 0.384237 Nov 20 21:05:29.583879 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2620/5335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:29 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1472 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:29.640264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:29.641216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:29.648722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.653366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.654410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.654871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.730493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-810d6853-e548-4ad6-92af-3f9cdfa98652 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.093122 Nov 20 21:05:29.731920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2621/5336] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:29 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:29.778260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9946e258-78a4-4769-a1ce-e00f3df768e4 req-d2dbf52a-5e47-4205-ad98-50739aa7196b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2a7d6-51f3-4089-b760-0874e2e19f5f", "name": "network-vif-plugged", "status": "completed", "tag": "e27aebd4-294a-4f67-9404-737e55478135"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:29.779800 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:29.779800 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:29.788385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9946e258-78a4-4769-a1ce-e00f3df768e4 req-d2dbf52a-5e47-4205-ad98-50739aa7196b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:29.788946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9946e258-78a4-4769-a1ce-e00f3df768e4 req-d2dbf52a-5e47-4205-ad98-50739aa7196b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:29.802645 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9946e258-78a4-4769-a1ce-e00f3df768e4 req-d2dbf52a-5e47-4205-ad98-50739aa7196b service nova] Creating event network-vif-plugged:e27aebd4-294a-4f67-9404-737e55478135 for instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f on nch1-master-1 Nov 20 21:05:29.809551 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9946e258-78a4-4769-a1ce-e00f3df768e4 req-d2dbf52a-5e47-4205-ad98-50739aa7196b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035220 Nov 20 21:05:29.811092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2622/5337] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:05:29.816044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:29.826379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42c5361f-3c5d-4939-82de-00dfbc31ffcb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.293650 Nov 20 21:05:29.827795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2716/5338] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:29 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:30.451443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:30.452963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:30.460237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.461005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.462135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.462812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.510840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f19d653-8f3a-4f86-b987-88d2369196ec tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.064080 Nov 20 21:05:30.511606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2623/5339] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:30.600104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:30.601639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:30.609642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.610450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.611734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.613043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.744509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:30.746429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:30.754180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.754719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.755759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.756433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.801538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a0e458c-022e-4c64-ac9f-4379d9c98f3e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.061880 Nov 20 21:05:30.806568 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2624/5340] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:30 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:30.845685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:30.846415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:30.855120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.855782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.856732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:30.857174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:30.980935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:30.991786 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48536a29-8a8a-4a2a-a7a9-46c8b72380b2 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1644 microversion: 2.1 time: 0.393737 Nov 20 21:05:31.003955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2717/5341] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:30 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1644 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:31.010801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:31.011616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:31.018958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:31.019416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.020023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.020969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.021786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.027743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b82dea4-fa39-4dfd-b686-b1dc06bb2e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1314 microversion: 2.1 time: 0.186808 Nov 20 21:05:31.028872 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2625/5342] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:30 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:31.275139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:31.282515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d33b6108-952f-4802-b86f-c15dfcfe695a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1644 microversion: 2.1 time: 0.277092 Nov 20 21:05:31.283400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2718/5343] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:31 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1644 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:31.302127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:31.303556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:31.315349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.316213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.316991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.318245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.527880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:31.529510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:31.536328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.540005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.540830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.541265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.611406 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a1023ed-d023-4517-a132-7a7ea312bd99 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.089857 Nov 20 21:05:31.613403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2719/5344] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:31.818549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:31.821603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:31.838852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f3150c1-83e9-4252-8001-483125958ca2 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1795 microversion: 2.1 time: 0.541949 Nov 20 21:05:31.855485 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2626/5345] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:31 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1795 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:31.856170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.856170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.856170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:31.856170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:31.948950 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00069129-0c8e-48c0-922c-e78600d9ef1e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.137616 Nov 20 21:05:31.950207 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2720/5346] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:31 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:32.046615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:32.048407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:32.058510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.058973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.059789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.060314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.353771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:32.361242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef8fa405-66df-48d2-8b25-febca8a58233 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1500 microversion: 2.1 time: 0.320252 Nov 20 21:05:32.374352 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2627/5347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:32 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1500 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:32.382954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:32.383967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:32.391374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.391876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.392749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.393188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.471275 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6945d8fb-803d-4116-ba29-56e8eba8547e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f/action" status: 202 len: 0 microversion: 2.1 time: 0.093308 Nov 20 21:05:32.475415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2721/5348] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:05:32 2021] POST /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:32.481085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:32.481889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:32.490360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.492783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.493858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.494347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.625698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:32.626749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:32.639859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.640582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.641575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.642197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.688979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:32.691559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34e30b48-3849-4ec9-90e0-1c0a951bd3e5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.069493 Nov 20 21:05:32.692597 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2722/5349] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:32 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:32.697148 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a5ed007-67ec-442b-973b-9eea8b68eee2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1505 microversion: 2.1 time: 0.219775 Nov 20 21:05:32.702282 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2628/5350] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:32 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:32.968628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:32.969643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:32.976617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.977320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:32.978317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:32.978892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:33.023470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-429af43d-7588-4455-aff4-26db6cba8b1a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.063698 Nov 20 21:05:33.025327 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2723/5351] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:32 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:33.704315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:33.705289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:33.719853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:33.720059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:33.720533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:33.721110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:33.721227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:33.721550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:33.736306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:33.737275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:33.740054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:33.742444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:33.785400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a39dae52-c329-46cf-bcc2-8e3850ba4b60 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.085096 Nov 20 21:05:33.786673 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2629/5352] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:34.036713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:34.039387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:34.049468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.050223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.051354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.052033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.108692 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44c946b2-ccbb-4410-9d4b-9cfaee193a99 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.076304 Nov 20 21:05:34.113279 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2630/5353] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:34 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:34.443279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:34.454196 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d57dc9ce-af9f-4dd6-b4cb-565d8b0a6b71 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1485 microversion: 2.1 time: 0.739323 Nov 20 21:05:34.455217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2724/5354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:33 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1485 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:34.478804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:34.480703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:34.492661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.493232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.494219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.494776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.549769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lazy-loading 'flavor' on Instance uuid f6f2a7d6-51f3-4089-b760-0874e2e19f5f {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:05:34.762440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fbaf1e9c-a759-4a80-8631-626babc2b532 req-15dcb006-c776-494c-b56a-7f7166f0214c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ba7955-5181-4b9d-8046-1ebc20efd258", "tag": "985be6fd-eb24-486a-842e-0c2a592276ef"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:34.763996 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:34.763996 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:05:34.784767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fbaf1e9c-a759-4a80-8631-626babc2b532 req-15dcb006-c776-494c-b56a-7f7166f0214c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.784767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fbaf1e9c-a759-4a80-8631-626babc2b532 req-15dcb006-c776-494c-b56a-7f7166f0214c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.811618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fbaf1e9c-a759-4a80-8631-626babc2b532 req-15dcb006-c776-494c-b56a-7f7166f0214c service nova] Creating event network-changed:985be6fd-eb24-486a-842e-0c2a592276ef for instance 45ba7955-5181-4b9d-8046-1ebc20efd258 on nch1-master-1 Nov 20 21:05:34.817550 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fbaf1e9c-a759-4a80-8631-626babc2b532 req-15dcb006-c776-494c-b56a-7f7166f0214c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059832 Nov 20 21:05:34.821615 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2725/5355] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:05:34.830972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:34.832182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:34.840871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.841558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.842959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:34.843552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:34.913647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c55c1a72-fa55-4671-aa07-5831fb1944fd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.085864 Nov 20 21:05:34.916522 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2726/5356] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:35.084520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4163372a-adee-46b7-a110-26287141404d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f/action" status: 202 len: 0 microversion: 2.1 time: 0.613859 Nov 20 21:05:35.088343 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2631/5357] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:05:34 2021] POST /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:35.094564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:35.095269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:35.110509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.110997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:35.111898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.113347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:35.123631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:35.125090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:35.150419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.151252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:35.154112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.160238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:35.284643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bdc4658-f196-428e-ba4f-9591e9e50092 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.166211 Nov 20 21:05:35.285780 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2632/5358] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:35 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:35.597349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:35.622325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f792cdde-2455-4741-9426-a7dd530cd10a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1491 microversion: 2.1 time: 0.531220 Nov 20 21:05:35.635667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2727/5359] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:35 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1491 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:35.928911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:35.930016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:35.937802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.946781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:35.947864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:35.948309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:36.042431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff17606f-637c-4019-9846-e097204a9643 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.117978 Nov 20 21:05:36.043116 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2633/5360] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:35 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:36.297017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:36.298617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:36.311406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:36.313046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:36.317452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:36.318449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:36.420590 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fffd85eb-f7c2-4428-88f1-28c544db5e98 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.125547 Nov 20 21:05:36.422733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2728/5361] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:36 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:36.642642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:36.644087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:36.653464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:36.653972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:36.660803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:36.661277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:36.921196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:36.933888 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91784263-a1fa-4d00-bef5-8e06ae9f9b59 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1512 microversion: 2.1 time: 0.295564 Nov 20 21:05:36.935261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2634/5362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:36 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:37.055636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:37.057300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:37.076061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.076526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:37.077344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.077968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:37.158420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-231b6aa8-e170-44c5-8d52-e4e3ab48f933 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.108021 Nov 20 21:05:37.161802 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2729/5363] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:37 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:37.434647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:37.436085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:37.448029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.450335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:37.453978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.455447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:37.519204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c957de45-b786-42a2-948f-ec9065561200 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.088709 Nov 20 21:05:37.520615 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2635/5364] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:37 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:37.953800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:37.955068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:37.970022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.970701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:37.971524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:37.971951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:38.174955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:38.176210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:38.202552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:38.205805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:38.210652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:38.212956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:38.291855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-09ca66eb-453f-431c-afe4-d003bdaaab85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.122091 Nov 20 21:05:38.297787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2636/5365] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:38 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:38.322670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:38.332771 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e428979-012b-4063-8881-73bfef60015c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.382947 Nov 20 21:05:38.333355 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2730/5366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:37 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:38.536161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:38.537481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:38.550443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:38.551118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:38.552802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:38.555515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:38.612223 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-23146279-9bc0-4285-a69c-e51982ce76b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.084344 Nov 20 21:05:38.614551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2637/5367] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:38 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:39.309314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:39.310323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:39.336009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.339773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.342032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.353783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:39.354506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:39.367670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.386398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.388865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.393273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.394875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.446847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1997eefd-5ba7-45b3-be67-11043259a8df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.141576 Nov 20 21:05:39.458735 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2731/5368] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:39 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:39.625635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:39.629843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:39.660869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.661328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.664851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:39.665309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:39.770753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:39.779403 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07925fc4-0770-401f-be88-abfe15a35974 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.430538 Nov 20 21:05:39.781754 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2638/5369] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:39 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:39.809822 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-462952b1-c6f9-466f-8fdf-523974ada768 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.188509 Nov 20 21:05:39.814603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2732/5370] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:39 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:40.464918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:40.466537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:40.473316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.474069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.476013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.476719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.545914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5591445f-77a1-4a3e-add7-4b6e5aa4003d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.084622 Nov 20 21:05:40.548084 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2639/5371] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:40.800016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:40.801326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:40.813999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.814560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.815779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.816410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.824044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:40.825361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:40.840267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.844900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.845775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:40.846285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:40.943435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d486208f-4f4f-4955-a993-c4ec3966e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.124331 Nov 20 21:05:40.945582 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2640/5372] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:40 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:41.016037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:41.029201 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-930ab3c7-24cc-4817-af51-7c1942ce14aa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.233293 Nov 20 21:05:41.040109 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2733/5373] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:40 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:41.375078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-55aa1fda-7d5e-40cf-9f02-b5e8431fc540 req-d9cad0f3-61a5-4ef7-9be2-b575b231f28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2a7d6-51f3-4089-b760-0874e2e19f5f", "name": "network-vif-plugged", "status": "completed", "tag": "e27aebd4-294a-4f67-9404-737e55478135"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:41.376774 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:41.376774 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:41.391160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-55aa1fda-7d5e-40cf-9f02-b5e8431fc540 req-d9cad0f3-61a5-4ef7-9be2-b575b231f28f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:41.392577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-55aa1fda-7d5e-40cf-9f02-b5e8431fc540 req-d9cad0f3-61a5-4ef7-9be2-b575b231f28f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:41.424817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-55aa1fda-7d5e-40cf-9f02-b5e8431fc540 req-d9cad0f3-61a5-4ef7-9be2-b575b231f28f service nova] Creating event network-vif-plugged:e27aebd4-294a-4f67-9404-737e55478135 for instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f on nch1-master-1 Nov 20 21:05:41.440852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-55aa1fda-7d5e-40cf-9f02-b5e8431fc540 req-d9cad0f3-61a5-4ef7-9be2-b575b231f28f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070199 Nov 20 21:05:41.441756 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2641/5374] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:05:41.561173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:41.562282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:41.577293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:41.579532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:41.581057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:41.581917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:41.669775 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c32aa93b-f7f9-4939-9377-db5fcc2dad15 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.112520 Nov 20 21:05:41.676880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2734/5375] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:41.957377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:41.958811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:41.967660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:41.968304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:41.971293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:41.972159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:42.028552 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2f8d432-a0b2-4e27-a21e-e0c7d580dfe0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.075897 Nov 20 21:05:42.038446 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2642/5376] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:41 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:42.047592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:42.049138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:42.059761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:42.060562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:42.061624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:42.062418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:42.348190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:42.358860 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffedbbcd-05a1-4cbc-a4a7-f39062e3f6e9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.315297 Nov 20 21:05:42.370096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2735/5377] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:42 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:42.685528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:42.688118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:42.712050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:42.714786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:42.715716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:42.716389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:42.793568 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49743e4b-d74c-45ab-bcc1-5125aa79e026 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.112174 Nov 20 21:05:42.797901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2643/5378] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:43.043636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:43.044564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:43.056648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.057286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.059120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.060099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.124558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a68cc41-a22a-4716-8f45-53a5147a1a04 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.084791 Nov 20 21:05:43.125238 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2736/5379] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:43 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:43.386404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:43.393241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:43.420077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.420819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.422019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.422695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.624134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:43.636628 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-370d299d-5dcc-47a7-9b62-c5df02155a25 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.261599 Nov 20 21:05:43.647781 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2644/5380] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:43 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:43.805812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:43.806963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:43.816876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.817326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.818316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:43.818985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:43.868148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-886b7fec-6098-4d3a-8e79-52499e97dc3d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066849 Nov 20 21:05:43.869039 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2737/5381] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:43 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:44.137966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:44.139700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:44.156026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.156485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.159412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.163332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.243438 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0de2c9e4-4e0e-40cd-9412-ccd18c46af52 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.107194 Nov 20 21:05:44.245980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2645/5382] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:44 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:44.655586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:44.657126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:44.674591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.675527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.676585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.677251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.882724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:44.883740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:44.891753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.892449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.893369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:44.893968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:44.949145 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a467ce8-4643-4545-bbcc-10ff14a54314 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.071659 Nov 20 21:05:44.952941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2646/5383] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:44 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:44.967884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:44.976344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e128f07-724b-4fc7-8dbc-d46547f39b47 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.325566 Nov 20 21:05:44.986810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2738/5384] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:44 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:45.258916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:45.261193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:45.275368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:45.275772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:45.276759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:45.277354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:45.344249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3268f7f-cf40-41f2-9ef5-f1b21b19f088 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.090210 Nov 20 21:05:45.345955 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2647/5385] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:45 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:45.964999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:45.966763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:45.974723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:45.984079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:45.985160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:45.985761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:45.995567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:45.996955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:46.028928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:46.029453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:46.031228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:46.031688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:46.082295 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20d72ee3-f0c3-44de-93b9-09a48a6ddbde tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.120075 Nov 20 21:05:46.083791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2739/5386] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:46.234962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:46.242623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d1dfaff-2ed5-499c-81a4-e7d12559adf9 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.251351 Nov 20 21:05:46.243459 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2648/5387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:45 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:46.358932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:46.360515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:46.371315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:46.372671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:46.373768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:46.375109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:46.505704 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a25a632-9d2d-40db-9558-5ed150b3eee7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.152352 Nov 20 21:05:46.508051 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2740/5388] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:46 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:47.095067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:47.096203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:47.107261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.107716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.118939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.119448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.205232 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d20a0de0-d20e-4173-bed2-a6bf3d08213b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.113591 Nov 20 21:05:47.210846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2649/5389] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:47 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:47.262646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:47.263463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:47.281075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.282904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.283763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.284206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.523050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:47.524600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:47.552708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.558902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.560924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:47.561389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:47.600391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:47.609979 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-64702ed7-8209-4cef-b443-211c28f974b7 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.352897 Nov 20 21:05:47.614263 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2741/5390] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:47 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:47.667783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abd5da43-bdbb-4879-be89-568031da3956 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.151816 Nov 20 21:05:47.669046 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2650/5391] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:47 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:48.219737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:48.220977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:48.236850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.238527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.239792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.240471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.311981 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e78ab426-c08b-409d-8bd2-fb3a9f293402 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093451 Nov 20 21:05:48.313938 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2742/5392] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:48 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:48.631562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:48.632798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:48.645275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.654851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.655890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.656444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.683488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:48.686659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:48.703350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.709877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.716117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:48.717152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:48.789465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f82970fe-95c2-4af5-8124-ce96eb8ac49a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.110030 Nov 20 21:05:48.796338 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2743/5393] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:48 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:48.963769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:48.977886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe4c7d5d-e522-4cdb-820d-c084c7224e8c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.350730 Nov 20 21:05:48.980653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2651/5394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:48 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:49.325741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:49.326791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:49.345499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:49.345955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:49.346802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:49.347247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:49.442036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ae9fa78-869f-42c2-8dee-c2c49b3fc3d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.120530 Nov 20 21:05:49.442785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2744/5395] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:49 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:49.804367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:49.805321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:49.825102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:49.825833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:49.828651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:49.829103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:49.899223 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c83c4693-1467-4a30-a57e-62fa01a75b40 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.100271 Nov 20 21:05:49.902642 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2652/5396] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:49 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:50.010411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:50.012140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:50.029134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.032393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.033790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.039260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.455012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:50.456479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:50.490889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.491682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.496456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.497311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.583265 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a098f90e-fcab-4d5e-8e26-db72a622c284 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.131850 Nov 20 21:05:50.590154 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2653/5397] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:50.857269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:50.874171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-612cf9e2-158b-4639-ac16-c8e750e73c94 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.868971 Nov 20 21:05:50.888417 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2745/5398] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:50 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:50.912447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:50.914671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:50.923259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.923930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.924900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:50.925477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:50.981913 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e967704-11d4-450a-ac39-37ba8a92b381 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.073939 Nov 20 21:05:50.983120 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2654/5399] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:50 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:51.596476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:51.597737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:51.606963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:51.607663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:51.608635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:51.609231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:51.660541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2688b7f-d0e6-4a1d-b67c-5e10cad83ea1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.067512 Nov 20 21:05:51.665323 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2746/5400] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:51.893480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:51.894218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:51.904627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:51.905394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:51.906565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:51.907159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:51.994850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:51.996606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:52.009504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:52.011055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:52.016382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:52.016382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:52.062994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-381cf366-9b2e-4fde-9b1a-375c7ca01fc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.073128 Nov 20 21:05:52.066955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2747/5401] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:51 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:52.152569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:52.166273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-088719cb-5aa2-46c3-b323-2dd5c15b84d2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1507 microversion: 2.1 time: 0.276998 Nov 20 21:05:52.180139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2655/5402] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:51 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:52.681221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:52.682714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:52.695058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:52.695855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:52.697716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:52.698408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:52.784858 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-192910e3-cb4c-4e3e-8850-50cce2f384ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.108261 Nov 20 21:05:52.786462 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2748/5403] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:53.074531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:53.075775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:53.085700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.086426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.087629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.088290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.150408 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-31f00d72-9f76-41ed-b477-9662048adc02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.079742 Nov 20 21:05:53.151981 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2656/5404] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:53 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:53.189522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:53.191019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:53.199856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.200307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.201102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.201536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.620938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:53.628551 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f07d3c2b-015e-4b5a-ab84-198eb81c201c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1504 microversion: 2.1 time: 0.443362 Nov 20 21:05:53.629138 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2749/5405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:53 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:53.797254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:53.798552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:53.805414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.805876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.810714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:53.811176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:53.856315 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54318d53-04c5-47c5-9af4-164c85328832 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062842 Nov 20 21:05:53.860545 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2657/5406] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:53 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:54.163597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:54.164758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:54.172894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.173581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.174776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.175365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.221449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb8bc3b0-ad50-4c8c-a1da-ab63fee9f703 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.061895 Nov 20 21:05:54.222803 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2750/5407] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:54 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:54.647338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:54.648067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:54.656338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.657088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.658506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.658999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.869401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:54.870440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:54.880217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.880708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.882080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:54.882522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:54.930890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2070007b-1ff5-4c34-b1ba-c3b43cc88e9b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066018 Nov 20 21:05:54.931584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2751/5408] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:55.035360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:55.044322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a37392fa-11f5-4376-a031-902939e6d884 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1504 microversion: 2.1 time: 0.401415 Nov 20 21:05:55.045044 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2658/5409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:54 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:55.234535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:55.235553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:55.245267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:55.245730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:55.246722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:55.247171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:55.293609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dc95b3f-6910-449a-9ad0-879404d73c50 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.063102 Nov 20 21:05:55.294313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2752/5410] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:55 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:55.945666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:55.946630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:55.978340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:55.979145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:55.980111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:55.983107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.064846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:56.066018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:56.073658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98141386-de55-4373-9444-10ffc9331a1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.134341 Nov 20 21:05:56.079422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2659/5411] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:55 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:56.080160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.080618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.083046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.083662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.270921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:56.279966 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ba7fb29-4c1c-4c49-bf27-836afd32046c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 200 len: 1447 microversion: 2.1 time: 0.220973 Nov 20 21:05:56.283171 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2753/5412] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:56 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 1447 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:05:56.300348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:56.301058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:56.311908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.312367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.313176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.313620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.316163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:56.317077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:56.329346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.333712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.334866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.335457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.409854 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1900afd7-a54d-4710-a603-0a87f8d8b43e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.103726 Nov 20 21:05:56.411298 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2754/5413] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:56 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:56.588081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:56.604361 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d91dbde-f6e5-4e06-877b-5d5f27364fc2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.308192 Nov 20 21:05:56.605064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2660/5414] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:56 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:56.631975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:56.632805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:56.645794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.647257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.648549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.649002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.837218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:56.851244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff79fd94-2f8f-4d46-a451-42445d130787 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.225915 Nov 20 21:05:56.852419 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2755/5415] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:56 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:56.869162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-462731e7-ed9a-4c8d-b967-3ca054ac1e11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:56.877271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462731e7-ed9a-4c8d-b967-3ca054ac1e11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.877903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-462731e7-ed9a-4c8d-b967-3ca054ac1e11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.903781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-462731e7-ed9a-4c8d-b967-3ca054ac1e11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Going to try to stop instance {{(pid=140942) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:05:56.954784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-462731e7-ed9a-4c8d-b967-3ca054ac1e11 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.090950 Nov 20 21:05:56.955570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2661/5416] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:05:56 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:56.967345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:56.968233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:56.978842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.979684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:56.980582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:56.981057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.086024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:57.088826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:57.096175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:57.096635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.097445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:57.097885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.142882 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21f8ac6d-d16c-4eef-8b25-4c6316f0cdf0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.061729 Nov 20 21:05:57.148323 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2662/5417] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:57 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:57.160630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:57.170486 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ddbdd30-8b29-408e-ac0e-f8e6cc47cf2c tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.208674 Nov 20 21:05:57.171309 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2756/5418] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:56 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:57.326482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9cb378be-59a8-4775-b21e-9fbbd8b12e45 req-e5719d82-9aa1-4bcc-a120-28b77f469911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2a7d6-51f3-4089-b760-0874e2e19f5f", "name": "network-vif-unplugged", "status": "completed", "tag": "e27aebd4-294a-4f67-9404-737e55478135"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:57.328012 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:05:57.328012 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:05:57.343028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9cb378be-59a8-4775-b21e-9fbbd8b12e45 req-e5719d82-9aa1-4bcc-a120-28b77f469911 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:57.343480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9cb378be-59a8-4775-b21e-9fbbd8b12e45 req-e5719d82-9aa1-4bcc-a120-28b77f469911 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.373399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_external_events [req-9cb378be-59a8-4775-b21e-9fbbd8b12e45 req-e5719d82-9aa1-4bcc-a120-28b77f469911 service nova] Unable to find a host for instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f. Dropping event network-vif-unplugged {{(pid=140942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:05:57.374346 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9cb378be-59a8-4775-b21e-9fbbd8b12e45 req-e5719d82-9aa1-4bcc-a120-28b77f469911 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.052350 Nov 20 21:05:57.375311 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2663/5419] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:05:57 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 20 21:05:57.423730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:57.424789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:57.435147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:57.435860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.436754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:57.437268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:57.489060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a050c9e8-2f63-4078-84d7-ddfa19fee525 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 32638 microversion: 2.20 time: 0.068901 Nov 20 21:05:57.491948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2757/5420] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:57 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 32638 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:58.155128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:58.156788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:58.171334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.172048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.176491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.179675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.189862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:58.191130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:58.211172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.211784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.215855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.218496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.270097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb0c5563-ee02-4fd6-a84b-0476be3ad8cc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.119125 Nov 20 21:05:58.270900 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2664/5421] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:58 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:58.505102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:58.507217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:58.520309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:58.528544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.529835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.530878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.531474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.532798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfefbbf6-a398-4b9d-972f-12c2c2f7e462 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.347744 Nov 20 21:05:58.533407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2758/5422] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:58 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:05:58.673490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a710e610-20e4-4acf-a29b-51c4070d8466 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 200 len: 40791 microversion: 2.20 time: 0.171453 Nov 20 21:05:58.674597 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2665/5423] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:58 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 40791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:05:58.686530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:58.687399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:58.708142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.719529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.728346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:58.728844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:58.761683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83ab482d-089d-4f00-b1ca-4b06ba4af25c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/ips" status: 200 len: 152 microversion: 2.20 time: 0.079728 Nov 20 21:05:58.763630 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2759/5424] 10.222.0.41 () {60 vars in 1288 bytes} [Sat Nov 20 21:05:58 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/ips => generated 152 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:05:59.284504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:05:59.286490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:59.309293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:59.314151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:59.315100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:59.316177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:59.385945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a33ae9e7-3f14-4de1-b754-d9790d86e2c3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.106668 Nov 20 21:05:59.387121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2666/5425] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:05:59 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:05:59.550924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:05:59.551529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:05:59.562703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:59.563158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:59.563971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:05:59.564414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:05:59.813813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:05:59.824022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6da8c97-c90a-4e81-b40f-132a673605c2 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.277353 Nov 20 21:05:59.830113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2760/5426] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:05:59 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:00.409671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:00.436150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:00.459896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:00.466484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:00.467443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:00.467970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:00.556656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6eee4be9-f4e9-4a42-be1c-f51c6bbfa6b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.160722 Nov 20 21:06:00.561484 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2667/5427] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:00.851071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:00.852343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:00.865213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:00.866342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:00.867354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:00.867969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.175133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:01.186399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:01.188505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:01.197597 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e373b01-911c-46f4-84a1-40ca2cde9b18 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.356513 Nov 20 21:06:01.205307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.205974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2761/5428] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:00 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:01.206845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.208282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.209271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.266527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lazy-loading 'flavor' on Instance uuid 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:06:01.571452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:01.572532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:01.583163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.586976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.592023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.597496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.695187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79659ba5-b1e4-4a39-abb9-3d70d316c7ff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.128573 Nov 20 21:06:01.700700 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2762/5429] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:01.753658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd5d21d7-7bed-4bb8-b680-c2acc3099963 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 202 len: 0 microversion: 2.20 time: 0.571870 Nov 20 21:06:01.754654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2668/5430] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:01 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:01.779212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:01.801769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:01.825751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.826140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:01.826945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:01.827380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:02.219685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:02.220658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:02.231020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:02.236030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:02.237082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:02.238351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:02.319653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:02.334478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:02.336041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:02.338108 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e92001f-3b41-401e-b004-0b8315ad6df7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.576400 Nov 20 21:06:02.339836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2763/5431] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:01 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:02.596472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:02.607446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fb61e85-3530-40f4-9b54-9c1bac53fab4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.391852 Nov 20 21:06:02.612624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2669/5432] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:02 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:02.707588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:02.709063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:02.719961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:02.720418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:02.721227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:02.721659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:02.795883 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be88632c-c7cc-4957-b63e-837977e9c5cd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.091797 Nov 20 21:06:02.796566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2764/5433] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:03.358195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:03.358814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:03.387822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.388279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.389092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.389842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.629419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:03.631594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:03.644129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.644581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.652674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.653375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.696656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:03.705245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:03.711652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:03.712884 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-299f02b0-1e98-4e87-a46b-1f9cac3c63bf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.359612 Nov 20 21:06:03.714709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2670/5434] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:03 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:03.809359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:03.810508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:03.825898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.826587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.827504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:03.828131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:03.906571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29add0fd-71f6-49a8-9bf6-9f055c8ef821 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.100597 Nov 20 21:06:03.910773 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2671/5435] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:03 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:04.751336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:04.754218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:04.769446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:04.775532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:04.778014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:04.778764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:04.954799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:04.967094 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-72a68b72-93f3-40ee-a0d9-c099a105283b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 1.341945 Nov 20 21:06:04.971388 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2765/5436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:03 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:04.985997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:04.986965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:05.006776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:05.007446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:05.016801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:05.017453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:05.051858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:05.069044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:05.078571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:05.079844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73e7a28d-e61c-4b3f-81da-53d89c114441 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.350480 Nov 20 21:06:05.080753 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2672/5437] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:04 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:05.111374 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9a70610-b3b1-405a-8645-fbc31ddb06bc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.133034 Nov 20 21:06:05.116876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2766/5438] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:04 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:05.988318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:05.990899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:06.017840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.020560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.023646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.026396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.101139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:06.102540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:06.113604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.120529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.121583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.122211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.545288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:06.556924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c37db471-2787-4fd4-955f-6de3f0f2e001 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1678 microversion: 2.1 time: 0.572421 Nov 20 21:06:06.557565 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2673/5439] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:05 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1678 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:06.569737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:06.569737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:06.580988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.581691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.584172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:06.584783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:06.664325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b54f2ed8-b249-40e3-996a-7066249161c7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.105018 Nov 20 21:06:06.665366 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2674/5440] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:06 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:06.690432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:06.706843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:06.713420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:06.715057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8bf96121-b3ff-4f24-a885-d5b88f26c2a9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.618688 Nov 20 21:06:06.720236 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2767/5441] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:06 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:07.575163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:07.575857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:07.585258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.586288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.587497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.588137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.676626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:07.677910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:07.700131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.700916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.701769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.703455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.763455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41e370df-192b-4dbb-88cb-e61a64743b07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.090210 Nov 20 21:06:07.770547 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2768/5442] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:07.778915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:07.779856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:07.789386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.789935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.790834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.791407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:07.883316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:07.907229 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-463a4247-df8a-4725-9992-bf5fb3efa18b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1655 microversion: 2.1 time: 0.329298 Nov 20 21:06:07.909529 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2675/5443] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:07 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1655 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:07.955880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5602f3a1-11b4-46c1-9780-40a8896ca0b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:07.975725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5602f3a1-11b4-46c1-9780-40a8896ca0b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:07.976998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5602f3a1-11b4-46c1-9780-40a8896ca0b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:08.042808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5602f3a1-11b4-46c1-9780-40a8896ca0b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Going to try to start instance {{(pid=140942) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:06:08.120107 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5602f3a1-11b4-46c1-9780-40a8896ca0b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.196285 Nov 20 21:06:08.122064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2676/5444] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:06:07 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:08.137292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:08.138958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:08.153656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:08.154598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:08.155670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:08.156260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:08.345342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:08.360821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:08.362948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:08.371619 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40203255-e24c-4edc-a622-d01b3834ee24 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.597560 Nov 20 21:06:08.373365 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2769/5445] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:07 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:08.578157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:08.591402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a441ffd-30e7-4a90-b3d0-3cc74040969e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1664 microversion: 2.1 time: 0.460760 Nov 20 21:06:08.603340 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2677/5446] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:08 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1664 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:08.776949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:08.777875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:08.804394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:08.805049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:08.806136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:08.811920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:08.883576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f53ee603-9197-4bad-bc36-c9599638b014 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.109901 Nov 20 21:06:08.888526 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2770/5447] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:09.394475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:09.397289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:09.408316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.409825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.411730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.413526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.624361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:09.625394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:09.644143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.644869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.647266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.648508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.712896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:09.725305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:09.727179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:09.728854 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63cdb4e7-e217-4a1f-bebc-b7ca834dc7c2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.338800 Nov 20 21:06:09.730177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2678/5448] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:09 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:09.895731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:09.897142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:09.903809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.904498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.905525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:09.906147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:09.963316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-302114c1-c3ac-4857-b25b-1143cd93b07a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.070822 Nov 20 21:06:09.967784 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2679/5449] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:09 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:10.001812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:10.010318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2b88621-7a09-4ef2-abbb-59674cfd02ff tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1664 microversion: 2.1 time: 0.403065 Nov 20 21:06:10.011181 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2771/5450] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:09 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1664 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:10.749165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:10.750792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:10.773171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:10.773901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:10.775029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:10.775649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:10.984755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:10.986750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:10.998667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:10.999667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:11.001058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:11.001987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:11.065738 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a58d6bd2-5370-494b-863a-cb2fd5e0d5bd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.088618 Nov 20 21:06:11.067666 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2772/5451] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:10 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:11.074215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:11.075931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:11.089597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:11.090542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:11.092532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:11.093386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:11.190608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:11.223291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:11.225599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:11.228009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03fcaabc-c5da-4e30-b780-b6de09214f53 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.483251 Nov 20 21:06:11.240933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2680/5452] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:10 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:11.694044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:11.702089 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-80572bb1-f2f5-4b71-93d9-ebde799878a3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.632707 Nov 20 21:06:11.702932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2773/5453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:11 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:11.719278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:11.719816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:11.727713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:11.728172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:11.729669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:11.730159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.023884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:12.040969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c5e3bff-eb2a-4545-9e51-4fbc87f1488d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.325327 Nov 20 21:06:12.042211 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2681/5454] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:11 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:12.064041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:12.065283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:12.074223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.074915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.076075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.076709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.078856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:12.080418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:12.091887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.092635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.093674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.094338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.152811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4f46148-4921-4f76-8e55-04e1b73eba59 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.076143 Nov 20 21:06:12.155855 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2682/5455] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:12.247161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:12.250893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:12.265585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.267055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.269715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.270663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.579977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:12.590850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8298d72-0dbf-443e-beb7-f07ab0eaafb1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.529834 Nov 20 21:06:12.602819 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2774/5456] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:12 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:12.619263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:12.620122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:12.633576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.634612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.635610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.636266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.680177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lazy-loading 'flavor' on Instance uuid ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:06:12.774922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:12.819576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:12.821353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:12.822762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a0d6f56-d038-4724-b2c5-be769a7d9e10 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1744 microversion: 2.20 time: 0.580098 Nov 20 21:06:12.823830 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2683/5457] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:12 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1744 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:12.902361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e593bbb-cadb-4791-9de2-f8dc07847e8b tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.285845 Nov 20 21:06:12.909451 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2775/5458] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:06:12 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:12.918510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:12.919267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:12.939143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.941245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:12.944278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:12.948860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:13.182367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:13.187195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:13.203303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:13.207132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:13.208385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:13.209281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:13.320876 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63097f84-0fdf-4a62-9587-d4de27e6b27d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.155030 Nov 20 21:06:13.323767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2776/5459] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:13.328435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:13.340210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9d96bb0-228e-45d1-baae-e1b0a5e4f46e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1676 microversion: 2.1 time: 0.432239 Nov 20 21:06:13.340803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2684/5460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:12 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1676 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:13.847473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:13.849737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:13.858439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:13.859147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:13.860113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:13.860705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:14.335776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:14.337434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:14.360421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:14.361540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:14.366941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:14.368113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:14.471193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9b1ad62-d801-4362-8442-6dc97006f843 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.137274 Nov 20 21:06:14.472078 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2685/5461] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:14 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:14.498588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:14.501233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:14.549094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:14.562756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:14.563825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:14.564693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:14.715938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:14.727868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:14.750444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:14.751695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-baa47801-61f1-4f80-a9e3-b609e94a1711 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1744 microversion: 2.20 time: 0.913280 Nov 20 21:06:14.764771 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2777/5462] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:13 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1744 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:15.422268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:15.441870 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4bb6fdfd-fa2f-4a95-b01a-6160d14eab88 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1659 microversion: 2.1 time: 0.961204 Nov 20 21:06:15.449553 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2686/5463] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:14 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1659 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:15.466354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:15.466895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:15.488985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.489972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.491649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:15.493194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:15.498785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.499296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.520096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.526334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.542695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.543312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.712659 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d812977-ca0e-49db-91d6-b726eb29414e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.227494 Nov 20 21:06:15.714236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2687/5464] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:15 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:15.761953 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3bf7d7b-e91a-4bf6-9a3f-c146a43e00b1 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action" status: 202 len: 0 microversion: 2.1 time: 0.298764 Nov 20 21:06:15.765985 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2778/5465] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:06:15 2021] POST /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:15.778771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:15.778771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:15.790570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:15.791828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:15.807420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.808298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.809332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.811820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.825157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.825927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:15.840675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:15.841436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:16.619210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:16.629082 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cd2ab6ba-8740-4764-8e58-c0e66e751e37 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1665 microversion: 2.1 time: 0.861661 Nov 20 21:06:16.633025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2688/5466] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:15 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1665 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:16.725670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:16.727418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:16.738349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:16.739140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:16.741221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:16.748036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:16.823104 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-540b4a3c-d518-4501-919c-8396a39892df tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.101581 Nov 20 21:06:16.824472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2689/5467] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:17.066010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:17.088344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:17.090778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:17.093494 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e7dcbbc-447c-4769-a50e-47ab974c9558 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 1.312846 Nov 20 21:06:17.114086 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2779/5468] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:15 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:17.651852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:17.652726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:17.669240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:17.669859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:17.670837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:17.671393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:17.836388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:17.837686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:17.854782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:17.855517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:17.863227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:17.863919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:17.947347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9e24320-1d75-469d-a01d-cab05685cdef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.115045 Nov 20 21:06:17.948408 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2780/5469] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:17 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:18.120851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:18.122228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:18.132433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:18.137019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:18.139237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:18.140186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:18.575193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:18.587100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18003795-8f36-417e-88b3-de84554f0c14 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1665 microversion: 2.1 time: 0.939196 Nov 20 21:06:18.592749 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2690/5470] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:17 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1665 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:18.959946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:18.961694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:18.977837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:18.987334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:18.988598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:18.990333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:19.144711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb6bbe2b-01f6-4a62-8db3-495a48efa5dd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.184077 Nov 20 21:06:19.151544 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2691/5471] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:19.183904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:19.192003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:19.196705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:19.198021 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2c6e0721-ad98-4015-af42-4adfdbd278ca tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 1.087332 Nov 20 21:06:19.198636 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2781/5472] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:18 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:19.610459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:19.611212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:19.621305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:19.628423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:19.629539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:19.631095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.158509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:20.159726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:20.175236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.175921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.177446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.178043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.280890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34abe005-952b-447d-8dd1-f6c41be7e19c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.126001 Nov 20 21:06:20.290143 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2782/5473] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:20 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:20.298852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:20.307132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:20.314039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:20.324642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f562f79-6c26-4971-af37-39556f3f411f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.717376 Nov 20 21:06:20.325963 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2692/5474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:19 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:20.343800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:20.344624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:20.346511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.347077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.347946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.353809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.356048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.362292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.363260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.363717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.706659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:20.721657 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2be694c3-9c77-4bd8-b310-356a52bea741 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1668 microversion: 2.1 time: 0.382704 Nov 20 21:06:20.722655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2693/5475] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:20 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:20.741564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:20.742577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:20.751968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.752426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.753237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.753678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:20.800688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:20.809839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Working on deleting snapshot 58817bc2-51a4-4896-bd21-c31a599d1af3 from shelved instance... Nov 20 21:06:20.894649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:20.913992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:20.924767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:20.926414 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7471d32-b20a-45b0-addb-559a51ce91ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.635081 Nov 20 21:06:20.928650 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2783/5476] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:20 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:20.933600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e4c32c73-20e6-4c2e-9ee0-640d3ecf469a req-6ff92e59-fb1c-430b-8fd7-c6611bde8711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "name": "network-vif-plugged", "status": "completed", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:20.940081 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:20.940081 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:20.961639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e4c32c73-20e6-4c2e-9ee0-640d3ecf469a req-6ff92e59-fb1c-430b-8fd7-c6611bde8711 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:20.965457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e4c32c73-20e6-4c2e-9ee0-640d3ecf469a req-6ff92e59-fb1c-430b-8fd7-c6611bde8711 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:21.010687 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e4c32c73-20e6-4c2e-9ee0-640d3ecf469a req-6ff92e59-fb1c-430b-8fd7-c6611bde8711 service nova] Creating event network-vif-plugged:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:06:21.040906 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e4c32c73-20e6-4c2e-9ee0-640d3ecf469a req-6ff92e59-fb1c-430b-8fd7-c6611bde8711 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110779 Nov 20 21:06:21.044326 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2784/5477] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:06:21.303245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:21.306722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:21.352874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:21.353069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:21.355448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:21.355836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:21.492535 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69333406-8caa-469a-a39d-a57b4f73ff03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.194554 Nov 20 21:06:21.494130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2785/5478] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:21 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:21.832383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Doing local delete in cell 547b6cf2-091d-4227-ac40-56296ab1bf90(cell1) {{(pid=140942) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 20 21:06:21.834023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:21.834545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:21.834983 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 20 21:06:21.839169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] deallocate_for_instance() {{(pid=140942) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 20 21:06:21.949758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:21.950760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:21.977013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:21.979721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:21.983445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:21.984098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:22.487079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:22.499632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:22.504025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:22.509513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14834a3c-074f-4bdf-97ce-68256972c471 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.564717 Nov 20 21:06:22.511787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2786/5479] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:21 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:22.543420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:22.546212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:22.565814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:22.566750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:22.568750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:22.571693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:22.656110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d43dd4d2-eef9-4f23-812d-27dcf5b9653f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.131552 Nov 20 21:06:22.657403 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2787/5480] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:23.549449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:23.550254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:23.573300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:23.574768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:23.575629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:23.578327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:24.483436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Updating instance_info_cache with network_info: [] {{(pid=140942) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 20 21:06:24.673015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:24.686171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:24.696242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:24.697755 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bffe082-d1cb-485b-bdea-3b1803c63328 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 1.170780 Nov 20 21:06:24.701642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2788/5481] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:23 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:24.715339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:24.716989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:24.732576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:24.733323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:24.735745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:24.736357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:24.824960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25d8f8a0-d2f1-4a6c-8c02-4f73ebc01186 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.121737 Nov 20 21:06:24.841121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2789/5482] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:24 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:24.853089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9a0048a9-405e-47c2-820c-13dbe4494e9f req-47f4ae45-8595-4c96-9e58-83a1a2b62910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f2a7d6-51f3-4089-b760-0874e2e19f5f", "name": "network-vif-deleted", "tag": "e27aebd4-294a-4f67-9404-737e55478135"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:24.859214 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:24.859214 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:24.895916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9a0048a9-405e-47c2-820c-13dbe4494e9f req-47f4ae45-8595-4c96-9e58-83a1a2b62910 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:24.896641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9a0048a9-405e-47c2-820c-13dbe4494e9f req-47f4ae45-8595-4c96-9e58-83a1a2b62910 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:24.960816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.server_external_events [req-9a0048a9-405e-47c2-820c-13dbe4494e9f req-47f4ae45-8595-4c96-9e58-83a1a2b62910 service nova] Unable to find a host for instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f. Dropping event network-vif-deleted {{(pid=140941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:06:24.967502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9a0048a9-405e-47c2-820c-13dbe4494e9f req-47f4ae45-8595-4c96-9e58-83a1a2b62910 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.124824 Nov 20 21:06:24.978895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2790/5483] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 137 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 20 21:06:25.392260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1276033f-88f2-4ad2-b230-85b84518ada5 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 204 len: 0 microversion: 2.1 time: 4.654949 Nov 20 21:06:25.393221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2694/5484] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:20 2021] DELETE /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 0 bytes in 4657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:06:25.406131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:25.406967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f6f2a7d6-51f3-4089-b760-0874e2e19f5f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:25.419804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.420258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.421075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.421585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.454238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f could not be found. Nov 20 21:06:25.457263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 404 to user: Instance f6f2a7d6-51f3-4089-b760-0874e2e19f5f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:25.458793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7de7bee-c23b-4fa0-baa5-5f362614d58e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f" status: 404 len: 111 microversion: 2.1 time: 0.056516 Nov 20 21:06:25.463152 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2791/5485] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:25 2021] GET /compute/v2.1/servers/f6f2a7d6-51f3-4089-b760-0874e2e19f5f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:06:25.472153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:25.473472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:25.490152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.491587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.494287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.499701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.573397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:25.720039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:25.720637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:25.734675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.735159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.737524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.737979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.792185 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c5069a70-f318-486a-8385-abae31369e8e tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 204 len: 0 microversion: 2.1 time: 0.324552 Nov 20 21:06:25.793385 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2695/5486] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:25 2021] DELETE /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:25.802957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:25.804172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:25.812195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.812951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:25.813915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:25.814612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:26.035685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:26.049887 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6811b84d-78fc-4fc6-bfda-4983b28fc5fa tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1465 microversion: 2.1 time: 0.250537 Nov 20 21:06:26.051071 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2696/5487] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:25 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:26.061312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:26.062404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:26.076788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:26.079234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:26.081425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:26.081887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:26.103794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:26.114795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:26.121276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:26.122568 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cdcc1b5-df46-4b0b-96de-34c42c7373b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.406764 Nov 20 21:06:26.123142 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2792/5488] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:25 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:26.175627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e4381e2-ec32-42a1-a2e2-c3827f15825d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.117093 Nov 20 21:06:26.177192 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2697/5489] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:26 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:26.511594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-152743571", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7e423f00-6cad-43f5-a5bf-960ac9228382"}], "key_name": "tempest-TestSecurityGroupsBasicOps-541437412", "security_groups": []}, "os:scheduler_hints": {"different_host": ["45ba7955-5181-4b9d-8046-1ebc20efd258"]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:26.637814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] validate_networks() for [('7e423f00-6cad-43f5-a5bf-960ac9228382', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:06:27.068223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:27.068928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:27.091772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:27.097608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:27.099712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:27.100374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:27.456529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:27.471358 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40bc1b7d-6c6c-4000-a685-2f1505ead004 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1465 microversion: 2.1 time: 0.408319 Nov 20 21:06:27.481767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2698/5490] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:27 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1465 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:27.487659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:27.490598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:27.502732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:27.503373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:27.504532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:27.504665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.122360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:06:28.122896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:28.125300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:06:28.125998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:06:28.126627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:06:28.127221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:06:28.132389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:28.138427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:28.143568 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-15760536-55b2-4327-ba7d-59090977865b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.660632 Nov 20 21:06:28.147264 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2699/5491] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:27 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:28.159027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.163226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.164215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.164667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.168502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:28.169108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:28.192919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.193654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.194710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.195161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.240172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for project 83a551019ab140bba8ec377d05167a62. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:06:28.257439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Getting quotas for user 42c838a4d9574ad9ae0d581484cb36a7 and project 83a551019ab140bba8ec377d05167a62. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:06:28.300372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:06:28.303697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:06:28.322832 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d16ded2b-469b-4bd8-91ef-2cbb8d7e9dcb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.169918 Nov 20 21:06:28.323703 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2700/5492] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:28.449619 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dd1fea2-978d-4072-b789-fd79c393b3a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.939476 Nov 20 21:06:28.451235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2793/5493] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:06:26 2021] POST /compute/v2.1/servers => generated 361 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:06:28.462008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0234a152-f4f6-42a7-a265-4353692ada59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:28.462771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0234a152-f4f6-42a7-a265-4353692ada59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:28.488403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:28.499872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:28.526149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.545673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.546840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:28.547448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:28.670370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0234a152-f4f6-42a7-a265-4353692ada59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:28.685033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0234a152-f4f6-42a7-a265-4353692ada59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1240 microversion: 2.1 time: 0.225086 Nov 20 21:06:28.686024 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2701/5494] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:28 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1240 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:28.867055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:28.876298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cedc50ef-4e7b-41a2-9586-7712e8bb1a7d tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1465 microversion: 2.1 time: 0.391659 Nov 20 21:06:28.876895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2794/5495] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:28 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1465 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:29.175275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:29.179983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:29.202421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.202882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:29.209222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.209796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:29.337089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:29.338199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:29.361534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.362059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:29.369610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.370196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:29.494478 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc3199c3-c64c-46f3-8a9a-cb50ba7105a3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.157968 Nov 20 21:06:29.497733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2795/5496] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:29.704234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:29.705314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:29.746964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.749011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:29.756771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:29.759455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:30.028292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:30.057411 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0c55982-e2fd-46a9-aae2-e8a089f130a7 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1236 microversion: 2.1 time: 0.358434 Nov 20 21:06:30.060675 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2796/5497] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:29 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1236 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:30.079852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:30.080794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:30.100475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:30.101740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:30.104007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:30.105741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:30.314922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:30.326106 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5a78a15-dc4e-4f60-89c6-571d4b5eff87 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1465 microversion: 2.1 time: 0.263575 Nov 20 21:06:30.353436 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2797/5498] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:30 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1465 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:30.509797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:30.511038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:30.557088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:30.557572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:30.558743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:30.559184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:30.682692 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-075465cc-62e6-4add-a802-82126e21268c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.172416 Nov 20 21:06:30.694846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2798/5499] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:31.098567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:31.122742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:31.136368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c967e588-23d5-4ab9-b512-75cd7992e423 req-a6b29e6d-0fa9-4af8-81c6-9d8901ed4786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f390f8d7-738a-4054-995b-3c2a44debc3f", "name": "network-vif-deleted", "tag": "2b058afc-10cf-4cd9-bbbc-13ea1bcc46be"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:31.139373 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:31.139373 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:31.143859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:31.152119 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee1eafc7-064f-4354-9de0-914501bd707a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 1.990957 Nov 20 21:06:31.164221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2702/5500] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:29 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:31.184045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c967e588-23d5-4ab9-b512-75cd7992e423 req-a6b29e6d-0fa9-4af8-81c6-9d8901ed4786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.185260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c967e588-23d5-4ab9-b512-75cd7992e423 req-a6b29e6d-0fa9-4af8-81c6-9d8901ed4786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.194438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:31.210716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:31.243144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.243676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.245627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.247445 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c967e588-23d5-4ab9-b512-75cd7992e423 req-a6b29e6d-0fa9-4af8-81c6-9d8901ed4786 service nova] Creating event network-vif-deleted:2b058afc-10cf-4cd9-bbbc-13ea1bcc46be for instance f390f8d7-738a-4054-995b-3c2a44debc3f on nch2-master-1 Nov 20 21:06:31.248015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.279742 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c967e588-23d5-4ab9-b512-75cd7992e423 req-a6b29e6d-0fa9-4af8-81c6-9d8901ed4786 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406668 Nov 20 21:06:31.280338 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2799/5501] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:06:31.362017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:31.362743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:31.376986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.377478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.378396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.378837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.467799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.468624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.469916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lazy-loading 'fault' on Instance uuid f390f8d7-738a-4054-995b-3c2a44debc3f {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:06:31.663754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:31.666394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:31.680068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9641d945-27a3-4ab8-88bd-c9b6dbf00412 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.514448 Nov 20 21:06:31.681269 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2703/5502] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:31 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:31.683785 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b56252ab-3e5f-4e7c-bac7-16c3f63d78a0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 200 len: 1304 microversion: 2.1 time: 0.326639 Nov 20 21:06:31.693310 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2800/5503] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:31 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 1304 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:31.717638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:31.719058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:31.732263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.741370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.749269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:31.749980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:31.898108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1fe7f678-507e-43d9-966a-125f9b8fbb2b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.197497 Nov 20 21:06:31.899166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2704/5504] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:32.179783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:32.180768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:32.194742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:32.198092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:32.199863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:32.202829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:32.703044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:32.705891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:32.717042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:32.717866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:32.719156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:32.719839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:32.959464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:32.981969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99920e2d-156c-4238-ad1c-517ffe8980b9 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.288269 Nov 20 21:06:32.988377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2705/5505] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:32 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:32.998811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:32.999576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: f390f8d7-738a-4054-995b-3c2a44debc3f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:33.026786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.027540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.028729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.029400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.066280 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance f390f8d7-738a-4054-995b-3c2a44debc3f could not be found. Nov 20 21:06:33.069215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 404 to user: Instance f390f8d7-738a-4054-995b-3c2a44debc3f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:33.071289 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ded288b6-6fbc-4418-a690-6495c5c28736 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f" status: 404 len: 111 microversion: 2.1 time: 0.081574 Nov 20 21:06:33.073538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2706/5506] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:32 2021] GET /compute/v2.1/servers/f390f8d7-738a-4054-995b-3c2a44debc3f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:06:33.082105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:33.087945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:33.109833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.110708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.112046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.115421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.188986 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82f7ea32-5645-4536-977c-f0c3ba9ce6ef tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.113037 Nov 20 21:06:33.198443 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2707/5507] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:33.208578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:33.211069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:33.219463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.221083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.222139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.222820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.288734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:33.442845 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bc6902df-4fdc-43f6-a3d9-af40122c4bab tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 204 len: 0 microversion: 2.1 time: 0.240339 Nov 20 21:06:33.443764 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2708/5508] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:33 2021] DELETE /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:33.453344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:33.456790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:33.480087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.480956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.482020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:33.482790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:33.545570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:33.559135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:33.563149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:33.566737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d443275-19b1-4869-bfdb-5ff3230ba1ee tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 1.391011 Nov 20 21:06:33.569976 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2801/5509] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:32 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:33.835524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:33.845100 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cfe5d308-4a7d-415b-8d09-3839007e3482 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1507 microversion: 2.1 time: 0.396072 Nov 20 21:06:33.848924 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2709/5510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:33 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:33.999410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:34.000036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:34.026272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.026969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.027939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.028414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.204481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:34.205579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:34.212873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.213332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.214164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.214604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.216135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:34.223682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e0a8567-0c8f-42b4-8933-8107fe5ccb34 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.228025 Nov 20 21:06:34.224257 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2802/5511] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:33 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:34.340343 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ce10c22-ded7-4c9e-8ea1-d35cfae8ceee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.139210 Nov 20 21:06:34.341005 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2710/5512] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:34.621480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:34.622170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:34.630698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.631151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.652022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.654085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.868164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:34.868858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:34.887730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.888171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:34.888982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:34.889417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.384333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:35.394163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:35.404563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:35.406310 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-adfa360d-f7f6-43c4-942b-3a0046c07355 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.788514 Nov 20 21:06:35.407128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2803/5513] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:34 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:35.422189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:35.423042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:35.433613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:35.441778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.443620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:35.444296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.587652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:35.600210 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-041a365c-2bbd-4871-a345-19536e038e00 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1507 microversion: 2.1 time: 0.736154 Nov 20 21:06:35.601124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2711/5514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:34 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1507 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:35.612876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:35.614351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:35.647486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:35.648525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.650421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:35.651457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.738251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:35.743047 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea17dd48-25ea-435b-8c26-19763e8e0595 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.140472 Nov 20 21:06:35.744969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2712/5515] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:35 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:35.753666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-40146a8a-7e58-48d7-b7bf-bcdd82bba668 req-08dc54e9-2bb0-4168-916d-e3a568b92338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c387821-7036-4775-8529-21f7ee97701a", "tag": "582622c7-8ba0-4fdf-889b-124b2c558258"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:35.755999 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:35.755999 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:06:35.763307 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-401d88a1-3840-4393-bad8-b6dfc7e8a130 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.354336 Nov 20 21:06:35.763928 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2804/5516] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:35 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:35.777121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-40146a8a-7e58-48d7-b7bf-bcdd82bba668 req-08dc54e9-2bb0-4168-916d-e3a568b92338 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:35.778835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-40146a8a-7e58-48d7-b7bf-bcdd82bba668 req-08dc54e9-2bb0-4168-916d-e3a568b92338 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:35.798844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-40146a8a-7e58-48d7-b7bf-bcdd82bba668 req-08dc54e9-2bb0-4168-916d-e3a568b92338 service nova] Creating event network-changed:582622c7-8ba0-4fdf-889b-124b2c558258 for instance 4c387821-7036-4775-8529-21f7ee97701a on nch2-master-1 Nov 20 21:06:35.806020 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-40146a8a-7e58-48d7-b7bf-bcdd82bba668 req-08dc54e9-2bb0-4168-916d-e3a568b92338 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056037 Nov 20 21:06:35.806999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2713/5517] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:06:36.388648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a3a80650-9792-4707-8da0-404bc214d5d4 req-2355f27a-fdba-4dbf-91c7-abb6f70def89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67eb997-9ace-4561-a2e9-959c7bf3252b", "name": "network-vif-deleted", "tag": "ef1ededa-73ec-4b63-8c91-5d3cfac10c0d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:36.396828 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:36.396828 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:36.419546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a3a80650-9792-4707-8da0-404bc214d5d4 req-2355f27a-fdba-4dbf-91c7-abb6f70def89 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.426833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:36.427617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:36.437858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a3a80650-9792-4707-8da0-404bc214d5d4 req-2355f27a-fdba-4dbf-91c7-abb6f70def89 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.447354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.447881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.448688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.459340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.492208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a3a80650-9792-4707-8da0-404bc214d5d4 req-2355f27a-fdba-4dbf-91c7-abb6f70def89 service nova] Creating event network-vif-deleted:ef1ededa-73ec-4b63-8c91-5d3cfac10c0d for instance a67eb997-9ace-4561-a2e9-959c7bf3252b on nch2-master-1 Nov 20 21:06:36.505852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a3a80650-9792-4707-8da0-404bc214d5d4 req-2355f27a-fdba-4dbf-91c7-abb6f70def89 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121158 Nov 20 21:06:36.514211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2805/5518] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:06:36.618964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:36.619912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:36.634755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.635639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.638316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.639073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.723428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.724126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.724744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lazy-loading 'fault' on Instance uuid a67eb997-9ace-4561-a2e9-959c7bf3252b {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:06:36.850945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:36.881571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:36.888689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:36.903646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cab8051a-634a-4a61-ae7f-7d62c1930e2a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.476944 Nov 20 21:06:36.904582 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2714/5519] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:36 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:36.938630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:36.940078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:36.960917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.961686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:36.963522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:36.964198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:37.089092 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ff27abb-6307-43d6-9c6f-7af02d681375 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.181572 Nov 20 21:06:37.104163 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2715/5520] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:36 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:37.110437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:37.111158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:37.140813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:37.144371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:37.147239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:37.155042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:37.240875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:37.267413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e5e95ef-2488-43d2-b668-b1efed03688a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 200 len: 1305 microversion: 2.1 time: 0.644364 Nov 20 21:06:37.273211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2806/5521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:36 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 1305 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:37.513257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:37.522541 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-22b6eb19-080f-4aa8-b742-4df356fe278b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.416696 Nov 20 21:06:37.523324 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2716/5522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:37 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:37.924390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:37.925391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:37.934372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:37.935199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:37.936201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:37.936827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.111239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:38.112282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:38.126102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.126864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.127995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.128545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.208169 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f414f601-4aa9-4641-9296-68a1e939ab5f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.100427 Nov 20 21:06:38.209543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2717/5523] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:38 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:38.270578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:38.281958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:38.289012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:38.292939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:38.293862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: a67eb997-9ace-4561-a2e9-959c7bf3252b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:38.303397 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ececc19-0798-4503-b790-cbd7e292a6e2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.383951 Nov 20 21:06:38.307521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.309268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.310963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.311649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.321703 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2807/5524] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:37 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:38.346173 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance a67eb997-9ace-4561-a2e9-959c7bf3252b could not be found. Nov 20 21:06:38.348026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 404 to user: Instance a67eb997-9ace-4561-a2e9-959c7bf3252b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:38.351201 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab58fdd2-8958-40bd-a217-80f8a061bbc3 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b" status: 404 len: 111 microversion: 2.1 time: 0.063734 Nov 20 21:06:38.352292 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2718/5525] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:38 2021] GET /compute/v2.1/servers/a67eb997-9ace-4561-a2e9-959c7bf3252b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:06:38.359892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:38.360428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:38.381488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.382245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.383429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.384305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.444201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:38.540758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:38.541448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:38.556611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.561163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.563501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.564122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.618115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54e32dba-db04-431f-b7a3-d9558188d375 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 204 len: 0 microversion: 2.1 time: 0.261158 Nov 20 21:06:38.619614 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2808/5526] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:38 2021] DELETE /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:06:38.659155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:38.660237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:38.672367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.681163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.682569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:38.683413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:38.864520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:38.876322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a93f798b-57d6-44fb-b917-d0d2a4d9c139 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.340513 Nov 20 21:06:38.879062 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2719/5527] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:38 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:39.205626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:39.221994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1a7dcf65-04ad-48ea-9216-07eb91c0e65f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1495 microversion: 2.1 time: 0.586716 Nov 20 21:06:39.222473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:39.224505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:39.232999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2809/5528] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:38 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1495 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:39.257083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.259200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:39.262669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.263135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:39.332849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:39.335024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:39.349922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.350408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:39.354804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.355202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:39.430141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b926276-d076-4d72-aba2-b98fae95e9a6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.212781 Nov 20 21:06:39.435598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2720/5529] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:39 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:39.858648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:39.868475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:39.876888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:39.878462 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c010b3d-8f81-4aee-b20d-73a3020eb323 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.554047 Nov 20 21:06:39.879822 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2810/5530] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:39 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:39.897846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:39.898687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:39.914533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.922644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:39.923678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:39.925706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.249713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:40.250641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:40.264585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.268101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.272522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.273128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.445636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:40.464468 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eee8837-b9d5-46b7-baf9-dbf849ca8f1e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.571898 Nov 20 21:06:40.473958 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2721/5531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:39 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:40.479723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:40.486905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:40.506183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.507046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.508018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.508612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.657395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6bcb109a-5169-4540-951d-9e1728efa6c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.174556 Nov 20 21:06:40.657395 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2722/5532] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:40.676568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:40.696019 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d98d75a-cdf9-4d4f-ae58-1591546c3747 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1495 microversion: 2.1 time: 0.449884 Nov 20 21:06:40.696611 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2811/5533] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:40 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1495 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:40.898378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:40.900723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:40.911610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.912326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:40.913287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:40.913874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.193255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:41.204272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:41.208268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:41.213932 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2072c29-6079-43d5-a1f3-c04f12fd21af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.320202 Nov 20 21:06:41.219809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2723/5534] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:40 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:41.465827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b485da3c-fda8-4d75-8583-c51a5114b7d4 req-d48fdc14-fcee-4dfe-ba88-597a98f6b8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c387821-7036-4775-8529-21f7ee97701a", "name": "network-vif-plugged", "status": "completed", "tag": "582622c7-8ba0-4fdf-889b-124b2c558258"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:41.468043 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:41.468043 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:41.480022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b485da3c-fda8-4d75-8583-c51a5114b7d4 req-d48fdc14-fcee-4dfe-ba88-597a98f6b8e6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.481050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b485da3c-fda8-4d75-8583-c51a5114b7d4 req-d48fdc14-fcee-4dfe-ba88-597a98f6b8e6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.494672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:41.495275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:41.506284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b485da3c-fda8-4d75-8583-c51a5114b7d4 req-d48fdc14-fcee-4dfe-ba88-597a98f6b8e6 service nova] Creating event network-vif-plugged:582622c7-8ba0-4fdf-889b-124b2c558258 for instance 4c387821-7036-4775-8529-21f7ee97701a on nch2-master-1 Nov 20 21:06:41.510007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.510488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.512019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.513785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.515606 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b485da3c-fda8-4d75-8583-c51a5114b7d4 req-d48fdc14-fcee-4dfe-ba88-597a98f6b8e6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188513 Nov 20 21:06:41.516828 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2812/5535] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:06:41.612848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-43592362-7df1-4625-a396-ed0c57aa487c req-fa9fb2be-7fea-4ff1-aa75-8bdcc7332cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea408b76-6111-499e-93d3-91486b7f5ea0", "name": "network-vif-deleted", "tag": "060b39d6-eba6-405a-948f-556357f13071"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:41.615417 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:41.615417 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:41.632174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-43592362-7df1-4625-a396-ed0c57aa487c req-fa9fb2be-7fea-4ff1-aa75-8bdcc7332cb5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.633001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-43592362-7df1-4625-a396-ed0c57aa487c req-fa9fb2be-7fea-4ff1-aa75-8bdcc7332cb5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.686976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-43592362-7df1-4625-a396-ed0c57aa487c req-fa9fb2be-7fea-4ff1-aa75-8bdcc7332cb5 service nova] Creating event network-vif-deleted:060b39d6-eba6-405a-948f-556357f13071 for instance ea408b76-6111-499e-93d3-91486b7f5ea0 on nch2-master-1 Nov 20 21:06:41.768283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-43592362-7df1-4625-a396-ed0c57aa487c req-fa9fb2be-7fea-4ff1-aa75-8bdcc7332cb5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161330 Nov 20 21:06:41.769530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2813/5536] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:06:41.775576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:41.775850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:41.777012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:41.783988 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-069ab22c-0934-480e-9d8a-d5275df1832a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.297012 Nov 20 21:06:41.785493 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2724/5537] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:41 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:41.790986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:41.792569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.793345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:41.793942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.797549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.798220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.806509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.809825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.813269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:41.813966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:41.877057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0fcbce21-9fe6-4f02-a199-97278f82ac7d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.105713 Nov 20 21:06:41.878637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2814/5538] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:41.921087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:41.968830 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2932a725-73d8-4f4b-8376-9c36f6bf2fe0 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 200 len: 1453 microversion: 2.1 time: 0.181558 Nov 20 21:06:41.970641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2725/5539] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:41 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:42.239927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:42.241034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:42.267174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.273796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.275029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.275639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.820567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:42.822871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:42.836010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.836736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.838023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.838563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.940737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:42.950686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:42.960928 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-acfbfaa9-8f20-4fd8-8fe8-02f90cc2580c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1298 microversion: 2.1 time: 0.162547 Nov 20 21:06:42.962315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2726/5540] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:42 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:42.966156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:42.967322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:42.967930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:42.968502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:42.969152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63f0f9b9-ceb8-49ff-bd7d-83058711f808 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1739 microversion: 2.20 time: 0.734961 Nov 20 21:06:42.981098 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2815/5541] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:42 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1739 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:42.981321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.981321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.981321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:42.981321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:42.987389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:42.987998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ea408b76-6111-499e-93d3-91486b7f5ea0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:43.004036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.005144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.006298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.006683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.025728 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance ea408b76-6111-499e-93d3-91486b7f5ea0 could not be found. Nov 20 21:06:43.026362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 404 to user: Instance ea408b76-6111-499e-93d3-91486b7f5ea0 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:43.027420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24b89215-9e78-42d4-adc4-a8e4d4a132fe tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0" status: 404 len: 111 microversion: 2.1 time: 0.043638 Nov 20 21:06:43.031955 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2816/5542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:42 2021] GET /compute/v2.1/servers/ea408b76-6111-499e-93d3-91486b7f5ea0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:06:43.035597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-045f144d-4fa8-4d5a-8cd0-a396d4b86224 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.071686 Nov 20 21:06:43.040110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2727/5543] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:43.048000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:43.048442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:43.055061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.055515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.056315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.056761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.091501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:43.213040 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac65d257-dc30-4985-9543-4cac7fed9682 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 204 len: 0 microversion: 2.1 time: 0.171536 Nov 20 21:06:43.213588 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2817/5544] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:43 2021] DELETE /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:43.223955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:43.224684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:43.233420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.233883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.234750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.235418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.445100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:43.452898 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06adbe85-d09a-452f-95a7-62131439f231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1674 microversion: 2.1 time: 0.234090 Nov 20 21:06:43.458392 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2728/5545] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:43 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:43.981727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:43.981727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:43.990437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:43.991005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.992818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:43.993016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:43.996675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:43.997606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.001811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.002487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.003316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.004116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.238459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:44.248187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2578e701-8090-412a-b505-f6ad56aa6a59 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1471 microversion: 2.1 time: 0.273901 Nov 20 21:06:44.249455 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2818/5546] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:43 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1471 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:44.256307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:44.257299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:44.264320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.265073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.266309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.266934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.279841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:44.291572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:44.293992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:44.295933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f55768fb-5516-4704-a7ea-bbf495efc4ba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1721 microversion: 2.20 time: 0.311754 Nov 20 21:06:44.308956 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2729/5547] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:43 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:44.314116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:44.315052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:44.329612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.330133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.331017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.331471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.341793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48281aa4-afba-4d35-9cd6-1b97f962f3ed tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.091002 Nov 20 21:06:44.346300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2819/5548] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:44 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:44.461127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:44.471573 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e4d13a2-b897-4ed3-9cf9-e27a6ad6ba7e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1471 microversion: 2.1 time: 0.161242 Nov 20 21:06:44.473605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:44.474746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:44.475054 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2730/5549] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:44 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:44.493102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:44.495008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:44.500879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.502254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.505573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.507309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.510234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.516767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.517841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.522222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.800356 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5c63825-ebfc-4c05-af3b-0c7fc7ee06d9 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1622 microversion: 2.1 time: 0.312225 Nov 20 21:06:44.806370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2731/5550] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:44 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1622 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:44.822773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:44.824071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:44.836963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.837712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.838730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:44.839337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:44.977749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:45.005263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75ae6b27-c068-46b9-ad66-b78f7ee2cf8f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1674 microversion: 2.1 time: 0.534789 Nov 20 21:06:45.009870 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2820/5551] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:44 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1674 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:45.147966 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32fa81c5-3a8c-414e-9d27-bf843d35b353 tempest-TestSecurityGroupsBasicOps-581293780 tempest-TestSecurityGroupsBasicOps-581293780-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1914 microversion: 2.1 time: 0.328799 Nov 20 21:06:45.151747 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2732/5552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:44 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1914 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:06:45.275057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:45.275901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:45.294360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.294866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.300333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.302261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.317886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:45.318693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:45.337240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.337809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.338740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.339272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.402841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:06:45.570379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d67547ee-a1d4-45ad-af02-0f03889be9c0 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 204 len: 0 microversion: 2.1 time: 0.302407 Nov 20 21:06:45.574387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2821/5553] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:06:45 2021] DELETE /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:45.595052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:45.601100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:45.614384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.616526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.618957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.619894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.705455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf794cff-062f-4b30-b39b-805a72661e1b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.127442 Nov 20 21:06:45.711459 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2822/5554] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:45.717139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:45.717844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:45.734155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.735297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.737280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:45.737888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:45.886231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:45.904898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:45.907045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:45.908774 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2f09ea7-33f0-487d-9e49-aa248b6d063d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1721 microversion: 2.20 time: 0.595949 Nov 20 21:06:45.909531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2733/5555] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:45 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1721 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:46.019504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:46.024573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:46.025988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:46.034497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.036075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:46.037273 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cb6bb47-9cd9-43d0-9c6c-be51db67fb6c tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1477 microversion: 2.1 time: 0.324432 Nov 20 21:06:46.037759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.038468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:46.049279 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2823/5556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:45 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:46.384905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:46.392741 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b775f33-cbf4-449c-a89f-69e044df5231 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1674 microversion: 2.1 time: 0.372952 Nov 20 21:06:46.393322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2734/5557] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:46 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1674 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:46.718824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:46.719833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:46.728054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.728502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:46.729298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.730341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:46.777237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c02bd0f9-46f1-4384-aa16-2f09adba9b76 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062539 Nov 20 21:06:46.778707 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2824/5558] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:46 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:46.929939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:46.938216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:46.947238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.947795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:46.948601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:46.949036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.060952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:47.062338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:47.079036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.079757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.080899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.081605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.204586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:47.214905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:47.216424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:47.217787 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e81a1599-e058-4f4b-9f0a-3704b3d70b8c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1664 microversion: 2.20 time: 0.292394 Nov 20 21:06:47.218558 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2735/5559] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:46 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1664 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:47.237218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aba81b62-e009-44af-8093-0e9eed95f96c"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:47.238402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:47.245803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.246359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.247164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.247609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.403989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:47.438793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2c084d2-435a-4708-b1bb-fb47d39a8852 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 200 len: 1477 microversion: 2.1 time: 0.381750 Nov 20 21:06:47.440685 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2825/5560] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:47 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 1477 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:47.455769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:47.456407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:47.483694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.485219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.486143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.486597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.696461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:47.709474 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c560c3c1-510c-44ae-b68d-6862ca8bfc9f tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1607 microversion: 2.1 time: 0.267557 Nov 20 21:06:47.710406 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aecfaecd-b9fc-42f4-a83d-bce138c89bb3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.471972 Nov 20 21:06:47.711605 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2736/5561] 10.222.0.41 () {62 vars in 1363 bytes} [Sat Nov 20 21:06:47 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments => generated 188 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:06:47.733470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2826/5562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:47 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1607 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:47.738196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4406989f-9117-4e84-9ca9-250397368128 req-08d2ac01-79c9-4b1d-a6ac-3e16e3930cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c387821-7036-4775-8529-21f7ee97701a", "name": "network-vif-deleted", "tag": "582622c7-8ba0-4fdf-889b-124b2c558258"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:47.741874 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:47.741874 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:06:47.760052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4406989f-9117-4e84-9ca9-250397368128 req-08d2ac01-79c9-4b1d-a6ac-3e16e3930cc5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.760736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4406989f-9117-4e84-9ca9-250397368128 req-08d2ac01-79c9-4b1d-a6ac-3e16e3930cc5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.788751 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4406989f-9117-4e84-9ca9-250397368128 req-08d2ac01-79c9-4b1d-a6ac-3e16e3930cc5 service nova] Creating event network-vif-deleted:582622c7-8ba0-4fdf-889b-124b2c558258 for instance 4c387821-7036-4775-8529-21f7ee97701a on nch2-master-1 Nov 20 21:06:47.791291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:47.792406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:47.801961 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4406989f-9117-4e84-9ca9-250397368128 req-08d2ac01-79c9-4b1d-a6ac-3e16e3930cc5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082515 Nov 20 21:06:47.803158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2737/5563] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:06:47.807058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.808648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.809792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.812032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.828140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5ea89348-7b40-40d0-a3b3-a2c075c9c7a9 req-80b72990-0d62-439f-b73a-cc85083b60d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "name": "network-vif-unplugged", "status": "completed", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:47.831564 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:47.831564 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:06:47.843406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5ea89348-7b40-40d0-a3b3-a2c075c9c7a9 req-80b72990-0d62-439f-b73a-cc85083b60d3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.844070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5ea89348-7b40-40d0-a3b3-a2c075c9c7a9 req-80b72990-0d62-439f-b73a-cc85083b60d3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.871379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_external_events [req-5ea89348-7b40-40d0-a3b3-a2c075c9c7a9 req-80b72990-0d62-439f-b73a-cc85083b60d3 service nova] Unable to find a host for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c. Dropping event network-vif-unplugged {{(pid=140942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:06:47.872599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5ea89348-7b40-40d0-a3b3-a2c075c9c7a9 req-80b72990-0d62-439f-b73a-cc85083b60d3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050157 Nov 20 21:06:47.874303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2738/5564] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:47 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 20 21:06:47.900922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d70f49e-f715-42d0-93bc-2dc803613f46 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.113236 Nov 20 21:06:47.907322 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2827/5565] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:47 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:47.937329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:47.938011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:47.946061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.947311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:47.949101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:47.949985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.132630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-aeaae0a3-60e4-40ec-af75-c86fee4ba107 req-e01fbca4-748d-4941-9369-72140efd60f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac0cb20d-db15-45dc-96f2-65d5fdbfbce2", "name": "network-vif-deleted", "tag": "5e95aa78-cf30-4872-a515-77b24aeb0899"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:48.136595 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:06:48.136595 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:06:48.166095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-aeaae0a3-60e4-40ec-af75-c86fee4ba107 req-e01fbca4-748d-4941-9369-72140efd60f9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.166721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-aeaae0a3-60e4-40ec-af75-c86fee4ba107 req-e01fbca4-748d-4941-9369-72140efd60f9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.208108 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-aeaae0a3-60e4-40ec-af75-c86fee4ba107 req-e01fbca4-748d-4941-9369-72140efd60f9 service nova] Creating event network-vif-deleted:5e95aa78-cf30-4872-a515-77b24aeb0899 for instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 on nch2-master-1 Nov 20 21:06:48.225890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-aeaae0a3-60e4-40ec-af75-c86fee4ba107 req-e01fbca4-748d-4941-9369-72140efd60f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100914 Nov 20 21:06:48.227072 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2828/5566] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:06:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:06:48.234989 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f472f48f-6590-4ab4-9d83-a513e8f6d235 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action" status: 202 len: 0 microversion: 2.20 time: 0.301635 Nov 20 21:06:48.235949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2739/5567] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:47 2021] POST /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:06:48.248046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:48.249091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:48.256562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.257577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.258637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.259535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.458447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:48.460206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 4c387821-7036-4775-8529-21f7ee97701a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:48.469531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.474426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.475520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.477512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.515888 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] HTTP exception thrown: Instance 4c387821-7036-4775-8529-21f7ee97701a could not be found. Nov 20 21:06:48.526458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Returning 404 to user: Instance 4c387821-7036-4775-8529-21f7ee97701a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:48.529413 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b60b2d2-7845-4aeb-8768-a811d2440ef3 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a" status: 404 len: 111 microversion: 2.1 time: 0.074464 Nov 20 21:06:48.533316 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2740/5568] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:48 2021] GET /compute/v2.1/servers/4c387821-7036-4775-8529-21f7ee97701a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:06:48.684472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:48.694384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:48.695884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:48.697088 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49417812-c621-4f51-8e00-fa48946f2f0a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1750 microversion: 2.20 time: 0.454989 Nov 20 21:06:48.710153 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2829/5569] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:48 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1750 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:48.737474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:48.740094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:48.752391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.752924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.753664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.754181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.858887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.859942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.860682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lazy-loading 'fault' on Instance uuid ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:06:48.917731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:48.919100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:48.936733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.937644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.939146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:48.940016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:48.944079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a234e3eb60044c593ed012693fda496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e51856fcb6a14eb6a78ce767f46c8472', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:48.955166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd690d5a-5eb9-4fae-b826-43330de7313a tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 200 len: 1328 microversion: 2.1 time: 0.222094 Nov 20 21:06:48.955838 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2741/5570] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:48 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 1328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:06:49.041808 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b539b906-ef89-459c-8bc8-68c89f539518 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.129857 Nov 20 21:06:49.049009 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2830/5571] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:48 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:49.718414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:49.720154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:49.746947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:49.749721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:49.750883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:49.755314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:49.972977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:49.973802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] [instance: ac0cb20d-db15-45dc-96f2-65d5fdbfbce2] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:49.982119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:49.982582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:49.983389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:49.983830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:50.016363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] HTTP exception thrown: Instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 could not be found. Nov 20 21:06:50.016971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Returning 404 to user: Instance ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:06:50.017812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61a14b15-4b18-49f2-9404-d7e2e8094cb4 tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2" status: 404 len: 111 microversion: 2.1 time: 0.049031 Nov 20 21:06:50.018433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2831/5572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:06:49 2021] GET /compute/v2.1/servers/ac0cb20d-db15-45dc-96f2-65d5fdbfbce2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:06:50.031956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4956d066-639f-43f7-bad7-4224bdbf5afb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] Calling method '.version_select at 0x7f3f86534700>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:50.077247 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4956d066-639f-43f7-bad7-4224bdbf5afb tempest-ServerActionsTestJSON-1950593969 tempest-ServerActionsTestJSON-1950593969-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475445537" status: 202 len: 0 microversion: 2.1 time: 0.051330 Nov 20 21:06:50.077888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2832/5573] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 21:06:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475445537 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:06:50.082979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:50.087345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:50.102336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:50.103019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:50.112908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:50.114256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:50.188096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cbeea47-d6f4-4b4b-9ce5-63ca81edda97 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.108510 Nov 20 21:06:50.188558 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2833/5574] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:50.226576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:50.236764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:50.244918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:50.246366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4523a174-aa6f-4bfd-9cb8-d9af21221c95 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1752 microversion: 2.20 time: 0.534293 Nov 20 21:06:50.248561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2742/5575] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:49 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1752 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:51.211598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:51.213212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:51.221030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:51.221693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:51.222770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:51.223487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:51.268842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:51.271708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:51.293655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:51.294888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bf22a4c-c311-468e-908d-e3776c175aff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093465 Nov 20 21:06:51.296597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:51.297555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2834/5576] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:51.299594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:51.303137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:52.041697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:52.057918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:52.061471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:52.067847 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bdbe0d23-87be-4157-9ab6-b3e1add9bfb1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.803483 Nov 20 21:06:52.068816 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2743/5577] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:51 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:06:52.309840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:52.310940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:52.319818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:52.320499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:52.321547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:52.322182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:52.385672 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b25cac3b-18f4-4cf3-b328-d8838b54c49f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.080731 Nov 20 21:06:52.386459 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2835/5578] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:53.089156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:53.090806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:53.114821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:53.116506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:53.130329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:53.131163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:53.403273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:53.404579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:53.423803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:53.425502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:53.428043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:53.428854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:53.524364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b30fb83b-2116-458f-9c80-e5056ef7f2ea tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.127213 Nov 20 21:06:53.525758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2836/5579] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:53 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:53.783873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:53.797077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:53.801420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:53.804433 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac55822b-5bf1-4eeb-b17f-88286f59555a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.720838 Nov 20 21:06:53.805586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2744/5580] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:53 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:54.538798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:54.539933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:54.549096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:54.549548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:54.550382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:54.551340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:54.634488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-858a0cb3-b992-4bf2-a9b5-bb223f794b01 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.100764 Nov 20 21:06:54.638652 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2837/5581] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:54.823186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:54.824458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:54.839419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:54.850403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:54.855414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:54.857297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:55.356207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:55.372906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:55.376684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:55.380615 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d45b30cc-f8d6-44fd-853f-01a496f9421f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.560311 Nov 20 21:06:55.381933 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2745/5582] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:54 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:55.647826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:55.648889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:55.682397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:55.682844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:55.683692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:55.684141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:55.827905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d53d6e3-2604-4fd9-95f0-d2830ea20a38 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.185149 Nov 20 21:06:55.828639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2838/5583] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:55 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:56.410534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:56.411376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:56.431559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:56.433070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:56.434039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:56.440692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:56.844023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:56.846337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:56.870892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:56.871655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:56.873446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:56.874679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:57.001967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:57.032305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:57.041092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:57.043672 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29b843e0-fa4b-4f99-8dc5-db9c4f7985cc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.646564 Nov 20 21:06:57.047048 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2746/5584] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:56 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:06:57.092935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb440cab-5da2-4d11-aecc-1d5ec2838fc2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.254461 Nov 20 21:06:57.100789 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2839/5585] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:56 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:58.064691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:06:58.067825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:58.084892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:58.085647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:58.089233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:58.089683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:58.114989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:58.116680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:58.145658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:58.148763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:58.149887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:58.152487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:58.291918 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71d85402-5077-499c-b514-9a5d726d67d4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.182025 Nov 20 21:06:58.294564 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2840/5586] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:58 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:59.311273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:06:59.315991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:06:59.345131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:59.346741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:59.350910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:06:59.351654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:06:59.489745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f6e90e6b-597d-4578-b97c-394f6f769932 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.187886 Nov 20 21:06:59.491646 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2841/5587] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:06:59 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:06:59.544320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:59.558308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:59.579161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:06:59.582810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c395f76-027d-4f64-a622-aa4adcea3a0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 1.521267 Nov 20 21:06:59.592814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2747/5588] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:06:58 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:00.534272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:00.536780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:00.556481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:00.573479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:00.578092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:00.579949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:00.612009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:00.612799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:00.640909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:00.643828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:00.646475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:00.648140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:00.681090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43aeca14-8255-48d7-bc0c-34b3f73c864a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.181773 Nov 20 21:07:00.682431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2842/5589] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:01.704353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:01.708979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:01.723467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:01.728033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:01.737093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:01.740362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:01.834312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-103f924f-c2c5-4f2c-b30d-3a3a04ba465f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.142019 Nov 20 21:07:01.835876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2843/5590] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:01.885282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:01.904855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:01.908266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:01.918384 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b6c470a-c815-440e-a43e-63d121c3e04c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 1.310895 Nov 20 21:07:01.919889 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2748/5591] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:00 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:02.847747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:02.850454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:02.870260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:02.894129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:02.898219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:02.898741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:02.938374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:02.939163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:02.959799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:02.960287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:02.961204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:02.975161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:03.034554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3d3e035-fb64-4cb3-8abb-a1d1a083f1e6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.190783 Nov 20 21:07:03.040259 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2844/5592] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:03.736567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:03.737169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:03.763476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:03.764104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:03.764971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:03.775639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:03.888069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:07:03.919301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:03.936559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:03.950679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:03.952777 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e12f05e1-d8e4-4e1d-bc4d-f300039efab4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 1.018121 Nov 20 21:07:03.953621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2749/5593] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:02 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:03.979414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f9b0d778-12ad-4f3f-a914-c14891a78a3e req-a6c1de33-c2c2-40ef-8e42-cfeda9e5cfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ba7955-5181-4b9d-8046-1ebc20efd258", "tag": "985be6fd-eb24-486a-842e-0c2a592276ef"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:04.000649 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:04.000649 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:07:04.028219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f9b0d778-12ad-4f3f-a914-c14891a78a3e req-a6c1de33-c2c2-40ef-8e42-cfeda9e5cfb5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:04.030234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f9b0d778-12ad-4f3f-a914-c14891a78a3e req-a6c1de33-c2c2-40ef-8e42-cfeda9e5cfb5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:04.067899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f9b0d778-12ad-4f3f-a914-c14891a78a3e req-a6c1de33-c2c2-40ef-8e42-cfeda9e5cfb5 service nova] Creating event network-changed:985be6fd-eb24-486a-842e-0c2a592276ef for instance 45ba7955-5181-4b9d-8046-1ebc20efd258 on nch1-master-1 Nov 20 21:07:04.076648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f9b0d778-12ad-4f3f-a914-c14891a78a3e req-a6c1de33-c2c2-40ef-8e42-cfeda9e5cfb5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121484 Nov 20 21:07:04.085145 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2750/5594] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:04.090833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:04.092130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:04.111604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:04.112309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:04.115063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:04.117322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:04.166032 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-15ba0714-d014-4679-b1b8-8753e1e9cf1d tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "DELETE /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 204 len: 0 microversion: 2.1 time: 0.439609 Nov 20 21:07:04.168276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2845/5595] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:07:03 2021] DELETE /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:07:04.182843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:04.185419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:04.198034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:04.201923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:04.203052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:04.203637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:04.217425 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b170e9dd-0e35-484f-bf9a-09ff9d5c26b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.130632 Nov 20 21:07:04.223321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2751/5596] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:04 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:04.980275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:04.981844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:05.007411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:05.009661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:05.035084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:05.038659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:05.254992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:05.268300 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ca0825a3-00a7-4231-8644-78efcbd1a57e tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1769 microversion: 2.1 time: 1.095489 Nov 20 21:07:05.269084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2846/5597] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:04 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1769 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:05.276147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:05.277549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:05.287782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:05.289372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:05.290569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:05.291310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:05.376578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c386efb4-b8c0-4c96-8763-49bf8225ae79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.102441 Nov 20 21:07:05.380941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2847/5598] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:05 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:05.935228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:05.969051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:05.971260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:05.973334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40522c59-e1fa-4c70-81ae-a63147802f19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 1.004908 Nov 20 21:07:05.985542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2752/5599] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:04 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:06.287571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:06.289399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:06.323620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:06.324954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:06.327027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:06.327411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:06.393367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:06.399487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:06.426624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:06.427079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:06.427892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:06.428375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:06.592624 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6971ea97-ed33-4b0f-8664-3f016feabea2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.195168 Nov 20 21:07:06.603441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2753/5600] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:06 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:06.994508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:06.995214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:07.009499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:07.012177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:07.013075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:07.013936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:07.323591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:07.336348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:07.338195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:07.342123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c5d2c00-9b4b-42bc-80bf-d2d9aefd0ebe tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.353561 Nov 20 21:07:07.353632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2754/5601] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:06 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:07.610696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:07.611614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:07.626548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:07.628349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:07.630364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:07.630821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:07.718082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:07.730890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b9161ec2-b330-4af1-ba67-9fe28280dc4f tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1769 microversion: 2.1 time: 1.447962 Nov 20 21:07:07.738970 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2848/5602] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:06 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1769 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:07.743876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59df7738-d7a2-46d1-b4df-f1e6fc8be038 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.138560 Nov 20 21:07:07.749003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2755/5603] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:08.365085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:08.365712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:08.375365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.376078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.377039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.377631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.751776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:08.752457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:08.782394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:08.793577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:08.794719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.795732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.796583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.797022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.799251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:08.801001 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb85f962-36f9-4588-8fa1-9c8a25e48560 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.443494 Nov 20 21:07:08.801586 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2849/5604] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:08 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:08.820276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:08.821356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:08.846266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.847394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.852891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:08.853639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:08.918893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0090f8c1-3341-49b5-af05-b0a18fc0a2ba tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.112285 Nov 20 21:07:08.921095 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2850/5605] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:09.135158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c44758ce-1588-4cbd-bb42-56a2a2a0e0ed req-0cb44faa-d829-450c-af35-4404a4ab3230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ba7955-5181-4b9d-8046-1ebc20efd258", "name": "network-vif-deleted", "tag": "985be6fd-eb24-486a-842e-0c2a592276ef"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:09.137499 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:09.137499 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:07:09.151346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c44758ce-1588-4cbd-bb42-56a2a2a0e0ed req-0cb44faa-d829-450c-af35-4404a4ab3230 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:09.152152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c44758ce-1588-4cbd-bb42-56a2a2a0e0ed req-0cb44faa-d829-450c-af35-4404a4ab3230 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:09.171715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c44758ce-1588-4cbd-bb42-56a2a2a0e0ed req-0cb44faa-d829-450c-af35-4404a4ab3230 service nova] Creating event network-vif-deleted:985be6fd-eb24-486a-842e-0c2a592276ef for instance 45ba7955-5181-4b9d-8046-1ebc20efd258 on nch1-master-1 Nov 20 21:07:09.180865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c44758ce-1588-4cbd-bb42-56a2a2a0e0ed req-0cb44faa-d829-450c-af35-4404a4ab3230 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050419 Nov 20 21:07:09.182502 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2851/5606] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:07:09.255020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c838a4d9574ad9ae0d581484cb36a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a551019ab140bba8ec377d05167a62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:09.294958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fad5e355-d4e7-484b-88d3-e89415201f6b tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 200 len: 1650 microversion: 2.1 time: 0.547061 Nov 20 21:07:09.298043 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2756/5607] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:08 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 1650 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:07:09.828358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:09.828358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:09.848450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:09.849643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:09.855888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:09.857818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:10.040176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1015066194", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "fd6757f0-07f9-4f9b-8569-3dacfd7cd36f"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:10.130915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] validate_networks() for [('fd6757f0-07f9-4f9b-8569-3dacfd7cd36f', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:07:10.138203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:10.148259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:10.150150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:10.151891 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f20a25d1-f4f7-4b57-ad60-1b62ec1fc37f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.332322 Nov 20 21:07:10.152778 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2757/5608] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:09 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:10.163717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:10.164956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:10.171669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:10.172128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:10.172924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:10.173370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:10.215317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50eb76df-1584-4f9d-800b-251441b39850 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.061194 Nov 20 21:07:10.216013 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2758/5609] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:10 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:10.319060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:10.319671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] [instance: 45ba7955-5181-4b9d-8046-1ebc20efd258] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:10.326945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:10.327405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:10.328408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:10.329000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:10.343886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] HTTP exception thrown: Instance 45ba7955-5181-4b9d-8046-1ebc20efd258 could not be found. Nov 20 21:07:10.344489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Returning 404 to user: Instance 45ba7955-5181-4b9d-8046-1ebc20efd258 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:07:10.345322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cecbf302-1463-4e33-8849-f69fbe3e9c9a tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258" status: 404 len: 111 microversion: 2.1 time: 0.030763 Nov 20 21:07:10.345880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2759/5610] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:10 2021] GET /compute/v2.1/servers/45ba7955-5181-4b9d-8046-1ebc20efd258 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:07:10.972088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:07:10.974328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:07:10.975184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:07:10.975865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:07:10.977531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:07:11.006357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.008933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.011542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.018944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.082200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Getting quotas for project 0400d56719ed494ebd32c09923c9b578. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:07:11.091922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Getting quotas for user 956af8deb83e498f8ed25d79f1349378 and project 0400d56719ed494ebd32c09923c9b578. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:07:11.106793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:07:11.110485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:07:11.173818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:11.174723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:11.190167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.190780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.193884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.194657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.218678 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9385b9bf-3211-4117-9601-f57c085aa8ef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435712 Nov 20 21:07:11.219664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2852/5611] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:07:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:07:11.231278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:11.232717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:11.242001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.242806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.243821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:11.244798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:11.320579 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ba69312-3baa-4936-b9eb-72bd07b7ff07 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093822 Nov 20 21:07:11.326686 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2853/5612] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:11 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:11.333830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60126033-8126-4e5f-877b-818cceee10cd tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:11.334741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60126033-8126-4e5f-877b-818cceee10cd tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:11.473585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60126033-8126-4e5f-877b-818cceee10cd tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:11.486422 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60126033-8126-4e5f-877b-818cceee10cd tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1217 microversion: 2.1 time: 0.156203 Nov 20 21:07:11.510317 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2854/5613] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:11 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:11.826414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:11.837424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:11.839402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:11.840883 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b71ae3d-018a-47c3-8629-d3dd0b94340d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.672555 Nov 20 21:07:11.842020 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2760/5614] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:11 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:12.333153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:12.334320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:12.341748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.342464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:12.343443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.343900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:12.388091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0530fb93-3ff7-4111-991e-7a05bb0e2984 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.058928 Nov 20 21:07:12.389524 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2855/5615] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:12.516214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:12.516720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:12.539433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.540828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:12.541751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.544119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:12.801912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:12.811790 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c084601c-0534-4f3e-a696-c870ef005630 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1277 microversion: 2.1 time: 0.300472 Nov 20 21:07:12.814295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2761/5616] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:12 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:12.861155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:12.862239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:12.879249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.879665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:12.880461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:12.880910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:13.074632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:13.089573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:13.096348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:13.098393 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5b95917-5629-41e7-9feb-46c0507fb3b8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.241573 Nov 20 21:07:13.099577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2856/5617] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:12 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:13.400841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:13.401939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:13.412887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:13.413327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:13.419353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:13.419353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:13.464509 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21a01fb2-7e94-4f4e-b743-3e51391a03be tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.067222 Nov 20 21:07:13.468613 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2762/5618] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:13.765251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e298c005-7b46-4a61-b8d4-60337dc06681 req-6448730d-abea-4add-b480-fa27bf35c182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "name": "network-vif-plugged", "status": "completed", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:13.766821 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:13.766821 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:07:13.778463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e298c005-7b46-4a61-b8d4-60337dc06681 req-6448730d-abea-4add-b480-fa27bf35c182 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:13.779004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e298c005-7b46-4a61-b8d4-60337dc06681 req-6448730d-abea-4add-b480-fa27bf35c182 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:13.797226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e298c005-7b46-4a61-b8d4-60337dc06681 req-6448730d-abea-4add-b480-fa27bf35c182 service nova] Creating event network-vif-plugged:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:07:13.803905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e298c005-7b46-4a61-b8d4-60337dc06681 req-6448730d-abea-4add-b480-fa27bf35c182 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042103 Nov 20 21:07:13.805867 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2857/5619] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:13.835955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:13.843680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:13.860473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:13.860950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:13.861972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:13.862606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:14.064537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:14.073980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-300f6bd3-d2e3-4273-968f-0b73a738aeb1 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1275 microversion: 2.1 time: 0.246308 Nov 20 21:07:14.089019 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2763/5620] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:13 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1275 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:07:14.122043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:14.124740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:14.136371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:14.136953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:14.138468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:14.139951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:14.434489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:14.455882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:14.458918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:14.460716 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-39863604-bd6c-4804-9e00-2aa8f0f5a3e0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.347492 Nov 20 21:07:14.473425 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2858/5621] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:14 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:14.480181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:14.481801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:14.491688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:14.492361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:14.493498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:14.494207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:14.553819 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-987e890f-fd9b-4ed1-9bbf-817a248a3e73 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.077403 Nov 20 21:07:14.554858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2764/5622] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:14 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:15.093308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:15.093937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:15.101355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.101815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.102661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.103107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.239872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:15.249040 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-094a7257-e35e-40dd-8a09-f38ddd91e087 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.160075 Nov 20 21:07:15.249625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2859/5623] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:15 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:15.482601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:15.484131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:15.494186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.494809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.495781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.497890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.568378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:15.570234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:15.576598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.577053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.577853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:15.578333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:15.629661 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-55dd67e9-362f-4bc6-8187-1263ce1b90d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066571 Nov 20 21:07:15.630867 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2860/5624] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:15 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:16.109301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:16.119021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:16.132073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:16.135153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f05bcc3-23fb-413e-8175-029b271726a0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1808 microversion: 2.20 time: 0.658515 Nov 20 21:07:16.136613 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2765/5625] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:15 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1808 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:16.268282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:16.269190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:16.276931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:16.277345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:16.278346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:16.278979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:16.512017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:16.524843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50c493bf-325d-4c7b-81e7-b21e4dcd53f2 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.261465 Nov 20 21:07:16.525593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2861/5626] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:16 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:16.645154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:16.646929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:16.660616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:16.661767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:16.662921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:16.663628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:16.763951 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8ca389c-a517-4a0a-98f6-aa02155bbf23 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.124057 Nov 20 21:07:16.764942 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2766/5627] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:17.162275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:17.163095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:17.179376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:17.181398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:17.182784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:17.186394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:17.230757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a4a99fa1-5424-48da-815e-1b33e37e5d8a req-b93bd4a1-59c3-4750-9a6a-02a8862694cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be8e160-dc20-49a4-a5d7-0c9efb0dfe29", "tag": "ec80320f-e59f-4690-a3d9-c1ad5f142f34"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:17.232456 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:17.232456 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:07:17.262915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4a99fa1-5424-48da-815e-1b33e37e5d8a req-b93bd4a1-59c3-4750-9a6a-02a8862694cb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:17.269144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4a99fa1-5424-48da-815e-1b33e37e5d8a req-b93bd4a1-59c3-4750-9a6a-02a8862694cb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:17.318359 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a4a99fa1-5424-48da-815e-1b33e37e5d8a req-b93bd4a1-59c3-4750-9a6a-02a8862694cb service nova] Creating event network-changed:ec80320f-e59f-4690-a3d9-c1ad5f142f34 for instance 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 on nch1-master-1 Nov 20 21:07:17.328537 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a4a99fa1-5424-48da-815e-1b33e37e5d8a req-b93bd4a1-59c3-4750-9a6a-02a8862694cb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102275 Nov 20 21:07:17.331957 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2767/5628] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:07:17.544859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:17.545578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:17.571382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:17.571856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:17.572687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:17.573134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:18.342718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:18.355315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:18.362325 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-982a6833-ff48-4a1d-a951-27128c8dace6 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.824079 Nov 20 21:07:18.369276 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2768/5629] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:17 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:07:18.374728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:18.375867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:18.384454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:18.384926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:18.385934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:18.386414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:18.407999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:18.410149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:18.411599 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb642d15-e900-4ee2-8eb7-206cf09b2c23 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1795 microversion: 2.20 time: 1.258770 Nov 20 21:07:18.447646 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2862/5630] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:17 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1795 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:18.455957 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af4272e1-d33f-42e7-b61a-7d6484694990 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.084841 Nov 20 21:07:18.457054 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2769/5631] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:19.381001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:19.381645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:19.388656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:19.389696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:19.390601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:19.391149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:19.469321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:19.470456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:19.478918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:19.479370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:19.480181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:19.480600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:19.523933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27058bd0-b792-4892-9c13-75f4f06b0c08 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.058552 Nov 20 21:07:19.524599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2770/5632] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:19 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:19.807193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:19.819134 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77fe7188-33ad-4e24-a9ac-7e300edd36af tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.443317 Nov 20 21:07:19.830197 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2863/5633] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:19 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:20.275786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5aa667e2-cd58-469a-a8dd-4c9db7689033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] Calling method '.version_select at 0x7f3f85e3c5e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:20.322617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5aa667e2-cd58-469a-a8dd-4c9db7689033 tempest-TestSecurityGroupsBasicOps-1433820409 tempest-TestSecurityGroupsBasicOps-1433820409-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-541437412" status: 202 len: 0 microversion: 2.1 time: 0.052443 Nov 20 21:07:20.325042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2771/5634] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:07:20 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-541437412 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:20.543596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:20.543596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:20.557681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:20.565410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:20.568982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:20.570198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:20.667638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-479cc7f8-3ce2-4da7-9cf9-16ebd796270e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.135368 Nov 20 21:07:20.673877 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2864/5635] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:20 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:20.839281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:20.840018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:20.853758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:20.853758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:20.854473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:20.854915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:21.141499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:21.150098 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1fea85e7-e24f-4e89-825b-42fa9171eb87 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.316212 Nov 20 21:07:21.150701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2772/5636] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:20 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:21.682799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:21.684616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:21.709002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:21.709870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:21.712494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:21.713343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:21.784288 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a52e84c-04d0-4818-90ae-5bf2f895d1e1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.105997 Nov 20 21:07:21.786182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2865/5637] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:21 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:22.168459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:22.169674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:22.179306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:22.180120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:22.181439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:22.182292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:22.516801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:22.548533 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ae987d5-c72d-4b1f-98a3-ecda42d1f447 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.384737 Nov 20 21:07:22.553936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2773/5638] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:22 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:22.802304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:22.803933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:22.827535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:22.827997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:22.828824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:22.829268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:22.903405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-518e3129-8391-4892-88af-37bd2ece9454 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.108924 Nov 20 21:07:22.904241 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2866/5639] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:23.570247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:23.571133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:23.589036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:23.589501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:23.590345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:23.590951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:23.744713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:23.752798 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f0cc905-495a-4245-9232-856e0fbc1eef tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.187909 Nov 20 21:07:23.754634 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2774/5640] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:23 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:23.916398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0134ffca-d829-4c64-be08-255830daddf8 req-e71eb5cb-ec9f-4360-ab74-717adaefe264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be8e160-dc20-49a4-a5d7-0c9efb0dfe29", "name": "network-vif-plugged", "status": "completed", "tag": "ec80320f-e59f-4690-a3d9-c1ad5f142f34"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:23.921532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:23.923749 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:23.923749 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:07:23.924559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:23.939918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0134ffca-d829-4c64-be08-255830daddf8 req-e71eb5cb-ec9f-4360-ab74-717adaefe264 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:23.940272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0134ffca-d829-4c64-be08-255830daddf8 req-e71eb5cb-ec9f-4360-ab74-717adaefe264 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:23.946842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:23.947576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:23.948605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:23.949306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:23.955911 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0134ffca-d829-4c64-be08-255830daddf8 req-e71eb5cb-ec9f-4360-ab74-717adaefe264 service nova] Creating event network-vif-plugged:ec80320f-e59f-4690-a3d9-c1ad5f142f34 for instance 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 on nch1-master-1 Nov 20 21:07:23.962427 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0134ffca-d829-4c64-be08-255830daddf8 req-e71eb5cb-ec9f-4360-ab74-717adaefe264 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049188 Nov 20 21:07:23.964183 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2775/5641] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:23.999298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7e3c2d9-022b-48b7-bce8-7d3686425ecd tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.080168 Nov 20 21:07:24.004291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2867/5642] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:23 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:24.806941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:24.809100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:24.816163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:24.816914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:24.817785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:24.825235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:25.013518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:25.014954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:25.028362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:25.028845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:25.029678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:25.030142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:25.100091 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e191a9f-0e9c-49e0-98e1-021bad57b08c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.091170 Nov 20 21:07:25.102733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2868/5643] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:25 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:25.151135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:25.167930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e032f2fc-7bed-42c6-9b92-a895154d40cc tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1317 microversion: 2.1 time: 0.391915 Nov 20 21:07:25.168935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2776/5644] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:24 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:26.115263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:26.116694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.124254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.124952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.126879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.127494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.172286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e612b6f-f6c2-41de-b479-b6e11c443436 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062275 Nov 20 21:07:26.172982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2869/5645] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:26 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:26.187225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.188442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.198580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.199284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.200207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.201111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.353465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:26.365099 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b79969c-4549-4aaf-a644-ad2725895564 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1507 microversion: 2.1 time: 0.182206 Nov 20 21:07:26.365692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2777/5646] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:26 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:26.383343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.384338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.393601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.396296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.397106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.397544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.424115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d7e6e42-1652-4217-a5c2-d4f03c175b01 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips" status: 200 len: 110 microversion: 2.1 time: 0.045655 Nov 20 21:07:26.424709 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2870/5647] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:07:26 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips => generated 110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:07:26.435846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.436560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.444048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.444517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.445328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.445774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.471335 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef5f9e37-4924-4781-bba3-8f1b7668503b tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips" status: 200 len: 110 microversion: 2.1 time: 0.039119 Nov 20 21:07:26.472370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2778/5648] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:07:26 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:26.481917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.482989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.489914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.490606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.491581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.492168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.528763 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b24d2faf-2e1b-48b9-9d7e-733d7cfee3fe tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips/tempest-ServerAddressesTestJSON-1225219149-network" status: 200 len: 95 microversion: 2.1 time: 0.050440 Nov 20 21:07:26.529375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2871/5649] 10.222.0.41 () {58 vars in 1400 bytes} [Sat Nov 20 21:07:26 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29/ips/tempest-ServerAddressesTestJSON-1225219149-network => generated 95 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:07:26.540509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.541128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.547909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.548367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.549159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.549596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.577791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:07:26.683630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f12584df-71a8-4fd5-8212-afc8b420dd04 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 204 len: 0 microversion: 2.1 time: 0.146706 Nov 20 21:07:26.684633 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2779/5650] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:07:26 2021] DELETE /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:07:26.694103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:26.695582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:26.711057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.711529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.712403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:26.713023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:26.978741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:26.986291 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d9447108-299c-4665-bd79-e30ddec48c97 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1513 microversion: 2.1 time: 0.296361 Nov 20 21:07:26.987201 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2872/5651] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:26 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:07:27.185267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:27.186312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:27.193797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:27.194509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:27.195169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:27.195608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:27.244658 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5944c13d-de58-4714-881f-60703e94849e tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.063228 Nov 20 21:07:27.246269 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2780/5652] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:27 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:28.004914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:28.005451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:28.014157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:28.014615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:28.015411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:28.015849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:28.223089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:28.235585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6b0c19c1-2716-4017-b3c4-4fa7f318f8eb tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1513 microversion: 2.1 time: 0.235169 Nov 20 21:07:28.248686 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2873/5653] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:27 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1513 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:28.264682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:28.265698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:28.274149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:28.278585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:28.280352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:28.281043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:28.335804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63f81899-7f98-4ff6-9d81-2f633914ae03 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.075159 Nov 20 21:07:28.337069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2781/5654] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:28.917217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f4b45552-4c8d-4530-8a76-bf544b0d834e req-111a3cad-9627-4200-a638-2364efbb1ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be8e160-dc20-49a4-a5d7-0c9efb0dfe29", "name": "network-vif-deleted", "tag": "ec80320f-e59f-4690-a3d9-c1ad5f142f34"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:28.919307 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:28.919307 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:07:28.935830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4b45552-4c8d-4530-8a76-bf544b0d834e req-111a3cad-9627-4200-a638-2364efbb1ada service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:28.936562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4b45552-4c8d-4530-8a76-bf544b0d834e req-111a3cad-9627-4200-a638-2364efbb1ada service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:28.949398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f4b45552-4c8d-4530-8a76-bf544b0d834e req-111a3cad-9627-4200-a638-2364efbb1ada service nova] Creating event network-vif-deleted:ec80320f-e59f-4690-a3d9-c1ad5f142f34 for instance 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 on nch1-master-1 Nov 20 21:07:28.954661 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f4b45552-4c8d-4530-8a76-bf544b0d834e req-111a3cad-9627-4200-a638-2364efbb1ada service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043680 Nov 20 21:07:28.955410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2874/5655] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:29.266571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:29.267964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:29.282531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:29.283354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:29.284447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:29.285488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:29.350043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:29.351073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:29.361528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:29.365787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:29.366497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:29.366929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:29.367375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lazy-loading 'fault' on Instance uuid 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:07:29.367779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:29.368378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:29.453952 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-023ea77b-7887-4954-87c2-8836639ecd85 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.107113 Nov 20 21:07:29.454522 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2875/5656] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:29.474917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '956af8deb83e498f8ed25d79f1349378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0400d56719ed494ebd32c09923c9b578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:29.482411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2355b9f5-09d9-42cd-bb8b-5f43bc05d35f tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 200 len: 1307 microversion: 2.1 time: 0.230928 Nov 20 21:07:29.483610 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2782/5657] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:29 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:30.467049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:30.468056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:30.479504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:30.480165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:30.482412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:30.483120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:30.499437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:30.500170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] [instance: 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:30.508974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:30.510196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:30.511478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:30.512128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:30.541360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71edc9df-f627-4c63-9aaf-f567751551c8 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.078039 Nov 20 21:07:30.542024 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2876/5658] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:30.555939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] HTTP exception thrown: Instance 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 could not be found. Nov 20 21:07:30.556568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] Returning 404 to user: Instance 0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:07:30.557631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b654618f-3f9c-43ec-b188-c55f611830b8 tempest-ServerAddressesTestJSON-755222255 tempest-ServerAddressesTestJSON-755222255-project] 10.222.0.41 "GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29" status: 404 len: 111 microversion: 2.1 time: 0.061909 Nov 20 21:07:30.578349 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2783/5659] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:07:30 2021] GET /compute/v2.1/servers/0be8e160-dc20-49a4-a5d7-0c9efb0dfe29 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:07:31.555232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:31.566794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:31.587100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:31.587563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:31.588380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:31.594786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:31.673387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28d86ae6-7736-4273-9160-e260bea4c4f7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.123608 Nov 20 21:07:31.674207 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2877/5660] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:32.688490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:32.689558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:32.705891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:32.707539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:32.710312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:32.710962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:32.801071 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d35f0fbd-bade-4f9c-92cd-0faab5d6c602 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.115908 Nov 20 21:07:32.801895 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2784/5661] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:32 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:32.970736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1484172716", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": "none"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:33.032070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:07:33.032491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:07:33.032958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:07:33.033362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:07:33.033771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:07:33.043655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:33.044481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:33.045858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:33.046345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:33.065588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Getting quotas for project 07e3ab1a287341b3a5667a071a1eebc1. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:07:33.071644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Getting quotas for user edd37e58d9984e1b8529c224bd930297 and project 07e3ab1a287341b3a5667a071a1eebc1. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:07:33.084644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:07:33.087124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:07:33.145053 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-554b539d-6c42-4f1c-bcd5-a1f017b354dc tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.345568 Nov 20 21:07:33.146126 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2878/5662] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:07:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 20 21:07:33.156776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:33.157554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:33.266682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:33.301738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:33.305485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:33.310976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6f0cc08-b462-4c18-a260-20e42c79db96 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1278 microversion: 2.57 time: 0.157363 Nov 20 21:07:33.313795 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2785/5663] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:33 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:33.813890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:33.815090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:33.824982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:33.826828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:33.828430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:33.829138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:33.874181 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-46efec6b-f93a-4df5-858f-3e2cfaa76fff tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.064811 Nov 20 21:07:33.874969 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2879/5664] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:33 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:34.338736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:34.340053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:34.349394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:34.350128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:34.351402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:34.352042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:34.487323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:34.494982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:34.497066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:34.500618 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e7df8a7-7109-4635-bd5b-186a9655bd0a tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1348 microversion: 2.57 time: 0.170591 Nov 20 21:07:34.502158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2786/5665] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:34 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1348 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:34.890366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:34.892185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:34.902450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:34.903144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:34.904663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:34.905393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:34.963387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c2fd3d6-e5d6-4293-a97a-64729a8ed374 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.079941 Nov 20 21:07:34.967532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2880/5666] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:34 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:35.532880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:35.534339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:35.568693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:35.569551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:35.570482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:35.571123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:35.673804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:35.685391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:35.687610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:35.689009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98aa45a7-b90b-4404-9cfe-0222f4f7ad56 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1336 microversion: 2.57 time: 0.167309 Nov 20 21:07:35.690114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2787/5667] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:35 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:35.976258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:35.977577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:35.985555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:35.986006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:35.986812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:35.987662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:36.037589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f620c8b5-ca12-47c4-af53-0d4244895ed7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.065625 Nov 20 21:07:36.042001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2881/5668] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:35 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:36.708566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:36.709155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:36.716226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:36.716674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:36.717466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:36.717902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:36.805898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:36.814001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:36.815732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:36.816776 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2bf22ff3-75b9-4f4c-b0a4-7ac0ec8865b2 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1357 microversion: 2.57 time: 0.112310 Nov 20 21:07:36.817538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2788/5669] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:36 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:36.835907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:36.837510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:36.844505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:36.844954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:36.845745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:36.846217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:36.937969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:07:36.938420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:07:36.938889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:07:36.939290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:07:36.939696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:07:37.024858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:37.041820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.045202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.047770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.050372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.052179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:37.053588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:37.061368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.062201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.063248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.064180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.161583 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-933c63ee-26c1-4a1e-90ad-309e010dcb33 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "POST /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858/action" status: 202 len: 1138 microversion: 2.57 time: 0.326481 Nov 20 21:07:37.163212 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2882/5670] 10.222.0.41 () {62 vars in 1319 bytes} [Sat Nov 20 21:07:36 2021] POST /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858/action => generated 1138 bytes in 332 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 20 21:07:37.179947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:37.181814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:37.189168 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9bce6cab-00dc-4194-a6fe-1c99bdc199d7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.136088 Nov 20 21:07:37.190557 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2789/5671] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:37 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:37.191385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.192040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.192912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:37.193356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:37.310787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:37.320124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:37.321772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:37.323277 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dce4a25d-ea30-4ae7-a281-c0f813d1e73e tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.147790 Nov 20 21:07:37.323942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2883/5672] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:37 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:38.202818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:38.204004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:38.214830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:38.215644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:38.216687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:38.217282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:38.266797 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd69a9f1-9d15-4ff2-95fc-31d74fd8a078 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.068141 Nov 20 21:07:38.272245 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2790/5673] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:38 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:38.342233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:38.342846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:38.350300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:38.351148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:38.352283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:38.352955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:38.430524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:38.441712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:38.443534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:38.444773 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24c173f0-0edc-46ec-bd76-2e7dca6346a0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.106646 Nov 20 21:07:38.445341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2884/5674] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:38 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:39.280270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:39.281192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:39.288805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:39.289257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:39.290069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:39.290516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:39.336342 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c582e472-e656-4ae8-a651-4548aa24c6c4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.060120 Nov 20 21:07:39.337936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2791/5675] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:39 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:39.464618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:39.465226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:39.473617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:39.474073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:39.474955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:39.475392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:39.560272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:39.571508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:39.573512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:39.575080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aeb467ac-077e-42be-bbcf-038c6fa6abad tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.114370 Nov 20 21:07:39.586653 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2885/5676] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:39 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:40.349637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:40.350852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:40.358275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:40.359048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:40.359915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:40.360524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:40.407291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-890723fb-1327-4f7c-89f9-9d7fc0500989 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.062083 Nov 20 21:07:40.408246 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2792/5677] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:40 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:40.593522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:40.594382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:40.602527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:40.603609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:40.604472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:40.604969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:40.701064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:40.716427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:40.718740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:40.720167 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50458385-f1b7-4479-ba4a-4e23b61cc6b0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.130381 Nov 20 21:07:40.721280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2886/5678] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:40 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:41.421761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:41.422817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:41.430749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:41.431236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:41.432202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:41.432647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:41.480009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b08a193a-5283-4688-bcd1-45695e57d409 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.063263 Nov 20 21:07:41.480680 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2793/5679] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:41 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:41.741425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:41.742076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:41.749021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:41.749479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:41.750327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:41.750772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:41.828231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:41.838644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:41.840275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:41.841745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad225874-3878-4ce6-958e-f7651f5d2c13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.105068 Nov 20 21:07:41.853873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2887/5680] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:41 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:42.493724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:42.494884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:42.502118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:42.503379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:42.504596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:42.505469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:42.579275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ddbae2c-60bf-4ad1-91fa-83b4aca0bb78 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.089436 Nov 20 21:07:42.580117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2794/5681] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:42 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:42.860679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:42.861898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:42.869473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:42.870164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:42.870966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:42.871405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:42.937911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:42.947502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:42.948997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:42.950260 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-266e29e3-3738-4f50-9fd4-41894483dd06 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.093256 Nov 20 21:07:42.950823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2888/5682] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:42 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:43.598386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:43.599422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:43.617966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:43.619906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:43.624925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:43.625422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:43.681749 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50db4894-9f4c-48cb-9749-7cd0acb382dc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093075 Nov 20 21:07:43.686096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2795/5683] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:43 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:43.970006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:43.970651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:43.978188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:43.979004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:43.979925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:43.980367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:44.059468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:44.073170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:44.078167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:44.084665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa4425ae-630e-487e-888c-748c85bf1682 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.119398 Nov 20 21:07:44.085311 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2889/5684] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:43 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:44.696199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:44.697599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:44.713726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:44.714574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:44.715735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:44.716252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:44.778251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-974a4b2c-708b-4e30-a1a0-b1992f492bf5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.087777 Nov 20 21:07:44.779219 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2796/5685] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:44 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:45.104194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:45.105520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:45.111554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:45.112333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:45.113657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:45.114129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:45.229950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:45.240068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:45.242469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:45.244006 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-05d5cdfe-365c-47e8-ac5a-8f9f4ce72e13 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.143891 Nov 20 21:07:45.244741 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2890/5686] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:45 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:45.792272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:45.793887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:45.807878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:45.809138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:45.810218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:45.811290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:45.863103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5870dd86-af45-4704-8208-2936c6c6f347 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.074599 Nov 20 21:07:45.864480 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2797/5687] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:45 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:46.264921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:46.266468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:46.276921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:46.277945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:46.279794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:46.281032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:46.387841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:46.397328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:46.398989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:46.400159 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-799c0917-55b7-40d0-b488-2c6ecf189193 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.139043 Nov 20 21:07:46.401320 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2891/5688] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:46 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:46.877005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:46.878611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:46.888015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:46.888702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:46.889822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:46.890459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:46.942824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cdfc0ca-d21a-4dc2-b2c8-294242f2602c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.069606 Nov 20 21:07:46.943512 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2798/5689] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:46 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:47.422899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:47.424077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:47.431764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:47.432573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:47.433610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:47.434281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:47.516527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:47.525636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:47.527779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:47.530777 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb4416c3-cf2b-4392-a8c5-b37f432f176d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.115110 Nov 20 21:07:47.531844 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2892/5690] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:47 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:47.954908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:47.957285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:47.964708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:47.965495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:47.966574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:47.967229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:48.019596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fec9a194-81b3-4fe4-b166-61079048b90b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.067457 Nov 20 21:07:48.020818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2799/5691] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:47 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:48.549845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:48.551114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:48.557716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:48.558463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:48.559587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:48.560351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:48.669787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:48.682082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:48.684301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:48.685726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9af9867f-5c70-40ac-b5f4-a1996b65a31d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.140462 Nov 20 21:07:48.698519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2893/5692] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:48 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:49.032362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:49.034100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:49.041626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:49.042383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:49.043363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:49.043801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:49.092455 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41c6aff3-8f53-43da-b9aa-6b5a2fd28313 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.063944 Nov 20 21:07:49.093452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2800/5693] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:49 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:49.705012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:49.705654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:49.712879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:49.713335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:49.714168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:49.714606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:49.780738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:49.797124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:49.798761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:49.800706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3664fb6-20c9-4a1d-b123-6de79a026179 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.099494 Nov 20 21:07:49.801574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2894/5694] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:49 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:50.106994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:50.109044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:50.119875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:50.120874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:50.122093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:50.123710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:50.177836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e39cd7cc-85aa-4960-b093-e746e0c3c5af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.076303 Nov 20 21:07:50.182310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2801/5695] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:50 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:50.819085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:50.819698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:50.829232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:50.829691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:50.837657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:50.838268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:50.933315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:50.942966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:50.944544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:50.945769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a790432-4820-46de-a424-276253cade50 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.130759 Nov 20 21:07:50.946553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2895/5696] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:50 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:51.100321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:51.105487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:51.116792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.117303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.118887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.119384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.164444 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb623cc7-ba9d-4df5-b794-0ef1eb6613b6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments/aba81b62-e009-44af-8093-0e9eed95f96c" status: 200 len: 194 microversion: 2.20 time: 0.069714 Nov 20 21:07:51.165233 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2802/5697] 10.222.0.41 () {60 vars in 1453 bytes} [Sat Nov 20 21:07:51 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments/aba81b62-e009-44af-8093-0e9eed95f96c => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:07:51.188758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:51.189591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:51.200134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.201195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.202359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.203690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.248222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:51.248871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:51.256341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.256795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.257605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.258031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.260095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ae738a27-a05a-4f7c-b387-60d0ed684fd3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.074961 Nov 20 21:07:51.261497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2896/5698] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:51 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:07:51.362759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lazy-loading 'services' on Instance uuid 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:07:51.445733 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2caa4b19-e551-47f7-8496-792e03f6ddde tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments/aba81b62-e009-44af-8093-0e9eed95f96c" status: 202 len: 0 microversion: 2.20 time: 0.201395 Nov 20 21:07:51.446684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2803/5699] 10.222.0.41 () {60 vars in 1456 bytes} [Sat Nov 20 21:07:51 2021] DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments/aba81b62-e009-44af-8093-0e9eed95f96c => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:07:51.456624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:51.460007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:51.476284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.477095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.478132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.478741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.556228 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c35b9e1-b2b4-4357-b990-b73b26f08650 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105141 Nov 20 21:07:51.560895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2897/5700] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 21:07:51 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:07:51.966071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:51.967143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:51.975058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.975541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:51.976859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:51.977312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:52.069923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:52.079620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:52.083151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:52.088916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b1e2e94-c88d-4fff-b9f8-211f17ba274d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.127540 Nov 20 21:07:52.090813 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2804/5701] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:51 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:52.272538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:52.273564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:52.280233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:52.280777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:52.281640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:52.282248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:52.324957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a86f7e87-2f8a-4345-bdde-567ab50f6fa6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.056015 Nov 20 21:07:52.326527 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2898/5702] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:52 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:52.571791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:52.572979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:52.585670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:52.588611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:52.590969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:52.591652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:52.693236 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60b346ac-3385-4891-af1d-0c6b7443ae9f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128451 Nov 20 21:07:52.693833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2805/5703] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 21:07:52 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:07:53.111058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:53.112289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:53.120751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.121485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.122351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.122784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.235716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:53.244329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:53.249914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:53.251598 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-28fc1a6b-8396-4f4e-8027-868be39f1baa tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.145803 Nov 20 21:07:53.252180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2899/5704] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:53 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:53.337158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:53.340036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:53.349634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.350125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.350944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.351385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.413683 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8ae287b5-18db-43d5-ad0a-a974f11b0738 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.079788 Nov 20 21:07:53.415410 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2806/5705] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:53 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:53.704867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:53.705868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:53.712991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.713585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.714465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.714966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.755886 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d203e4f-a6c5-4b6b-85f3-ad00ce8b46ef tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054790 Nov 20 21:07:53.756482 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2900/5706] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 21:07:53 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:07:53.829807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:53.830806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:53.841051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.841602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.842427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:53.843041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:53.880802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:07:53.993600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b55cc743-2d66-4e56-aa84-a8aed927a81b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 204 len: 0 microversion: 2.20 time: 0.168589 Nov 20 21:07:53.998321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2807/5707] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 21:07:53 2021] DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:07:54.002711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:54.003585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:54.010345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.010798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.011581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.012193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.172925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.183337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.185438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.186660 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a14e67e-5956-47e0-86fd-a420422c13d4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.187994 Nov 20 21:07:54.187407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2901/5708] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:53 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:54.273061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:54.273762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:54.280288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.280751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.281605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.282083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.351415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.359570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.361097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:54.362858 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-898f0e47-04e5-4b9b-9efe-09e16b369a66 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.093699 Nov 20 21:07:54.363845 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2808/5709] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:54 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:54.427054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:54.428069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:54.434805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.435259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.436050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:54.436490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:54.494443 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d86bd90c-ed4b-4af2-9835-f2e2acf5b9af tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.071280 Nov 20 21:07:54.499337 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2902/5710] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:54 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:55.210076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:55.211444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:55.220295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.220792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.222300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.222879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.381974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:55.382637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:55.397658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.398326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.398975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.399509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.400179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.416994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.419931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.421390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32598a27-7ceb-4f07-b042-ebc72fad9767 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1723 microversion: 2.20 time: 0.217633 Nov 20 21:07:55.422639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2809/5711] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:55 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:55.508560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:55.509965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:55.516165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.529575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.531683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:55.532903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.533637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.536101 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec11f213-b2b7-4c15-b4ec-4b55c02c5882 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.158854 Nov 20 21:07:55.536431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:55.537364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:55.540211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2903/5712] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:55 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:07:55.585298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14974971-28f2-4c35-9bb3-acf7d1e0a5d3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.081578 Nov 20 21:07:55.590652 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2810/5713] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:55 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:56.440617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:56.451900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:56.469491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.470218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.471818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.472360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.561990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:56.563314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:56.588077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.588797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.589785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.590482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.709546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.717134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.719330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.722308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.723693 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-201f09f0-4f03-4cae-a126-3613c26a4f88 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.168617 Nov 20 21:07:56.740960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.740960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:56.740960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1702df43-f089-4931-8daf-2aeb72707434 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 200 len: 1656 microversion: 2.20 time: 0.297091 Nov 20 21:07:56.742533 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2811/5714] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:56 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:56.746854 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2904/5715] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:56 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 1656 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:56.750537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:56.753936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:56.768776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.769534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.770510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:56.771362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:56.846685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ba3f788-f8ac-48b5-92cb-d34d545e1fb1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.101650 Nov 20 21:07:56.848144 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2812/5716] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:56 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:57.192139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-af568e89-1499-443c-a98a-92ea86036777 req-e375f0c7-d1ef-4647-a37a-deaa9fcbf81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e1e4483-b5f5-47d3-b58f-1fdaaefd311c", "name": "network-vif-deleted", "tag": "d827fb61-04e5-4891-8bee-97e47804c603"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:57.194791 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:07:57.194791 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:07:57.206285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-af568e89-1499-443c-a98a-92ea86036777 req-e375f0c7-d1ef-4647-a37a-deaa9fcbf81e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.207129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-af568e89-1499-443c-a98a-92ea86036777 req-e375f0c7-d1ef-4647-a37a-deaa9fcbf81e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.247769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-af568e89-1499-443c-a98a-92ea86036777 req-e375f0c7-d1ef-4647-a37a-deaa9fcbf81e service nova] Creating event network-vif-deleted:d827fb61-04e5-4891-8bee-97e47804c603 for instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c on nch1-master-1 Nov 20 21:07:57.257833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-af568e89-1499-443c-a98a-92ea86036777 req-e375f0c7-d1ef-4647-a37a-deaa9fcbf81e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070387 Nov 20 21:07:57.261681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2905/5717] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:07:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:07:57.748872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:57.749565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:57.755639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:57.756336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:57.765277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.765727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.766564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.767001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.772114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.772576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.773387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.773828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.815504 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. Nov 20 21:07:57.816422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:07:57.817324 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b6d23b5-7a81-4d48-9ab2-72b22d97e3f6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 404 len: 111 microversion: 2.20 time: 0.068470 Nov 20 21:07:57.818353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2906/5718] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:57 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:07:57.826401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a49ad91d-ea4f-4976-9648-4c3184689770 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '.version_select at 0x7f3f864c2430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:57.851725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a49ad91d-ea4f-4976-9648-4c3184689770 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281131937" status: 204 len: 0 microversion: 2.20 time: 0.028500 Nov 20 21:07:57.853370 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2907/5719] 10.222.0.41 () {60 vars in 1258 bytes} [Sat Nov 20 21:07:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281131937 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:07:57.864683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:57.866004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:57.866735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:57.873986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.874578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:57.875021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.876009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:57.876131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:57.876720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:57.877273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c9a4a19-a590-4b50-b985-b1e352816b4b tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.132389 Nov 20 21:07:57.886400 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2813/5720] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:57 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:57.934525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b86ab62-1a56-4dc9-acfb-bc389a5476d9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.075956 Nov 20 21:07:57.942290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2908/5721] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:57 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:58.885680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: .version_select at 0x7f3f85d65f70>, body: {"keypair": {"name": "tempest-keypair-254082720"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:58.899921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:07:58.907958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:58.917682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:07:58.920233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:58.920942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:58.922212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:58.922972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:58.933234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:07:59.037487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:59.047004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:59.048691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:07:59.050968 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6077d61-c379-44c2-ab4f-2150f0cc0fe7 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.154870 Nov 20 21:07:59.066895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2909/5722] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:07:58 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:07:59.071953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:07:59.073721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:07:59.082420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:59.083209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:59.084820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:07:59.085784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:07:59.138081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b1d7f11-ead9-443c-9400-eaf54b7ba1b7 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.069537 Nov 20 21:07:59.142897 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2910/5723] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:07:59 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:07:59.235634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:07:59.243543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:07:59.260704 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9b0c5c1-510e-492c-97ee-659cae5d4acf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.379433 Nov 20 21:07:59.261756 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2814/5724] 10.222.0.41 () {62 vars in 1198 bytes} [Sat Nov 20 21:07:58 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 381 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:08:00.071832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:00.072948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:00.085367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:00.085820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:00.091581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:00.092082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:00.151470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:00.152443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:00.161047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:00.161826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:00.162871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:00.163507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:00.192567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:00.203982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:00.205599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:00.213684 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3aef6670-e0d5-439d-b0bb-7d23b287fe17 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.145131 Nov 20 21:08:00.217845 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2911/5725] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:00 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:00.241383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c19665f5-882a-4010-89cb-f82bb87876ee tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.093895 Nov 20 21:08:00.245624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2815/5726] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:00 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:01.232869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:01.233568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:01.255172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:01.257028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:01.262846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:01.263356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:01.264224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:01.264668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:01.274370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:01.274819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:01.275634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:01.290167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:01.375734 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-044b3874-b6fa-4eb7-8d11-05e39da37764 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.126262 Nov 20 21:08:01.377409 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2816/5727] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:01 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:01.383721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-780228294", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b0462fe-9d19-4cda-815b-86a91b87f9c7"}], "security_groups": [{"name": "tempest-securitygroup--63237440"}], "key_name": "tempest-keypair-254082720", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:01.410825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:01.422741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:01.427624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:01.429575 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61291ca7-2f47-4cef-9724-3662351d728f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.200530 Nov 20 21:08:01.430433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2912/5728] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:01 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:01.656833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] validate_networks() for [('2b0462fe-9d19-4cda-815b-86a91b87f9c7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:08:02.395651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:02.398476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:02.414143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.415201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.417262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.418765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.436632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:08:02.437144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:08:02.437724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:08:02.440350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:08:02.440877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:08:02.456706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.457586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.458735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.459477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.479042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for project 185bc78201f1431881a86d4894780efb. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:08:02.479560 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7db60e2-ae37-4bb3-bc24-6250d5797a21 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.091561 Nov 20 21:08:02.480237 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2913/5729] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:02 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:02.487212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Getting quotas for user 0d10d9e45a7644f2a580fc0d28668661 and project 185bc78201f1431881a86d4894780efb. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:08:02.489324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:02.490027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:02.501366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:08:02.504737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:08:02.505677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.524032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.525296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:02.525895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:02.587910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dde958c9-d72f-4483-9f53-5d6282e8cebb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.208914 Nov 20 21:08:02.589379 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2817/5730] 10.222.0.41 () {62 vars in 1187 bytes} [Sat Nov 20 21:08:01 2021] POST /compute/v2.1/servers => generated 400 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 20 21:08:02.624922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:02.626815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:02.662428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.671986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.682460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.683926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95def203-d208-4e98-84c7-ebcd69650f44 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.202616 Nov 20 21:08:02.687059 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2914/5731] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:02 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:02.763682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.774032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.775583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:02.776687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0079a742-bf79-4e74-9168-d74082d8d636 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1280 microversion: 2.20 time: 0.177302 Nov 20 21:08:02.777241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2818/5732] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:02 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:03.496233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:03.498397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:03.514359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.515112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.516013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.516468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.571319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce84ecae-71f4-4e9b-9428-d33d00233e8d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.082232 Nov 20 21:08:03.572724 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2915/5733] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:03 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:03.707431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:03.708106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:03.719246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.720064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.721317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.722370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.796988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:03.798274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:03.817675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.831182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.832052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:03.832173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.832496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:03.844333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.847909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.849144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a4614e2-03e0-4859-b4d8-bc39caa53141 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.148184 Nov 20 21:08:03.850826 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2819/5734] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:03 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:03.933874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.950994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.953239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:03.957235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfc45344-30ed-4ef5-b601-2ddc85192e8a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1332 microversion: 2.20 time: 0.164165 Nov 20 21:08:03.958820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2916/5735] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:03 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:08:04.584694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:04.586277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:04.594650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.595282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:04.597094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.597747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:04.666432 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed98104a-a35f-4cd1-ac9a-6a774b4488c9 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.085921 Nov 20 21:08:04.668032 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2820/5736] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:04 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:04.878929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:04.879549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:04.916075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.920067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:04.925399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.928948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:04.977883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:04.979864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:04.995116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.995582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:04.997210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:04.997664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:05.122128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.136970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.139180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.141561 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c40fc50e-c725-48be-8cab-750143907e38 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.277026 Nov 20 21:08:05.143107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2917/5737] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:04 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:05.203481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.213232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.215342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:05.216746 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c7ee55d4-6f07-4b52-bf61-6069f3711cd0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1338 microversion: 2.20 time: 0.243688 Nov 20 21:08:05.219032 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2821/5738] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:04 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1338 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:05.679584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:05.680558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:05.690152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:05.696097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:05.697419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:05.698643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:05.774693 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ead9ece9-0516-4be6-90bb-6b600791c6d6 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.098753 Nov 20 21:08:05.779986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2918/5739] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:05 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:06.162559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:06.163162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:06.172008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.176295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.178321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.181684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.241131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:06.242383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:06.261000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.264127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.265198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.265818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.315303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.323586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.325187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.331868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-22de6da2-a08d-4c52-bfbd-7a4e03421b7d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.167870 Nov 20 21:08:06.333651 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2822/5740] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:06 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:06.794228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:06.794228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:06.800973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.802018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.803147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:06.803686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:06.868448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a01867df-36aa-4f5d-be96-4b23d7ee2e1c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.082689 Nov 20 21:08:06.869107 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2823/5741] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:06 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:06.956695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.965511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.967042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:06.968368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1acff343-4480-4b4f-b69e-5028a0ab74ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.733438 Nov 20 21:08:06.969084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2919/5742] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:06 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:07.353352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:07.354696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:07.378393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.379201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.385248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.385939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.484850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:07.493833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:07.495364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:07.496554 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44615d1a-9178-4f6f-be66-9d749e8dc266 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.147736 Nov 20 21:08:07.502413 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2824/5743] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:07 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:07.589077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ced3cac3-6fb2-41ca-a3db-e0bdcfee3141 req-e222ce93-0b7e-4b99-85a3-5d7ab3b4e93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:07.592561 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:07.592561 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:07.603575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ced3cac3-6fb2-41ca-a3db-e0bdcfee3141 req-e222ce93-0b7e-4b99-85a3-5d7ab3b4e93b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.604264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ced3cac3-6fb2-41ca-a3db-e0bdcfee3141 req-e222ce93-0b7e-4b99-85a3-5d7ab3b4e93b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.617961 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ced3cac3-6fb2-41ca-a3db-e0bdcfee3141 req-e222ce93-0b7e-4b99-85a3-5d7ab3b4e93b service nova] Creating event network-changed:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch2-master-1 Nov 20 21:08:07.624988 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ced3cac3-6fb2-41ca-a3db-e0bdcfee3141 req-e222ce93-0b7e-4b99-85a3-5d7ab3b4e93b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044051 Nov 20 21:08:07.626364 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2920/5744] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:08:07.881865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:07.883407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:07.890444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.891300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.892104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.892695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.935915 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99df1322-87b4-4d38-89b5-d419f7e7a3b1 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.058745 Nov 20 21:08:07.936642 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2825/5745] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:07 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:07.988872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:07.989931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:07.997148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.997781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:07.998705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:07.999235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:08.153875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.167885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.169634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.173463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fae5ee0-b90e-481d-941f-b83ecc60e824 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.190039 Nov 20 21:08:08.174823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2921/5746] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:07 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:08.516094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:08.516937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:08.529535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:08.530322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:08.531356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:08.531957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:08.660472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.671814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.675103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:08.679338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be07d861-70d0-41b7-a5db-e27f6f575c02 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1366 microversion: 2.57 time: 0.167430 Nov 20 21:08:08.697740 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2826/5747] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:08 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:08.948738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:08.950318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:08.958587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:08.959389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:08.960390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:08.961026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:09.036487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f32f94a0-7d02-42f9-aceb-aecb57ca29b5 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.088870 Nov 20 21:08:09.039833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2922/5748] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:08 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:09.192746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:09.193364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:09.201550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:09.202315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:09.203468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:09.204105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:09.368824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.377071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.379503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.381139 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e202aba-7f71-4a85-bafa-ff1902175baa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.192803 Nov 20 21:08:09.382313 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2827/5749] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:09 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:09.712424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:09.714806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:09.723638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:09.724825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:09.726175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:09.727249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:09.831241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.847751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.849773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:09.851377 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8c32f1f-0516-47b0-b2eb-3bc2ed5c5748 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1372 microversion: 2.57 time: 0.150246 Nov 20 21:08:09.852506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2923/5750] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:09 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:08:10.050956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:10.052071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:10.061811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.062345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.063531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.063981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.130025 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-401e4f85-2103-4b29-9bda-f3666f345b5a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.083395 Nov 20 21:08:10.133293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2828/5751] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:10 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:10.399620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:10.400263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:10.407663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.408196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.409741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.410205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.576325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.589693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.591646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.593133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91c789ba-c60d-4608-a834-b4489dcf8192 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.197233 Nov 20 21:08:10.594104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2924/5752] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:10 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:10.871755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:10.872556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:10.883279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.883974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.885041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:10.885587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:10.962106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.972475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.974253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:10.975570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a32fa97-95bf-426a-bf37-f65b4447257c tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1357 microversion: 2.57 time: 0.107894 Nov 20 21:08:10.976137 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2829/5753] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:10 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:10.997970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:10.998502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:11.005573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.006020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.006828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.007261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.033944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:08:11.130282 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3148c49e-19e4-435c-ac57-273cd89aa07f tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 204 len: 0 microversion: 2.1 time: 0.135511 Nov 20 21:08:11.131555 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2925/5754] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:08:10 2021] DELETE /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:08:11.140400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:11.141015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:11.152725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.153358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:11.153770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.154403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:11.155001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.155667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.161820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.162302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.164500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.164946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.218351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8c68c2b-0b9e-47f8-a285-e117c7e6f00d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.070776 Nov 20 21:08:11.228922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2926/5755] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:11 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:11.243915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:11.252196 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a617eb57-8050-4012-aa9b-0a832cc1d9c0 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1297 microversion: 2.1 time: 0.114884 Nov 20 21:08:11.252545 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2830/5756] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:11 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:11.612341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:11.613306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:11.630761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.632586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.635491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:11.636278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:11.910622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:11.923082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:11.928462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:11.929909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61855ddc-e213-43ba-a758-2e847a687c4a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.322439 Nov 20 21:08:11.930757 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2927/5757] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:11 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:12.232837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:12.234017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:12.246294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.247224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:12.248160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.248718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:12.270671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:12.272188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:12.281949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.285776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:12.287242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.288041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:12.318297 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ce3f371-0d38-4dca-9497-924690317e33 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.090328 Nov 20 21:08:12.324985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2831/5758] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:12 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:12.378258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd37e58d9984e1b8529c224bd930297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07e3ab1a287341b3a5667a071a1eebc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:12.393721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d389b1a6-06f8-4e96-bbac-2cd40695cc5d tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 200 len: 1297 microversion: 2.1 time: 0.128780 Nov 20 21:08:12.394652 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2928/5759] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:12 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:12.949141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:12.949844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:12.957562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.958018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:12.959015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:12.959453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.152863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:13.161753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:13.164605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:13.166095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-990d0e3b-b784-497e-9f0f-57c1adc83f6b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.221052 Nov 20 21:08:13.166757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2832/5760] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:12 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:13.332885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:13.335661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:13.343285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:13.344066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.345091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:13.345770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.394318 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe392cd2-76dc-4b9d-8eaa-f06c4ba90d79 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.066218 Nov 20 21:08:13.395643 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2929/5761] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:13 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:13.412249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:13.412931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] [instance: a89e1004-0524-4a95-8505-27d92f982858] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:13.421142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:13.421686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.422570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:13.423025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.441235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] HTTP exception thrown: Instance a89e1004-0524-4a95-8505-27d92f982858 could not be found. Nov 20 21:08:13.441856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] Returning 404 to user: Instance a89e1004-0524-4a95-8505-27d92f982858 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:08:13.442794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af7adcd6-2a47-457b-a1a7-49448515ba11 tempest-ServerShowV257Test-1459575142 tempest-ServerShowV257Test-1459575142-project] 10.222.0.41 "GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858" status: 404 len: 111 microversion: 2.1 time: 0.036559 Nov 20 21:08:13.446355 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2833/5762] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:13 2021] GET /compute/v2.1/servers/a89e1004-0524-4a95-8505-27d92f982858 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:08:13.624482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fbb34590-dd5f-4241-b93f-b6479da4bd85 req-f934103a-b75e-4e99-8329-9d4b97f7e807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "name": "network-vif-plugged", "status": "completed", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:13.626361 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:13.626361 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:13.644009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fbb34590-dd5f-4241-b93f-b6479da4bd85 req-f934103a-b75e-4e99-8329-9d4b97f7e807 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:13.650314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fbb34590-dd5f-4241-b93f-b6479da4bd85 req-f934103a-b75e-4e99-8329-9d4b97f7e807 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:13.677679 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fbb34590-dd5f-4241-b93f-b6479da4bd85 req-f934103a-b75e-4e99-8329-9d4b97f7e807 service nova] Creating event network-vif-plugged:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch2-master-1 Nov 20 21:08:13.683959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fbb34590-dd5f-4241-b93f-b6479da4bd85 req-f934103a-b75e-4e99-8329-9d4b97f7e807 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063931 Nov 20 21:08:13.684745 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2930/5763] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:14.185566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:14.186519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:14.195535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:14.197069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:14.198216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:14.199218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:14.409869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:14.411713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:14.420094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:14.420682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:14.421574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:14.422201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:14.462323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:14.471924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:14.474137 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f077b205-7c7f-4f4d-9e89-c69c96f50fbc tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.069677 Nov 20 21:08:14.474448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:14.475977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d71e1d3-6c9e-4220-8689-d7bade2feec7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1404 microversion: 2.20 time: 0.294963 Nov 20 21:08:14.487336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2931/5764] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:14 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:14.487742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2834/5765] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:14 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1404 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:15.487114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:15.488129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:15.494707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:15.495507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:15.496124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.496578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:15.497846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.498562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:15.504424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.504424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:15.505337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.506499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:15.566351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8642748c-1660-4d0b-aa7e-bd9eff20f75a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.083159 Nov 20 21:08:15.572017 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2932/5766] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:15 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:15.835203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:15.848358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:15.850078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:15.851319 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f1a23957-dc67-473b-9470-a2a4060498ac tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1596 microversion: 2.20 time: 0.360336 Nov 20 21:08:15.852415 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2835/5767] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:15 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1596 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:08:15.870611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:15.871338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:15.880326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.881127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:15.882262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:15.882754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:16.075432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ecdf7da1-16a3-42d1-baae-c31f7b4d3b08 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.209490 Nov 20 21:08:16.090934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2933/5768] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 21:08:15 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:16.581568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:16.582553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:16.591129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:16.592267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:16.593116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:16.593561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:16.650867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b0ce3fb-a1d9-4b14-9850-e05761e65c1f tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.074624 Nov 20 21:08:16.658463 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2836/5769] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:16 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:17.670692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:17.672326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:17.681336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:17.682010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:17.683325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:17.684187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:17.752557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93ef6ee4-1db1-450f-ad79-d23a11825a26 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.086221 Nov 20 21:08:17.762133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2934/5770] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:17 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:18.194574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:18.202078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:18.217640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:18.218127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:18.219788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:18.220703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:18.312189 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-158391a9-5f10-4da9-a7ff-11ad0c8bc388 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.124003 Nov 20 21:08:18.314898 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2837/5771] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:18 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:18.746858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-96168781-8a17-4980-ba10-d8bc5024003c req-6b4ef0b4-3c17-4533-abfd-e3a49e65f076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:18.748752 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:18.748752 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:18.761201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-96168781-8a17-4980-ba10-d8bc5024003c req-6b4ef0b4-3c17-4533-abfd-e3a49e65f076 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:18.761662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-96168781-8a17-4980-ba10-d8bc5024003c req-6b4ef0b4-3c17-4533-abfd-e3a49e65f076 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:18.769867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:18.771436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:18.780163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-96168781-8a17-4980-ba10-d8bc5024003c req-6b4ef0b4-3c17-4533-abfd-e3a49e65f076 service nova] Creating event network-changed:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch2-master-1 Nov 20 21:08:18.794705 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-96168781-8a17-4980-ba10-d8bc5024003c req-6b4ef0b4-3c17-4533-abfd-e3a49e65f076 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577883 Nov 20 21:08:18.796187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:18.796683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:18.797521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:18.797976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:18.800110 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2935/5772] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:18.868220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99375482-94a1-49e8-9c82-b6df60de1067 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.103076 Nov 20 21:08:18.870982 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2838/5773] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:18 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:19.328907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:19.329957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:19.347856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:19.349140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:19.358031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:19.358793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:19.425216 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2174508-142f-488b-be27-3737aa795528 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.105093 Nov 20 21:08:19.426589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2936/5774] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:19 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:08:19.883266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:19.884426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:19.895512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:19.899500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:19.901223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:19.902224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:19.987821 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aec272bb-7ca3-41f1-9a01-607e279d454a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.106830 Nov 20 21:08:19.989658 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2839/5775] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:19 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:20.437711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:20.439656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:20.454431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:20.456366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:20.464811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:20.478030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:20.580407 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a0b681b-2fb0-4576-995f-2e147f6a0b93 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.146149 Nov 20 21:08:20.581081 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2937/5776] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:20 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:21.006429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:21.009191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:21.025352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:21.026221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:21.028595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:21.030344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:21.102503 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84718661-eea3-4cbe-abe3-ab3ba6b5f804 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.104920 Nov 20 21:08:21.103491 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2840/5777] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:20 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:21.593021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:21.594778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:21.605661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:21.610365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:21.613006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:21.615464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:21.669059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b773d7ee-5224-4eca-a34a-831eb4e25f05 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.080785 Nov 20 21:08:21.675329 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2938/5778] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:21 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:22.119442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:22.121345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:22.133383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:22.135144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:22.136220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:22.137865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:22.203472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ebe5ec0-a42f-4f06-bb53-02fb0de52248 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.090862 Nov 20 21:08:22.204472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2841/5779] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:22 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:22.683146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:22.684184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:22.697653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:22.698126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:22.706802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:22.708373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:22.790956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e972acf-d385-4b38-80a7-ebc0c80aea58 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.111728 Nov 20 21:08:22.792262 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2939/5780] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:22 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:23.215652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:23.216675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:23.224327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:23.224785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:23.225582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:23.226014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:23.803387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:23.807237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:23.821773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:23.822646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:23.823958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:23.824593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:23.861014 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba4e95eb-5d51-4371-b853-ae8c62e59087 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.649291 Nov 20 21:08:23.863901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2842/5781] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:23 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:23.879790 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-535586d7-2ac5-4a52-894b-1c55164add26 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.079545 Nov 20 21:08:23.889590 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2940/5782] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:23 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:08:24.215802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: .version_select at 0x7f3f85dec310>, body: {"keypair": {"name": "tempest-keypair-511437608"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:24.236344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:08:24.242592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:08:24.649298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:08:24.655645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:08:24.676531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1763b2e0-ae0d-4b14-ac6f-a9a213c7fddc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.722363 Nov 20 21:08:24.677632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2843/5783] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:08:23 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:24.877370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:24.883848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:24.893268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:24.894762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:24.903777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:24.904411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:24.905612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:24.906261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:24.912321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:24.914467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:24.916273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:24.916974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:24.965237 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-66bccbc2-fd0e-41c3-9831-e06e53680484 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.077799 Nov 20 21:08:24.965884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2844/5784] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:24 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:08:25.009841 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd69cad0-266b-46c6-bae7-5d8f34640280 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.137091 Nov 20 21:08:25.015215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2941/5785] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:24 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:25.978623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:25.980688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:25.993439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:25.993889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:25.997296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:26.000160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:26.023993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:26.026465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:26.045002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:26.047952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:26.049590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:26.052734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:26.092766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-29a27135-0528-4939-b773-b99331b743f4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.119476 Nov 20 21:08:26.095348 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2845/5786] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:25 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:26.139901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-daff6643-aef2-47ab-98ee-51530df322a0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.120503 Nov 20 21:08:26.140849 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2942/5787] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:26 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:27.106935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:27.109486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:27.120483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:27.121148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:27.122315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:27.122911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:27.156496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:27.158140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:27.167788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:27.168228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:27.179174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:27.179893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:27.181913 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8152db4-4d90-43e7-a637-33f36982d33e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 14 microversion: 2.20 time: 0.079705 Nov 20 21:08:27.183482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2846/5788] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:27 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:27.193600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1133815171", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3a9bbee-3f9c-4365-ad64-26cea020ff3a"}], "security_groups": [{"name": "tempest-securitygroup--1148158458"}], "key_name": "tempest-keypair-511437608", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:27.286825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-251f6e49-6913-4572-add2-405b02258e5c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.137321 Nov 20 21:08:27.287653 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2943/5789] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:27 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:27.431266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] validate_networks() for [('f3a9bbee-3f9c-4365-ad64-26cea020ff3a', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:08:28.194358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:28.196031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:28.210125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.219087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.222536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.223224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.336419 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d1da248e-6ace-491c-a213-ff38f5e8cb8d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 8207 microversion: 2.20 time: 0.147024 Nov 20 21:08:28.340562 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2944/5790] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:28 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 8207 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:08:28.346579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:28.347913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:28.356071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.356782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.357745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.358581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.436293 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9bdd0cc2-5c96-45f1-8d7e-0802ec840a24 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.094146 Nov 20 21:08:28.443532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2945/5791] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:28 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:28.607507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:08:28.608508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:08:28.609482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:08:28.610164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:08:28.611390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:08:28.633211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.635294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.636910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:28.639897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:28.663668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:08:28.672079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:08:28.688899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:08:28.691824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:08:28.760630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a6acfed-a9b1-412b-9641-922fe221fc4a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.575261 Nov 20 21:08:28.761215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2847/5792] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:08:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:08:28.776258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd83160c-108d-457a-bf05-6caeb0645c36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:28.777860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd83160c-108d-457a-bf05-6caeb0645c36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:28.967837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fd83160c-108d-457a-bf05-6caeb0645c36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:28.977495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd83160c-108d-457a-bf05-6caeb0645c36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1237 microversion: 2.1 time: 0.203689 Nov 20 21:08:28.985357 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2946/5793] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:28 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1237 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:29.349593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:29.351168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:29.368930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:29.369672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:29.370599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:29.371046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:29.432579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1dde55fa-1de6-4a6d-94c0-5715b150a129 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 16396 microversion: 2.20 time: 0.089131 Nov 20 21:08:29.437239 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2848/5794] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:29 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 16396 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:29.451389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:29.452500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:29.460892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:29.461594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:29.462618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:29.463221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:29.526246 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89773950-2075-49aa-9cc2-76317aa92966 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.077406 Nov 20 21:08:29.540792 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2947/5795] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:29 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:29.996180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:29.997855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:30.010726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.011538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.012463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.012913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.148269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:30.156206 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f800f562-1cac-436f-8f9c-d7f937722f47 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1297 microversion: 2.1 time: 0.164448 Nov 20 21:08:30.157190 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2849/5796] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:29 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1297 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:30.447856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:30.449845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:30.466997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.468183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.469369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.470184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.526947 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21053645-4c71-4064-9ba0-19af18d3453c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 16396 microversion: 2.20 time: 0.084411 Nov 20 21:08:30.527626 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2948/5797] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:30 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 16396 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:30.540974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:30.542509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:30.551100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.551573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.552389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:30.552838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:30.614553 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b3e0d827-364a-4c72-930c-021a41aafadb tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.078818 Nov 20 21:08:30.620738 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2850/5798] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:30 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:31.175806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:31.176640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:31.194210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.197436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.198508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.205373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.404264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:31.414678 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a90f2308-84a2-4379-b2fa-265a5a39b92f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.244214 Nov 20 21:08:31.415587 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2949/5799] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:31 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:31.539964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:31.541185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:31.549596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.550075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.550887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.551365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.596203 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f98a0108-245b-4ff7-832f-622ad9562149 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 16396 microversion: 2.20 time: 0.060875 Nov 20 21:08:31.597045 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2851/5800] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:31 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 16396 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:31.629534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:31.631326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:31.645958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.646443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.647422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.647882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.705215 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30784e85-9dfc-4a01-a296-f26e16ff0bb4 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action" status: 200 len: 40762 microversion: 2.32 time: 0.080726 Nov 20 21:08:31.707251 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2950/5801] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:31 2021] POST /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/action => generated 40762 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:31.721288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:31.722293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:31.729854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.730627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.731658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:31.732416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:31.994565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0c1cb94d-e20b-442b-9433-273c7f81f11d req-e4158a11-5a89-40ae-9c9a-130dfa082c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01d099b-cd9f-487e-b0ce-4fb5ac9440c0", "tag": "3ae4ae95-4d21-46e0-9882-157821324f20"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:31.996794 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:31.996794 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:32.012808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c1cb94d-e20b-442b-9433-273c7f81f11d req-e4158a11-5a89-40ae-9c9a-130dfa082c40 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.015254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c1cb94d-e20b-442b-9433-273c7f81f11d req-e4158a11-5a89-40ae-9c9a-130dfa082c40 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.037990 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0c1cb94d-e20b-442b-9433-273c7f81f11d req-e4158a11-5a89-40ae-9c9a-130dfa082c40 service nova] Creating event network-changed:3ae4ae95-4d21-46e0-9882-157821324f20 for instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 on nch1-master-1 Nov 20 21:08:32.046116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0c1cb94d-e20b-442b-9433-273c7f81f11d req-e4158a11-5a89-40ae-9c9a-130dfa082c40 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059535 Nov 20 21:08:32.047785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2951/5802] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:32.089716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:32.107062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:32.108598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:32.115205 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9ae39f2-f20f-4120-a65f-cbe1619f43f3 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2951 microversion: 2.32 time: 0.402207 Nov 20 21:08:32.116119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2852/5803] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:08:31 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2951 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:32.152702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:32.153271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:32.172458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.172925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.173824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.176166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.357033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1a0704a-fdec-4741-9c87-4fe053719f12 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.208598 Nov 20 21:08:32.357740 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2952/5804] 10.222.0.41 () {60 vars in 1315 bytes} [Sat Nov 20 21:08:32 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83/os-interface => generated 1831 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:08:32.432818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:32.433950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:32.442831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.444417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.445596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.446561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.610032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:32.611413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:32.618819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.619323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.620436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:32.621018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:32.677909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:32.686505 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-60154b50-fd42-4588-ba44-16ac43622606 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.257968 Nov 20 21:08:32.690203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2853/5805] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:32 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:32.702837 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65eb0e05-27b6-4b9f-8b20-46f42565ad5d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 16396 microversion: 2.20 time: 0.095485 Nov 20 21:08:32.705689 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2953/5806] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:32 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 16396 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:33.703123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:33.704077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:33.713677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:33.714982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:33.717943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:33.718286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:33.718779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:33.720848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:33.730988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:33.731774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:33.732833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:33.733502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:33.803233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07c6dd6d-d9e4-41cd-981e-68f87cc375bb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.090715 Nov 20 21:08:33.804627 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2954/5807] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:33 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:34.037592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:34.044940 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-505bda7b-cfd1-4b94-a3eb-c80adc54343b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.345715 Nov 20 21:08:34.055206 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2854/5808] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:33 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:34.815565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:34.816566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:34.823966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:34.824695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:34.825376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:34.825841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:34.871685 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fa623f1-d244-486c-8104-ca4fde236a67 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.060208 Nov 20 21:08:34.872373 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2955/5809] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:34 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:35.062078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:35.062766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:35.071311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:35.071970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:35.072906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:35.073361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:35.279358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:35.287527 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c9df525-c79f-42bb-b293-ba12debf4a3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.229068 Nov 20 21:08:35.297402 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2855/5810] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:35 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:35.884942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:35.885954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:35.898110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:35.901059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:35.903531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:35.904817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:35.948090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db9dd9dd-c0b6-4315-b16d-0a8e304659b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.067752 Nov 20 21:08:35.951605 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2956/5811] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:35 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:36.306861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:36.308183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:36.315749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:36.317518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:36.318600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:36.319196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:36.474980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:36.483036 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14dad930-58e3-491f-b036-6166c7b92602 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.180548 Nov 20 21:08:36.483736 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2856/5812] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:36 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:36.962847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:36.963846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:36.971635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:36.972522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:36.973547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:36.974042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:37.024354 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6873487-e1d6-4243-a99e-38c86b7be5c6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.065301 Nov 20 21:08:37.026771 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2957/5813] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:36 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:37.502369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:37.503790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:37.511609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:37.512211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:37.513269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:37.513722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:37.778452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:37.788490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c13845a4-3653-499f-a252-344d5270a607 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.290474 Nov 20 21:08:37.789529 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2857/5814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:37 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:38.036564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:38.037315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-dee7cc29-b357-481c-9a74-4a8b3fe6509a req-c6a4aeaa-51e5-4931-af41-6daab3cb896e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01d099b-cd9f-487e-b0ce-4fb5ac9440c0", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4ae95-4d21-46e0-9882-157821324f20"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:38.037788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:38.039718 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:38.039718 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:38.045303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:38.045694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:38.046672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:38.048908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dee7cc29-b357-481c-9a74-4a8b3fe6509a req-c6a4aeaa-51e5-4931-af41-6daab3cb896e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:38.049649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-dee7cc29-b357-481c-9a74-4a8b3fe6509a req-c6a4aeaa-51e5-4931-af41-6daab3cb896e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:38.053138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:38.064927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-dee7cc29-b357-481c-9a74-4a8b3fe6509a req-c6a4aeaa-51e5-4931-af41-6daab3cb896e service nova] Creating event network-vif-plugged:3ae4ae95-4d21-46e0-9882-157821324f20 for instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 on nch1-master-1 Nov 20 21:08:38.071569 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-dee7cc29-b357-481c-9a74-4a8b3fe6509a req-c6a4aeaa-51e5-4931-af41-6daab3cb896e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037951 Nov 20 21:08:38.072871 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2958/5815] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:38.127037 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69a838e7-1964-4b6a-9173-022cf9cd3691 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.092995 Nov 20 21:08:38.129327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2858/5816] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:38 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:38.805576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:38.806302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:38.812506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:38.812960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:38.813783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:38.814255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:38.987080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:38.995531 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8c0af32-6737-4a11-90dd-5905475c6027 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1363 microversion: 2.1 time: 0.194312 Nov 20 21:08:38.996123 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2959/5817] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:38 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:39.140558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:39.141527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:39.152603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:39.153085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:39.167252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:39.167702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:39.212363 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd2c2331-df98-454d-87ef-24fcfe25eba1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.075892 Nov 20 21:08:39.217091 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2859/5818] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:39 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:40.015550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:40.017720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:40.026831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.028542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.029734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.030432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.225851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:40.227515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:40.245766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.246307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.251706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.252625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.346904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98a974e0-cc03-403a-b66a-1586bfb1dbdb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.124718 Nov 20 21:08:40.347574 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2860/5819] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:40 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:08:40.379651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:08:40.432740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e952a40-2f4f-441e-87bd-2501cf64f893 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1550 microversion: 2.1 time: 0.420565 Nov 20 21:08:40.434215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2960/5820] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:08:40 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1550 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:40.452002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:40.452822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:40.460759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.461441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.462968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:40.463622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:40.950955 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e49742c-990b-4097-995f-57c4e1f5ef74 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.503809 Nov 20 21:08:40.951796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2861/5821] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:08:40 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-interface => generated 285 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:41.359005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:41.360016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:41.373511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:41.375820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:41.378593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:41.379343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:41.459960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e57c60cf-1446-4350-9979-cab4eccc68b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.105309 Nov 20 21:08:41.466944 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2961/5822] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:41 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:42.477190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:42.478850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:42.495951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:42.496418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:42.497243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:42.497683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:42.600336 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-19f25d09-f3d1-47dc-9ac7-d2d0ca5f3a4f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.127815 Nov 20 21:08:42.604837 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2862/5823] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:42 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:42.873826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:42.875542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:42.879767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d71e3a12-9a8f-43de-af41-39a9e1390a01 req-e48cdb0d-eaec-40ca-9f82-5c2d89301658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01d099b-cd9f-487e-b0ce-4fb5ac9440c0", "tag": "3ae4ae95-4d21-46e0-9882-157821324f20"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:42.881280 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:42.881280 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:42.885687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:42.891221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:42.892250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:42.892786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:42.900115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d71e3a12-9a8f-43de-af41-39a9e1390a01 req-e48cdb0d-eaec-40ca-9f82-5c2d89301658 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:42.900836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d71e3a12-9a8f-43de-af41-39a9e1390a01 req-e48cdb0d-eaec-40ca-9f82-5c2d89301658 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:42.917400 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d71e3a12-9a8f-43de-af41-39a9e1390a01 req-e48cdb0d-eaec-40ca-9f82-5c2d89301658 service nova] Creating event network-changed:3ae4ae95-4d21-46e0-9882-157821324f20 for instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 on nch1-master-1 Nov 20 21:08:42.941349 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d71e3a12-9a8f-43de-af41-39a9e1390a01 req-e48cdb0d-eaec-40ca-9f82-5c2d89301658 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065556 Nov 20 21:08:42.942531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2863/5824] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:08:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:42.973229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c5c042f-2a82-4384-be80-ef83f5746f26 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.103372 Nov 20 21:08:42.973890 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2962/5825] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:42 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:43.616108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:43.617302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:43.629144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:43.629798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:43.632320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:43.633136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:43.728712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-570e8841-20dc-4b95-a1d4-bfcce94f5aa1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.116879 Nov 20 21:08:43.730152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2864/5826] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:43 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:43.987006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:43.989428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:44.005614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:44.008098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:44.009846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:44.011891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:44.108944 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00ed9df9-31e5-4327-b6d7-ad8db5fe36d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.127610 Nov 20 21:08:44.110165 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2963/5827] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:43 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:44.745933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:44.766245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:44.776055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:44.777347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:44.778444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:44.779051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:44.850689 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ef76f9f-7401-4459-8c5c-fba6e6f6a364 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 24563 microversion: 2.20 time: 0.112655 Nov 20 21:08:44.851384 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2865/5828] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:44 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 24563 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:45.121480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:45.122575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:45.131827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:45.132810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:45.133827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:45.134547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:45.185985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-baa3b687-4eef-4809-832d-a3f317a4a33e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.064584 Nov 20 21:08:45.189530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2964/5829] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:45 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:08:45.864481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:45.866550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:45.879163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:45.880192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:45.881229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:45.881901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:45.971700 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf3ddba3-5ed1-402b-9176-a7d4d6278848 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.112002 Nov 20 21:08:45.975695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2866/5830] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:45 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:46.199941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:46.200953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:46.212674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:46.213124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:46.213928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:46.219114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:46.294189 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f87d5129-3767-4dee-bb38-ab6e6cc874c3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.098275 Nov 20 21:08:46.295847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2965/5831] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:46 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:46.990710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:46.991748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:47.006549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:47.007012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:47.014649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:47.015351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:47.109686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86e27558-b65c-4114-9346-2439298a4795 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.126014 Nov 20 21:08:47.112688 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2867/5832] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:46 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:47.310215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:47.312043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:47.326131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:47.327109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:47.328346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:47.329019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:47.374236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49c61d71-1485-4d85-b9bb-3e397a2add57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.069387 Nov 20 21:08:47.376370 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2966/5833] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:47 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:48.128801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:48.130561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:48.145652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:48.146463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:48.147883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:48.148527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:48.216886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c41339fa-94ed-4084-a798-fcb2e1b177d7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.095709 Nov 20 21:08:48.224030 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2868/5834] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:48 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:48.396279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:48.398357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:48.409486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:48.410461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:48.411767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:48.412642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:48.494977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f1ab2a7b-6a50-4e11-8155-bb7941f98ac9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.109215 Nov 20 21:08:48.496036 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2967/5835] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:48 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:08:49.237860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:49.240262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:49.248930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:49.251837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:49.252887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:49.255444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:49.323220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55df16ac-7b79-4545-90b7-97dcea1f809a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.092957 Nov 20 21:08:49.329734 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2869/5836] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:49 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:49.522275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:49.524975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:49.537431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:49.538303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:49.539654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:49.540420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:49.597397 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8867aeb2-8bec-426c-8b82-0fdb54782d10 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.093564 Nov 20 21:08:49.598697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2968/5837] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:49 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:50.337234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:50.338806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:50.356307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:50.357084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:50.358961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:50.364068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:50.435212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ead4801-35e3-41a4-8640-34585fb640b0 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.102530 Nov 20 21:08:50.439853 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2870/5838] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:50 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:50.611101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:50.612427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:50.622350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:50.625502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:50.626782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:50.627236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:50.715432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c55a94b-6d95-4222-9464-d2d3a5471edf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 14 microversion: 2.1 time: 0.109532 Nov 20 21:08:50.716429 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2969/5839] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:50 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:08:51.110148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57079a1b-5991-40b3-bcaf-182a29a001a4 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2036459922", "availability_zone": "foo_zone"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.113068 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.113068 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:51.114534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.aggregate [None req-57079a1b-5991-40b3-bcaf-182a29a001a4 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Generated uuid a40fbea0-2369-437c-a08b-8a2b0d6eb44f for aggregate {{(pid=140942) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 20 21:08:51.149311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57079a1b-5991-40b3-bcaf-182a29a001a4 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.194422 Nov 20 21:08:51.150035 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2871/5840] 10.222.0.41 () {60 vars in 1163 bytes} [Sat Nov 20 21:08:50 2021] POST /compute/v2.1/os-aggregates => generated 209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:08:51.161902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-405340d4-c6c6-4391-ab15-ae9691d39d47 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.163350 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.163350 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:51.190581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-405340d4-c6c6-4391-ab15-ae9691d39d47 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.033321 Nov 20 21:08:51.197744 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2970/5841] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.207499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:51.209459 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.209459 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:51.211109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.211764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.212745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.213198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.258994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6880e247-930e-4322-8cc9-cf6c6c812807 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.060654 Nov 20 21:08:51.260321 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2872/5842] 10.222.0.41 () {58 vars in 1175 bytes} [Sat Nov 20 21:08:51 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:08:51.272564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54f78478-ff95-46e1-897e-6988191a77d1 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:51.273256 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.273256 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:51.283676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54f78478-ff95-46e1-897e-6988191a77d1 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014601 Nov 20 21:08:51.286122 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2971/5843] 10.222.0.41 () {58 vars in 1142 bytes} [Sat Nov 20 21:08:51 2021] GET /compute/v2.1/os-aggregates => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.295950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f030c98-3a98-4528-aad4-6f625bfc9901 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.297321 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.297321 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:51.311814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f030c98-3a98-4528-aad4-6f625bfc9901 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.312398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f030c98-3a98-4528-aad4-6f625bfc9901 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.447067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.448098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:51.455311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.455777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.456559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.457004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.508110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67a02647-2ec7-42ce-8b4c-193e71541775 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.064152 Nov 20 21:08:51.509553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2972/5844] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:51.662858 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f030c98-3a98-4528-aad4-6f625bfc9901 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.370716 Nov 20 21:08:51.663457 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2873/5845] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.673847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d23995e-f9bb-47dc-abeb-f9614f58de17 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:51.674696 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.674696 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:51.683480 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d23995e-f9bb-47dc-abeb-f9614f58de17 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013612 Nov 20 21:08:51.684064 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2973/5846] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:08:51 2021] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.696245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21f76b74-9adb-40f0-85b4-2ab699984ade tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-993877146", "availability_zone": "foo_zone"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.732917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.734798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:51.746672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.747459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.748467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.749100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:51.786514 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.786514 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:51.803421 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-278bb6f0-044f-4463-8e6e-ce9c25495a9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 8205 microversion: 2.1 time: 0.075806 Nov 20 21:08:51.805902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2974/5847] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 8205 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:08:51.836659 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21f76b74-9adb-40f0-85b4-2ab699984ade tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.144268 Nov 20 21:08:51.842316 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2874/5848] 10.222.0.41 () {60 vars in 1172 bytes} [Sat Nov 20 21:08:51 2021] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.848912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d1e09d4b-71c2-4757-9add-100c8f856d76 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.850711 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.850711 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:51.893156 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d1e09d4b-71c2-4757-9add-100c8f856d76 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.047304 Nov 20 21:08:51.898843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2975/5849] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:08:51.906086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f25d8dc-d658-4310-94a3-c14f5d1f76cf tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:51.907498 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.907498 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:51.917921 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f25d8dc-d658-4310-94a3-c14f5d1f76cf tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.017339 Nov 20 21:08:51.926715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2875/5850] 10.222.0.41 () {58 vars in 1151 bytes} [Sat Nov 20 21:08:51 2021] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:51.933247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dff1e06a-0196-499f-af71-af33937a7822 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:51.935036 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:51.935036 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:08:51.949837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dff1e06a-0196-499f-af71-af33937a7822 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:51.950590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dff1e06a-0196-499f-af71-af33937a7822 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:52.234566 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dff1e06a-0196-499f-af71-af33937a7822 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.307269 Nov 20 21:08:52.236465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2976/5851] 10.222.0.41 () {60 vars in 1193 bytes} [Sat Nov 20 21:08:51 2021] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:08:52.252469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9502c55f-f723-4b6a-a050-7d8dc52780e5 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:08:52.253784 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:08:52.253784 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:08:52.306266 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9502c55f-f723-4b6a-a050-7d8dc52780e5 tempest-TestAggregatesBasicOps-552009321 tempest-TestAggregatesBasicOps-552009321-project-admin] 10.222.0.41 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.063524 Nov 20 21:08:52.309956 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2876/5852] 10.222.0.41 () {58 vars in 1154 bytes} [Sat Nov 20 21:08:52 2021] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 20 21:08:52.521855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:52.525077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:52.542765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:52.546902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:52.550823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:52.551572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:52.607287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14e09a85-7b9f-408f-984a-625f2798a7d8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.090511 Nov 20 21:08:52.608757 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2977/5853] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:52 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:52.824756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:52.825912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:52.833288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:52.833756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:52.834600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:52.835047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:52.902120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a04a56ad-34dd-4e03-8633-c51acac77b3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 16381 microversion: 2.1 time: 0.089169 Nov 20 21:08:52.903099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2877/5854] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:52 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 16381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:53.621731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:53.623679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:53.642863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:53.643754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:53.644817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:53.645462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:53.714114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8175d4a1-2244-477e-91ac-8943563a6145 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.096421 Nov 20 21:08:53.715385 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2978/5855] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:53 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:53.915283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:53.916316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:53.924754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:53.925493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:53.926499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:53.927042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:53.973419 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89f9bb3a-5c9c-491f-8dc9-c3eb2fbc20c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 16381 microversion: 2.1 time: 0.062449 Nov 20 21:08:53.974619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2878/5856] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:53 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 16381 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:54.730553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:54.731615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:54.743818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:54.744204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:54.745026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:54.745472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:54.810825 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b667ae4c-761d-42ca-9c88-c93f35cb903d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.087524 Nov 20 21:08:54.812489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2979/5857] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:54 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:54.985722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:54.987857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:54.997061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:54.997524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:54.999240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:54.999641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:55.052266 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-295cc17e-1960-4f32-9ef3-c66675a1322d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 16381 microversion: 2.1 time: 0.070349 Nov 20 21:08:55.053098 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2879/5858] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:54 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 16381 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:55.823939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:55.825738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:55.847030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:55.848542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:55.849666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:55.850386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:55.913367 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17ae3fdd-badb-4c82-9980-ae55fd4f8e12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.093247 Nov 20 21:08:55.914475 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2980/5859] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:55 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:56.066507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:56.068371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:56.076648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:56.077240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:56.078320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:56.079957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:56.129883 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-74c590af-5ea0-406c-b9d0-3188241f1d49 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 16381 microversion: 2.1 time: 0.069937 Nov 20 21:08:56.134156 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2880/5860] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:56 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 16381 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:56.929100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:56.930552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:56.942185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:56.943200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:56.945364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:56.946318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:57.003150 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e48f26f-d463-48d4-94ba-8d48ca4ac60d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.080542 Nov 20 21:08:57.009470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2981/5861] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:56 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:57.143257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:57.144280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:57.151996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:57.152713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:57.154555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:57.155225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:57.236279 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dca0719c-fe9d-48e4-902a-9e583b1d865c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.097757 Nov 20 21:08:57.236983 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2881/5862] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:57 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:58.017379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:58.018769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:58.026085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:58.026842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:58.028057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:58.028573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:58.073474 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df531b54-1147-403f-bb24-f93a0768b56e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.061013 Nov 20 21:08:58.074360 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2982/5863] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:58 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:58.248254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:58.249261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:58.257124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:58.257832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:58.258937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:58.259381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:58.302642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ebea85e7-6930-4203-882f-32cecef14973 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.058110 Nov 20 21:08:58.306517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2882/5864] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:58 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:08:59.087020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:59.088566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:59.095770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:59.096461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:59.098308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:59.099061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:59.151298 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3173f64-a4e9-4bd0-9c32-bc0e04874526 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.069352 Nov 20 21:08:59.156204 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2983/5865] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:08:59 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:08:59.315672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:08:59.317457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:08:59.339955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:59.340890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:59.342023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:08:59.342726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:08:59.411984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fed77e6-6a79-4dfa-9135-c422b6350d7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.101006 Nov 20 21:08:59.417858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2883/5866] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:08:59 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:00.311320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:00.314235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:00.326805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:00.327334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:00.328158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:00.328649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:00.390133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-140a7406-1cb4-45a9-8e41-1355258a9699 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.229675 Nov 20 21:09:00.394394 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2984/5867] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:00 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:00.426939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:00.428393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:00.443475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:00.444074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:00.445029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:00.445895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:00.523397 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-085d66e0-0d30-484a-84d8-50cb6e9227d1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.100921 Nov 20 21:09:00.524085 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2884/5868] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:00 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:01.410885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:01.411922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:01.422524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:01.424888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:01.429319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:01.429937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:01.526766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c4bdc87c-86da-40f4-bf9f-99f855ade47e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.127108 Nov 20 21:09:01.530744 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2985/5869] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:01 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:01.541834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:01.542903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:01.567484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:01.567966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:01.568811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:01.569269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:01.654289 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-757fbee8-c5ae-4f59-844a-0b49bacf9b8b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.116263 Nov 20 21:09:01.665145 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2885/5870] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:01 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:02.543072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:02.544726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:02.561261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:02.564993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:02.566176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:02.566837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:02.672948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-231ff5ec-6a3d-4dc7-b7b4-d59a973cfb0d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.134065 Nov 20 21:09:02.673889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:02.675213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:02.676254 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2986/5871] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:02 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:02.686091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:02.686864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:02.688431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:02.689154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:02.768311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ac97572-59c5-4ff1-ad6a-e04bddd3b47d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.105563 Nov 20 21:09:02.770023 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2886/5872] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:02 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:03.689971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:03.691032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:03.709895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:03.711126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:03.712172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:03.712762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:03.782773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:03.783922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:03.799211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9797248-074c-426f-a67f-157df358fa02 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.110794 Nov 20 21:09:03.799463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:03.799984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:03.801039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:03.802283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2987/5873] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:03 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:03.802681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:03.864143 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc7aaacc-19f3-4227-a9b6-795732c66913 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.087046 Nov 20 21:09:03.866865 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2887/5874] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:03 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:04.812284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:04.814329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:04.825812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:04.826355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:04.827351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:04.829070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:04.877956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:04.879231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:04.887402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:04.887960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:04.888850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:04.888976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f274e0c-f7ab-46ef-a34f-f22825b8b80d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.080719 Nov 20 21:09:04.889422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:04.894287 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2988/5875] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:04 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:04.944967 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4956b2e0-e60a-475d-808e-1e6370f72f23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.071360 Nov 20 21:09:04.947628 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2888/5876] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:04 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:05.902768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:05.903938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:05.921267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:05.922009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:05.924089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:05.924530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:05.958457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:05.960045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:05.972242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:05.973008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:05.973980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:05.974609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:05.986226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3fbfa6b-ac9a-42ae-bb9f-b442eecdd3dc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.087930 Nov 20 21:09:05.987560 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2989/5877] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:05 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:06.036096 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4a3011b-ee42-4076-88ae-26b7f41a19a7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.080122 Nov 20 21:09:06.038652 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2889/5878] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:05 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:07.002853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:07.004502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:07.024110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:07.024834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:07.025835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:07.026469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:07.049099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:07.050819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:07.062383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:07.063594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:07.064469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:07.065251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:07.104429 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59f95355-8236-4fdf-a072-3ec2bcd77470 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.105779 Nov 20 21:09:07.105905 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2990/5879] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:06 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:07.138544 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-582631fd-c1ec-477b-99f9-af6588ebe32b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.093799 Nov 20 21:09:07.139691 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2890/5880] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:07 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:08.117567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:08.127283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:08.135541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:08.135816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:08.136627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:08.137255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:08.154439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:08.156247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:08.170672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:08.171139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:08.171969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:08.173031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:08.237410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1414da04-945e-40ea-bc09-643c279e9bdd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.123689 Nov 20 21:09:08.240267 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4980b3d8-1318-4865-9339-d04dcf62554c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 24555 microversion: 2.1 time: 0.091304 Nov 20 21:09:08.241688 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2891/5881] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:08 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 24555 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:08.242547 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2991/5882] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:08 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:09.251300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:09.253317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:09.254633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:09.255861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:09.263778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:09.264577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:09.265613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:09.267498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:09.268417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:09.268937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:09.270399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:09.271102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:09.324316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-93b601fa-3263-4d70-bfc3-5013a9e2b7b7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.077352 Nov 20 21:09:09.326302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2892/5883] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:09 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:09.334865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-35383369-83de-44af-b67d-7a239f5f5f86 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.085923 Nov 20 21:09:09.339830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2992/5884] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:09 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:10.338106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:10.340146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:10.347851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:10.348566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:10.349641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:10.350359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:10.351451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:10.352582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:10.364561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:10.375393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:10.376867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:10.378173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:10.405638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b4577569-bcd3-44bd-90f3-1141ed0f2934 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.071865 Nov 20 21:09:10.408249 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2893/5885] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:10 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:10.432645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2019c0ae-24d4-48da-92d4-21cfa793cb41 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.087985 Nov 20 21:09:10.439189 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2993/5886] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:10 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:11.422207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:11.424000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:11.443355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:11.444828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:11.445976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:11.446648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:11.446765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:11.448022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:11.461619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:11.462531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:11.463580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:11.464528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:11.516900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a85ee8c-365a-42a3-9ae2-7ab343079c0e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.073184 Nov 20 21:09:11.518942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2994/5887] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:11 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:11.526460 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0641adb0-1dae-4bf2-a81c-e3d4d7ebded3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.109594 Nov 20 21:09:11.527149 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2894/5888] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:11 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:12.541268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:12.542676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:12.549532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:12.551900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:12.555950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:12.556405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:12.557218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:12.557656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:12.561576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:12.562467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:12.565246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:12.566607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:12.620939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11463e1a-3775-4e57-ad22-fd10c7bfa3fc tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.084954 Nov 20 21:09:12.621682 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2895/5889] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:12 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:12.624849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-92c68891-6546-4f87-a752-035daf820961 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.096951 Nov 20 21:09:12.625636 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2995/5890] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:12 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:13.638116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:13.642564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:13.644358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:13.646428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:13.664567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:13.666375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:13.668650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:13.681635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:13.682224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:13.683098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:13.687253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:13.688367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:13.767901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f7ddcc3-4eac-4d91-b971-0e2290fd3de9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.137193 Nov 20 21:09:13.775285 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ab2d187-1d13-49f1-a6e3-82ee4bb8b065 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.141215 Nov 20 21:09:13.778448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2896/5891] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:13 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:13.780624 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2996/5892] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:13 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:14.784410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:14.794138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:14.796401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:14.799186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:14.816540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:14.816991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:14.823371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:14.823886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:14.824887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:14.826329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:14.826799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:14.828916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:14.911973 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-189ca9ef-2599-4466-9a8a-9d1a8f17232e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.132712 Nov 20 21:09:14.917260 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2897/5893] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:14 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:14.920058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4347521b-ee21-4175-bc4e-33be18bc6e8a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.131006 Nov 20 21:09:14.921307 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2997/5894] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:14 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:15.924886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:15.938268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:15.939965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:15.941224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:15.961705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:15.963112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:15.963795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:15.964069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:15.965060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:15.966795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:15.967444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:15.968067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:16.049184 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50fa4b9a-4bd8-4c87-bf91-bb4a25894d63 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.118657 Nov 20 21:09:16.061920 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4bf2a0e2-0793-4051-bbca-508f812522f1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.141420 Nov 20 21:09:16.062591 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2998/5895] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:15 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:16.068118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2898/5896] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:15 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:17.065495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:17.066727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:17.076461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:17.077517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:17.089645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:17.096119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:17.097132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:17.098581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:17.099340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:17.101522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:17.102337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:17.103575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:17.199385 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-faba01bc-c63f-4441-a10e-43c17172cbaa tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.139113 Nov 20 21:09:17.208434 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ef4a639-3653-481c-9954-b9adf0d23158 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.136207 Nov 20 21:09:17.213260 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 2999/5897] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:17 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:17.220372 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2899/5898] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:17 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:18.231197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:18.233010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:18.233337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:18.237009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:18.256941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:18.260253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:18.260777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:18.261594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:18.262038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:18.267373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:18.270317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:18.273436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:18.367356 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba1262e2-94b5-4ea7-b0c3-27bc3e08d02a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.150321 Nov 20 21:09:18.371434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3000/5899] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:18 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:18.379430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec2eef7c-5f18-4dfa-96f5-977bff3e6a8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.154615 Nov 20 21:09:18.380140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2900/5900] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:18 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:19.264678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Action: 'create', calling method: .version_select at 0x7f3f8645dd30>, body: {"keypair": {"name": "tempest-TestServerBasicOps-834387733"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:19.289719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for project 76440d312bb547959d5437ce510b515b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:09:19.296421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for user 16e21f61da0f4ac09d66266e3bad99fe and project 76440d312bb547959d5437ce510b515b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:09:19.380671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:19.381698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:19.396331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:19.397076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:19.398118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:19.398778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:19.498231 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-550064b4-3d2d-4d8f-baa3-ac76aeaf16a8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.121579 Nov 20 21:09:19.507636 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2901/5901] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:19 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:19.532008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:19.533659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:19.548254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:19.549949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:19.553863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:19.554532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:19.630852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44be7a53-0e53-462f-9d77-5b3243627451 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.121459 Nov 20 21:09:19.631738 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2902/5902] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:19 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:19.725939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for project 76440d312bb547959d5437ce510b515b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:09:19.732299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for user 16e21f61da0f4ac09d66266e3bad99fe and project 76440d312bb547959d5437ce510b515b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:09:19.750425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c720ac0b-a340-429f-9c2f-cda223ab35d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.703900 Nov 20 21:09:19.755426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3001/5903] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:09:19 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:20.521452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:20.522856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:20.549265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:20.549733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:20.557067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:20.557625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:20.626486 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4bd1367e-b75c-457b-bcf7-eb50a46f1d93 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.110656 Nov 20 21:09:20.627175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2903/5904] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:20 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:20.643923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:20.644960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:20.674530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:20.675778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:20.676644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:20.677091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:20.757328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-186a2be0-8c71-4feb-aae0-812c7cf2eb15 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.113202 Nov 20 21:09:20.760858 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3002/5905] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:20 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:21.478229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-272769822", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-834387733", "security_groups": [{"name": "tempest-secgroup-smoke-829510264"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "f2fe32bd-ee9f-42ff-914b-61d7b525e3e5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:21.642194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:21.643254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:21.652796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:21.653481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:21.654043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:21.654505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:21.717964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] validate_networks() for [('f2fe32bd-ee9f-42ff-914b-61d7b525e3e5', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:09:21.723505 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4701febb-f265-4361-80bb-4588c74d30f4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.087246 Nov 20 21:09:21.724639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3003/5906] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:21 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:21.772639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:21.773822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:21.798282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:21.798821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:21.799937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:21.800466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:21.886492 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab97b52f-48e4-4754-9f8d-2fefcf18fdbf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.117057 Nov 20 21:09:21.892022 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3004/5907] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:21 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:22.736267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:22.737277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:22.750393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:22.755344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:22.756203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:22.765602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:22.854869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd1efb7e-4f22-4b95-b067-efd4c447fbfd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.122290 Nov 20 21:09:22.856025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3005/5908] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:22 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:22.902302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:22.903963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:22.920610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:22.921839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:22.923337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:22.924057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:22.980891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for project 76440d312bb547959d5437ce510b515b. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:09:22.992388 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-821016b3-13d8-44c7-92e7-8c1c3c5ee67f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.096058 Nov 20 21:09:22.997752 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3006/5909] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:22 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:23.003364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for user 16e21f61da0f4ac09d66266e3bad99fe and project 76440d312bb547959d5437ce510b515b. Resources: dict_keys(['metadata_items']) {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:09:23.036384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:09:23.036824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:09:23.037311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:09:23.037764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:09:23.041225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:09:23.058650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:23.062344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:23.065307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:23.066328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:23.094201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for project 76440d312bb547959d5437ce510b515b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:09:23.100887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Getting quotas for user 16e21f61da0f4ac09d66266e3bad99fe and project 76440d312bb547959d5437ce510b515b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:09:23.116386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:09:23.121833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:09:23.205329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44e278c4-81f4-4a0d-8bf6-439562ec1a5d tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.731525 Nov 20 21:09:23.211729 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2904/5910] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:09:21 2021] POST /compute/v2.1/servers => generated 405 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:09:23.217165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5d43f2a-4fed-4fe4-8ba5-325c698dfdef tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:23.218145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5d43f2a-4fed-4fe4-8ba5-325c698dfdef tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:23.321872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5d43f2a-4fed-4fe4-8ba5-325c698dfdef tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:23.333683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5d43f2a-4fed-4fe4-8ba5-325c698dfdef tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1301 microversion: 2.1 time: 0.120850 Nov 20 21:09:23.336677 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3007/5911] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:23 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:09:23.868269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:23.870039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:23.892997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:23.894926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:23.898001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:23.898747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:23.974914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-640da93c-9417-409d-a4ff-28e0d69d9997 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.111081 Nov 20 21:09:23.979333 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2905/5912] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:23 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:24.010839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:24.013323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:24.024135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:24.024720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:24.025672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:24.026434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:24.080050 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cdf9cfd1-655d-4630-bbee-a0917c9fc2a2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.074529 Nov 20 21:09:24.081477 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3008/5913] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:24 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:24.355197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:24.355927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:24.373205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:24.374598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:24.377609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:24.378095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:24.472973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:24.481322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d1fb19b-769c-42ce-94d2-c00453876b27 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1353 microversion: 2.1 time: 0.131716 Nov 20 21:09:24.481980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2906/5914] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:24 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:24.988896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:25.001048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:25.013091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.014508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.017903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.018668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.087190 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f822183c-b438-4f9d-b59e-c7a3a92570eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.102466 Nov 20 21:09:25.087190 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3009/5915] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:24 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:25.093021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:25.093372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:25.103752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.112017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.132636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.133098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.200500 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ee3abb2-302e-4541-9338-7c57f97b9bdf tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.110699 Nov 20 21:09:25.206793 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2907/5916] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:25 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:25.502710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:25.504838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:25.512835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.513792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.514874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:25.515766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:25.600203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:25.611276 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-13be6435-2bab-4659-bf14-4d32dfec0788 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1359 microversion: 2.1 time: 0.113987 Nov 20 21:09:25.614747 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3010/5917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:25 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1359 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:09:26.102633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:26.104405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:26.121554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.123482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.126709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.127480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.179115 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b84e7e5-c396-42ba-8b89-c83df7e7b6c9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.083016 Nov 20 21:09:26.183740 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2908/5918] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:26 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:26.223551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:26.224828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:26.232828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.233491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.236526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.237192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.297740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb58822e-cd0c-4cc5-b862-43b76cef0cf5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.087678 Nov 20 21:09:26.304782 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3011/5919] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:26 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:26.639299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:26.641841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:26.650441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.651873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.653591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.654331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.805496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-35eb56c1-f883-4cea-ab43-84f4ab916a40 req-ae6bfb5e-678f-4500-8949-da1b1fd00f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f7cf2f-0d15-498f-a32c-2fa01b79f22d", "tag": "3132aec5-17c1-4ad9-a513-e12a061edbf5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:26.808909 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:09:26.808909 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:09:26.831342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-35eb56c1-f883-4cea-ab43-84f4ab916a40 req-ae6bfb5e-678f-4500-8949-da1b1fd00f39 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:26.835236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-35eb56c1-f883-4cea-ab43-84f4ab916a40 req-ae6bfb5e-678f-4500-8949-da1b1fd00f39 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:26.859286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-35eb56c1-f883-4cea-ab43-84f4ab916a40 req-ae6bfb5e-678f-4500-8949-da1b1fd00f39 service nova] Creating event network-changed:3132aec5-17c1-4ad9-a513-e12a061edbf5 for instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d on nch1-master-1 Nov 20 21:09:26.865636 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-35eb56c1-f883-4cea-ab43-84f4ab916a40 req-ae6bfb5e-678f-4500-8949-da1b1fd00f39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066806 Nov 20 21:09:26.866833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3012/5920] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:09:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:09:27.039952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:27.049009 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3865f36-db32-465a-8e13-16f2a2f11504 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.420306 Nov 20 21:09:27.053317 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2909/5921] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:26 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:09:27.193847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:27.194635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:27.204877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:27.205847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:27.206984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:27.208272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:27.264987 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f34e4fb-79c0-411d-b4ee-12d1e54d2125 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.075805 Nov 20 21:09:27.266365 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3013/5922] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:27 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:27.313869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:27.315040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:27.328566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:27.329905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:27.331146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:27.331821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:27.396018 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f3ac303-14bc-48eb-82c1-fd56c838309a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.086750 Nov 20 21:09:27.397322 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2910/5923] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:27 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:28.075163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:28.080167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:28.089198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.089904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.090840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.091275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.285821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:28.287264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:28.294696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.295514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.297353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.297907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.352745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2f0e072-7d09-4dad-b1aa-54d696754444 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.078140 Nov 20 21:09:28.364128 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2911/5924] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:28 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:28.407396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:28.409188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:28.410477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:28.420589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.420805 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ce1a9c2-b036-4281-8d1b-d78cf86b3e99 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.351569 Nov 20 21:09:28.422945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.424057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:28.424881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:28.433243 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3014/5925] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:28 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:28.480930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00f2988b-e887-4394-b412-f178f056db38 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.076465 Nov 20 21:09:28.482309 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2912/5926] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:28 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:29.378982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:29.381794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:29.398395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.399244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.400059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.400965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.439361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:29.440055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:29.455894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.459116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b7ee069-5b94-43c2-9790-e3d867c8ebcc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.089687 Nov 20 21:09:29.460977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.465104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3015/5927] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:29 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:29.466783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.467233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.497607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:29.502471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:29.512814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.513638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.515011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:29.516586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:29.575871 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6374c174-b6ff-4c42-a8bc-55e53d8e32e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.086368 Nov 20 21:09:29.578258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3016/5928] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:29 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:29.705665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:29.713320 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81601968-5d18-4253-8d5a-0d23caea1f06 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.278891 Nov 20 21:09:29.714172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2913/5929] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:29 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:30.472603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:30.473644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:30.481367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.481820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.482649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.483082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.526623 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8c772b8-2e44-45c5-9e2f-9df32a6a3dbf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.058002 Nov 20 21:09:30.527592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3017/5930] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:30 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:30.588662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:30.590176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:30.596810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.597354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.598272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.598797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.642218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fad13fe5-aa58-4dd0-b98e-402d1823174a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.057121 Nov 20 21:09:30.643024 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2914/5931] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:30 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:30.732745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:30.733713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:30.742160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.742619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.743607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:30.744058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:30.915772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:30.925193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db1c85a0-76b5-4caa-bbe4-a73011ae9123 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.197581 Nov 20 21:09:30.925783 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3018/5932] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:30 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:31.539730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:31.540822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:31.557237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.557894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:31.558905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.559522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:31.616811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d2175d8e-4b77-43e9-a10c-5ee58e166ab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.081206 Nov 20 21:09:31.618538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2915/5933] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:31 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:31.654702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:31.656715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:31.664289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.664747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:31.665613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.666080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:31.708530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73166bd1-d5e3-4636-90c4-53b83c013446 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.057849 Nov 20 21:09:31.709936 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3019/5934] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:31 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:31.942982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:31.943688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:31.950937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.951435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:31.952277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:31.953341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.204307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:32.212873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d521a9dc-c501-4f9e-b909-7db6b6510209 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.273812 Nov 20 21:09:32.213975 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2916/5935] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:31 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:09:32.343973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-569a1f6d-315f-48fe-914a-347c9c7b708f req-d7b74eed-16b9-4814-b9a8-a62c4db1f00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f7cf2f-0d15-498f-a32c-2fa01b79f22d", "name": "network-vif-plugged", "status": "completed", "tag": "3132aec5-17c1-4ad9-a513-e12a061edbf5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:32.345702 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:09:32.345702 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:09:32.353927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-569a1f6d-315f-48fe-914a-347c9c7b708f req-d7b74eed-16b9-4814-b9a8-a62c4db1f00f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:32.354511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-569a1f6d-315f-48fe-914a-347c9c7b708f req-d7b74eed-16b9-4814-b9a8-a62c4db1f00f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.369444 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-569a1f6d-315f-48fe-914a-347c9c7b708f req-d7b74eed-16b9-4814-b9a8-a62c4db1f00f service nova] Creating event network-vif-plugged:3132aec5-17c1-4ad9-a513-e12a061edbf5 for instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d on nch1-master-1 Nov 20 21:09:32.375426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-569a1f6d-315f-48fe-914a-347c9c7b708f req-d7b74eed-16b9-4814-b9a8-a62c4db1f00f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Nov 20 21:09:32.376233 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3020/5936] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:09:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:09:32.629461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:32.630659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:32.641894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:32.642376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.643343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:32.643788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.688849 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41f44e09-1f16-4930-8cf8-d60e7cca421c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.063584 Nov 20 21:09:32.689791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2917/5937] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:32 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:32.721437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:32.722484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:32.729216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:32.729674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.730500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:32.730939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:32.772758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7866e2df-ff60-4e37-a9a2-373f9d623d00 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.055309 Nov 20 21:09:32.773413 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3021/5938] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:32 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:33.230698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:33.231396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:33.239381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.239837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.240826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.241274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.402289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:33.411497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9990d4f-71b8-487f-8137-31fa6831c59c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1426 microversion: 2.1 time: 0.184649 Nov 20 21:09:33.412205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2918/5939] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:33 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1426 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:33.701559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:33.702471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:33.710325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.710785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.711584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.712028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.760171 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b469df1e-4e1f-43de-8f86-12225bcd43d8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.062898 Nov 20 21:09:33.761250 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3022/5940] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:33 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:33.785622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:33.787568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:33.808022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.808862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.809869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:33.810507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:33.855490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d4fb2a1-d5c4-4f44-a120-017287a68317 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.074214 Nov 20 21:09:33.858936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2919/5941] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:33 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:34.429061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:34.429754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:34.444119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.444574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.445605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.445841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.670625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:34.678125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-226ea46b-adf0-4181-a9f9-b1f441a622bf tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1607 microversion: 2.1 time: 0.253021 Nov 20 21:09:34.678711 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3023/5942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:34 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1607 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:34.695645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:34.696375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:34.703921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.704380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.705195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.705622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.773014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:34.773876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:34.782362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.782816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.784380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.784833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.829188 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aa36b897-a8da-411c-9280-8fece95c84c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.060508 Nov 20 21:09:34.830931 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3024/5943] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:34 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:34.849794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:34.858545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21ef68a3-24cb-463a-be4e-bd932e6b3229 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1607 microversion: 2.1 time: 0.166970 Nov 20 21:09:34.859656 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2920/5944] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:34 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1607 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:09:34.869906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:34.871373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:34.877078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:34.877746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:34.880144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.880853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.882100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.882549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.884387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.884930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.885892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:34.886662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:34.927217 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-580a140d-df89-48be-a1ea-fea4663193af tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.061079 Nov 20 21:09:34.928042 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3025/5945] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:34 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:35.106642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:35.116805 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc1d50b1-7076-4eae-b3d1-7eedc4934d09 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1607 microversion: 2.1 time: 0.244953 Nov 20 21:09:35.117491 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2921/5946] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:09:34 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1607 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:09:35.841813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:35.844154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:35.851882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:35.853028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:35.854028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:35.854731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:35.899815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f0c2081-2f5c-4f46-8a38-2b158862d6e6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.061786 Nov 20 21:09:35.902088 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3026/5947] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:35 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:35.941129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:35.942259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:35.949168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:35.949700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:35.950525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:35.950962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:35.995606 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ea3a483c-f767-40cd-a382-e7bdc01b77ea tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.059123 Nov 20 21:09:35.996767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2922/5948] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:35 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:36.933322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:36.935983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:36.945420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:36.946304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:36.947554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:36.948379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:37.009016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a86e381-f66b-426c-9601-ca1a68e00517 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.099580 Nov 20 21:09:37.014843 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3027/5949] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:36 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:37.018262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:37.019731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:37.050586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:37.052382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:37.055350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:37.056814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:37.145831 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3273d414-7a43-4593-ad37-eec5da88ca4e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.140390 Nov 20 21:09:37.152140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2923/5950] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:37 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:37.849077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-68db7024-1ac6-4ed7-ae53-a180fd9f9939 req-647abf4f-7d6d-41aa-9446-667dcb87aef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6f7cf2f-0d15-498f-a32c-2fa01b79f22d", "tag": "3132aec5-17c1-4ad9-a513-e12a061edbf5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:37.850607 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:09:37.850607 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:09:37.868934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68db7024-1ac6-4ed7-ae53-a180fd9f9939 req-647abf4f-7d6d-41aa-9446-667dcb87aef6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:37.869396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68db7024-1ac6-4ed7-ae53-a180fd9f9939 req-647abf4f-7d6d-41aa-9446-667dcb87aef6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:37.887338 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-68db7024-1ac6-4ed7-ae53-a180fd9f9939 req-647abf4f-7d6d-41aa-9446-667dcb87aef6 service nova] Creating event network-changed:3132aec5-17c1-4ad9-a513-e12a061edbf5 for instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d on nch1-master-1 Nov 20 21:09:37.894511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-68db7024-1ac6-4ed7-ae53-a180fd9f9939 req-647abf4f-7d6d-41aa-9446-667dcb87aef6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049256 Nov 20 21:09:37.895525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3028/5951] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:09:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:09:38.033389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:38.035242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:38.058238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:38.060088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:38.062685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:38.068186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:38.138947 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6e026c5-353d-4b74-829b-e29577b43be3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.118674 Nov 20 21:09:38.140295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2924/5952] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:38 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:38.163209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:38.164233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:38.173825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:38.174306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:38.175110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:38.178274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:38.266831 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2e5f0da-9973-4db5-bd3b-f8e5f429aab1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.110047 Nov 20 21:09:38.267398 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3029/5953] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:38 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:39.153884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:39.155902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:39.163939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:39.164414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:39.165233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:39.165680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:39.230478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a0b8963-cec7-4f6a-979b-5ae6b8b513c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.082691 Nov 20 21:09:39.231921 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2925/5954] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:39 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:39.279493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:39.280956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:39.288481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:39.289163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:39.290357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:39.290804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:39.360054 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e483723d-054b-4013-ab09-f1fb3de29dc2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.084662 Nov 20 21:09:39.360919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3030/5955] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:39 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:40.243955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:40.245572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:40.254391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:40.255040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:40.256028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:40.256624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:40.332743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c5b0edf-7201-4bb1-b385-3db7276bafb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.090836 Nov 20 21:09:40.335550 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2926/5956] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:40 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:40.380256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:40.382163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:40.392846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:40.395885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:40.396881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:40.398298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:40.487779 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acd97f17-7b44-45c0-9b19-83ab2e367295 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.114182 Nov 20 21:09:40.491742 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3031/5957] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:40 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:41.346823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:41.348417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:41.355839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:41.356299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:41.357085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:41.357725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:41.406118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c5d15d7-c776-44b9-8265-ddb232428cf2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.063307 Nov 20 21:09:41.407047 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2927/5958] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:41 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:41.506213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:41.508178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:41.519988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:41.520831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:41.521823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:41.523029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:41.578070 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0dec1066-296c-4a41-a4d5-a2d0c7de78b3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.078198 Nov 20 21:09:41.578912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3032/5959] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:41 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:42.418353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:42.419373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:42.429448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:42.429925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:42.430785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:42.431237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:42.473729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cb1df64-236d-411b-8b0e-3fe4c33f534d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.059366 Nov 20 21:09:42.474708 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2928/5960] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:42 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:42.590908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:42.592020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:42.599371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:42.599904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:42.600761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:42.601293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:42.641418 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-29bfd5f7-2378-42d5-b3a8-714b10d56f8e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.054761 Nov 20 21:09:42.645492 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3033/5961] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:42 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:43.486251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:43.487273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:43.495153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:43.495614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:43.496427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:43.496871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:43.543999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aec75a50-e341-4e39-a407-5738ed0038ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.062098 Nov 20 21:09:43.545372 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2929/5962] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:43 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:43.653696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:43.654759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:43.662681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:43.663138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:43.663978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:43.664417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:43.706325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b9964ae8-86fd-4cd5-a31d-563815095635 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.056769 Nov 20 21:09:43.707193 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3034/5963] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:43 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:44.556433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:44.557583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:44.565438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:44.565975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:44.566866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:44.567384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:44.614095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b107fde-aa3b-40a9-9d8f-5218c7015e7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.061744 Nov 20 21:09:44.614996 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2930/5964] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:44 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:44.719629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:44.720560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:44.727988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:44.728443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:44.729264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:44.729702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:44.776586 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0d979c0-4d97-4c70-abb0-2899c8da287b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.061811 Nov 20 21:09:44.777519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3035/5965] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:44 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:45.631620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:45.636415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:45.644285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:45.644746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:45.645560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:45.646006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:45.690643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8f3513f-2a2d-459a-9957-4909b45db284 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.062877 Nov 20 21:09:45.691843 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2931/5966] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:45 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:45.792082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:45.793250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:45.801370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:45.801828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:45.802950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:45.803127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:45.845377 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-718e5b33-4896-44bb-990d-64c201ddff7e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.059244 Nov 20 21:09:45.850187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3036/5967] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:45 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:46.703998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:46.705026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:46.712338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:46.712847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:46.713576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:46.714014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:46.754611 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49538511-e6a8-41dd-8365-409ba202d842 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.055353 Nov 20 21:09:46.755555 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2932/5968] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:46 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:46.857620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:46.859211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:46.866649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:46.867098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:46.867871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:46.868308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:46.914874 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88ff7da7-51cd-4b44-971f-d90847473772 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.061127 Nov 20 21:09:46.915825 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3037/5969] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:46 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:47.767785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:47.769342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:47.777989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:47.778557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:47.779501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:47.780134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:47.822311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78470b10-327d-4165-bb72-e89ae43194c8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.059000 Nov 20 21:09:47.823001 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2933/5970] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:47 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:47.927411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:47.928448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:47.937174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:47.937921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:47.938742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:47.939216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:47.980194 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99a44704-05ec-4f21-93be-8d8d9271b217 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.056731 Nov 20 21:09:47.980991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3038/5971] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:47 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:48.834996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:48.836017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:48.843979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:48.844553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:48.845401 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:48.845854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:48.888566 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27d408ab-02ed-43b2-bc9c-bc2f688b6f1d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.057487 Nov 20 21:09:48.889437 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2934/5972] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:48 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:48.992052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:48.993056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:49.001073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:49.001530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:49.002351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:49.002797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:49.047182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-146b69c5-34ac-468b-b862-f46944485e8f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.058231 Nov 20 21:09:49.048105 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3039/5973] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:48 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:49.901492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:49.902632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:49.910494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:49.910949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:49.912083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:49.912525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:49.958255 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c78cd43e-85ff-4a13-b6d9-20f6437fc945 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.060865 Nov 20 21:09:49.962081 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2935/5974] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:49 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:50.059900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:50.060973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:50.069150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:50.069598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:50.070481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:50.070920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:50.110861 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-97da9e24-a4bc-49fb-a1e8-a9ad388a2c19 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.055199 Nov 20 21:09:50.114840 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3040/5975] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:50 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:09:50.971046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:50.972155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:50.979788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:50.980244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:50.981035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:50.981475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:51.022930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a6897ec4-ab31-4353-8d37-710516a8feac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.056465 Nov 20 21:09:51.023590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2936/5976] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:50 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:51.123604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:51.125789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:51.133569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:51.134009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:51.134815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:51.135242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:51.179643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-796293e7-1c26-4d50-a11f-6c6722d1678e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.060388 Nov 20 21:09:51.180310 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3041/5977] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:51 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:52.037032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:52.038830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:52.047342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:52.047807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:52.048615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:52.049059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:52.092625 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a2dd88b-d3ea-47fe-ba31-39075f9043b0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.061000 Nov 20 21:09:52.094911 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2937/5978] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:52 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:52.193475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:52.195874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:52.206801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:52.207931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:52.209363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:52.209815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:52.269409 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3390851a-15d3-4708-82c9-2d0dd2222ea8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 32638 microversion: 2.20 time: 0.081183 Nov 20 21:09:52.274514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3042/5979] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:52 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 32638 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:53.105250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:53.106277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:53.113793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.114300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.115104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.115544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.157166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b4ed69e-5979-4af9-95ef-5447a275dfc7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.055832 Nov 20 21:09:53.158132 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2938/5980] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:53 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:53.282904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:53.284011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:53.305044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.305514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.306415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.306857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.362243 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ff795e1-671c-41e2-bbc4-743278119936 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 200 len: 40782 microversion: 2.20 time: 0.083529 Nov 20 21:09:53.362919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3043/5981] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:53 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 40782 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:09:53.375165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:53.375848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:53.384330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.384789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.385869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:53.386380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:53.413495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c88b215-8f57-4ef0-b867-6a33c245ab12 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/ips" status: 200 len: 152 microversion: 2.20 time: 0.044306 Nov 20 21:09:53.414292 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2939/5982] 10.222.0.41 () {60 vars in 1288 bytes} [Sat Nov 20 21:09:53 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/ips => generated 152 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:54.169741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:54.171466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:54.178416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:54.178867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:54.179646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:54.180085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:54.220487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-290c6a5f-c380-4329-a7f2-01cb05939d51 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.054738 Nov 20 21:09:54.224950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3044/5983] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:54 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:55.232742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:55.234374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:55.241977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.242598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:55.243492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.243941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:55.285802 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f80bbdf-fe1c-4215-ab3c-ed3d77e1c43e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.056640 Nov 20 21:09:55.286722 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2940/5984] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:55 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:55.468908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:55.469546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:55.479142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.479142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:55.479142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.479523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:55.508647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lazy-loading 'flavor' on Instance uuid 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:09:55.794994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8cb0d1c3-8f42-41c6-8656-eeae9a3b461f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 202 len: 0 microversion: 2.20 time: 0.330484 Nov 20 21:09:55.804763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:55.805461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:55.810598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3045/5985] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:09:55 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:09:55.813659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.814146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:55.815068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:55.815529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:56.078571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:56.087464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:56.088955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:56.090153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf8471e0-fa45-44e8-a7a9-6a2296446835 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.289531 Nov 20 21:09:56.091089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2941/5986] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:09:55 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:09:56.302705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:56.304376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:56.315492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:56.316078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:56.317044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:56.317485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:56.360242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d68bf1e5-657c-416c-940d-63f89cb1be99 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.065242 Nov 20 21:09:56.361145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3046/5987] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:56 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:57.108487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:57.109624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:57.117465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:57.117923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:57.118813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:57.119256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:57.255902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:57.263949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:57.266143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:57.267313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d43db365-b1f7-4199-906b-6151f7a049a8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.162659 Nov 20 21:09:57.267883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2942/5988] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:09:57 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:09:57.372429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:57.373408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:57.383043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:57.383806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:57.384959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:57.385174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:57.426257 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-890e7d5c-5102-40a2-b49b-7ced72770cb7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.057692 Nov 20 21:09:57.427001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3047/5989] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:57 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:58.286676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:58.287409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:58.294288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:58.294676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:58.295541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:58.296069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:58.439719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:58.440799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:58.446358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:58.448552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:58.449018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:58.449814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:58.450281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:58.456205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:58.458004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:58.459511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ec3b753-6aa1-4d7a-ad11-a4f47ad634c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.176810 Nov 20 21:09:58.460254 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2943/5990] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:09:58 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:09:58.493290 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ac3a5c8-8894-42f2-bf4d-24b72b0463a5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.058448 Nov 20 21:09:58.493950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3048/5991] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:58 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:09:59.477562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:09:59.478244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:59.485823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:59.486311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:59.487110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:59.487549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:59.505817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:09:59.507681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:09:59.517081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:59.517769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:59.518830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:09:59.530758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:09:59.597139 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e93c39cb-1c36-44e0-a8f2-39ff478698cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.095253 Nov 20 21:09:59.598284 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3049/5992] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:09:59 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:09:59.649479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:59.658186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:59.659777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:09:59.660950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-664b5ddb-9e80-4b94-a860-a1cda93bd855 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.187345 Nov 20 21:09:59.661513 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2944/5993] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:09:59 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:00.609958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:00.610982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:00.618269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:00.618713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:00.619486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:00.619920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:00.663730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-735198cb-6171-40b2-90f2-d852d0ce64e4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.058333 Nov 20 21:10:00.667723 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3050/5994] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:00 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:00.679379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:00.679990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:00.687480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:00.688049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:00.688854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:00.689295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:00.825130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:00.833066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:00.834621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:00.835974 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb5222a3-1558-42c4-ac0d-573202c9d4df tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.160377 Nov 20 21:10:00.836531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2945/5995] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:00 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:01.677710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:01.679376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:01.688270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:01.688944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:01.690381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:01.691165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:01.735200 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1828207-fbee-4b9f-8553-f124f6bc552d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.062530 Nov 20 21:10:01.735787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3051/5996] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:01 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:01.854897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:01.855760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:01.864299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:01.864748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:01.865767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:01.866257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:02.001326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:02.009429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:02.011126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:02.012292 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-044a3f12-3cd9-42d0-8f81-d753ce54cb27 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.161595 Nov 20 21:10:02.012862 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2946/5997] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:01 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:02.747852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:02.748871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:02.756406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:02.757223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:02.758158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:02.758604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:02.806033 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cdf9c5c5-c7fa-4883-9253-482611b15e44 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.062376 Nov 20 21:10:02.810164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3052/5998] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:02 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:03.030323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:03.030939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:03.037645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:03.038157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:03.038942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:03.039407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:03.277550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:03.286957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:03.288552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:03.289817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e20fde4b-fdf6-43ba-89e2-39db590c81fd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.263283 Nov 20 21:10:03.290840 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2947/5999] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:03 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:03.818311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:03.819339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:03.826887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:03.827343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:03.828122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:03.828555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:03.868024 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0938a1b7-6888-4c2c-b2f8-5d081eb4d2f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.053674 Nov 20 21:10:03.868711 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3053/6000] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:03 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:04.307645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:04.308250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:04.315115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:04.315568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:04.316468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:04.317021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:04.468943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:04.477456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:04.479199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:04.480839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7d74ad2c-61e9-4f6d-98a3-cd10806119dd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.176804 Nov 20 21:10:04.481748 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2948/6001] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:04 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:04.881997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:04.883175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:04.891520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:04.892265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:04.892756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:04.893198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:04.944940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e0ea7b0-fa41-4269-ae92-2f37bc1d4c7f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.066170 Nov 20 21:10:04.945464 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3054/6002] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:04 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:10:05.499860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:05.500462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:05.509522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:05.510390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:05.511813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:05.512648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:05.645742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:05.653536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:05.655742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:05.656907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2ef29630-1e37-4d00-ac2b-dbc5ce3ae6f3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.161131 Nov 20 21:10:05.657463 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2949/6003] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:05 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:05.956742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:05.958120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:05.965413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:05.965941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:05.966854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:05.967525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:06.009322 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-48001a38-124d-4119-b912-e24ebc15bab9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.057227 Nov 20 21:10:06.013323 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3055/6004] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:05 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:06.675537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:06.676152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:06.684403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:06.684952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:06.685969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:06.687298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:06.833849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:06.841756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:06.843465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:06.844638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c406695-e0ad-49cf-9470-e8a7d2688f01 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1742 microversion: 2.20 time: 0.173287 Nov 20 21:10:06.845255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2950/6005] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:06 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:07.022136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:07.023427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:07.030963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:07.031409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:07.032190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:07.032621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:07.073804 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e8df82f3-03a4-4ef7-92b1-628254688c67 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.055885 Nov 20 21:10:07.074476 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3056/6006] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:07 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:07.864204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:07.864768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:07.871574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:07.872026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:07.872819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:07.873259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:08.009010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:08.018741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:08.020573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:08.021891 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f4eafe86-7010-4fa9-89dd-a28dc4420766 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1742 microversion: 2.20 time: 0.161595 Nov 20 21:10:08.022703 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2951/6007] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:07 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:08.086282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:08.087878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:08.104018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:08.104732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:08.106246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:08.106813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:08.152022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5161cf2d-346f-4266-ad7b-75406b173fb1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.070430 Nov 20 21:10:08.152695 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3057/6008] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:08 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:10:09.041210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:09.043366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:09.052029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:09.052722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:09.053636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:09.054315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:09.165044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:09.166169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:09.179988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:09.182077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:09.185836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:09.186528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:09.207684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:09.217754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:09.219630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:09.221012 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0741b3bd-551a-406d-8743-db5205662ef5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.183492 Nov 20 21:10:09.222093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2952/6009] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:09 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:09.256721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87e66a77-c7c3-4a36-8c09-33e37aaa20ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.094813 Nov 20 21:10:09.257917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3058/6010] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:09 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:10.243445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:10.244703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:10.254246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:10.254963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:10.256128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:10.256981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:10.270388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:10.271661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:10.294414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:10.295086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:10.296412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:10.297609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:10.375848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ef1dfd2-399f-4872-9a19-0db4d7e01246 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.110098 Nov 20 21:10:10.377073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3059/6011] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:10 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:10:10.457396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:10.467470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:10.469351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:10.471273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70e59c98-6eba-4e2c-8b5a-a366a859417d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.234831 Nov 20 21:10:10.483683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2953/6012] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:10 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:11.388479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:11.390466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:11.398454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:11.399323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:11.400187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:11.404202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:11.457275 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12bb15a4-ac9d-454f-aee8-15196145beab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.072671 Nov 20 21:10:11.457971 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3060/6013] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:11 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:11.490575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:11.491144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:11.498465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:11.499239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:11.500455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:11.500907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:11.660098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:11.668077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:11.669715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:11.671079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27528cd9-7d0c-40ea-b0f2-5268624e3581 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.184521 Nov 20 21:10:11.671821 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2954/6014] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:11 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:12.094395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3c31ec0b-0a65-44a5-8605-6751aba7b0b7 req-1a30266a-c3d6-4cf4-b362-9439c55ddd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "name": "network-vif-plugged", "status": "completed", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:12.095806 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:12.095806 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:10:12.116065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3c31ec0b-0a65-44a5-8605-6751aba7b0b7 req-1a30266a-c3d6-4cf4-b362-9439c55ddd5d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:12.116629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3c31ec0b-0a65-44a5-8605-6751aba7b0b7 req-1a30266a-c3d6-4cf4-b362-9439c55ddd5d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:12.132965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3c31ec0b-0a65-44a5-8605-6751aba7b0b7 req-1a30266a-c3d6-4cf4-b362-9439c55ddd5d service nova] Creating event network-vif-plugged:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch2-master-1 Nov 20 21:10:12.140588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3c31ec0b-0a65-44a5-8605-6751aba7b0b7 req-1a30266a-c3d6-4cf4-b362-9439c55ddd5d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049440 Nov 20 21:10:12.141817 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3061/6015] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:12.470839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:12.472130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:12.491489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:12.501676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:12.504899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:12.505566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:12.585318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d841040c-68c3-43af-8282-02dfa25a18c7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.120111 Nov 20 21:10:12.591298 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2955/6016] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:12 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:12.692407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:12.694036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:12.704215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:12.705169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:12.706509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:12.707549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:12.881911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:12.891698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:12.893793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:12.895244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11347753-f8ff-421b-9bef-4a0d7006588a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.210220 Nov 20 21:10:12.896039 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3062/6017] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:12 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:13.599224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:13.600939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:13.613998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.614853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:13.615988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.616643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:13.663090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0b9f0d5-f99c-400e-965b-d005ed329d61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.067583 Nov 20 21:10:13.663927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2956/6018] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:13 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:10:13.879786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:13.880340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:13.887779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.888528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:13.890166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.891034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:13.915361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:13.916051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:13.922699 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4534546f-dbc1-456d-9af9-583073ed18d1 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046946 Nov 20 21:10:13.923728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3063/6019] 10.222.0.41 () {58 vars in 1292 bytes} [Sat Nov 20 21:10:13 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d/os-server-password => generated 116 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:10:13.924442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.924993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:13.925925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:13.926407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:14.165352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:14.175939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:14.178327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:14.183120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc86c885-2ac4-47f3-885e-b624df8337a4 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.272340 Nov 20 21:10:14.184140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2957/6020] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:13 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:14.675911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:14.677038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:14.684312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:14.684769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:14.685864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:14.686367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:14.730976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7bff080e-f167-4bd4-b452-11628558f711 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.058752 Nov 20 21:10:14.733087 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3064/6021] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:14 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:15.204998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:15.205645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:15.212672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:15.213433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:15.214590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:15.215312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:15.403879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:15.414721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:15.416522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:15.417896 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82389dc9-659e-462a-9ccf-dfa191bd6669 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.218091 Nov 20 21:10:15.418993 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2958/6022] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:15 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:15.743803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:15.744822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:15.752749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:15.753457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:15.754483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:15.754926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:15.817307 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c98177b-628e-44b5-bc98-83cb5599e5df tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 32630 microversion: 2.1 time: 0.076672 Nov 20 21:10:15.818610 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3065/6023] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:15 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 32630 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:16.440483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:16.441041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:16.449395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.450652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.452671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.453287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.628534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:16.642344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:16.644055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:16.645256 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c7121205-2337-41ea-93ac-590fa2f7e7d6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.212532 Nov 20 21:10:16.645833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2959/6024] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:16 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:16.830243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:16.832080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:16.840400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.841362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.842773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.843576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.911614 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b753b77-ce25-41aa-bf33-fff382621b91 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 200 len: 40781 microversion: 2.1 time: 0.085737 Nov 20 21:10:16.915349 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3066/6025] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:16 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 40781 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:10:16.932275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:16.933041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:16.946780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.947650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.948688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:16.949235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:16.986308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cbf9055b-363b-49cd-a7d3-29ab1f14a589 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/ips" status: 200 len: 146 microversion: 2.1 time: 0.048697 Nov 20 21:10:16.986308 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2960/6026] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:10:16 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:17.007513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-851923860", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:17.066673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:10:17.385938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:10:17.386457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:10:17.387262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:10:17.387860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:10:17.388449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:10:17.398283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:17.398997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:17.399999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:17.400620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:17.419697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Getting quotas for project 7e963a326fb146adb3e89d20c539ea57. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:10:17.426481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Getting quotas for user d9606be55a4b4391b304cf7a9f6005b3 and project 7e963a326fb146adb3e89d20c539ea57. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:10:17.440384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:10:17.442982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:10:17.495682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4573adab-4b1b-464c-a9df-5ed0fee4cbd7 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490581 Nov 20 21:10:17.496983 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3067/6027] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:10:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:10:17.507012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b0766234-eb46-4cb9-8149-ef20ee8a9ee8 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:17.508547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b0766234-eb46-4cb9-8149-ef20ee8a9ee8 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:17.579115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b0766234-eb46-4cb9-8149-ef20ee8a9ee8 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:17.586729 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b0766234-eb46-4cb9-8149-ef20ee8a9ee8 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1214 microversion: 2.1 time: 0.083662 Nov 20 21:10:17.587452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2961/6028] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:17 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:17.666952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:17.667662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:17.675859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:17.676013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:17.676886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:17.677541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:17.874003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:17.887137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:17.888657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:17.890615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7c586f1-f2cf-4330-9d73-05c1d896c90b tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.229441 Nov 20 21:10:17.891392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3068/6029] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:17 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:18.608087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:18.608845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:18.624095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:18.624480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:18.625354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:18.625735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:18.741120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:18.757904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0c74788-7a47-4492-bfa9-54d5c3d026af tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1274 microversion: 2.1 time: 0.154379 Nov 20 21:10:18.758857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2962/6030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:18 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:18.909324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:18.910021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:18.916994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:18.917444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:18.918253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:18.918687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:19.055478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:19.064147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:19.065638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:19.067026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fc8eb5d-1619-4354-81ab-d49d10f7d948 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1737 microversion: 2.20 time: 0.162281 Nov 20 21:10:19.067600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3069/6031] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:18 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:19.194390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afabfac2-5807-4d77-9ff3-9126704d7471"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:19.196106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:19.203214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:19.203753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:19.204618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:19.205265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:19.466495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b07fdc4-10e6-411f-be56-bc6f57c673ba tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278470 Nov 20 21:10:19.468064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2963/6032] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:10:19 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:19.775576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:19.776199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:19.783943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:19.784732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:19.785863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:19.787085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:20.012700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:20.022576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8d1acae-7978-41b4-b9ac-55e4f32dfb9a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.250582 Nov 20 21:10:20.023599 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3070/6033] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:19 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:20.085916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:20.087233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:20.094923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:20.095627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:20.096434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:20.096878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:20.328699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:20.336735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:20.338467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:20.339674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0693c126-dfaa-4da0-a34d-7c56fcdbc8a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1719 microversion: 2.20 time: 0.257812 Nov 20 21:10:20.340241 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2964/6034] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:20 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:20.693592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a8c86441-ebd3-4a13-81fe-b9b1c82cd83e req-4800a895-bb0b-4293-9295-879a45027dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b7045c0-b775-4510-b6c3-dd2c02899f65", "tag": "de098d60-dfd2-427d-9e26-412db1a38a6a"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:20.696003 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:20.696003 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:10:20.704669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a8c86441-ebd3-4a13-81fe-b9b1c82cd83e req-4800a895-bb0b-4293-9295-879a45027dae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:20.705367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a8c86441-ebd3-4a13-81fe-b9b1c82cd83e req-4800a895-bb0b-4293-9295-879a45027dae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:20.728530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a8c86441-ebd3-4a13-81fe-b9b1c82cd83e req-4800a895-bb0b-4293-9295-879a45027dae service nova] Creating event network-changed:de098d60-dfd2-427d-9e26-412db1a38a6a for instance 3b7045c0-b775-4510-b6c3-dd2c02899f65 on nch2-master-1 Nov 20 21:10:20.733817 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a8c86441-ebd3-4a13-81fe-b9b1c82cd83e req-4800a895-bb0b-4293-9295-879a45027dae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043812 Nov 20 21:10:20.734938 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3071/6035] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:21.040074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:21.040784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:21.047306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:21.047853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:21.048654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:21.049098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:21.236957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:21.251605 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64607de2-6bbc-4b97-a8ff-e1bbf3a40f20 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.215010 Nov 20 21:10:21.252066 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2965/6036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:21 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:21.361139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:21.361843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:21.368035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:21.368488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:21.369282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:21.369721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:21.524631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:21.539221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:21.541874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:21.543446 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2091ca3f-af46-407e-9cbe-99fc2ec7323e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1719 microversion: 2.20 time: 0.188492 Nov 20 21:10:21.544789 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3072/6037] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:21 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:22.004701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d36bbab5-73e2-46e8-8c27-592523793744 req-1b6ae041-cba7-40d1-835e-ed5962a3174a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "name": "network-vif-unplugged", "status": "completed", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:22.006794 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:22.006794 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:22.014441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d36bbab5-73e2-46e8-8c27-592523793744 req-1b6ae041-cba7-40d1-835e-ed5962a3174a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.014847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d36bbab5-73e2-46e8-8c27-592523793744 req-1b6ae041-cba7-40d1-835e-ed5962a3174a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.025969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_external_events [req-d36bbab5-73e2-46e8-8c27-592523793744 req-1b6ae041-cba7-40d1-835e-ed5962a3174a service nova] Unable to find a host for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1. Dropping event network-vif-unplugged {{(pid=140942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:10:22.026891 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d36bbab5-73e2-46e8-8c27-592523793744 req-1b6ae041-cba7-40d1-835e-ed5962a3174a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026106 Nov 20 21:10:22.027493 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2966/6038] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:21 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 20 21:10:22.268994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:22.269550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:22.275482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.275925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.276686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.277130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.568074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:22.568802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:22.575508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.575957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.576775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.577259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.722859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:22.731914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:22.732372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:22.734284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:22.736153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c841bebc-4dd3-464d-bb71-960f4b295ab6 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1662 microversion: 2.20 time: 0.171745 Nov 20 21:10:22.737027 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2967/6039] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:22 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:22.748889 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81673e45-ef46-42ee-9dc5-d4d73ef50329 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.483516 Nov 20 21:10:22.749641 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3073/6040] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:22 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:22.754563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4972b21b-fa11-4ec9-8890-516259485f08"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:22.755994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:22.762111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.762577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.763371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.763958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.789839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57f64825-ad6e-4cdf-83fd-c9a5d84c59c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:22.796751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57f64825-ad6e-4cdf-83fd-c9a5d84c59c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.797201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57f64825-ad6e-4cdf-83fd-c9a5d84c59c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.819734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57f64825-ad6e-4cdf-83fd-c9a5d84c59c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:10:22.862726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57f64825-ad6e-4cdf-83fd-c9a5d84c59c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 202 len: 0 microversion: 2.1 time: 0.076404 Nov 20 21:10:22.863585 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3074/6041] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:22 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:10:22.872283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:22.873552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:22.882035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.883220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:22.884052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:22.884489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.030863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c590d4b8-3179-4bd4-8f7a-b6a87706d530 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280335 Nov 20 21:10:23.031472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2968/6042] 10.222.0.41 () {62 vars in 1363 bytes} [Sat Nov 20 21:10:22 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:10:23.034291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:23.042326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-afc23465-16a7-4f57-bb0c-a9810415e3eb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.174186 Nov 20 21:10:23.042903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3075/6043] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:22 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:23.141529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:23.142067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:23.147923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.148376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.149162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.149604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.360161 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1a40cbe-20a9-4160-949c-4bd4cfaf751c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments/4972b21b-fa11-4ec9-8890-516259485f08" status: 202 len: 0 microversion: 2.20 time: 0.222568 Nov 20 21:10:23.360740 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2969/6044] 10.222.0.41 () {60 vars in 1456 bytes} [Sat Nov 20 21:10:23 2021] DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments/4972b21b-fa11-4ec9-8890-516259485f08 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:10:23.419658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:23.420888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:23.427696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.428137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.428905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.429337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.625147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db45c0eb-b85b-478f-bbea-7d5659dcb937 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action" status: 202 len: 0 microversion: 2.20 time: 0.209040 Nov 20 21:10:23.625803 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3076/6045] 10.222.0.41 () {62 vars in 1318 bytes} [Sat Nov 20 21:10:23 2021] POST /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:10:23.633931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:23.634725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:23.642616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.643056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.643871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.644348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.765802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:23.766463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:23.772349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.772800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.774287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:23.774726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:23.815883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:23.824356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:23.828023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:23.829221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cda28ca2-0343-4608-a8ac-35b7e204655e tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1670 microversion: 2.20 time: 0.199261 Nov 20 21:10:23.830114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2970/6046] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:23 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1670 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:23.919851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:23.927778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa7078be-e4e1-4d79-ab25-d99cfcb917d3 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.166283 Nov 20 21:10:23.934149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3077/6047] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:23 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:24.062437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:24.063432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:24.071873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.072746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:24.073791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.074431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:24.222395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:24.230449 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-977a7ac6-5c6d-433a-b36d-3a0c3bc82407 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.172577 Nov 20 21:10:24.231033 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2971/6048] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:24 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:24.847295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:24.848116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:24.854760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.855204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:24.855972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.856404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:24.945801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:24.946626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:24.954077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.954555 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:24.955370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:24.955817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:25.002994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:25.011290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:25.012787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:25.014622 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33be671c-635a-46a5-b768-ed484ca131e9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.170403 Nov 20 21:10:25.015195 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3078/6049] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:24 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:25.248812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:25.249632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:25.255609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:25.256148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:25.257244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:25.257771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:25.315085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:25.331907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-555ba5a1-1e23-479e-885e-84694fa871fd tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.390165 Nov 20 21:10:25.332510 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2972/6050] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:24 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:25.398737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:25.406896 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9786bad8-f6be-44cc-b6ae-01b0fe7d825f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.162248 Nov 20 21:10:25.407412 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3079/6051] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:25 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:25.533030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-271073a6-9011-451b-ba26-e781b933abfd req-7b1de4e3-b0c2-4c2a-95c9-279108fd63a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:25.534587 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:25.534587 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:25.542594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-271073a6-9011-451b-ba26-e781b933abfd req-7b1de4e3-b0c2-4c2a-95c9-279108fd63a1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:25.543054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-271073a6-9011-451b-ba26-e781b933abfd req-7b1de4e3-b0c2-4c2a-95c9-279108fd63a1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:25.560499 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-271073a6-9011-451b-ba26-e781b933abfd req-7b1de4e3-b0c2-4c2a-95c9-279108fd63a1 service nova] Creating event network-changed:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch1-master-1 Nov 20 21:10:25.566670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-271073a6-9011-451b-ba26-e781b933abfd req-7b1de4e3-b0c2-4c2a-95c9-279108fd63a1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039105 Nov 20 21:10:25.567577 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2973/6052] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:26.034421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:26.035683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:26.042272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.042801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.043601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.044041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.098372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1a343e01-4177-4c50-8076-a499529b68ae req-a208515e-718a-4935-8676-5e3921d0a139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7045c0-b775-4510-b6c3-dd2c02899f65", "name": "network-vif-plugged", "status": "completed", "tag": "de098d60-dfd2-427d-9e26-412db1a38a6a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:26.100119 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:26.100119 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:26.109783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a343e01-4177-4c50-8076-a499529b68ae req-a208515e-718a-4935-8676-5e3921d0a139 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.110527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a343e01-4177-4c50-8076-a499529b68ae req-a208515e-718a-4935-8676-5e3921d0a139 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.127108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1a343e01-4177-4c50-8076-a499529b68ae req-a208515e-718a-4935-8676-5e3921d0a139 service nova] Creating event network-vif-plugged:de098d60-dfd2-427d-9e26-412db1a38a6a for instance 3b7045c0-b775-4510-b6c3-dd2c02899f65 on nch2-master-1 Nov 20 21:10:26.133374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1a343e01-4177-4c50-8076-a499529b68ae req-a208515e-718a-4935-8676-5e3921d0a139 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044091 Nov 20 21:10:26.134961 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2974/6053] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:26.221695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:26.233559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:26.235555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:26.237420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a917d64-3b1b-4a71-9a16-c4ace5cb4acd tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.208178 Nov 20 21:10:26.238286 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3080/6054] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:26 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:26.349478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:26.350385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:26.356761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.357329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.358937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.359637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.424593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:26.425296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:26.432405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.433729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.434838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:26.435394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:26.613065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:26.622595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-909189f2-1191-41a8-bf96-808537ea30df tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1314 microversion: 2.1 time: 0.277062 Nov 20 21:10:26.628494 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2975/6055] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:26 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:26.703662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:26.712442 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f601c89d-5717-43b2-a9cd-ce7eb8c199a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.292346 Nov 20 21:10:26.713637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3081/6056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:26 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:27.258433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:27.259843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:27.267678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.268438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.269357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.269871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.441069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:27.449719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:27.453933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:27.455885 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49688556-3b39-4051-9814-30b02dd344da tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.202548 Nov 20 21:10:27.456566 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2976/6057] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:27 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:27.642677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:27.643289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:27.649978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.650484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.651261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.651694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.731164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:27.731961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:27.738575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.739034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.739826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.740267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.796513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:27.806530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3da6d6a-4667-4d0f-9df3-cab2d13d4b21 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1463 microversion: 2.1 time: 0.168315 Nov 20 21:10:27.809707 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3082/6058] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:27 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:27.849380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:27.850169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:27.856270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.856727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.858131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.858623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.888414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:10:27.910431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:27.918539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-087f3f3f-33fa-40df-b8c4-0f926afe1c60 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.191036 Nov 20 21:10:27.919222 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2977/6059] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:27 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:27.978115 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f9ad16d-af62-4671-b854-8496013ef1a2 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 204 len: 0 microversion: 2.1 time: 0.131962 Nov 20 21:10:27.982292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3083/6060] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:10:27 2021] DELETE /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:10:27.987702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:27.988558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:27.995169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.995877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:27.996867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:27.997307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:28.138262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:28.146447 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e529da0e-19b0-4767-95ee-027a153284a6 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1469 microversion: 2.1 time: 0.162460 Nov 20 21:10:28.147294 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2978/6061] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:27 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:28.474816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:28.475782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:28.488738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:28.488738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:28.488738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:28.488738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:28.635097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:28.643031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:28.644529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:28.645691 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8fb06bd8-67dc-4ca2-8868-bbdba89b4b62 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.174978 Nov 20 21:10:28.646299 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3084/6062] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:28 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:28.938793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:28.940410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:28.947640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:28.948129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:28.948933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:28.949384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:29.089287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:29.099054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccfa35d0-f697-4f88-ad71-0c46ebb8ae7c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.165779 Nov 20 21:10:29.099823 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2979/6063] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:28 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:29.164507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:29.165182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:29.172122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:29.172573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:29.173354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:29.173793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:29.314255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:29.323778 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87f68874-fbdb-4694-90f4-440abe577845 tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1469 microversion: 2.1 time: 0.162833 Nov 20 21:10:29.328093 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3085/6064] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:29 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:29.663890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:29.664505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:29.671389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:29.671909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:29.672675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:29.673117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:29.996056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:30.004594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:30.006119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:30.007751 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b854892-6e4c-4849-b937-dede1609e1c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.347667 Nov 20 21:10:30.008315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2980/6065] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:29 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:30.116548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:30.117988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:30.125367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.125815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.126637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.127072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.192790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9c956ffa-2276-4ac6-8853-2e4e8a0c6fa6 req-3e8af3f3-a068-4dad-a34b-81ee6055e04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b7045c0-b775-4510-b6c3-dd2c02899f65", "name": "network-vif-deleted", "tag": "de098d60-dfd2-427d-9e26-412db1a38a6a"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:30.194821 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:30.194821 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:30.224589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9c956ffa-2276-4ac6-8853-2e4e8a0c6fa6 req-3e8af3f3-a068-4dad-a34b-81ee6055e04f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.225031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9c956ffa-2276-4ac6-8853-2e4e8a0c6fa6 req-3e8af3f3-a068-4dad-a34b-81ee6055e04f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.252760 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9c956ffa-2276-4ac6-8853-2e4e8a0c6fa6 req-3e8af3f3-a068-4dad-a34b-81ee6055e04f service nova] Creating event network-vif-deleted:de098d60-dfd2-427d-9e26-412db1a38a6a for instance 3b7045c0-b775-4510-b6c3-dd2c02899f65 on nch2-master-1 Nov 20 21:10:30.259270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9c956ffa-2276-4ac6-8853-2e4e8a0c6fa6 req-3e8af3f3-a068-4dad-a34b-81ee6055e04f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070206 Nov 20 21:10:30.266935 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2981/6066] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:10:30.325744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:30.336359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a22bd6e2-0ab7-4c9e-8996-9cd103a9bf70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.223508 Nov 20 21:10:30.337415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3086/6067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:30 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:30.348540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:30.353259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:30.361676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.362292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.363251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.363791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.399802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:30.400486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:30.401016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lazy-loading 'fault' on Instance uuid 3b7045c0-b775-4510-b6c3-dd2c02899f65 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:10:30.450079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9606be55a4b4391b304cf7a9f6005b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e963a326fb146adb3e89d20c539ea57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:30.457945 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02903a44-6a93-4118-8cfe-3bdd075fcd0a tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 200 len: 1304 microversion: 2.1 time: 0.118914 Nov 20 21:10:30.458818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2982/6068] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:30 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:31.026848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:31.027455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:31.034221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.034676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.035460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.035928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.190119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:31.198547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:31.200046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:31.201244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59921425-0572-4906-9e11-54c9578c40c9 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.178114 Nov 20 21:10:31.201810 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3087/6069] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:31 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:31.354671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:31.356471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:31.364974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.365517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.366704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.367356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.476536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:31.477149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] [instance: 3b7045c0-b775-4510-b6c3-dd2c02899f65] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:31.483454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.483901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.484723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:31.485157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:31.500203 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] HTTP exception thrown: Instance 3b7045c0-b775-4510-b6c3-dd2c02899f65 could not be found. Nov 20 21:10:31.500816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] Returning 404 to user: Instance 3b7045c0-b775-4510-b6c3-dd2c02899f65 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:10:31.501649 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ef2a6f55-41d7-4956-8219-71ac3b3f748d tempest-VolumesNegativeTest-452759441 tempest-VolumesNegativeTest-452759441-project] 10.222.0.41 "GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65" status: 404 len: 111 microversion: 2.1 time: 0.028814 Nov 20 21:10:31.502270 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3088/6070] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:31 2021] GET /compute/v2.1/servers/3b7045c0-b775-4510-b6c3-dd2c02899f65 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:10:31.511863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:31.521583 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79955118-2762-4e10-ac5c-dca4ff508613 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.171273 Nov 20 21:10:31.531331 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2983/6071] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:31 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:32.219586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:32.220053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:32.226437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:32.226897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:32.227687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:32.228129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:32.426758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:32.434654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:32.436280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:32.437465 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d33dbac-837a-466c-8926-4f9b3f6ec4e3 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.222615 Nov 20 21:10:32.438182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3089/6072] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:32 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:32.548670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:32.549283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:32.556608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:32.557158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:32.557969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:32.558445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:32.745882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:32.755949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f41fbada-6f21-441f-9540-4dba7d10fd36 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.220719 Nov 20 21:10:32.757349 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2984/6073] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:32 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:33.455909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:33.456524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:33.463814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:33.464094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:33.464846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:33.465291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:33.641874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:33.650236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:33.651723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:33.652869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61877a0f-445b-40f4-9df5-8645f126ee3a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.200751 Nov 20 21:10:33.653426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3090/6074] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:33 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:33.774703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:33.776212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:33.788614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:33.790587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:33.795966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:33.796444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:33.969711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:33.978259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-003019f4-1520-41cd-ae50-c283d6a02195 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.207390 Nov 20 21:10:33.978851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2985/6075] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:33 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:34.674837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:34.675645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:34.683740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:34.684309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:34.685186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:34.686185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:34.828304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:34.837584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:34.839093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:34.840255 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9088a599-83d7-405e-8a4b-287b6391b50d tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.171030 Nov 20 21:10:34.840822 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3091/6076] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:34 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:34.997224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:34.998849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:35.006746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:35.013157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:35.014359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:35.017879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:35.176147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:35.184696 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00ef82b2-0620-4c0f-a8f5-260b3b77fcc6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.191243 Nov 20 21:10:35.185364 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2986/6077] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:34 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:35.858950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:35.859649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:35.867181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:35.868487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:35.869748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:35.870374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.036882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.047270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.049463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.051625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f35ef7a-5412-4269-b0f9-dea1b2afa7f2 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.196525 Nov 20 21:10:36.052392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3092/6078] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:35 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:36.202629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:36.203538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:36.228955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.229347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.230449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.231477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.341922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:36.342886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:36.348921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.349484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.350472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.350994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.385565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:10:36.503810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.515937 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a5f2410b-9da0-4075-9234-29d76ef724ca tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.317781 Nov 20 21:10:36.526514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3093/6079] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:36 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:36.559549 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0fb97c4e-8a1e-4809-8f8a-b686316c9e3c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 204 len: 0 microversion: 2.32 time: 0.547876 Nov 20 21:10:36.561034 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2987/6080] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 21:10:36 2021] DELETE /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:10:36.570217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:36.571243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:36.579103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.579558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.580351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:36.580788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:36.814743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.823466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.824950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:36.826774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-84f45631-de0e-4ad5-b410-d47f8816b8e2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2957 microversion: 2.32 time: 0.260902 Nov 20 21:10:36.827341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3094/6081] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:36 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2957 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:37.071782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:37.072482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:37.080754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.081189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:37.081979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.082456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:37.295326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:37.309149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:37.311656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:37.313132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a3899a7-c6df-4130-a4ee-68e8254528a5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.245547 Nov 20 21:10:37.313787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2988/6082] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:37 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:37.532730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:37.534754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:37.545763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.546692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:37.547767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.548418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:37.773616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:37.784868 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c70c3ab5-289a-4dd0-a6da-eed5e859bc8e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1724 microversion: 2.1 time: 0.255774 Nov 20 21:10:37.785467 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3095/6083] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:37 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:37.847701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:37.848920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:37.859028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.859496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:37.860319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:37.860768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:38.206712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.216187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.218390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.219799 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54f78626-c34f-4e99-8af0-d683a95d9d0c tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2957 microversion: 2.32 time: 0.376761 Nov 20 21:10:38.232423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2989/6084] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:37 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2957 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:38.333215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:38.333893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:38.339868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:38.340386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:38.341183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:38.341672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:38.479492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.488187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.490446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:38.491830 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2f5189ee-5b87-4458-a4b3-ed3e7fdafe9a tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.162868 Nov 20 21:10:38.492426 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3096/6085] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:38 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:38.801929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:38.802782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:38.808812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:38.809275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:38.810125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:38.810956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.034386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.043518 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-58655907-e9d7-452c-9c6d-68c27bd9c9c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1701 microversion: 2.1 time: 0.245018 Nov 20 21:10:39.044435 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2990/6086] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:38 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1701 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:39.061321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce77e371-e326-4a3f-a78f-d16c106ac899 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:39.069933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce77e371-e326-4a3f-a78f-d16c106ac899 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.070421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce77e371-e326-4a3f-a78f-d16c106ac899 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.096880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce77e371-e326-4a3f-a78f-d16c106ac899 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Going to try to start instance {{(pid=140941) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:10:39.142836 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce77e371-e326-4a3f-a78f-d16c106ac899 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 202 len: 0 microversion: 2.1 time: 0.085690 Nov 20 21:10:39.143596 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3097/6087] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:10:39 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:10:39.153368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:39.154035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:39.162023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.162785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.163939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.164546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.241010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:39.241939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:39.249985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.250680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.252464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.253254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.454539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.464869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.467298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.468646 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43ec4424-e688-4c8f-9a6e-dbbabf40173b tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2915 microversion: 2.32 time: 0.232022 Nov 20 21:10:39.495283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3098/6088] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:39 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2915 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:10:39.507351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.511530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:39.512261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:39.523316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c04ad5c0-3dd8-4b80-818f-f813395f1ec7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1710 microversion: 2.1 time: 0.374815 Nov 20 21:10:39.526600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.527294 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2991/6089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:39 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1710 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:39.527417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.528787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.529839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.675950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.683889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.685668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:39.687503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-868d1952-0f4f-40a2-bdf1-376f50f92443 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.179584 Nov 20 21:10:39.688286 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3099/6090] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:39 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:39.916458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0d231f23-15b1-45f5-87af-9e6f22673a90 req-709ec445-37fd-4034-bfb2-35990918d222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-deleted", "tag": "1d8adb08-4bb0-45be-8e71-4a53fb65eb7e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:39.918132 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:39.918132 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:39.925387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0d231f23-15b1-45f5-87af-9e6f22673a90 req-709ec445-37fd-4034-bfb2-35990918d222 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:39.925832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0d231f23-15b1-45f5-87af-9e6f22673a90 req-709ec445-37fd-4034-bfb2-35990918d222 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:39.937390 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0d231f23-15b1-45f5-87af-9e6f22673a90 req-709ec445-37fd-4034-bfb2-35990918d222 service nova] Creating event network-vif-deleted:1d8adb08-4bb0-45be-8e71-4a53fb65eb7e for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:39.942588 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0d231f23-15b1-45f5-87af-9e6f22673a90 req-709ec445-37fd-4034-bfb2-35990918d222 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029829 Nov 20 21:10:39.943180 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2992/6091] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:40.113227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0559107f-8893-47a6-a068-ed0f0e63b2ab req-3a99bece-d461-4175-9dfd-c3414ead465b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-unplugged", "status": "completed", "tag": "a1c1d818-4c07-4d09-b360-b1acc5a224b8"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:40.115583 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:40.115583 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:10:40.125703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0559107f-8893-47a6-a068-ed0f0e63b2ab req-3a99bece-d461-4175-9dfd-c3414ead465b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.126261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0559107f-8893-47a6-a068-ed0f0e63b2ab req-3a99bece-d461-4175-9dfd-c3414ead465b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.139496 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0559107f-8893-47a6-a068-ed0f0e63b2ab req-3a99bece-d461-4175-9dfd-c3414ead465b service nova] Creating event network-vif-unplugged:a1c1d818-4c07-4d09-b360-b1acc5a224b8 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:40.144792 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0559107f-8893-47a6-a068-ed0f0e63b2ab req-3a99bece-d461-4175-9dfd-c3414ead465b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035697 Nov 20 21:10:40.145826 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3100/6092] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:40.500755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:40.504547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:40.526757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.533240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.534517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.534983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.545059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:40.546268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:40.553077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.554413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.555818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.556487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.731537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.742843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-599c11db-dbba-419c-ac39-14e40b63bb0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1710 microversion: 2.1 time: 0.205805 Nov 20 21:10:40.743752 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3101/6093] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:40 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:10:40.749146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:40.750019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:40.756424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.756943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.757897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:40.758426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:40.878180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.895509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.898299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.899788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92da6107-e7b7-4efe-88c6-39a9f1557615 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2707 microversion: 2.32 time: 0.413480 Nov 20 21:10:40.900863 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2993/6094] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:40 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2707 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:40.962357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.982830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.985783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:40.988359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7704d9a5-ba48-4870-a961-e26564161ce8 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.243193 Nov 20 21:10:40.989052 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3102/6095] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:40 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:41.762341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:41.763059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:41.775608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:41.776633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:41.779819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:41.780594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:41.921779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:41.922410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:41.930143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:41.930771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:41.931573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:41.932003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:42.065316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.078493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb1e5c60-310f-416e-8eb6-23ef6a0ed77c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1714 microversion: 2.1 time: 0.320655 Nov 20 21:10:42.080423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2994/6096] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:41 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1714 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:10:42.088359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-deleted", "tag": "fafe012b-fc11-4ebf-90fb-e3698bda3e63"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-deleted", "tag": "144b0c11-f5e6-471f-8963-411ff27f7777"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-deleted", "tag": "a1c1d818-4c07-4d09-b360-b1acc5a224b8"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:42.090327 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:42.090327 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:42.090650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.098605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:42.099067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:42.099514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.101007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.102346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-67bf9248-ae69-4391-9b57-65f07ac5f99d tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 2613 microversion: 2.32 time: 0.185048 Nov 20 21:10:42.102911 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3103/6097] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:41 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 2613 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:42.108194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:42.108873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:42.115111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:42.115551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:42.116636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:42.117258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:42.124969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Creating event network-vif-deleted:fafe012b-fc11-4ebf-90fb-e3698bda3e63 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:42.125493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Creating event network-vif-deleted:144b0c11-f5e6-471f-8963-411ff27f7777 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:42.126008 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] Creating event network-vif-deleted:a1c1d818-4c07-4d09-b360-b1acc5a224b8 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:42.132763 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-47ccd56f-0d6c-443e-814a-7625bb654e21 req-d9742dcb-1db7-4add-beff-76e67e173ce0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050690 Nov 20 21:10:42.133745 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2995/6098] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:42 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:42.164393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-unplugged", "status": "completed", "tag": "5332c620-9136-495b-bd4d-92357990f3a2"}, {"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-unplugged", "status": "completed", "tag": "144b0c11-f5e6-471f-8963-411ff27f7777"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:42.166352 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:42.166352 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:42.181072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:42.181912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:42.202353 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] Creating event network-vif-unplugged:5332c620-9136-495b-bd4d-92357990f3a2 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:42.203141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] Creating event network-vif-unplugged:144b0c11-f5e6-471f-8963-411ff27f7777 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:42.209762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-9141a81e-6bdc-48bb-8eb8-3f89e003e0e5 req-25733fe8-18c5-4cad-a305-b8ee4d39e7a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.052821 Nov 20 21:10:42.210908 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2996/6099] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:42 2021] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:42.262419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.271499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.273168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:42.274820 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6b1eb6a9-b733-482b-98f0-e4171de6cacb tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.170574 Nov 20 21:10:42.275652 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3104/6100] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:42 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:43.130889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:43.133747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:43.140921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:43.141434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:43.142391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:43.142952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:43.237703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.247154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.260309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '44b2e036131a42309c890afd6c70a34c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff892c31a4354551b7c9e9c01d5b7b6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.262431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-780452c3-805a-4b5b-bc16-51357d3b1258 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 200 len: 1604 microversion: 2.32 time: 0.137908 Nov 20 21:10:43.275086 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2997/6101] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:43 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:43.295403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:43.296068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:43.303389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:43.303819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:43.304776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:43.305367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:43.471971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.480433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.482501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:43.483657 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b37634e3-4141-4217-a9d4-2c9dd829d5fa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.192903 Nov 20 21:10:43.484234 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3105/6102] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:43 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:44.170706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c6a4efab-f7b6-402a-917f-5ab116675459 req-32ca2098-c6c0-4e39-b77b-b00a5b86a6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f0d8b2-1575-409b-929c-720a90a1fe83", "name": "network-vif-deleted", "tag": "5332c620-9136-495b-bd4d-92357990f3a2"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:44.172477 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:44.172477 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:10:44.180324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6a4efab-f7b6-402a-917f-5ab116675459 req-32ca2098-c6c0-4e39-b77b-b00a5b86a6f8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.180789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6a4efab-f7b6-402a-917f-5ab116675459 req-32ca2098-c6c0-4e39-b77b-b00a5b86a6f8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.192377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c6a4efab-f7b6-402a-917f-5ab116675459 req-32ca2098-c6c0-4e39-b77b-b00a5b86a6f8 service nova] Creating event network-vif-deleted:5332c620-9136-495b-bd4d-92357990f3a2 for instance c9f0d8b2-1575-409b-929c-720a90a1fe83 on nch2-master-1 Nov 20 21:10:44.198778 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c6a4efab-f7b6-402a-917f-5ab116675459 req-32ca2098-c6c0-4e39-b77b-b00a5b86a6f8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032497 Nov 20 21:10:44.199553 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2998/6103] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:44.227493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e9ff961d-c942-48f9-aa24-c5c5f41466be req-d8f04530-8a84-4ce2-a17d-5e4b184a9325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "name": "network-vif-plugged", "status": "completed", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:44.229550 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:10:44.229550 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:10:44.237709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e9ff961d-c942-48f9-aa24-c5c5f41466be req-d8f04530-8a84-4ce2-a17d-5e4b184a9325 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.238232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e9ff961d-c942-48f9-aa24-c5c5f41466be req-d8f04530-8a84-4ce2-a17d-5e4b184a9325 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.249513 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e9ff961d-c942-48f9-aa24-c5c5f41466be req-d8f04530-8a84-4ce2-a17d-5e4b184a9325 service nova] Creating event network-vif-plugged:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch1-master-1 Nov 20 21:10:44.255188 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e9ff961d-c942-48f9-aa24-c5c5f41466be req-d8f04530-8a84-4ce2-a17d-5e4b184a9325 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031530 Nov 20 21:10:44.255797 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3106/6104] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:10:44.285199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:44.286336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:44.295771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.296262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.297085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.297590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.320265 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] HTTP exception thrown: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. Nov 20 21:10:44.321614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Returning 404 to user: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:10:44.323026 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-591eda71-a18a-4aa2-ba01-39c1d72fe00a tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 404 len: 111 microversion: 2.32 time: 0.042410 Nov 20 21:10:44.324009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 2999/6105] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:44 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:10:44.338151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c27c99f-5878-4649-a950-6db815fdaf16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '.version_select at 0x7f3f86534550>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:44.365703 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c27c99f-5878-4649-a950-6db815fdaf16 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555259458" status: 204 len: 0 microversion: 2.32 time: 0.035172 Nov 20 21:10:44.370359 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3107/6106] 10.222.0.41 () {60 vars in 1261 bytes} [Sat Nov 20 21:10:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555259458 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:10:44.501710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:44.502358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:44.509797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.510553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.511548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:44.512613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:44.771661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:44.781597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:44.783256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:44.784528 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-51149ee7-2df5-4da3-9d66-9dba5c3548b5 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.286747 Nov 20 21:10:44.785182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3000/6107] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:44 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:45.804025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:45.804806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:45.812924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:45.813379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:45.814237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:45.814778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:46.018072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:46.030140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:46.032585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:46.033785 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9746df58-22b1-4984-a6e8-89b445dc1277 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1728 microversion: 2.20 time: 0.233476 Nov 20 21:10:46.034380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3108/6108] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:45 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:47.052998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:47.053785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:47.061977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.062467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.063398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.064017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.304879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:47.323750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:47.325672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:47.327559 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80e6b7b7-aef3-4d86-a1e1-937af4e9cdfa tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1715 microversion: 2.20 time: 0.279501 Nov 20 21:10:47.328212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3001/6109] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:10:47 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1715 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:10:47.895762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:47.896344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:47.903622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.904993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.905800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.906265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.921776 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] HTTP exception thrown: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. Nov 20 21:10:47.922425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Returning 404 to user: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:10:47.923274 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79f2613e-5203-4b09-ba56-48b450db28f2 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 404 len: 111 microversion: 2.1 time: 0.031256 Nov 20 21:10:47.924502 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3109/6110] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:10:47 2021] DELETE /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:10:47.932813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:47.933566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] [instance: c9f0d8b2-1575-409b-929c-720a90a1fe83] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:47.940003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.940549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.941473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:47.941983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:47.956145 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] HTTP exception thrown: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. Nov 20 21:10:47.956993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] Returning 404 to user: Instance c9f0d8b2-1575-409b-929c-720a90a1fe83 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:10:47.957909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff3bb6f3-1393-4e7f-b0ac-ab491a2eb1b0 tempest-TaggedBootDevicesTest-1735451821 tempest-TaggedBootDevicesTest-1735451821-project] 10.222.0.41 "GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83" status: 404 len: 111 microversion: 2.1 time: 0.029719 Nov 20 21:10:47.958575 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3002/6111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:47 2021] GET /compute/v2.1/servers/c9f0d8b2-1575-409b-929c-720a90a1fe83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:10:56.631824 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:10:56.632540 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:10:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:10:58.382714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-105093785", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "db248f70-92ce-470d-a8dd-1b99f1d82f6d"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:10:58.456334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] validate_networks() for [('db248f70-92ce-470d-a8dd-1b99f1d82f6d', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:10:59.049132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:10:59.049556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:10:59.050026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:10:59.050676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:10:59.051086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:10:59.060814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:59.061261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:59.062224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:10:59.062671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:10:59.079568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Getting quotas for project 321f486ad3cb47d391a2136722e74f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:10:59.085010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Getting quotas for user f88dfc4cbff24026af90af84ca24d310 and project 321f486ad3cb47d391a2136722e74f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:10:59.097970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:10:59.100459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:10:59.147710 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03b89360-1f70-4065-85ac-c5bddd8f4132 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768945 Nov 20 21:10:59.148990 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3110/6112] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:10:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:10:59.161160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40e43a53-9c67-4a11-9306-1606b72638a0 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:10:59.162469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40e43a53-9c67-4a11-9306-1606b72638a0 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:10:59.395898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40e43a53-9c67-4a11-9306-1606b72638a0 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:10:59.402630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40e43a53-9c67-4a11-9306-1606b72638a0 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1218 microversion: 2.1 time: 0.245766 Nov 20 21:10:59.403213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3003/6113] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:10:59 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1218 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:00.422343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:00.423097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:00.431153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:00.431605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:00.432401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:00.432840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:00.495791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:00.504782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-855cde28-865a-4561-8eb4-ae9edce30a1c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1276 microversion: 2.1 time: 0.088996 Nov 20 21:11:00.506091 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3111/6114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:00 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:01.525567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:01.526223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:01.533657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:01.534468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:01.535650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:01.536323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:01.782885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:01.790980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-569f564f-c09e-40f5-919d-dd8474bda77e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.271919 Nov 20 21:11:01.791680 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3004/6115] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:01 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:01.923024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-63c5aafb-4fde-4205-a91f-9dff2735673f req-a856b354-bfbf-42ab-9e32-8142b083c73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1", "tag": "10a38d43-1627-4b21-9693-d4121d894a27"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:01.925432 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:01.925432 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:01.934188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63c5aafb-4fde-4205-a91f-9dff2735673f req-a856b354-bfbf-42ab-9e32-8142b083c73d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:01.935523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63c5aafb-4fde-4205-a91f-9dff2735673f req-a856b354-bfbf-42ab-9e32-8142b083c73d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:01.951550 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-63c5aafb-4fde-4205-a91f-9dff2735673f req-a856b354-bfbf-42ab-9e32-8142b083c73d service nova] Creating event network-changed:10a38d43-1627-4b21-9693-d4121d894a27 for instance 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 on nch2-master-1 Nov 20 21:11:01.957065 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-63c5aafb-4fde-4205-a91f-9dff2735673f req-a856b354-bfbf-42ab-9e32-8142b083c73d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038604 Nov 20 21:11:01.957749 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3112/6116] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:02.809394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:02.810407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:02.828660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:02.829114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:02.830109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:02.830713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:03.074139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:03.082890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b762727c-330a-478c-bfe8-df152d034270 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.278878 Nov 20 21:11:03.083469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3005/6117] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:02 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:03.500160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1556781052", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "f125f0d0-c201-4c42-ad1a-c71ec26ad678"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:03.792330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] validate_networks() for [('f125f0d0-c201-4c42-ad1a-c71ec26ad678', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:04.100498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:04.101112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:04.108308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:04.108760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:04.109543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:04.109981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:04.151401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:11:04.151853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:11:04.152352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:11:04.152891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:11:04.153971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:11:04.162863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:04.163466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:04.164285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:04.164721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:04.182826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Getting quotas for project 80f03c0efdbc4740b111c5c75504f936. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:11:04.188446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Getting quotas for user 4ee66e9255e94958b298e0389103b405 and project 80f03c0efdbc4740b111c5c75504f936. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:11:04.201682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:11:04.204119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:11:04.247495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:04.253530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab75ced7-016a-466d-9627-b9dd8b6626cd tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870092 Nov 20 21:11:04.254618 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3113/6118] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:11:04.255982 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4754ea0b-625c-433d-bc76-623614e74022 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.158850 Nov 20 21:11:04.256728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3006/6119] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:04 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:04.265143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42d318fa-b847-4d94-b8ee-b513d045589c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:04.265753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42d318fa-b847-4d94-b8ee-b513d045589c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:04.318253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-42d318fa-b847-4d94-b8ee-b513d045589c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:04.326721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42d318fa-b847-4d94-b8ee-b513d045589c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1217 microversion: 2.1 time: 0.066078 Nov 20 21:11:04.327299 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3114/6120] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:04 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:05.272487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:05.273106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:05.281171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:05.281636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:05.282655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:05.283098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:05.347713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:05.348847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:05.356981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:05.357435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:05.358250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:05.358862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:05.426933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:05.434959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf9c80fc-7da1-40d2-960d-79fdd88b823c tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1277 microversion: 2.1 time: 0.095070 Nov 20 21:11:05.436268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3115/6121] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:05 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1277 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:05.519059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:05.526695 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7894c197-9dd8-4ccd-a377-7578e2571b6c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.257778 Nov 20 21:11:05.527203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3007/6122] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:05 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:06.453525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:06.454200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:06.461392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:06.462317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:06.463200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:06.463646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:06.549159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:06.550716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:06.559059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:06.560851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:06.563482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:06.564204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:06.630148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:06.637576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-621e44e4-85ff-4058-b5f6-41ef2cc5f492 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.188698 Nov 20 21:11:06.638168 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3116/6123] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:06 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:06.787261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:06.795512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a79324ab-90c1-4c50-a6e0-8d5935dcf7d2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.253786 Nov 20 21:11:06.796098 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3008/6124] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:06 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:07.125480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-71f3fd98-429c-4e07-ac6e-71c664b957f9 req-1f39a368-1b81-4c11-b457-1dfc6da39e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82849d65-1f55-430a-9c76-3f62cec6dd45", "tag": "b4310bf4-2992-455b-8b75-2604c19d7903"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:07.127077 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:07.127077 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:07.144092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-71f3fd98-429c-4e07-ac6e-71c664b957f9 req-1f39a368-1b81-4c11-b457-1dfc6da39e88 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:07.144535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-71f3fd98-429c-4e07-ac6e-71c664b957f9 req-1f39a368-1b81-4c11-b457-1dfc6da39e88 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:07.156508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-71f3fd98-429c-4e07-ac6e-71c664b957f9 req-1f39a368-1b81-4c11-b457-1dfc6da39e88 service nova] Creating event network-changed:b4310bf4-2992-455b-8b75-2604c19d7903 for instance 82849d65-1f55-430a-9c76-3f62cec6dd45 on nch1-master-1 Nov 20 21:11:07.161353 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-71f3fd98-429c-4e07-ac6e-71c664b957f9 req-1f39a368-1b81-4c11-b457-1dfc6da39e88 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040359 Nov 20 21:11:07.161968 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3117/6125] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:07.654194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:07.654869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:07.661537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:07.661995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:07.662824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:07.663264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:07.814943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:07.815853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:07.822650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:07.822945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:07.823748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:07.824186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:07.971812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:07.971998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:07.979763 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f174815a-4315-417d-b9ef-c5bf150730a2 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.329483 Nov 20 21:11:07.979948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acbe9d37-e5ab-4623-8a90-bf2dc21cad7c tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.171356 Nov 20 21:11:07.980594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3118/6126] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:07 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:07.982386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3009/6127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:07 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:08.256655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b2c0496d-3050-4526-b369-31d85a7804d3 req-9e4c7306-a9db-4745-918b-6612fd7dd31c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1", "name": "network-vif-plugged", "status": "completed", "tag": "10a38d43-1627-4b21-9693-d4121d894a27"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:08.258431 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:08.258431 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:08.267011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b2c0496d-3050-4526-b369-31d85a7804d3 req-9e4c7306-a9db-4745-918b-6612fd7dd31c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:08.267714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b2c0496d-3050-4526-b369-31d85a7804d3 req-9e4c7306-a9db-4745-918b-6612fd7dd31c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:08.286799 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b2c0496d-3050-4526-b369-31d85a7804d3 req-9e4c7306-a9db-4745-918b-6612fd7dd31c service nova] Creating event network-vif-plugged:10a38d43-1627-4b21-9693-d4121d894a27 for instance 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 on nch2-master-1 Nov 20 21:11:08.292198 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b2c0496d-3050-4526-b369-31d85a7804d3 req-9e4c7306-a9db-4745-918b-6612fd7dd31c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039516 Nov 20 21:11:08.292893 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3119/6128] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:08.997029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:08.997822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:08.998344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:08.999182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:09.004603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:09.005102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:09.005227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:09.005645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:09.006187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:09.006669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:09.006793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:09.007129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:09.144559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:09.146410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:09.152190 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-321354c8-6658-481b-87d3-badcdcae2878 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.158901 Nov 20 21:11:09.152769 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3010/6129] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:08 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:09.154705 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-516f55ca-dac7-4031-9c55-6499807229fb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1318 microversion: 2.1 time: 0.161221 Nov 20 21:11:09.155280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3120/6130] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:08 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:10.170173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:10.170892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:10.172047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:10.172664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:10.178065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:10.178547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:10.179310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:10.179425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:10.179769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:10.179895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:10.180554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:10.181014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:10.326127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:10.334123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62ccae79-70db-40ed-9615-cb177b0d0686 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.168151 Nov 20 21:11:10.334735 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3011/6131] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:10 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:10.566994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:10.574335 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-20541700-c996-4d10-b552-2efddf4a37f2 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1506 microversion: 2.1 time: 0.406837 Nov 20 21:11:10.575402 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3121/6132] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:10 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:11.350971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:11.351624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:11.358403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:11.358856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:11.359638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:11.360077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:11.489311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:11.496516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36759c9e-6600-4a6c-9080-4e61d9d5f9e7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.149309 Nov 20 21:11:11.497329 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3012/6133] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:11 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:12.037666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cf4195c-9738-4402-9871-a54b9aa3916c", "device": "/dev/sdb"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:12.039266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:12.046963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:12.047409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:12.048184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:12.048618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:12.276627 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff0867b6-cab5-4660-bff9-020f12def715 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "POST /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.242505 Nov 20 21:11:12.277211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3122/6134] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:11:12 2021] POST /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1/os-volume_attachments => generated 194 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:12.512663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:12.513192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:12.522679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:12.523232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:12.524116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:12.524558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:12.667650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:12.675739 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-651c3069-83bc-45a2-8bd3-d526b907cd91 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.166879 Nov 20 21:11:12.676312 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3013/6135] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:12 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:12.837847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ead37ef3-e504-4a45-bd51-d66e37cdea58 req-d3386713-4311-42fe-b8a1-7cca1736d192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82849d65-1f55-430a-9c76-3f62cec6dd45", "name": "network-vif-plugged", "status": "completed", "tag": "b4310bf4-2992-455b-8b75-2604c19d7903"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:12.839925 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:12.839925 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:12.848738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ead37ef3-e504-4a45-bd51-d66e37cdea58 req-d3386713-4311-42fe-b8a1-7cca1736d192 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:12.849452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ead37ef3-e504-4a45-bd51-d66e37cdea58 req-d3386713-4311-42fe-b8a1-7cca1736d192 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:12.861131 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ead37ef3-e504-4a45-bd51-d66e37cdea58 req-d3386713-4311-42fe-b8a1-7cca1736d192 service nova] Creating event network-vif-plugged:b4310bf4-2992-455b-8b75-2604c19d7903 for instance 82849d65-1f55-430a-9c76-3f62cec6dd45 on nch1-master-1 Nov 20 21:11:12.866002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ead37ef3-e504-4a45-bd51-d66e37cdea58 req-d3386713-4311-42fe-b8a1-7cca1736d192 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Nov 20 21:11:12.867035 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3123/6136] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:13.692466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:13.693084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:13.699974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:13.700526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:13.701936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:13.702547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:13.844252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:13.851493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1faafa82-dc08-4d17-841e-5aa6523c1530 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1317 microversion: 2.1 time: 0.162730 Nov 20 21:11:13.852089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3014/6137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:13 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:14.868860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:14.869636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:14.877053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:14.877505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:14.878309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:14.878741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.024551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:15.033893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a90fb048-723b-49f1-a9e3-12e2f44fc900 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1506 microversion: 2.1 time: 0.168970 Nov 20 21:11:15.034387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3124/6138] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:14 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:15.054618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:15.055520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:15.066199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.066669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.067479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.067928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.107697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:15.108699 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a38b64a6-7c80-47b4-8d76-dc86a8342b21 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/os-instance-actions/req-ab75ced7-016a-466d-9627-b9dd8b6626cd" status: 200 len: 313 microversion: 2.1 time: 0.060445 Nov 20 21:11:15.109297 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3015/6139] 10.222.0.41 () {58 vars in 1418 bytes} [Sat Nov 20 21:11:15 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/os-instance-actions/req-ab75ced7-016a-466d-9627-b9dd8b6626cd => generated 313 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:15.121064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:15.122002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:15.128246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.128695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.129469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.129912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.205870 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-632a07b8-768b-40bf-bf59-58b69b2849b7 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "POST /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/action" status: 202 len: 0 microversion: 2.1 time: 0.088418 Nov 20 21:11:15.206529 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3125/6140] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:15 2021] POST /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:15.214958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:15.216024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:15.224418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.225133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.226163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:15.226659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:15.477176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:15.484629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2b52206-db77-47fc-a0b0-a58ea94cf343 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1508 microversion: 2.1 time: 0.273899 Nov 20 21:11:15.485503 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3016/6141] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:15 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1508 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:16.503425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:16.504077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:16.511473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.511935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.512728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.513173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.647932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:16.655330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2346628a-e969-407f-9921-f0c9781c592d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1506 microversion: 2.1 time: 0.157505 Nov 20 21:11:16.655901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3126/6142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:16 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:16.673458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '.version_select at 0x7f3f85d1cd30>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:16.674930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:16.681960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.682456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.683263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.683753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.715419 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-debb97d3-e624-4223-b61e-4d806fe0abe8 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.046344 Nov 20 21:11:16.715992 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3017/6143] 10.222.0.41 () {58 vars in 1295 bytes} [Sat Nov 20 21:11:16 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45/os-instance-actions => generated 611 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:16.727550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:16.728054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:16.734895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.735353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.736149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.736590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.763267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:11:16.851029 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b955ae9-347b-4c77-ae30-d3c2f0d99332 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "DELETE /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 204 len: 0 microversion: 2.1 time: 0.126962 Nov 20 21:11:16.851834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3127/6144] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:11:16 2021] DELETE /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:11:16.860567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:16.861176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:16.867398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.868051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:16.869134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:16.869711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:17.012636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:17.020198 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c779422-10c8-468d-88f4-527b24c2c4a5 tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1512 microversion: 2.1 time: 0.164357 Nov 20 21:11:17.020697 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3018/6145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:16 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:17.315886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:17.316376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:17.322808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:17.323315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:17.324095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:17.324533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:17.405815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lazy-loading 'services' on Instance uuid b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:11:17.472430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8885708-b0e5-43ab-aebf-10f597ae7e9f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments/afabfac2-5807-4d77-9ff3-9126704d7471" status: 202 len: 0 microversion: 2.1 time: 0.160629 Nov 20 21:11:17.473024 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3128/6146] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:11:17 2021] DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments/afabfac2-5807-4d77-9ff3-9126704d7471 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:18.045914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:18.046673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:18.053343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:18.053805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:18.054652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:18.055096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:18.198763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:18.207764 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aaace621-81a3-4f30-8c6e-627891cdbaeb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1512 microversion: 2.1 time: 0.173060 Nov 20 21:11:18.208347 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3019/6147] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:18 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:18.583211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d592dc64-57f7-4c14-a47b-072440d18e68 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:18.590242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d592dc64-57f7-4c14-a47b-072440d18e68 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:18.590704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d592dc64-57f7-4c14-a47b-072440d18e68 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:18.613664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d592dc64-57f7-4c14-a47b-072440d18e68 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:11:18.659936 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d592dc64-57f7-4c14-a47b-072440d18e68 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 202 len: 0 microversion: 2.1 time: 0.080275 Nov 20 21:11:18.660594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3129/6148] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:18 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:18.668544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:18.669816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:18.676661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:18.677404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:18.678320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:18.678984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:18.897344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:18.905066 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e3a06de-9d8d-4aa0-9c69-1fe73e9f10ec tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.240017 Nov 20 21:11:18.905647 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3020/6149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:18 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:19.202996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1217324e-9819-4754-9508-45f5fbd3360e req-6c584a88-ac4f-4a2c-8b62-b34e2e32273a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82849d65-1f55-430a-9c76-3f62cec6dd45", "name": "network-vif-deleted", "tag": "b4310bf4-2992-455b-8b75-2604c19d7903"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:19.204937 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:19.204937 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:19.213841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1217324e-9819-4754-9508-45f5fbd3360e req-6c584a88-ac4f-4a2c-8b62-b34e2e32273a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:19.214320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1217324e-9819-4754-9508-45f5fbd3360e req-6c584a88-ac4f-4a2c-8b62-b34e2e32273a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:19.224625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:19.225254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:19.229989 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1217324e-9819-4754-9508-45f5fbd3360e req-6c584a88-ac4f-4a2c-8b62-b34e2e32273a service nova] Creating event network-vif-deleted:b4310bf4-2992-455b-8b75-2604c19d7903 for instance 82849d65-1f55-430a-9c76-3f62cec6dd45 on nch1-master-1 Nov 20 21:11:19.234407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:19.234859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:19.235660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:19.236195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:19.237569 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1217324e-9819-4754-9508-45f5fbd3360e req-6c584a88-ac4f-4a2c-8b62-b34e2e32273a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038700 Nov 20 21:11:19.238556 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3130/6150] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:11:19.309459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee66e9255e94958b298e0389103b405', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80f03c0efdbc4740b111c5c75504f936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:19.316885 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f5c71dd-9ddc-46c0-8ee9-1b6c5ed098fb tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 200 len: 1302 microversion: 2.1 time: 0.096107 Nov 20 21:11:19.317458 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3021/6151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:19 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:19.923295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:19.923991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:19.930171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:19.930625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:19.931402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:19.931836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.062992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:20.070265 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21b2b2a2-8a2a-4ade-b67b-15a751b1ffcb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.151763 Nov 20 21:11:20.070847 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3131/6152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:19 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:20.333800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:20.334449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] [instance: 82849d65-1f55-430a-9c76-3f62cec6dd45] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:20.341155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.341601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.342483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.342997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.355842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] HTTP exception thrown: Instance 82849d65-1f55-430a-9c76-3f62cec6dd45 could not be found. Nov 20 21:11:20.356428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] Returning 404 to user: Instance 82849d65-1f55-430a-9c76-3f62cec6dd45 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:20.357236 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3be8471-0db6-470b-a318-aec301faa75d tempest-InstanceActionsTestJSON-1580901096 tempest-InstanceActionsTestJSON-1580901096-project] 10.222.0.41 "GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45" status: 404 len: 111 microversion: 2.1 time: 0.027163 Nov 20 21:11:20.358418 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3022/6153] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:20 2021] GET /compute/v2.1/servers/82849d65-1f55-430a-9c76-3f62cec6dd45 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:20.431077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:20.432162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:20.446948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.449935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.450941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.452181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.481081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68930f2c-f6ad-46e7-a860-97e55e4c1f3c tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053744 Nov 20 21:11:20.481649 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3132/6154] 10.222.0.41 () {60 vars in 1342 bytes} [Sat Nov 20 21:11:20 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:20.537548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:20.537669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:20.544815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.546176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.547192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.547642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.573426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:11:20.653555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d87c784-6df7-4d61-af2d-13f864a8912f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 204 len: 0 microversion: 2.20 time: 0.119859 Nov 20 21:11:20.654891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3023/6155] 10.222.0.41 () {60 vars in 1279 bytes} [Sat Nov 20 21:11:20 2021] DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:11:20.663786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:20.664394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:20.671344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.671813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.672604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:20.673358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:20.815357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:20.823898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:20.825388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:20.827245 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-04202f88-7a26-47f8-99b3-1c15808fdaec tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.166976 Nov 20 21:11:20.827846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3133/6156] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:11:20 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:11:21.088498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:21.089204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:21.095137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:21.095592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:21.096391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:21.096838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:21.527823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:21.537519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5502f5f9-7c5b-4594-afd2-638333cc3604 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.453004 Nov 20 21:11:21.538130 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3024/6157] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:21 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:21.846633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:21.847312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:21.854295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:21.854683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:21.855658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:21.856090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:21.991733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:22.001365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:22.002897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:22.004107 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5d0be70-70e9-4c79-b38b-bd4db742481f tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1721 microversion: 2.20 time: 0.161495 Nov 20 21:11:22.004868 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3134/6158] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:11:21 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 20 21:11:22.559914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:22.562517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:22.570491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:22.570944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:22.571741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:22.572178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:22.897127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:22.918269 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e650825-b1b7-4966-9d90-b0c187287d57 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.366870 Nov 20 21:11:22.931818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3025/6159] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:22 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:23.024665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:23.025284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:23.037639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.038316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.040000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.040612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.141001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:23.151161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:23.153637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d10d9e45a7644f2a580fc0d28668661', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bc78201f1431881a86d4894780efb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:23.166234 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2446f905-9acc-45f9-82e6-282c207a1904 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 200 len: 1655 microversion: 2.20 time: 0.146413 Nov 20 21:11:23.167449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3135/6160] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:11:23 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 20 21:11:23.173215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2c44717e-28b5-4c3b-8e51-16082d41dc04 req-113e1415-c00d-4e2a-a13b-178576ce12de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aaa552a-405f-4fb1-89d8-49b2f1a432a1", "name": "network-vif-deleted", "tag": "feeb1d8b-d286-4060-b7ac-a8b34a5f75e9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:23.174787 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:23.174787 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:23.192102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2c44717e-28b5-4c3b-8e51-16082d41dc04 req-113e1415-c00d-4e2a-a13b-178576ce12de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.196050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2c44717e-28b5-4c3b-8e51-16082d41dc04 req-113e1415-c00d-4e2a-a13b-178576ce12de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.215959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2c44717e-28b5-4c3b-8e51-16082d41dc04 req-113e1415-c00d-4e2a-a13b-178576ce12de service nova] Creating event network-vif-deleted:feeb1d8b-d286-4060-b7ac-a8b34a5f75e9 for instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 on nch1-master-1 Nov 20 21:11:23.230238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2c44717e-28b5-4c3b-8e51-16082d41dc04 req-113e1415-c00d-4e2a-a13b-178576ce12de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059643 Nov 20 21:11:23.232268 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3136/6161] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:23.254709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2102533443", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:23.334918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] validate_networks() for [('13329dec-d6cb-4b40-9c80-e369d65965f5', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:23.721187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:11:23.721782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:11:23.722243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:11:23.722674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:11:23.723091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:11:23.733285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.734168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.735038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.735488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.758691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Getting quotas for project 8910f09f22a240eb9a228d72406a608b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:11:23.764369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Getting quotas for user 9f97aa90193b41ee80433f60dfc5070d and project 8910f09f22a240eb9a228d72406a608b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:11:23.777399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:11:23.780739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:11:23.831081 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14eef61f-7be0-49bf-ad8e-8b989d6c1122 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756924 Nov 20 21:11:23.836927 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3026/6162] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:11:23.843223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea9fe2ee-6bce-494d-abfd-0aa6fe851329 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:23.844440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea9fe2ee-6bce-494d-abfd-0aa6fe851329 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:23.900819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ea9fe2ee-6bce-494d-abfd-0aa6fe851329 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:23.908734 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea9fe2ee-6bce-494d-abfd-0aa6fe851329 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1217 microversion: 2.1 time: 0.070436 Nov 20 21:11:23.910263 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3137/6163] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:23 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:23.937380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:23.938162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:23.947448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.947911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:23.948721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:23.949317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:24.112004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:24.127296 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8f4c72bb-e6e2-4aeb-831c-023c03d59623 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.194679 Nov 20 21:11:24.139697 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3027/6164] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:23 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:24.185460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:24.186120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:24.195305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:24.195762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:24.196550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:24.197013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:24.212657 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. Nov 20 21:11:24.213367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:24.214432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af4f7f2a-bb46-4a89-83c2-81f98fc19347 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 404 len: 111 microversion: 2.20 time: 0.032763 Nov 20 21:11:24.215135 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3138/6165] 10.222.0.41 () {60 vars in 1276 bytes} [Sat Nov 20 21:11:24 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:11:24.225130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a26be364-1ab1-48f5-b8ef-1cb3f75eeb33 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '.version_select at 0x7f3f869e55e0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:24.249298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a26be364-1ab1-48f5-b8ef-1cb3f75eeb33 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-254082720" status: 204 len: 0 microversion: 2.20 time: 0.028724 Nov 20 21:11:24.249891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3028/6166] 10.222.0.41 () {60 vars in 1258 bytes} [Sat Nov 20 21:11:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-254082720 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 20 21:11:24.924538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:24.925157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:24.933346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:24.934162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:24.934717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:24.935068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:25.016372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:25.024992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8f4000b-f887-4d2d-8db9-0a22f3e64f9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1287 microversion: 2.1 time: 0.103981 Nov 20 21:11:25.025621 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3139/6167] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:24 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:25.146526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:25.147137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:25.155023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:25.155484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:25.156298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:25.156740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:25.385814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:25.394921 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-99dd2ebb-5908-431b-b1b5-e1998a1f8acd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.253274 Nov 20 21:11:25.404172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3029/6168] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:25 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:26.043217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:26.043858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:26.051360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.051804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.052587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.053022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.126436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:26.127274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:26.133706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.134415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.135806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.136445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.159119 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. Nov 20 21:11:26.159695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:26.160077 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c080358-a119-4710-9858-343e409b5604 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 404 len: 111 microversion: 2.1 time: 0.037933 Nov 20 21:11:26.160838 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3030/6169] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:11:26 2021] DELETE /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:11:26.168339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:26.168991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 8aaa552a-405f-4fb1-89d8-49b2f1a432a1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:26.178130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.178594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.179390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.180015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.192729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:26.194147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. Nov 20 21:11:26.195156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 8aaa552a-405f-4fb1-89d8-49b2f1a432a1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:26.195998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78390a18-33e7-4f29-a9e9-3b27deb086b1 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1" status: 404 len: 111 microversion: 2.1 time: 0.031285 Nov 20 21:11:26.196565 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3031/6170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:26 2021] GET /compute/v2.1/servers/8aaa552a-405f-4fb1-89d8-49b2f1a432a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:11:26.200507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5443dff3-b468-46ff-9420-643c1520585c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1317 microversion: 2.1 time: 0.160948 Nov 20 21:11:26.201867 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3140/6171] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:26 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:26.294614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-923680a3-7423-417b-a347-e13113ac2e68 req-06be0b67-5a2e-4fcc-b0f3-d214b884be67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:26.296684 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:26.296684 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:26.303802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-923680a3-7423-417b-a347-e13113ac2e68 req-06be0b67-5a2e-4fcc-b0f3-d214b884be67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.304591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-923680a3-7423-417b-a347-e13113ac2e68 req-06be0b67-5a2e-4fcc-b0f3-d214b884be67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.318833 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-923680a3-7423-417b-a347-e13113ac2e68 req-06be0b67-5a2e-4fcc-b0f3-d214b884be67 service nova] Creating event network-changed:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch1-master-1 Nov 20 21:11:26.323959 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-923680a3-7423-417b-a347-e13113ac2e68 req-06be0b67-5a2e-4fcc-b0f3-d214b884be67 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Nov 20 21:11:26.324798 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3032/6172] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:26.413076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:26.413712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:26.419791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.420864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.421651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:26.422104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:26.587947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:26.597472 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f7ce62a-efff-4194-9e34-22970d50d218 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.188321 Nov 20 21:11:26.606573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3141/6173] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:26 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:27.220030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:27.220891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:27.227375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.228014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.228980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.229583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.344743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:27.345344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:27.354260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.354794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.355721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.356478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.371236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. Nov 20 21:11:27.371959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:27.373102 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea9c3843-5cf8-400a-9a0b-e5574435d9c7 tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 404 len: 111 microversion: 2.1 time: 0.032378 Nov 20 21:11:27.373653 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3142/6174] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:11:27 2021] DELETE /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:27.381528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:27.382196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] [instance: 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:27.387913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.388372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.389202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.389645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.403568 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] HTTP exception thrown: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. Nov 20 21:11:27.405124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] Returning 404 to user: Instance 6e1e4483-b5f5-47d3-b58f-1fdaaefd311c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:27.406238 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ac6ecf0-8188-4d04-a2fe-66fd2c09eaba tempest-AttachVolumeShelveTestJSON-1652031106 tempest-AttachVolumeShelveTestJSON-1652031106-project] 10.222.0.41 "GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c" status: 404 len: 111 microversion: 2.1 time: 0.028435 Nov 20 21:11:27.410034 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3143/6175] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:27 2021] GET /compute/v2.1/servers/6e1e4483-b5f5-47d3-b58f-1fdaaefd311c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:11:27.446306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:27.454513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25ca33c9-6d72-4ae8-86e9-c5d965344388 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1317 microversion: 2.1 time: 0.239703 Nov 20 21:11:27.455092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3033/6176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:27 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:27.614631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:27.615227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:27.621104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.621548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:27.622349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:27.622793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:28.150467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:28.158040 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfc45949-81dc-4441-a4b5-e37df9c86869 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1678 microversion: 2.1 time: 0.547117 Nov 20 21:11:28.158637 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3144/6177] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:27 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1678 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:28.471147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:28.471849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:28.478633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:28.479086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:28.479982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:28.480423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:28.619285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:28.627225 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc95b02f-07fe-46b8-99f7-76ce3c86b573 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1317 microversion: 2.1 time: 0.159887 Nov 20 21:11:28.627803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3034/6178] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:28 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:29.175678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:29.176922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:29.183477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.183943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.184793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.185238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.389055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:29.399926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47ac3d04-8658-40f3-b105-e4014119041d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1655 microversion: 2.1 time: 0.227758 Nov 20 21:11:29.401445 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3145/6179] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:29 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1655 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:29.419042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4e00e7b-0c60-48c0-8c6a-a345892b0c04 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:29.426379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e00e7b-0c60-48c0-8c6a-a345892b0c04 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.427243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4e00e7b-0c60-48c0-8c6a-a345892b0c04 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.450525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4e00e7b-0c60-48c0-8c6a-a345892b0c04 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Going to try to start instance {{(pid=140942) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:11:29.510065 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4e00e7b-0c60-48c0-8c6a-a345892b0c04 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action" status: 202 len: 0 microversion: 2.1 time: 0.095793 Nov 20 21:11:29.510881 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3035/6180] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:29 2021] POST /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:29.521264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:29.522182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:29.530012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.530997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.532405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.533172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.645961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:29.647063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:29.653848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.655221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.656240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:29.656905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:29.710511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:29.719624 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce793560-2420-4a15-ae2b-540d96fd1d6e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1664 microversion: 2.1 time: 0.202617 Nov 20 21:11:29.720576 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3146/6181] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:29 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:30.154898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:30.162644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7e458b83-c076-4633-b652-d5ef94d0a54b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1317 microversion: 2.1 time: 0.520691 Nov 20 21:11:30.163235 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3036/6182] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:29 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:30.737246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:30.737849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:30.745786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:30.746295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:30.747077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:30.747515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:30.927422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:30.931936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3b21ba77-f37d-4b6f-ad08-5f62ae68b005 req-419e1b8b-596d-493e-bb6b-69e3352cfa3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "name": "network-vif-plugged", "status": "completed", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:30.934543 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:30.934543 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:30.936732 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-030e3d85-7642-455f-bfb6-b4971caa8187 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1664 microversion: 2.1 time: 0.203253 Nov 20 21:11:30.937567 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3147/6183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:30 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1664 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:30.950312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3b21ba77-f37d-4b6f-ad08-5f62ae68b005 req-419e1b8b-596d-493e-bb6b-69e3352cfa3d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:30.950746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3b21ba77-f37d-4b6f-ad08-5f62ae68b005 req-419e1b8b-596d-493e-bb6b-69e3352cfa3d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:30.969366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3b21ba77-f37d-4b6f-ad08-5f62ae68b005 req-419e1b8b-596d-493e-bb6b-69e3352cfa3d service nova] Creating event network-vif-plugged:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch1-master-1 Nov 20 21:11:30.975999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3b21ba77-f37d-4b6f-ad08-5f62ae68b005 req-419e1b8b-596d-493e-bb6b-69e3352cfa3d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056484 Nov 20 21:11:30.977152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3037/6184] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:31.179801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:31.180704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:31.186808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:31.187261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:31.188046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:31.188486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:31.365877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:31.375351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc491633-0707-4317-acef-e82d22e63b36 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1317 microversion: 2.1 time: 0.199283 Nov 20 21:11:31.376104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3148/6185] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:31 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:31.955371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:31.956182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:31.963580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:31.964020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:31.965021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:31.965469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:32.139989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:32.147313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e9e1fda-00ff-4975-816c-3fd22e6b5431 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1668 microversion: 2.1 time: 0.196123 Nov 20 21:11:32.147897 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3038/6186] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:31 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:32.393295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:32.393910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:32.400597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:32.401044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:32.401932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:32.402395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:32.539395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:32.547832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-571c44b4-c300-4ef6-a455-3a52daa5219c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.158850 Nov 20 21:11:32.548698 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3149/6187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:32 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:32.714491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1494835772", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:32.768172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] validate_networks() for [('13329dec-d6cb-4b40-9c80-e369d65965f5', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:33.143904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:11:33.144471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:11:33.144836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:11:33.145490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:11:33.145910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:11:33.155809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:33.156135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:33.156970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:33.157414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:33.176988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Getting quotas for project 8910f09f22a240eb9a228d72406a608b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:11:33.182293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Getting quotas for user 9f97aa90193b41ee80433f60dfc5070d and project 8910f09f22a240eb9a228d72406a608b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:11:33.195880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:11:33.198266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:11:33.244960 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd340f4e-325e-46d3-9865-e8d73f1b1ba6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534223 Nov 20 21:11:33.245950 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3039/6188] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:11:33.256452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5d376ba-950b-4296-a97a-1752eef914ce tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:33.257281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5d376ba-950b-4296-a97a-1752eef914ce tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:33.361463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5d376ba-950b-4296-a97a-1752eef914ce tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:33.370730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5d376ba-950b-4296-a97a-1752eef914ce tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1217 microversion: 2.1 time: 0.118165 Nov 20 21:11:33.375970 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3150/6189] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:33 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:33.946702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-544506465", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "fda6f72f-febf-4b40-96b5-852ad898230c"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:34.006748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] validate_networks() for [('fda6f72f-febf-4b40-96b5-852ad898230c', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:34.392991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:34.393574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:34.404476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:34.405790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:34.406851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:34.407473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:34.420279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:11:34.420821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:11:34.421502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:11:34.422115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:11:34.422685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:11:34.437286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:34.450799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:34.452335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:34.453516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:34.472288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:11:34.477923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for user 183a75eb42e44f92af23e4a3c5a5d40c and project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:11:34.479575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:34.489263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ca603c4-9222-4305-a360-ca575b778eff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1287 microversion: 2.1 time: 0.100167 Nov 20 21:11:34.490271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3151/6190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:34 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1287 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:34.494731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:11:34.498891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:11:34.543735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2438c1d4-7308-4ae6-b829-43bcf4526562 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727163 Nov 20 21:11:34.545136 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3040/6191] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:11:34.558441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e714324-46b5-49db-bcb5-08cfb5f0f2ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:34.559077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e714324-46b5-49db-bcb5-08cfb5f0f2ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:34.636922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e714324-46b5-49db-bcb5-08cfb5f0f2ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:34.645057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e714324-46b5-49db-bcb5-08cfb5f0f2ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1217 microversion: 2.1 time: 0.092428 Nov 20 21:11:34.645759 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3152/6192] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:34 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:35.508629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:35.509354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:35.516353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:35.517027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:35.517990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:35.518478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:35.667070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:35.667070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:35.673489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:35.674157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:35.675052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:35.675591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:35.747845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:35.756356 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cb5fc34-036e-4757-861c-9587ceb8f417 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1275 microversion: 2.1 time: 0.097017 Nov 20 21:11:35.757041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3153/6193] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:35 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:36.183110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:36.190623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67f61079-62fa-4a06-af1b-aef97db2fca3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.686721 Nov 20 21:11:36.191285 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3041/6194] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:35 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:36.412420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d306f896-a247-49ff-8770-5bc0dd2f7d34 req-2167c23c-0749-4026-9215-057730ad9b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6ade9c3-e4a1-4c87-88b1-fe6b141392de", "tag": "7909090b-1bd4-487a-938e-7d8d3409d2a1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:36.414115 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:36.414115 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:11:36.421352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d306f896-a247-49ff-8770-5bc0dd2f7d34 req-2167c23c-0749-4026-9215-057730ad9b84 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:36.421932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d306f896-a247-49ff-8770-5bc0dd2f7d34 req-2167c23c-0749-4026-9215-057730ad9b84 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:36.433973 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d306f896-a247-49ff-8770-5bc0dd2f7d34 req-2167c23c-0749-4026-9215-057730ad9b84 service nova] Creating event network-changed:7909090b-1bd4-487a-938e-7d8d3409d2a1 for instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de on nch2-master-1 Nov 20 21:11:36.440266 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d306f896-a247-49ff-8770-5bc0dd2f7d34 req-2167c23c-0749-4026-9215-057730ad9b84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103478 Nov 20 21:11:36.440878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3154/6195] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:36.773413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:36.774024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:36.781187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:36.781590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:36.782432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:36.782883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:36.867842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:36.876018 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2639e652-7d03-4de4-8aa8-93835256255e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1275 microversion: 2.1 time: 0.106427 Nov 20 21:11:36.876600 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3042/6196] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:36 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1275 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:37.207706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:37.208510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:37.215755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:37.216208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:37.217667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:37.218249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:37.359094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:37.367749 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30f4815d-5e0f-4c6f-8ffd-02d21ab0ffaf tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.164023 Nov 20 21:11:37.377365 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3155/6197] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:37 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:37.892883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:37.893505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:37.900271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:37.900791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:37.901538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:37.901988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:38.137672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:38.145264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bef04e0b-2e2d-472c-b5e3-ba0cc88d8f6b tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.256088 Nov 20 21:11:38.145877 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3043/6198] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:37 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:38.384910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:38.385529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:38.392992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:38.393444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:38.394275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:38.394723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:38.461903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b5b20f51-3e64-46d1-8202-84ca77cadfca req-1e971fa5-0f8a-4d3d-a46e-7b4e236a96c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0ccfd4-6b6e-4899-9ed1-1212c05019b1", "tag": "fe8ad4f3-a575-4aaa-8adc-9c254dddec31"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:38.463517 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:38.463517 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:38.471488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b5b20f51-3e64-46d1-8202-84ca77cadfca req-1e971fa5-0f8a-4d3d-a46e-7b4e236a96c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:38.472102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b5b20f51-3e64-46d1-8202-84ca77cadfca req-1e971fa5-0f8a-4d3d-a46e-7b4e236a96c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:38.485053 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b5b20f51-3e64-46d1-8202-84ca77cadfca req-1e971fa5-0f8a-4d3d-a46e-7b4e236a96c5 service nova] Creating event network-changed:fe8ad4f3-a575-4aaa-8adc-9c254dddec31 for instance bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 on nch1-master-1 Nov 20 21:11:38.490612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b5b20f51-3e64-46d1-8202-84ca77cadfca req-1e971fa5-0f8a-4d3d-a46e-7b4e236a96c5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031712 Nov 20 21:11:38.491702 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3044/6199] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:11:38.550902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:38.558152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-007cf206-d018-45f8-b903-7cd79408c285 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.176921 Nov 20 21:11:38.558758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3156/6200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:38 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:39.164090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:39.164781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:39.170929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:39.171378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:39.172196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:39.172632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:39.302606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:39.309855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdda0aaf-9170-4635-93bb-92d69b7a37ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.150598 Nov 20 21:11:39.310481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3045/6201] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:39 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:39.575668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:39.576928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:39.583695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:39.584153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:39.584944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:39.585388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:39.715136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:39.723139 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7253e750-59ef-48a5-8fae-c97fefaca51c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.151343 Nov 20 21:11:39.723710 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3157/6202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:39 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:40.328065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:40.328775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:40.335564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:40.336026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:40.336826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:40.337268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:40.473442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:40.480939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-96df1d79-a536-4873-bc13-1270d833d1b2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.157903 Nov 20 21:11:40.481520 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3046/6203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:40 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:40.740205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:40.742747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:40.750603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:40.751059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:40.751907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:40.752409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:40.897002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:40.904485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c8136b3d-06fe-4605-ba0a-60dc0cb34355 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.168341 Nov 20 21:11:40.905149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3158/6204] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:40 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:41.503852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:41.504621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:41.511520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:41.511976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:41.512763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:41.513250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:41.647101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:41.654904 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a41d02c-092e-4bdf-b22b-2f2e7cea53ff tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.155308 Nov 20 21:11:41.655476 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3047/6205] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:41 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:41.922270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:41.922911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:41.929433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:41.929881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:41.930685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:41.931120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:42.062233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:42.069483 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b602d37-9a36-4b54-96f5-8db18b971633 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.151686 Nov 20 21:11:42.070104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3159/6206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:41 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:42.443000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-977402c7-a248-4b39-8f12-3d8cde50bc75 req-6cafaac3-b5df-4697-bcd6-4e03a5e83775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ade9c3-e4a1-4c87-88b1-fe6b141392de", "name": "network-vif-plugged", "status": "completed", "tag": "7909090b-1bd4-487a-938e-7d8d3409d2a1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:42.444518 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:42.444518 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:42.451831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-977402c7-a248-4b39-8f12-3d8cde50bc75 req-6cafaac3-b5df-4697-bcd6-4e03a5e83775 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:42.452289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-977402c7-a248-4b39-8f12-3d8cde50bc75 req-6cafaac3-b5df-4697-bcd6-4e03a5e83775 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:42.463193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-977402c7-a248-4b39-8f12-3d8cde50bc75 req-6cafaac3-b5df-4697-bcd6-4e03a5e83775 service nova] Creating event network-vif-plugged:7909090b-1bd4-487a-938e-7d8d3409d2a1 for instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de on nch2-master-1 Nov 20 21:11:42.468685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-977402c7-a248-4b39-8f12-3d8cde50bc75 req-6cafaac3-b5df-4697-bcd6-4e03a5e83775 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090015 Nov 20 21:11:42.469325 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3048/6207] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:42.672047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:42.672651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:42.678545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:42.678991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:42.679765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:42.680197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:42.815974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:42.824271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2fcc73d-cc94-46f5-919d-4f364d931855 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.156546 Nov 20 21:11:42.825125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3160/6208] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:42 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:43.088220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:43.088922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:43.095626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:43.096076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:43.097127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:43.097820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:43.235706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:43.242958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-16af536b-ddf5-4074-9abc-d2384448fe52 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1317 microversion: 2.1 time: 0.159914 Nov 20 21:11:43.243526 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3049/6209] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:43 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:43.842428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:43.842960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:43.849706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:43.850203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:43.850986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:43.851425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:43.981290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:43.989208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1bcf24ff-9221-421b-abdf-57ec39fe2366 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.151093 Nov 20 21:11:43.989791 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3161/6210] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:43 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:44.260456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:44.261097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:44.268270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.268722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.269504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.269942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.403530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:44.411607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d704dfd-7235-4e44-98d4-3f57e17dc002 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1506 microversion: 2.1 time: 0.154991 Nov 20 21:11:44.412187 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3050/6211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:44 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:44.427334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:44.427832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:44.433581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.434031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.434836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.435327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.459853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:11:44.483464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c6e10c22-edd1-4ded-8050-d0a9fe969edd req-0b2a82cd-1c53-453d-a8a7-c99585d0951b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0ccfd4-6b6e-4899-9ed1-1212c05019b1", "name": "network-vif-plugged", "status": "completed", "tag": "fe8ad4f3-a575-4aaa-8adc-9c254dddec31"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:44.485073 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:44.485073 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:44.491906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6e10c22-edd1-4ded-8050-d0a9fe969edd req-0b2a82cd-1c53-453d-a8a7-c99585d0951b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.492357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c6e10c22-edd1-4ded-8050-d0a9fe969edd req-0b2a82cd-1c53-453d-a8a7-c99585d0951b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.504198 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c6e10c22-edd1-4ded-8050-d0a9fe969edd req-0b2a82cd-1c53-453d-a8a7-c99585d0951b service nova] Creating event network-vif-plugged:fe8ad4f3-a575-4aaa-8adc-9c254dddec31 for instance bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 on nch1-master-1 Nov 20 21:11:44.509413 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c6e10c22-edd1-4ded-8050-d0a9fe969edd req-0b2a82cd-1c53-453d-a8a7-c99585d0951b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029558 Nov 20 21:11:44.510024 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3051/6212] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:11:44.555839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2edb2eb-4039-4ef4-88c5-5f049d5e237f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 204 len: 0 microversion: 2.1 time: 0.131850 Nov 20 21:11:44.556763 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3162/6213] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:11:44 2021] DELETE /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:11:44.565066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:44.565999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:44.572139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.572595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.573374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:44.573812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:44.765547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:44.773024 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eed6b3b-944a-4a17-8a4c-53a0fb81036c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1512 microversion: 2.1 time: 0.212168 Nov 20 21:11:44.773621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3052/6214] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:44 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:45.007125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:45.007825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:45.014580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:45.014952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:45.015734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:45.016172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:45.151042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:45.158378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0c167ea-9fa1-4c90-ab69-cd71b8362c04 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1317 microversion: 2.1 time: 0.155599 Nov 20 21:11:45.158981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3163/6215] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:45 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:45.789426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:45.790042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:45.797385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:45.797841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:45.798654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:45.799094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:45.933689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:45.942068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17db1586-ceb7-4105-8e57-0ee39c79a059 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 200 len: 1512 microversion: 2.1 time: 0.156401 Nov 20 21:11:45.942676 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3053/6216] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:45 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:46.176086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:46.176671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:46.183420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:46.183992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:46.184778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:46.185264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:46.322535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:46.330324 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0665a900-46df-4a55-a09a-f2eb80d58cbd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1507 microversion: 2.1 time: 0.157930 Nov 20 21:11:46.330895 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3164/6217] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:46 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:46.438925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a7ef516d-864f-441c-a252-e3ac01da7c10 req-36c507e1-7b36-47f4-9660-ad972dcdfdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6ade9c3-e4a1-4c87-88b1-fe6b141392de", "name": "network-vif-deleted", "tag": "7909090b-1bd4-487a-938e-7d8d3409d2a1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:46.440729 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:46.440729 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:46.453354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a7ef516d-864f-441c-a252-e3ac01da7c10 req-36c507e1-7b36-47f4-9660-ad972dcdfdb6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:46.454801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a7ef516d-864f-441c-a252-e3ac01da7c10 req-36c507e1-7b36-47f4-9660-ad972dcdfdb6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:46.468617 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a7ef516d-864f-441c-a252-e3ac01da7c10 req-36c507e1-7b36-47f4-9660-ad972dcdfdb6 service nova] Creating event network-vif-deleted:7909090b-1bd4-487a-938e-7d8d3409d2a1 for instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de on nch2-master-1 Nov 20 21:11:46.476767 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a7ef516d-864f-441c-a252-e3ac01da7c10 req-36c507e1-7b36-47f4-9660-ad972dcdfdb6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040147 Nov 20 21:11:46.478496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3054/6218] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:46.959302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:46.959911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:46.965774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:46.966301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:46.967185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:46.967637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:46.982679 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. Nov 20 21:11:46.983275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:46.984112 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7297050-b5df-4936-a25b-e0f0e4c50416 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 404 len: 111 microversion: 2.1 time: 0.028495 Nov 20 21:11:46.984633 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3165/6219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:46 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:11:46.994934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:46.995738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:47.002321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.002774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.003549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.003984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.135328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:47.143490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b43ece0-f1e2-4481-ba1d-225bc6fc0774 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.153802 Nov 20 21:11:47.144082 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3055/6220] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:46 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:47.240772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbc1d5fc-bced-43f9-a15f-39867c13335b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:47.242004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbc1d5fc-bced-43f9-a15f-39867c13335b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:47.242821 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbc1d5fc-bced-43f9-a15f-39867c13335b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.005737 Nov 20 21:11:47.243332 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3166/6221] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:47 2021] POST /compute/v2.1/servers => generated 127 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:47.251564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:47.252206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:47.258372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.258820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.259599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.260036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.393548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:47.400876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e7e50db-7b2d-41e9-a185-4feab74922db tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.153717 Nov 20 21:11:47.401454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3056/6222] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:47 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:47.419065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:47.419767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:47.426702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.427146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.427929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.428371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.563188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:47.570668 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb5891a3-dafa-49cd-b1c5-d77892eba402 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.156029 Nov 20 21:11:47.571380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3167/6223] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:47 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:47.714369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6378e118-02e2-45ce-8e30-a5233665db32"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:47.715439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:47.722817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.723560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.724481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:47.724968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:47.974086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2f697f8-c61f-4d7a-8ac9-b7367ebe1f10 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263223 Nov 20 21:11:47.978097 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3057/6224] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:11:47 2021] POST /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:49.055251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cd702f2-86f8-45c7-837a-e431bde3cdac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1605103503", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "03759c8b-d076-4325-a9e8-74ab1406e8a5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:49.114384 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5cd702f2-86f8-45c7-837a-e431bde3cdac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Block Device 03759c8b-d076-4325-a9e8-74ab1406e8a5 is not bootable. Nov 20 21:11:49.114986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cd702f2-86f8-45c7-837a-e431bde3cdac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Block Device 03759c8b-d076-4325-a9e8-74ab1406e8a5 is not bootable. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:49.115808 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cd702f2-86f8-45c7-837a-e431bde3cdac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.064382 Nov 20 21:11:49.116375 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3168/6225] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:49 2021] POST /compute/v2.1/servers => generated 110 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:49.126495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:49.127399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:49.133819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:49.134294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:49.135071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:49.135508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:49.267166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:49.274519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffcdf411-70fc-4c07-8b54-66d669139d23 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.153552 Nov 20 21:11:49.275093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3058/6226] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:49 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:49.293816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:49.294700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:49.301242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:49.301703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:49.302537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:49.302977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:49.446321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:49.454354 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-49c26a6c-b680-4e1a-a100-824397753088 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.165256 Nov 20 21:11:49.454931 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3169/6227] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:49 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:50.801228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52861672-634f-47f6-b4e5-529a85be8b5c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1433197899", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "89603187-210f-4d54-a40f-71dfff8bc059", "destination_type": "local"}, {"source_type": "volume", "uuid": "508f276a-ae0f-4414-bedc-655e8fe45fb4", "destination_type": "invalid"}], "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:50.802987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52861672-634f-47f6-b4e5-529a85be8b5c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:50.803783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52861672-634f-47f6-b4e5-529a85be8b5c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.006288 Nov 20 21:11:50.804300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3059/6228] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:50 2021] POST /compute/v2.1/servers => generated 155 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:50.812375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:50.812987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:50.819683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:50.820135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:50.820925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:50.821361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:50.957892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:50.965268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1be38320-82c9-4ccb-b0de-553000da50e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.157206 Nov 20 21:11:50.965836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3170/6229] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:50 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:50.983511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:50.984124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:50.990932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:50.991417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:50.992227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:50.992674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.121767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.130008 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9807e438-27fe-4b98-a4cb-a3367a13ba3c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151568 Nov 20 21:11:51.130880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3060/6230] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:50 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:51.183669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-223f42f5-3b78-455f-8fdf-972eae02dfa7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941132577", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:51.185237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-223f42f5-3b78-455f-8fdf-972eae02dfa7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:51.186170 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-223f42f5-3b78-455f-8fdf-972eae02dfa7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.006185 Nov 20 21:11:51.187590 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3171/6231] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:51 2021] POST /compute/v2.1/servers => generated 624 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:51.195420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:51.196062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:51.202286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.202623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.203535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.203976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.291607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-645634534", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "fda6f72f-febf-4b40-96b5-852ad898230c"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:51.344515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.345126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] validate_networks() for [('fda6f72f-febf-4b40-96b5-852ad898230c', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:51.352191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5623318a-2e8b-4a43-8684-763b23904064 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160416 Nov 20 21:11:51.352773 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3061/6232] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:51 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:51.370145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:51.370765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:51.377585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.378071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.378882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.379322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.513174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.527631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67c0a548-2143-4d26-a533-119c375169de tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160989 Nov 20 21:11:51.534728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3062/6233] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:51 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:51.591242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-216fe314-add8-4d25-a360-ae677ad356fd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:51.592523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-216fe314-add8-4d25-a360-ae677ad356fd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:51.594560 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-216fe314-add8-4d25-a360-ae677ad356fd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006906 Nov 20 21:11:51.598600 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3063/6234] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:51 2021] POST /compute/v2.1/servers => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:51.603636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:51.604257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:51.612581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.613033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.613833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.614307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.723503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:11:51.723926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:11:51.724602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:11:51.725178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:11:51.725593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:11:51.734834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.735316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.736133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.736570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.753638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:11:51.753902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.759119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for user 183a75eb42e44f92af23e4a3c5a5d40c and project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:11:51.762447 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da885d1d-0234-46a9-88d3-60bc156c307f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.162646 Nov 20 21:11:51.763361 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3064/6235] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:51 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:51.772807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:11:51.775256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:11:51.779740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:51.780393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:51.786676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.787278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.788203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:51.788819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:51.820895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1ca1aef9-5ea4-4ed5-992d-957cb06ae2cb tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532929 Nov 20 21:11:51.822125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3172/6236] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:11:51.834111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5bb67bb-f9af-46a4-82fc-ae4dd5d2b579 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:51.834768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5bb67bb-f9af-46a4-82fc-ae4dd5d2b579 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:51.892078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e5bb67bb-f9af-46a4-82fc-ae4dd5d2b579 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.899694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5bb67bb-f9af-46a4-82fc-ae4dd5d2b579 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1217 microversion: 2.1 time: 0.071846 Nov 20 21:11:51.905598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3173/6237] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:51 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:51.941338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:51.948948 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f3a944e-aadd-4007-aaec-4498076f22e6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.172775 Nov 20 21:11:51.949525 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3065/6238] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:51 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:52.002492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d65d461-23c6-41bd-a31f-386d66fd3e3b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1109362750", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": -1, "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:52.013716 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7d65d461-23c6-41bd-a31f-386d66fd3e3b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Flavor -1 could not be found. Nov 20 21:11:52.014327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d65d461-23c6-41bd-a31f-386d66fd3e3b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:52.015211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d65d461-23c6-41bd-a31f-386d66fd3e3b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.017068 Nov 20 21:11:52.015766 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3174/6239] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:51 2021] POST /compute/v2.1/servers => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 21:11:52.023857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.024688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.031878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.032481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.033275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.033723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.172572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:52.180436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2418e495-ce54-4093-8bad-768d548c7be5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160353 Nov 20 21:11:52.181025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3066/6240] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:52.198764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.199530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.207232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.207680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.208737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.209161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.351952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:52.359885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e6c9384-c7c9-454a-b44a-7b34be7d1f2c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.165044 Nov 20 21:11:52.360465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3175/6241] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:52.416706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-affbbef5-2518-4aea-8f51-bcdfc673971d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-183108777", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:52.418195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-affbbef5-2518-4aea-8f51-bcdfc673971d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:52.419001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-affbbef5-2518-4aea-8f51-bcdfc673971d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.006224 Nov 20 21:11:52.419523 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3067/6242] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:52 2021] POST /compute/v2.1/servers => generated 145 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:11:52.427614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.428232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.434233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.434688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.435608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.436240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.572131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:52.579650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2002f49e-f661-4c0d-a9f3-03749ba13a8a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155678 Nov 20 21:11:52.580211 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3176/6243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:52.597535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.598214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.604834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.605299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.606129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.606560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.744687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:52.754244 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69d356e9-ff59-49b3-b6aa-093e06c7492e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160983 Nov 20 21:11:52.755717 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3068/6244] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:52.814753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dad61fe4-a04c-441d-9455-f56e7772ae3a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-567724772", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:52.817897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-dad61fe4-a04c-441d-9455-f56e7772ae3a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 20 21:11:52.818501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dad61fe4-a04c-441d-9455-f56e7772ae3a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:52.819291 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dad61fe4-a04c-441d-9455-f56e7772ae3a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.009045 Nov 20 21:11:52.819812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3177/6245] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:52 2021] POST /compute/v2.1/servers => generated 123 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:11:52.831113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.831724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.839442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.839898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.840702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.841144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.917458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:52.918242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:52.925922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.927038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.927684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:52.928124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:52.988589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:52.996052 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0b5086c-614b-4a7e-9cb3-1ad12841a03d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1275 microversion: 2.1 time: 0.083154 Nov 20 21:11:52.996624 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3178/6246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:53.371166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:53.379389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7d9ae19-950e-4666-ac8a-0490ebdd390a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.555136 Nov 20 21:11:53.379976 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3069/6247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:53.397067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:53.397780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:53.403916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:53.404374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:53.405834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:53.406598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:53.544830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:53.552808 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31c54275-6cdc-4aed-9f6e-caac16094cf0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.159363 Nov 20 21:11:53.553488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3179/6248] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:53 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:53.608205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-907454e9-6658-4def-9f5b-7e3c522c00a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1443504831", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "key_name": "tempest-key-1956584760", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:53.661762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-907454e9-6658-4def-9f5b-7e3c522c00a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] validate_networks() for [('13329dec-d6cb-4b40-9c80-e369d65965f5', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:11:53.957512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-907454e9-6658-4def-9f5b-7e3c522c00a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Invalid key_name provided. Nov 20 21:11:53.958152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-907454e9-6658-4def-9f5b-7e3c522c00a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid key_name provided. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:53.958993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-907454e9-6658-4def-9f5b-7e3c522c00a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.354558 Nov 20 21:11:53.959606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3070/6249] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:53 2021] POST /compute/v2.1/servers => generated 70 bytes in 356 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 20 21:11:53.968366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:53.969365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:53.976373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:53.976830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:53.977687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:53.978234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.013299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.014007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.021952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.022287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.023165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.023677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.116194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:54.123545 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9730f2b-82a3-4a6b-bf4e-fecab139fadb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.159658 Nov 20 21:11:54.124986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3180/6250] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:53 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:54.141665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.142422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.148616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.149077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.149916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.150390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.287641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:54.295466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:54.296495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9650c1f6-8571-43c8-bd48-7e1d67a280e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.157929 Nov 20 21:11:54.297376 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3181/6251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:54 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:54.313319 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e2ad0a33-b66d-4adc-8aad-4dd7aa5a4a06 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.304123 Nov 20 21:11:54.314516 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3071/6252] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:54 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:54.356750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03d2e92b-cb98-4335-9fb7-68de7c08687c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-496774158", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:54.446231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.security_group_api [None req-03d2e92b-cb98-4335-9fb7-68de7c08687c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Neutron security group does_not_exist not found {{(pid=140941) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 20 21:11:54.446879 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-03d2e92b-cb98-4335-9fb7-68de7c08687c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 20 21:11:54.447694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03d2e92b-cb98-4335-9fb7-68de7c08687c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:54.448559 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03d2e92b-cb98-4335-9fb7-68de7c08687c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.096196 Nov 20 21:11:54.449816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3182/6253] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:54 2021] POST /compute/v2.1/servers => generated 106 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:54.458486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.459106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.465000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.465460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.466287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.466731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.685147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:54.693536 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fe275b1-a2dd-4d9a-b670-f9342fd6a5a5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.238736 Nov 20 21:11:54.694304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3072/6254] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:54 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:54.712624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.713243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.719688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.720222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.721029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.721475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.762397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bc6ed77c-8e2a-4450-b3d5-6ec5e2140203 req-39d301e0-8514-493a-af42-acabf11f45ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188c7d5c-dd65-41fd-a579-108829f5bcaa", "tag": "307c8ef7-854a-498d-8e4d-7bf51ed6c803"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:54.764151 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:11:54.764151 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:11:54.773242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bc6ed77c-8e2a-4450-b3d5-6ec5e2140203 req-39d301e0-8514-493a-af42-acabf11f45ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.773718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bc6ed77c-8e2a-4450-b3d5-6ec5e2140203 req-39d301e0-8514-493a-af42-acabf11f45ea service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.788450 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bc6ed77c-8e2a-4450-b3d5-6ec5e2140203 req-39d301e0-8514-493a-af42-acabf11f45ea service nova] Creating event network-changed:307c8ef7-854a-498d-8e4d-7bf51ed6c803 for instance 188c7d5c-dd65-41fd-a579-108829f5bcaa on nch2-master-1 Nov 20 21:11:54.794998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bc6ed77c-8e2a-4450-b3d5-6ec5e2140203 req-39d301e0-8514-493a-af42-acabf11f45ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035421 Nov 20 21:11:54.796521 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3073/6255] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:11:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:11:54.869608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:54.877998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c6c6d82-7129-4d09-ae26-86f0af49c88e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.170784 Nov 20 21:11:54.878804 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3183/6256] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:54 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:54.895239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a508431-5b5f-475a-905f-894641997a9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.895838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8a508431-5b5f-475a-905f-894641997a9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 1c7405c8-c5c7-4cbf-8c83-61970d682cd8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.901300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-8a508431-5b5f-475a-905f-894641997a9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 1c7405c8-c5c7-4cbf-8c83-61970d682cd8 could not be found. Nov 20 21:11:54.901886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8a508431-5b5f-475a-905f-894641997a9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 1c7405c8-c5c7-4cbf-8c83-61970d682cd8 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:54.902761 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8a508431-5b5f-475a-905f-894641997a9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1c7405c8-c5c7-4cbf-8c83-61970d682cd8" status: 404 len: 111 microversion: 2.1 time: 0.011591 Nov 20 21:11:54.903310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3074/6257] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:11:54 2021] DELETE /compute/v2.1/servers/1c7405c8-c5c7-4cbf-8c83-61970d682cd8 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:54.912079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:54.912689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:54.918840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.919292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:54.920081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:54.920519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.055230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.063533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2295843-11be-4145-adf6-9f69a2745474 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155163 Nov 20 21:11:55.064119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3184/6258] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:54 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:55.081187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.081806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.088882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.089338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.090163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.090611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.283913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.291633 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b495cdd8-d2a2-4fd0-ab9f-cbad79a445ab tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.214796 Nov 20 21:11:55.292211 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3075/6259] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:55.307754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-292821a8-bdf8-4962-9d62-98448655de65 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.308241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-292821a8-bdf8-4962-9d62-98448655de65 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 21:11:55.308756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-292821a8-bdf8-4962-9d62-98448655de65 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 20 21:11:55.309317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-292821a8-bdf8-4962-9d62-98448655de65 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:55.310132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-292821a8-bdf8-4962-9d62-98448655de65 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.006097 Nov 20 21:11:55.310642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3185/6260] 10.222.0.41 () {58 vars in 1187 bytes} [Sat Nov 20 21:11:55 2021] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:11:55.319119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.319895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.326374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.326823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.328731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.329271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.332594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.333402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.340490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.340940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.341734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.342214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.476176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.485152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c665a6a3-8815-444f-a596-10b6b87695e9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.157673 Nov 20 21:11:55.485726 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3186/6261] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:55.584369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.591765 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-88b61f34-8998-43d9-a602-2adaf19bccd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.276610 Nov 20 21:11:55.592336 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3076/6262] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:55.609780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.610655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.616850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.617311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.618201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.618559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.757823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.765452 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dc8194e-41ff-49d2-9134-d8660411f976 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.159986 Nov 20 21:11:55.766031 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3187/6263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:55.781380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12a1a9a5-3b77-4dc5-954c-8992876a00b4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.781863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12a1a9a5-3b77-4dc5-954c-8992876a00b4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Failed to fetch instance by id -1 {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2871}} Nov 20 21:11:55.782402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-12a1a9a5-3b77-4dc5-954c-8992876a00b4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance -1 could not be found. Nov 20 21:11:55.782954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12a1a9a5-3b77-4dc5-954c-8992876a00b4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:55.783741 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12a1a9a5-3b77-4dc5-954c-8992876a00b4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.006161 Nov 20 21:11:55.784252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3077/6264] 10.222.0.41 () {58 vars in 1136 bytes} [Sat Nov 20 21:11:55 2021] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 7 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:11:55.792057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.792670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.799335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.799788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.800571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.801007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.935804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:55.943158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f8708a1-7db4-45ed-85f8-455f07ece967 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.154934 Nov 20 21:11:55.943736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3188/6265] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:55.961087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:55.961697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:55.969166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.969610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:55.970418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:55.970856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.099848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.107635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1685fb45-b763-4edf-be18-929aa462256c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.150640 Nov 20 21:11:56.108224 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3078/6266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:56.124690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-115a40a5-048f-498c-8075-1c23598215ae tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:56.125228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-115a40a5-048f-498c-8075-1c23598215ae tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 7f781a1d-3853-479d-8c10-244d9447db05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.131670 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-115a40a5-048f-498c-8075-1c23598215ae tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 7f781a1d-3853-479d-8c10-244d9447db05 could not be found. Nov 20 21:11:56.132248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-115a40a5-048f-498c-8075-1c23598215ae tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 7f781a1d-3853-479d-8c10-244d9447db05 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:56.133044 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-115a40a5-048f-498c-8075-1c23598215ae tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/7f781a1d-3853-479d-8c10-244d9447db05/action" status: 404 len: 111 microversion: 2.1 time: 0.012254 Nov 20 21:11:56.133579 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3189/6267] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:56 2021] POST /compute/v2.1/servers/7f781a1d-3853-479d-8c10-244d9447db05/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:56.141322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.141926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.147772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.148222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.148997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.149432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.285745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.293060 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0017b4e6-e70e-433e-ab68-57d96a2a0afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155615 Nov 20 21:11:56.293627 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3079/6268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:56.309648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.310220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.317055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.317503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.318304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.318746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.448782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.456852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-062a8473-f2f9-479d-8700-9d7017871fd4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.150878 Nov 20 21:11:56.457463 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3190/6269] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:56.473632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79d38d40-b069-4db9-845f-4a5b04b7ea4c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:56.474685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79d38d40-b069-4db9-845f-4a5b04b7ea4c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: b74e6811-9120-4f28-bcb4-0cf036f99cb8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.479915 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-79d38d40-b069-4db9-845f-4a5b04b7ea4c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance b74e6811-9120-4f28-bcb4-0cf036f99cb8 could not be found. Nov 20 21:11:56.480490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79d38d40-b069-4db9-845f-4a5b04b7ea4c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance b74e6811-9120-4f28-bcb4-0cf036f99cb8 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:56.481283 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79d38d40-b069-4db9-845f-4a5b04b7ea4c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/b74e6811-9120-4f28-bcb4-0cf036f99cb8/action" status: 404 len: 111 microversion: 2.1 time: 0.011403 Nov 20 21:11:56.481824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3080/6270] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:56 2021] POST /compute/v2.1/servers/b74e6811-9120-4f28-bcb4-0cf036f99cb8/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:56.489690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.490330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.496432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.496880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.497662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.498126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.502086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.502712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.509695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.510179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.510966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.511408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.638903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.646329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.647094 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-201b58b8-2d2f-490f-9d3e-fb763805a6d4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.161054 Nov 20 21:11:56.648568 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3191/6271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:56.653958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f88252ba-7ab1-43e4-bae0-e69d7a521ea1 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.155345 Nov 20 21:11:56.654539 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3081/6272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:56.668010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.668610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.674415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.674862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.675627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.676090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.804576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.812615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-245bbe81-ba83-4c90-bcd5-e19d88774534 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.147880 Nov 20 21:11:56.813180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3192/6273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:56.830202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2eea3ad7-656f-4d74-90a5-2f9c7a3a0626 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.830823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2eea3ad7-656f-4d74-90a5-2f9c7a3a0626 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: bb74fc0f-b1f8-4c6d-bac5-84d3b35ca479] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.836174 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-2eea3ad7-656f-4d74-90a5-2f9c7a3a0626 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance bb74fc0f-b1f8-4c6d-bac5-84d3b35ca479 could not be found. Nov 20 21:11:56.836703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2eea3ad7-656f-4d74-90a5-2f9c7a3a0626 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance bb74fc0f-b1f8-4c6d-bac5-84d3b35ca479 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:56.837516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2eea3ad7-656f-4d74-90a5-2f9c7a3a0626 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/bb74fc0f-b1f8-4c6d-bac5-84d3b35ca479" status: 404 len: 111 microversion: 2.1 time: 0.012830 Nov 20 21:11:56.838041 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3082/6274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/bb74fc0f-b1f8-4c6d-bac5-84d3b35ca479 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:56.845860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:56.846523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:56.852302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.852754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.853531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:56.853970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:56.986484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:56.993798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7de58abf-13e3-4368-812e-c0f576186d55 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151856 Nov 20 21:11:56.994404 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3193/6275] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:57.011508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.012122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.019569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.020024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.020811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.021253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.152922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.160459 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33d52dc4-e07f-4c8a-a3ac-7bfed6fb0e83 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.152604 Nov 20 21:11:57.161036 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3083/6276] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:57.214955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84f76a3b-b29a-41d6-b5f9-c7784f672467 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1036130654", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:57.216464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-84f76a3b-b29a-41d6-b5f9-c7784f672467 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:57.217395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-84f76a3b-b29a-41d6-b5f9-c7784f672467 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006568 Nov 20 21:11:57.218149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3194/6277] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:57 2021] POST /compute/v2.1/servers => generated 139 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:11:57.225416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.226034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.232027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.232483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.233816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.234302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.366717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.374551 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0401af1-26eb-4434-a36d-3f8deb4a7a31 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.152656 Nov 20 21:11:57.375119 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3084/6278] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:57.392845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.393447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.400423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.400872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.401654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.402118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.536092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.543569 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a2baf614-564f-4b26-97cf-11b34ecdf2be tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155286 Nov 20 21:11:57.544132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3195/6279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:57.597959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9bd9f043-602d-478e-8bb6-c25ce159764f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1634956243", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:57.599627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9bd9f043-602d-478e-8bb6-c25ce159764f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:57.600469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9bd9f043-602d-478e-8bb6-c25ce159764f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006393 Nov 20 21:11:57.600996 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3085/6280] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:11:57 2021] POST /compute/v2.1/servers => generated 133 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:11:57.609513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.610171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.616137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.616528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.617328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.617759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.670659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.671840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.678835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.679291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.680102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.680544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.749519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.757114 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-129f42b3-a607-4015-816a-f5cce9e192ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151808 Nov 20 21:11:57.757692 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3196/6281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:57.774424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.775034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.781080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.781527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.782327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.782763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.813990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.821560 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d74ebbbf-6470-4e1e-9e22-9caa3a667876 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.154588 Nov 20 21:11:57.822251 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3086/6282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:57.918104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:57.925960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f5ea33e-bb14-46b2-a504-99173f533637 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155077 Nov 20 21:11:57.926554 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3197/6283] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:57.942824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ff6e94a-6a1c-4796-b062-8909ce6a8988 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:57.943363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ff6e94a-6a1c-4796-b062-8909ce6a8988 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 71ce5de5-a12c-4e0a-b21e-142ac470d318] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.948590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1ff6e94a-6a1c-4796-b062-8909ce6a8988 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 71ce5de5-a12c-4e0a-b21e-142ac470d318 could not be found. Nov 20 21:11:57.949161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ff6e94a-6a1c-4796-b062-8909ce6a8988 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 71ce5de5-a12c-4e0a-b21e-142ac470d318 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:57.949953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ff6e94a-6a1c-4796-b062-8909ce6a8988 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/71ce5de5-a12c-4e0a-b21e-142ac470d318/action" status: 404 len: 111 microversion: 2.1 time: 0.010999 Nov 20 21:11:57.950507 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3087/6284] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:57 2021] POST /compute/v2.1/servers/71ce5de5-a12c-4e0a-b21e-142ac470d318/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:11:57.957861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:57.958511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:57.964229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.964668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:57.965441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:57.965872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.094752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:58.102111 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e14a877-48f9-4c29-af95-6dbcd45c1cc8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.147753 Nov 20 21:11:58.102717 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3198/6285] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:11:58.119971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:58.120490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:58.128144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.128601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.129388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.129831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.261769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:58.269116 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67b171f2-1caf-408a-a2f9-25f49eb97357 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.152976 Nov 20 21:11:58.269683 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3088/6286] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:58 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:58.285437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:58.285972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:58.291750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.292194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.292960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.293393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.374035 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-042d2f39-9a61-4aed-8a40-e34526ae37d5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.091796 Nov 20 21:11:58.374770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3199/6287] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:58 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:58.383554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:58.384174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:58.390648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.391173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.392123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.392590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.542944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:58.551805 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2b57fc0-ab41-42e8-a93f-5b473e686546 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1511 microversion: 2.1 time: 0.172514 Nov 20 21:11:58.552621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3089/6288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:58 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:58.839250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:58.839946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:58.848527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.848957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.849744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:58.850221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:58.984751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:58.992087 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-97726aaa-43ad-4b60-8cec-0917f7ffe38d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.157768 Nov 20 21:11:58.992660 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3200/6289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:58 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:59.568528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:59.569139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:59.576108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.576559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.578075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.578475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.713952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:11:59.722144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43b70275-d5f6-4a89-91a4-e64caeda69ed tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1491 microversion: 2.1 time: 0.157281 Nov 20 21:11:59.722727 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3090/6290] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:59 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1491 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:11:59.739169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:59.739700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:59.745489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.745930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.746734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.747165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.770135 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'pause' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state paused Nov 20 21:11:59.770665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'pause' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state paused {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:11:59.771481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11a7b928-4115-4d66-a347-956cdb180ec7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 143 microversion: 2.1 time: 0.036259 Nov 20 21:11:59.772015 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3201/6291] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:59 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 143 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 21:11:59.780800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:11:59.781429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:59.787319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.787780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.788576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.789042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.852861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69c89a02-2069-4d16-83ba-86fe74a97ead tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.076187 Nov 20 21:11:59.853786 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3091/6292] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:11:59 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:11:59.862908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:11:59.863734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:11:59.870889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.871351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:11:59.872164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:11:59.873000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:00.008694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:00.010507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:00.011211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:00.016884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73a0d981-ef45-4eab-a75d-ec06783d6403 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1498 microversion: 2.1 time: 0.157670 Nov 20 21:12:00.017701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3202/6293] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:11:59 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:00.018471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:00.018935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:00.019743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:00.020186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:00.164134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:00.173543 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26800390-1a75-45b8-8171-215386dfee03 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.167093 Nov 20 21:12:00.174155 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3092/6294] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:00 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:00.479360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ff107a0e-03a5-4222-9ec1-fb91d2525434 req-091c00cf-63a9-4873-aebc-12a425fab379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c7d5c-dd65-41fd-a579-108829f5bcaa", "name": "network-vif-plugged", "status": "completed", "tag": "307c8ef7-854a-498d-8e4d-7bf51ed6c803"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:00.481200 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:00.481200 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:00.489274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ff107a0e-03a5-4222-9ec1-fb91d2525434 req-091c00cf-63a9-4873-aebc-12a425fab379 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:00.490415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ff107a0e-03a5-4222-9ec1-fb91d2525434 req-091c00cf-63a9-4873-aebc-12a425fab379 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:00.503793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ff107a0e-03a5-4222-9ec1-fb91d2525434 req-091c00cf-63a9-4873-aebc-12a425fab379 service nova] Creating event network-vif-plugged:307c8ef7-854a-498d-8e4d-7bf51ed6c803 for instance 188c7d5c-dd65-41fd-a579-108829f5bcaa on nch2-master-1 Nov 20 21:12:00.509165 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ff107a0e-03a5-4222-9ec1-fb91d2525434 req-091c00cf-63a9-4873-aebc-12a425fab379 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Nov 20 21:12:00.510089 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3203/6295] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:01.034939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.035488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.042209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.042670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.043458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.043906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.179077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.186714 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c746ef6a-1bf3-4fe5-b835-458d1c99891f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.156134 Nov 20 21:12:01.187427 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3093/6296] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:01.191461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.192167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.198452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.198933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.200115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.200589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.204239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.204858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.210618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.211076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.211866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.212311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.336080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.344218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.344517 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7e69618e-62fd-441e-a48e-96387b606177 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1317 microversion: 2.1 time: 0.157995 Nov 20 21:12:01.345105 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3204/6297] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:01.351631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34bdd5f8-3d23-4bfd-8320-081b011e9506 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151002 Nov 20 21:12:01.352210 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3094/6298] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:01.368402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:01.369351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.375827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.376144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.377021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.377466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.391350 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. Nov 20 21:12:01.391949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:01.392771 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b20aa19f-20ff-4f39-af79-ec030a62ccec tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de/action" status: 404 len: 111 microversion: 2.1 time: 0.028095 Nov 20 21:12:01.393337 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3205/6299] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:01 2021] POST /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:12:01.403830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.404467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.410992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.411535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.412319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.412846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.548129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.555561 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d98b5623-4107-4cc0-81bf-679b92c86d53 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155377 Nov 20 21:12:01.556202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3095/6300] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:01.572729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.573348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.579953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.580407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.581191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.581644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.721448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.729473 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f238a782-6750-4f30-bf17-cf056b33a8e4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160393 Nov 20 21:12:01.730043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3206/6301] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:01.745595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-238d03d5-6aab-443c-9d70-5af0503e7739 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:01.746578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-238d03d5-6aab-443c-9d70-5af0503e7739 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: a764a8a9-65c2-4de8-a1fe-26ddc6c88af5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.752424 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-238d03d5-6aab-443c-9d70-5af0503e7739 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance a764a8a9-65c2-4de8-a1fe-26ddc6c88af5 could not be found. Nov 20 21:12:01.753131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-238d03d5-6aab-443c-9d70-5af0503e7739 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance a764a8a9-65c2-4de8-a1fe-26ddc6c88af5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:01.754919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-238d03d5-6aab-443c-9d70-5af0503e7739 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/a764a8a9-65c2-4de8-a1fe-26ddc6c88af5/action" status: 404 len: 111 microversion: 2.1 time: 0.012377 Nov 20 21:12:01.756219 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3096/6302] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:01 2021] POST /compute/v2.1/servers/a764a8a9-65c2-4de8-a1fe-26ddc6c88af5/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:01.763948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.765355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.771942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.772396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.773174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.773612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.904254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:01.912348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a67d6b34-94ff-46a6-ac5a-2f36e546011b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151963 Nov 20 21:12:01.912934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3207/6303] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:01.929420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:01.930077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:01.937500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.937948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:01.938785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:01.939227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.068327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.075717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e01de2f3-d25c-4711-8a15-c69611ec65ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.149951 Nov 20 21:12:02.076275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3097/6304] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:02.092758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:02.094296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.100205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.100655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.101433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.101872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.119530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. Nov 20 21:12:02.119530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:02.119530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b12526ac-4b13-47d7-961a-dde059506fdb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de/action" status: 404 len: 111 microversion: 2.1 time: 0.027928 Nov 20 21:12:02.119530 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3208/6305] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:02 2021] POST /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:02.125696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.126338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.132480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.132934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.134356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.134801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.267202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.274411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8749c987-0d99-4519-af6c-5af2cba407e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.152916 Nov 20 21:12:02.274981 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3098/6306] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:02.291027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.291640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.298885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.299332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.300114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.300554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.362418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.363168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.369195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.369816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.370695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.371151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.440555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.447891 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bb5174be-131a-4065-bc46-fa0b307332eb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160510 Nov 20 21:12:02.448466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3209/6307] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:02.464943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-001979a8-3470-450b-b2e9-a9202abb60c5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:02.466408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-001979a8-3470-450b-b2e9-a9202abb60c5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 2d95ed69-a340-4cbc-a478-72e09ed7121b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.472516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-001979a8-3470-450b-b2e9-a9202abb60c5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 2d95ed69-a340-4cbc-a478-72e09ed7121b could not be found. Nov 20 21:12:02.473097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-001979a8-3470-450b-b2e9-a9202abb60c5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 2d95ed69-a340-4cbc-a478-72e09ed7121b could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:02.473908 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-001979a8-3470-450b-b2e9-a9202abb60c5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/2d95ed69-a340-4cbc-a478-72e09ed7121b/action" status: 404 len: 111 microversion: 2.1 time: 0.012652 Nov 20 21:12:02.474505 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3210/6308] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:02 2021] POST /compute/v2.1/servers/2d95ed69-a340-4cbc-a478-72e09ed7121b/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:12:02.481945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.482796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.489317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.489760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.490563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.491082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.509882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.519218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-845a962b-afa5-48a9-ae9d-4903b858b5da tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1506 microversion: 2.1 time: 0.161411 Nov 20 21:12:02.525392 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3099/6309] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:02.539397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6378e118-02e2-45ce-8e30-a5233665db32"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:02.540462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.546676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.547137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.547971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.548416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.631840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Invalid volume: volume 6378e118-02e2-45ce-8e30-a5233665db32 is already attached to instances: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 Nov 20 21:12:02.632564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 400 to user: Invalid volume: volume 6378e118-02e2-45ce-8e30-a5233665db32 is already attached to instances: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:02.633479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d1391bc-f213-4666-a622-b871661e425f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098051 Nov 20 21:12:02.637612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3100/6310] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:12:02 2021] POST /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:12:02.638827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.648948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a46b2db6-759b-43d6-b4af-4dced9899369 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.170201 Nov 20 21:12:02.649537 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3211/6311] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:02.666514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.667139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.673591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.674291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.675096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.675660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.703825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.704402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.710539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.711093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.711941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.712444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.790264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lazy-loading 'services' on Instance uuid bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:02.810845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:02.818482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8437f078-2c7e-4354-bc79-c31c07ea30e2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155952 Nov 20 21:12:02.819061 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3101/6312] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:02.835159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95f4f35b-579a-492e-a215-b40d0fb41236 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:02.835705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95f4f35b-579a-492e-a215-b40d0fb41236 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 81ea09b7-89ab-449e-9a57-15e37691489f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.841339 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-95f4f35b-579a-492e-a215-b40d0fb41236 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 81ea09b7-89ab-449e-9a57-15e37691489f could not be found. Nov 20 21:12:02.841998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95f4f35b-579a-492e-a215-b40d0fb41236 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 81ea09b7-89ab-449e-9a57-15e37691489f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:02.843396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95f4f35b-579a-492e-a215-b40d0fb41236 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/81ea09b7-89ab-449e-9a57-15e37691489f/action" status: 404 len: 111 microversion: 2.1 time: 0.011963 Nov 20 21:12:02.843951 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3102/6313] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:02 2021] POST /compute/v2.1/servers/81ea09b7-89ab-449e-9a57-15e37691489f/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:02.853634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.854289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.860151 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-85a4b984-dccd-48c2-a1c2-5c5b27516993 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments/6378e118-02e2-45ce-8e30-a5233665db32" status: 202 len: 0 microversion: 2.1 time: 0.160587 Nov 20 21:12:02.863863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3212/6314] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:12:02 2021] DELETE /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments/6378e118-02e2-45ce-8e30-a5233665db32 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:12:02.864020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.864020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.864020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.864020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.869070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:02.870195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:02.878849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.879367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.880582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:02.881162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:02.915048 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-589539b5-1189-4e9f-9e94-446fe10624a9 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049836 Nov 20 21:12:02.915639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3213/6315] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:03.006705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.014070 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd2518fe-08a9-4223-a788-dcebb3cbf5df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.163792 Nov 20 21:12:03.014655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3103/6316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.030842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.031445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.037241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.037688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.038489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.038922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.168984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.177964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c0cb6bb-cd64-44fa-8241-04312edaf712 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.150780 Nov 20 21:12:03.178589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3214/6317] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.194917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:03.195464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.202154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.202693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.203484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.203925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.226355 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'restore' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active Nov 20 21:12:03.226929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'restore' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:03.227746 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e36759d-4efb-4b4b-9c62-04ee385f7454 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 145 microversion: 2.1 time: 0.036690 Nov 20 21:12:03.228288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3104/6318] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:03 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 145 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:12:03.236672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.237397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.243320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.243756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.244534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.244968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.379704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.387401 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06c0b3cb-cf48-4c27-9837-a7dd08d63296 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.154970 Nov 20 21:12:03.387974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3215/6319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.404355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.405509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.411332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.411791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.412575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.413020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.548488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.555901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e20674d2-6b99-42eb-820c-e8a5cf079e0c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155204 Nov 20 21:12:03.556475 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3105/6320] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.572460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0fe6c0c6-9182-434d-bb73-17cb3a62bef6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:03.572992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0fe6c0c6-9182-434d-bb73-17cb3a62bef6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 227c782d-d2e0-4009-a134-24e8a23383d8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.578304 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-0fe6c0c6-9182-434d-bb73-17cb3a62bef6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 227c782d-d2e0-4009-a134-24e8a23383d8 could not be found. Nov 20 21:12:03.578985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0fe6c0c6-9182-434d-bb73-17cb3a62bef6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 227c782d-d2e0-4009-a134-24e8a23383d8 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:03.579800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0fe6c0c6-9182-434d-bb73-17cb3a62bef6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/227c782d-d2e0-4009-a134-24e8a23383d8/action" status: 404 len: 111 microversion: 2.1 time: 0.011131 Nov 20 21:12:03.580356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3216/6321] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:03 2021] POST /compute/v2.1/servers/227c782d-d2e0-4009-a134-24e8a23383d8/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:03.588353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.588963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.595565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.596015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.596828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.597267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.736464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.743835 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-346a8b56-ef6f-4552-afe6-3588bab5ce8d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.159230 Nov 20 21:12:03.744401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3106/6322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.760924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.761621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.770175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.770639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.771434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.771880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.901192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:03.909206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c29e325f-e1bc-4401-a1c7-2707525db79a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.151986 Nov 20 21:12:03.909769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3217/6323] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:03.925348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.925545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:03.926095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.926291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.932017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.932179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.932476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.932593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.933260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.933377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.933696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.933795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.957519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'resume' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active Nov 20 21:12:03.958145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'resume' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:03.958978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b8f6769-cf74-4f2b-a957-a8e7795ead1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 144 microversion: 2.1 time: 0.037437 Nov 20 21:12:03.959546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3107/6324] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:03 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 144 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 21:12:03.963281 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbc1776b-b78d-4e95-b29d-afe7c8214dc2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041297 Nov 20 21:12:03.963851 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3218/6325] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:03.967410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:03.968099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:03.974837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.975294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:03.976085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:03.976530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.065904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2072184471", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "fda6f72f-febf-4b40-96b5-852ad898230c"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:04.113053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.117106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] validate_networks() for [('fda6f72f-febf-4b40-96b5-852ad898230c', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:12:04.120750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f7d3e6b-5754-4447-9e7d-f9fb5e95a281 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.156833 Nov 20 21:12:04.121320 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3108/6326] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:04.138525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.139135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.145532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.145984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.146799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.147237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.285222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.293078 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5b1f78c3-6f83-482c-9753-5bc8809a753d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.158135 Nov 20 21:12:04.293654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3109/6327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:04.350670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-886fb084-2825-466d-8933-5403f96eaf9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "13329dec-d6cb-4b40-9c80-e369d65965f5"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:04.351926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-886fb084-2825-466d-8933-5403f96eaf9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:04.352723 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-886fb084-2825-466d-8933-5403f96eaf9e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.005885 Nov 20 21:12:04.356011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3110/6328] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:12:04 2021] POST /compute/v2.1/servers => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:12:04.360797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.361405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.368601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.369060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.369885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.370351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.494972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:12:04.495477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:12:04.496048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:12:04.496519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:12:04.496883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:12:04.507027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.510129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.510514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.516841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.516841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.518999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d15bce7d-2160-419c-8c10-b2589487cae2 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.161900 Nov 20 21:12:04.519620 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3111/6329] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:04.533177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:12:04.538146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.538742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for user 183a75eb42e44f92af23e4a3c5a5d40c and project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:12:04.538875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.545111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.545677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.547382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.548057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.552044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:12:04.554424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:12:04.600154 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01e25396-ae22-4f11-827e-c829c2b93504 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538436 Nov 20 21:12:04.600900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3219/6330] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:12:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:12:04.610848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e2d14e8-75f2-4db3-a6dd-74ce6d8c644c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.611519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e2d14e8-75f2-4db3-a6dd-74ce6d8c644c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.666656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e2d14e8-75f2-4db3-a6dd-74ce6d8c644c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.673534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e2d14e8-75f2-4db3-a6dd-74ce6d8c644c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1218 microversion: 2.1 time: 0.066721 Nov 20 21:12:04.674559 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3220/6331] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:04.689201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.697557 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2642b955-fe87-43a1-9756-84961ae4f4bd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.164340 Nov 20 21:12:04.702099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3112/6332] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:04.714035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96fb0fae-b983-4622-b812-3569000c04c3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:04.714593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-96fb0fae-b983-4622-b812-3569000c04c3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c5a90887-80a7-46a1-a416-e405fe8d635b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.720422 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-96fb0fae-b983-4622-b812-3569000c04c3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c5a90887-80a7-46a1-a416-e405fe8d635b could not be found. Nov 20 21:12:04.721003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-96fb0fae-b983-4622-b812-3569000c04c3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c5a90887-80a7-46a1-a416-e405fe8d635b could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:04.721806 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-96fb0fae-b983-4622-b812-3569000c04c3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/c5a90887-80a7-46a1-a416-e405fe8d635b/action" status: 404 len: 111 microversion: 2.1 time: 0.011575 Nov 20 21:12:04.722540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3221/6333] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:04 2021] POST /compute/v2.1/servers/c5a90887-80a7-46a1-a416-e405fe8d635b/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:04.731007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.731864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.739089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.739634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.740490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.741073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.888118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:04.897546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-398a5ad3-e40b-45f4-9ae9-b4033238d31a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.170530 Nov 20 21:12:04.898212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3113/6334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:04.915320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:04.915849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:04.923632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.924086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:04.924882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:04.925324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.067824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:05.075593 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03f710d1-bd7d-4237-9e42-bbc370c07003 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.164019 Nov 20 21:12:05.076164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3222/6335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:05.092085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:05.092768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:05.098539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.098990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.099771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.100208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.123181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lazy-loading 'flavor' on Instance uuid 4a71a189-4354-4a63-93e2-c1b900b7c25c {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:05.381653 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eddc600e-a378-4afa-bf80-130be5e864e5 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.293173 Nov 20 21:12:05.382482 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3114/6336] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:05 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:12:05.390476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:05.391195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:05.397777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.398684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.399492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.399948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.568303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:05.577499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3b55287-488d-41f3-a359-39d8f84723d6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.190784 Nov 20 21:12:05.578534 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3223/6337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:05 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:05.691247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:05.691942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:05.698428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.698869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.699741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:05.700251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:05.768002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:05.775381 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aaea20e2-72f2-41b7-bbf6-f79952df8126 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1276 microversion: 2.1 time: 0.088480 Nov 20 21:12:05.775957 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3115/6338] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:05 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:06.595702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:06.596373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:06.603858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:06.604500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:06.605379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:06.605966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:06.743514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:06.750945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c6c7c56d-c85a-4590-889a-20ba735f2a85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.159444 Nov 20 21:12:06.751529 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3224/6339] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:06.793277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:06.793804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:06.800857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:06.801313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:06.802145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:06.802668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:06.826112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0b7ba552-6ff5-4aae-8103-0460c0ea7b49 req-8b2eb58b-f17c-4ceb-add0-83833be2771d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32cc822b-3909-42b1-bb52-f615e60c135b", "tag": "ca17f952-be7f-4220-9044-0f40a9ab6058"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:06.829097 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:06.829097 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:06.846172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0b7ba552-6ff5-4aae-8103-0460c0ea7b49 req-8b2eb58b-f17c-4ceb-add0-83833be2771d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:06.846712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0b7ba552-6ff5-4aae-8103-0460c0ea7b49 req-8b2eb58b-f17c-4ceb-add0-83833be2771d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:06.858093 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0b7ba552-6ff5-4aae-8103-0460c0ea7b49 req-8b2eb58b-f17c-4ceb-add0-83833be2771d service nova] Creating event network-changed:ca17f952-be7f-4220-9044-0f40a9ab6058 for instance 32cc822b-3909-42b1-bb52-f615e60c135b on nch2-master-1 Nov 20 21:12:06.863157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0b7ba552-6ff5-4aae-8103-0460c0ea7b49 req-8b2eb58b-f17c-4ceb-add0-83833be2771d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041146 Nov 20 21:12:06.863849 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3225/6340] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:07.043125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:07.050779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb4b07cd-47b0-40e2-896d-94220e2a4a1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.261161 Nov 20 21:12:07.051288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3116/6341] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:06 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:07.434102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:07.435104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:07.442564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.443022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.443813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.444362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.474163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c7680ef-80aa-4739-a5d6-aeaaf7c6fb0a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044132 Nov 20 21:12:07.474744 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3226/6342] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:07 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:07.533877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:07.534769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:07.541667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.542162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.542989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.543425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.581558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:07.670401 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ebc7b659-7505-412b-b1f1-ebffaad966de tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 204 len: 0 microversion: 2.1 time: 0.139686 Nov 20 21:12:07.676605 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3117/6343] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:07 2021] DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:07.681865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:07.682636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:07.693745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.695371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.696243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.696690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.770004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:07.770824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:07.777461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.777925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:07.778768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:07.779223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:08.224087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:08.230324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:08.231873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5598ca1c-eea0-45c9-974e-e0e53e59ede0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.467092 Nov 20 21:12:08.232467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3118/6344] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:07 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:08.238555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e00cef0f-a572-45f1-bf1d-99c842dc0414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1674 microversion: 2.1 time: 0.560690 Nov 20 21:12:08.238755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:08.239243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:08.240069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3227/6345] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:07 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1674 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:08.247950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:08.248631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:08.249721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:08.250266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:08.470989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:08.478492 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6303cc27-1411-48e8-bbe3-7a819909ce0c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.244765 Nov 20 21:12:08.479075 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3119/6346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:08 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:09.249650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:09.250373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:09.256875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:09.257609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:09.258668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.259275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.260170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.260797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.264391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.264843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.266000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.266472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.400530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:09.404632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:09.408166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ffbabc8-bf8c-40da-a40f-97b6dddb4931 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.162224 Nov 20 21:12:09.408749 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3228/6347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:09 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:09.412255 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cf939f9-fb6d-4f49-9b6d-e508728744cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1674 microversion: 2.1 time: 0.159723 Nov 20 21:12:09.412817 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3120/6348] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:09 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:09.494819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:09.495812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:09.501938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.502369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.503178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:09.503613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:09.634740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:09.643116 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe490457-509e-4208-8b66-056b3fd6419c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.151894 Nov 20 21:12:09.643758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3229/6349] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:09 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:10.428419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:10.430847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:10.431397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:10.431909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:10.443962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.444772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.445293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.445749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.446066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.446508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.447109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.447736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.529201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:10.539976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc1176a8-e2ea-491b-905a-cd597313c9c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 200 len: 1606 microversion: 2.1 time: 0.115154 Nov 20 21:12:10.540566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3230/6350] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:10 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 1606 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:10.661157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:10.661771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:10.667970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.668427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.669214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.669650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.714923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:10.723079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fb1bc4a-406d-463f-a146-bd243c716394 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.301674 Nov 20 21:12:10.724500 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3121/6351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:10 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:10.807965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:10.816739 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5e36459-14d0-46bf-8c35-f72f890ad62e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.159321 Nov 20 21:12:10.822678 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3231/6352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:10 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:10.894379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8fb1848a-45c2-4545-87bb-ab81332b980e req-e05c3b48-d435-4d1f-9047-e4aea4836a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01d099b-cd9f-487e-b0ce-4fb5ac9440c0", "name": "network-vif-deleted", "tag": "3ae4ae95-4d21-46e0-9882-157821324f20"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:10.896523 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:10.896523 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:10.905445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8fb1848a-45c2-4545-87bb-ab81332b980e req-e05c3b48-d435-4d1f-9047-e4aea4836a17 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:10.907033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8fb1848a-45c2-4545-87bb-ab81332b980e req-e05c3b48-d435-4d1f-9047-e4aea4836a17 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:10.919623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8fb1848a-45c2-4545-87bb-ab81332b980e req-e05c3b48-d435-4d1f-9047-e4aea4836a17 service nova] Creating event network-vif-deleted:3ae4ae95-4d21-46e0-9882-157821324f20 for instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 on nch1-master-1 Nov 20 21:12:10.926919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8fb1848a-45c2-4545-87bb-ab81332b980e req-e05c3b48-d435-4d1f-9047-e4aea4836a17 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040109 Nov 20 21:12:10.930753 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3122/6353] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:11.559542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:11.560156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:11.567721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.568169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.568963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.569614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.584646 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. Nov 20 21:12:11.585382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:11.586249 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-249bbce3-7b5f-4275-992f-c2373873160b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 404 len: 111 microversion: 2.1 time: 0.030587 Nov 20 21:12:11.586819 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3232/6354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:11 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:11.596072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-170773e2-340f-482b-ab75-b6d6f8a3ba3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '.version_select at 0x7f3f8693daf0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:11.614827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-170773e2-340f-482b-ab75-b6d6f8a3ba3f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511437608" status: 202 len: 0 microversion: 2.1 time: 0.023232 Nov 20 21:12:11.615602 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3123/6355] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 21:12:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511437608 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:12:11.741507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:11.742494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:11.749512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.750241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.751149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.751625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.834450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:11.835446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:11.844637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.846313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.847477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:11.848088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:11.928605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:11.936347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e283249-e788-4cdb-861a-6af92faa7e25 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.198625 Nov 20 21:12:11.946072 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3233/6356] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:11 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:12.084280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:12.092069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d457307d-a319-48cb-ad98-93716e0f055c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.261827 Nov 20 21:12:12.092644 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3124/6357] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:11 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:12.387334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: .version_select at 0x7f3f864cfa60>, body: {"keypair": {"name": "tempest-keypair-632597464"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:12.401560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:12:12.406694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:12:12.544522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8a869516-6454-47f9-9b0c-5683e252e2cc req-91feea6f-2f3a-4633-8282-7c660183c24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32cc822b-3909-42b1-bb52-f615e60c135b", "name": "network-vif-plugged", "status": "completed", "tag": "ca17f952-be7f-4220-9044-0f40a9ab6058"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:12.546610 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:12.546610 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:12.556137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a869516-6454-47f9-9b0c-5683e252e2cc req-91feea6f-2f3a-4633-8282-7c660183c24b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:12.556812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a869516-6454-47f9-9b0c-5683e252e2cc req-91feea6f-2f3a-4633-8282-7c660183c24b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:12.583092 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8a869516-6454-47f9-9b0c-5683e252e2cc req-91feea6f-2f3a-4633-8282-7c660183c24b service nova] Creating event network-vif-plugged:ca17f952-be7f-4220-9044-0f40a9ab6058 for instance 32cc822b-3909-42b1-bb52-f615e60c135b on nch2-master-1 Nov 20 21:12:12.590345 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8a869516-6454-47f9-9b0c-5683e252e2cc req-91feea6f-2f3a-4633-8282-7c660183c24b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049524 Nov 20 21:12:12.591931 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3125/6358] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:12.954149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:12.955559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:12.962373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:12.962820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:12.963601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:12.964036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:13.042839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:12:13.049114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:12:13.063255 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f06c145-a856-4cf2-8d8c-79b878dd8069 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.679666 Nov 20 21:12:13.063869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3234/6359] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:12:12 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:13.098667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:13.106317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62a4d114-3fc0-4822-8f47-d47091ff2afd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.156213 Nov 20 21:12:13.108681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:13.109829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:13.115868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:13.116323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:13.117322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:13.117943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:13.118098 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3126/6360] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:12 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:13.302717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:13.310307 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4627e22-75a2-4ab1-8daf-d81ad71c3a65 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1318 microversion: 2.1 time: 0.205402 Nov 20 21:12:13.311138 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3235/6361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:13 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:14.123985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:14.125267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:14.131896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.132348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.133140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.133585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.328270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:14.329108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:14.337016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.337634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.338580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.339388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.365830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:14.373354 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91f4f1e8-b29e-47c1-9b2d-eac6a63259d0 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.253317 Nov 20 21:12:14.374180 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3127/6362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:14 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:14.449418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-445040768", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3a9bbee-3f9c-4365-ad64-26cea020ff3a"}], "security_groups": [{"name": "tempest-securitygroup--255186657"}], "key_name": "tempest-keypair-632597464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:14.484694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:14.492493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d98aa10-4286-4355-9259-9f24d34f8e2a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1508 microversion: 2.1 time: 0.168450 Nov 20 21:12:14.493725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3236/6363] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:14 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:14.560672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] validate_networks() for [('f3a9bbee-3f9c-4365-ad64-26cea020ff3a', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:12:14.950275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:12:14.950782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:12:14.951423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:12:14.951856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:12:14.952373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:12:14.961395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.961961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.962886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:14.963399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:14.980751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:12:14.986687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Getting quotas for user e3d305b521dd42ac825783a5f0e0ffcf and project badea6f48ba34a31b8c22ca431cfebc4. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:12:14.998524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:12:15.000978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:12:15.052450 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1fc95854-3458-4f85-85da-a5d9fdb9e415 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607140 Nov 20 21:12:15.053110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3128/6364] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:12:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:12:15.063166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c286c112-71ed-4629-9392-740e52f9d209 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:15.063912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c286c112-71ed-4629-9392-740e52f9d209 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:15.117343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c286c112-71ed-4629-9392-740e52f9d209 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:15.124034 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c286c112-71ed-4629-9392-740e52f9d209 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1236 microversion: 2.1 time: 0.064687 Nov 20 21:12:15.124617 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3237/6365] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:15 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1236 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:15.393394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:15.394139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:15.400402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:15.400857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:15.401644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:15.402114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:15.539536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:15.547074 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01cdf600-27f3-4246-a321-9a92cebc7b37 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.159146 Nov 20 21:12:15.547671 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3129/6366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:15 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:15.810356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cca5e46-96e2-4959-bc27-d34e2329c021"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:15.811492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:15.819048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:15.819506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:15.820285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:15.820719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:16.083142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-631d3304-7a96-4d45-8196-d22053264b23 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276346 Nov 20 21:12:16.084380 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3238/6367] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:12:15 2021] POST /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:16.141428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:16.142316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:16.148974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:16.149439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:16.150276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:16.150886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:16.223566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:16.231909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64deb7de-2ec5-4893-a0fd-3788448c1b4e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1294 microversion: 2.1 time: 0.094751 Nov 20 21:12:16.232469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3130/6368] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:16 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:16.564791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:16.565493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:16.571754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:16.572214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:16.573032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:16.573475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:16.730658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:16.739413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c19e6414-deaf-4bf3-b07e-32b8bb261677 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.179181 Nov 20 21:12:16.740364 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3239/6369] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:16 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:17.252647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:17.253307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:17.260076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:17.260911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:17.261786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:17.262279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:17.525782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:17.533905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-19255343-e658-4c43-8ff4-9779bfa22ad8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.287071 Nov 20 21:12:17.534557 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3131/6370] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:17 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:17.757469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:17.758160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:17.765343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:17.766102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:17.766908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:17.767499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:17.892972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1f85b185-ec45-4429-b830-3c521980fd26 req-7c9727d7-1296-42d4-a4a4-7093da18292a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1e54ca-e5d2-4b0a-93b4-cafa96759822", "tag": "fdb38671-0374-4e8c-bd17-2c20287e73f0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:17.894729 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:17.894729 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:17.903432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1f85b185-ec45-4429-b830-3c521980fd26 req-7c9727d7-1296-42d4-a4a4-7093da18292a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:17.904842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1f85b185-ec45-4429-b830-3c521980fd26 req-7c9727d7-1296-42d4-a4a4-7093da18292a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:17.921770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1f85b185-ec45-4429-b830-3c521980fd26 req-7c9727d7-1296-42d4-a4a4-7093da18292a service nova] Creating event network-changed:fdb38671-0374-4e8c-bd17-2c20287e73f0 for instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 on nch1-master-1 Nov 20 21:12:17.930080 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1f85b185-ec45-4429-b830-3c521980fd26 req-7c9727d7-1296-42d4-a4a4-7093da18292a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040633 Nov 20 21:12:17.931508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3132/6371] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:17.956489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:17.964683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5544582c-2ac4-4b44-8447-fb2c9ed5f529 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.211034 Nov 20 21:12:17.965792 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3240/6372] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:17 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:18.334074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cca5e46-96e2-4959-bc27-d34e2329c021"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:18.335245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:18.341636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.342117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.343493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.344246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.428529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Invalid volume: volume 4cca5e46-96e2-4959-bc27-d34e2329c021 is already attached to instances: 32cc822b-3909-42b1-bb52-f615e60c135b Nov 20 21:12:18.429133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 400 to user: Invalid volume: volume 4cca5e46-96e2-4959-bc27-d34e2329c021 is already attached to instances: 32cc822b-3909-42b1-bb52-f615e60c135b {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:18.430217 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7aa2cdd5-e3b3-4a76-a4db-245f6c050c4f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102501 Nov 20 21:12:18.430792 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3133/6373] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:12:18 2021] POST /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:12:18.489893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:18.490416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:18.496719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.497167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.497955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.498415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.552054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:18.552816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:18.560214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.560905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.562525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.563100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.579391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lazy-loading 'services' on Instance uuid 32cc822b-3909-42b1-bb52-f615e60c135b {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:18.657687 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3096cadf-0fef-45e2-ac86-384ca8ba6db8 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments/4cca5e46-96e2-4959-bc27-d34e2329c021" status: 202 len: 0 microversion: 2.1 time: 0.171326 Nov 20 21:12:18.658418 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3241/6374] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:12:18 2021] DELETE /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments/4cca5e46-96e2-4959-bc27-d34e2329c021 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:12:18.667270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:18.668471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:18.675612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.676134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.676930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.677404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.713002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd1aa58b-a26e-4486-8003-af4ec312588d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049974 Nov 20 21:12:18.713991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3242/6375] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:18 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:12:18.778259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:18.785881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d0121ee-159c-40d1-9d12-bc2afbc247b2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.238200 Nov 20 21:12:18.786616 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3134/6376] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:18 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:18.982329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:18.982944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:18.989965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.990459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:18.991260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:18.991681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:19.131451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:19.138765 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e9b3472-b14b-412b-9c14-b6c9519318a4 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.160150 Nov 20 21:12:19.139332 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3243/6377] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:18 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:19.724483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:19.725457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:19.732296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:19.732748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:19.734121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:19.734569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:19.764189 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9d32bcc-0e4a-42c9-a16a-294ce7f7bf40 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043507 Nov 20 21:12:19.764980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3135/6378] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:19 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:19.803115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:19.803726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:19.810263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:19.810714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:19.811494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:19.811973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:19.861373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2018786943", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "fda6f72f-febf-4b40-96b5-852ad898230c"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:19.920680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] validate_networks() for [('fda6f72f-febf-4b40-96b5-852ad898230c', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:12:19.948943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:19.956410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ee5f0598-7e12-407c-baba-ff4aeb56b21d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.157167 Nov 20 21:12:19.956983 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3244/6379] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:19 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:20.155366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:20.156819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:20.163859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.164312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:20.165164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.165646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:20.295312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:12:20.296700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:12:20.297669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:12:20.298188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:12:20.298635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:12:20.308636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.308920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:20.309755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.310234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:20.315441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:20.323095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e5b6386-c333-4202-8f4e-a347c2e424cd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.171611 Nov 20 21:12:20.323676 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3245/6380] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:20 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:20.331036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:12:20.336454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Getting quotas for user 183a75eb42e44f92af23e4a3c5a5d40c and project 2f6f0739f21248e3b3e217472adf0459. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:12:20.348438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:12:20.350819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:12:20.394319 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f4b61e71-78aa-4ec3-8855-d0815faa7b47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537143 Nov 20 21:12:20.394983 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3136/6381] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:12:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:12:20.404742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8120fbdc-e49a-4097-8b13-70eeaeead1c6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:20.405506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8120fbdc-e49a-4097-8b13-70eeaeead1c6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:20.460704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8120fbdc-e49a-4097-8b13-70eeaeead1c6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:20.468026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8120fbdc-e49a-4097-8b13-70eeaeead1c6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1218 microversion: 2.1 time: 0.066849 Nov 20 21:12:20.468721 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3246/6382] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:20 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:20.973637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:20.981799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:20.992104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.992770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:20.994408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:20.995049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:21.167232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:21.174839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba300b5e-9a50-4df7-ad01-4a6afb535988 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.205916 Nov 20 21:12:21.175411 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3137/6383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:20 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:21.340201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:21.340846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:21.348739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:21.349132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:21.349913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:21.350381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:21.484454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:21.485375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:21.501130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:21.501877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:21.502871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:21.503494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:21.507378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:21.523371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-455ce07b-4bd6-4067-a7ea-89603fbbe314 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1533 microversion: 2.1 time: 0.186756 Nov 20 21:12:21.533812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3247/6384] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:21 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1533 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:21.623323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:21.631381 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08af5106-ddb9-47b7-b998-8139b92720bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1278 microversion: 2.1 time: 0.150537 Nov 20 21:12:21.631971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3138/6385] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:21 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:22.193256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:22.194675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:22.202151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.203702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.204786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.205405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.365887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:22.375858 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0367e3f0-9737-49f5-9208-5ac35e848782 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.185483 Nov 20 21:12:22.380145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3248/6386] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:22 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:22.540966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:22.541749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:22.549354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.549859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.551031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.551420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.648518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:22.649249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:22.655360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.656518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.657569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.658019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.793663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:22.797863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:22.802704 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c29e852-29b0-4962-b5c9-96a6938ff637 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.157710 Nov 20 21:12:22.803531 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3249/6387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:22 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:22.805643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c671635e-c00a-4885-a2cc-c83365376440 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1533 microversion: 2.1 time: 0.268488 Nov 20 21:12:22.815661 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3139/6388] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:22 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1533 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:22.895792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c2678a6c-455d-4580-847a-b614b29ec298 req-5a3a6f4e-0985-45b4-8f38-64877ecd38ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6625c47e-b6ab-4422-b493-4bd6f0e5ae0f", "tag": "ef4f1d76-f6af-45de-a0f8-87123cbee2b9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:22.897766 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:22.897766 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:22.906344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c2678a6c-455d-4580-847a-b614b29ec298 req-5a3a6f4e-0985-45b4-8f38-64877ecd38ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:22.907179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c2678a6c-455d-4580-847a-b614b29ec298 req-5a3a6f4e-0985-45b4-8f38-64877ecd38ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:22.927412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c2678a6c-455d-4580-847a-b614b29ec298 req-5a3a6f4e-0985-45b4-8f38-64877ecd38ae service nova] Creating event network-changed:ef4f1d76-f6af-45de-a0f8-87123cbee2b9 for instance 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f on nch1-master-1 Nov 20 21:12:22.932127 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c2678a6c-455d-4580-847a-b614b29ec298 req-5a3a6f4e-0985-45b4-8f38-64877ecd38ae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043022 Nov 20 21:12:22.932718 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3250/6389] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:23.351463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d5e0c467-5db9-400b-96c9-a6f7556e76ff req-0b903188-a3e0-4b61-bda9-e9ae9aa29c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1e54ca-e5d2-4b0a-93b4-cafa96759822", "name": "network-vif-plugged", "status": "completed", "tag": "fdb38671-0374-4e8c-bd17-2c20287e73f0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:23.352758 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:23.352758 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:23.360365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d5e0c467-5db9-400b-96c9-a6f7556e76ff req-0b903188-a3e0-4b61-bda9-e9ae9aa29c45 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.360827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d5e0c467-5db9-400b-96c9-a6f7556e76ff req-0b903188-a3e0-4b61-bda9-e9ae9aa29c45 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.372483 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d5e0c467-5db9-400b-96c9-a6f7556e76ff req-0b903188-a3e0-4b61-bda9-e9ae9aa29c45 service nova] Creating event network-vif-plugged:fdb38671-0374-4e8c-bd17-2c20287e73f0 for instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 on nch1-master-1 Nov 20 21:12:23.377955 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d5e0c467-5db9-400b-96c9-a6f7556e76ff req-0b903188-a3e0-4b61-bda9-e9ae9aa29c45 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030074 Nov 20 21:12:23.379244 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3140/6390] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:23.393930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:23.394664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:23.407260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.407706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.408507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.408939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.601599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:23.613794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e0befc7-43f9-49b3-bc62-de0755217c46 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.223059 Nov 20 21:12:23.615122 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3251/6391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:23 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:23.829243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:23.831891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:23.832800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:23.835340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:23.847748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.848352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.849569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.851354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.851963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.855456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:23.856632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:23.857976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:24.063544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:24.074715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3dfbbda4-254c-4799-9468-59ec227dcaf7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.255110 Nov 20 21:12:24.076865 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3252/6392] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:23 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:24.173288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:24.190944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee7320d0-296d-4964-974e-f8d09af535a2 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.373779 Nov 20 21:12:24.202918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3141/6393] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:23 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:24.631000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:24.631787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:24.639075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:24.640367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:24.641477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:24.642270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:24.795167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:24.808315 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed73365d-f298-4eeb-9f4f-e5e03aa25aac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1361 microversion: 2.1 time: 0.181226 Nov 20 21:12:24.808913 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3253/6394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:24 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:25.093548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:25.094830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:25.109130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.110417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.111491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.113181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.208526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:25.209434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:25.218936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.219683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.220817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.221438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.377814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:25.386562 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43cfbcbb-1a1b-486a-af14-ee3e11acfa85 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.297372 Nov 20 21:12:25.397709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3142/6395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:25 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:25.407325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5fe7ec27-af6a-4a67-a04e-a5c0336c7a80 req-a59fb7f8-31ca-474d-8fba-75cfe021febc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "name": "network-vif-plugged", "status": "completed", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:25.409343 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:25.409343 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:25.417350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5fe7ec27-af6a-4a67-a04e-a5c0336c7a80 req-a59fb7f8-31ca-474d-8fba-75cfe021febc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.418007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5fe7ec27-af6a-4a67-a04e-a5c0336c7a80 req-a59fb7f8-31ca-474d-8fba-75cfe021febc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.422847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:25.430823 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5fe7ec27-af6a-4a67-a04e-a5c0336c7a80 req-a59fb7f8-31ca-474d-8fba-75cfe021febc service nova] Creating event network-vif-plugged:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch1-master-1 Nov 20 21:12:25.431319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-75fecc66-ccd7-497a-8a5f-d70a8641728e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.226717 Nov 20 21:12:25.436214 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3254/6396] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:25 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:25.444053 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5fe7ec27-af6a-4a67-a04e-a5c0336c7a80 req-a59fb7f8-31ca-474d-8fba-75cfe021febc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042100 Nov 20 21:12:25.444708 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3143/6397] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:25.825815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:25.827709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:25.835509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.836212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.837063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:25.837508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:25.987480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:25.997534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bded246b-9c5e-436a-ae95-d910db1b0a7d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1548 microversion: 2.1 time: 0.175431 Nov 20 21:12:26.009661 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3255/6398] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:25 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:26.019141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:26.019363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:26.025738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.026305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.027223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.027748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.120537 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b91ef34a-b2a6-4f12-b0e3-0ec8f737f31e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109175 Nov 20 21:12:26.140903 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3144/6399] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:12:26 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:26.405182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:26.405949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:26.413871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.414867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.416145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.416598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.450930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:26.452874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:26.464856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.465781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.467160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:26.468816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:26.656612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:26.665090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc06a629-be9b-4db5-b63b-7a87152c7959 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.220310 Nov 20 21:12:26.665670 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3145/6400] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:26 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:26.786841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:26.794824 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e7a9617-f9cb-49a9-bd7c-0344c7bba1ea tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.394642 Nov 20 21:12:26.805247 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3256/6401] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:26 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:27.605156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:27.606684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:27.614585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.615036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.621531 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.622273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.626575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7fbe13ac-0800-4498-a21a-821419a6db99 req-56707da0-abea-410c-9468-a8a1007422a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1e54ca-e5d2-4b0a-93b4-cafa96759822", "tag": "fdb38671-0374-4e8c-bd17-2c20287e73f0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:27.628691 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:27.628691 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:27.652674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7fbe13ac-0800-4498-a21a-821419a6db99 req-56707da0-abea-410c-9468-a8a1007422a7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.658652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7fbe13ac-0800-4498-a21a-821419a6db99 req-56707da0-abea-410c-9468-a8a1007422a7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.674741 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7fbe13ac-0800-4498-a21a-821419a6db99 req-56707da0-abea-410c-9468-a8a1007422a7 service nova] Creating event network-changed:fdb38671-0374-4e8c-bd17-2c20287e73f0 for instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 on nch1-master-1 Nov 20 21:12:27.689777 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7fbe13ac-0800-4498-a21a-821419a6db99 req-56707da0-abea-410c-9468-a8a1007422a7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068035 Nov 20 21:12:27.695799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3257/6402] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:12:27.705578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:27.706806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:27.732183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.740877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.742215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.742898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.759082 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c987b56-672d-4dff-a5ee-eb36f3e2c794 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.157521 Nov 20 21:12:27.770759 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3146/6403] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:27 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:27.812845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:27.813932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:27.829599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.833720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:27.838354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:27.839928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:28.056901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:28.070905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5120036f-64b2-4f44-8f2d-af5aee844717 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.373445 Nov 20 21:12:28.081178 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3258/6404] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:27 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:28.692445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:28.701218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b6bc3eb-bf41-4a4a-bbba-fc359b06f44b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.892611 Nov 20 21:12:28.706139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3147/6405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:27 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:28.782030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:28.786029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:28.793143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:28.794026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:28.795179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:28.800859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:28.848081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-301a901d-a790-4fca-b69d-27626b7ebcfe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.069401 Nov 20 21:12:28.849351 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3259/6406] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:28 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:29.090719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:29.091804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:29.100191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.101032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.102178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.102994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.285848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:29.299605 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5dec59e6-9273-4f82-966c-12304c0f7ba3 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.214716 Nov 20 21:12:29.300538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3148/6407] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:29 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:29.408344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-778cab86-744a-4a5a-aace-ab0ded6b13a2 req-66e94442-2129-4c03-8899-9eef7635836d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6625c47e-b6ab-4422-b493-4bd6f0e5ae0f", "name": "network-vif-plugged", "status": "completed", "tag": "ef4f1d76-f6af-45de-a0f8-87123cbee2b9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:29.409823 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:29.409823 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:29.418425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-778cab86-744a-4a5a-aace-ab0ded6b13a2 req-66e94442-2129-4c03-8899-9eef7635836d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.418784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-778cab86-744a-4a5a-aace-ab0ded6b13a2 req-66e94442-2129-4c03-8899-9eef7635836d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.431741 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-778cab86-744a-4a5a-aace-ab0ded6b13a2 req-66e94442-2129-4c03-8899-9eef7635836d service nova] Creating event network-vif-plugged:ef4f1d76-f6af-45de-a0f8-87123cbee2b9 for instance 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f on nch1-master-1 Nov 20 21:12:29.439940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-778cab86-744a-4a5a-aace-ab0ded6b13a2 req-66e94442-2129-4c03-8899-9eef7635836d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 Nov 20 21:12:29.440841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3260/6408] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:29.718966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:29.719584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:29.726083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.726775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.727573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.728014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.860486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:29.862302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:29.874559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.875390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.876430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:29.877083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:29.877949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:29.886095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e7262a97-2259-4291-b552-b15ea0c09103 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.170849 Nov 20 21:12:29.897906 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3149/6409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:29 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:29.928203 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-214fc21b-b939-45ae-b97f-147c2e065a98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.071376 Nov 20 21:12:29.929549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3261/6410] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:29 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:30.316590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:30.317742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:30.326819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.327398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.328381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.328890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.506415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:30.521794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec48b47d-9121-48b1-967d-9ac75178f8c4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1318 microversion: 2.1 time: 0.208178 Nov 20 21:12:30.537209 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3150/6411] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:30 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:30.906414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:30.907510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:30.914960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.915760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.916848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.917526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.939419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:30.941308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:30.948209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.949210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.950232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:30.950846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:30.993712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-511da271-ce10-4f0f-93ce-726c89e8c412 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.058615 Nov 20 21:12:30.994388 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3151/6412] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:30 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:31.084421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:31.097269 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1770e31b-be3a-4ac5-8545-9466ae6a0a8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.195694 Nov 20 21:12:31.097859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3262/6413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:30 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:31.557823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:31.558645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:31.567002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:31.567455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:31.568252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:31.568690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:31.714885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:31.725622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ce0e9a6-5c07-4015-a359-79f9662c7259 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1507 microversion: 2.1 time: 0.172025 Nov 20 21:12:31.726257 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3152/6414] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:31 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:32.004655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:32.006589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:32.017596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:32.018460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:32.019471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:32.020103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:32.074924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30ed496c-c59b-4bd4-baec-2c3589bb09ac tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.072485 Nov 20 21:12:32.076452 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3263/6415] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:31 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:32.117420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:32.118067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:32.124771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:32.125237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:32.126237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:32.126693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:32.296940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:32.307726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-536feecd-a722-4569-9b9b-b2fc8be51bff tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.194810 Nov 20 21:12:32.308317 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3153/6416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:32 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:33.079639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a35edc4-f036-418e-9ab7-1dc17c833f8c"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:33.082690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:33.086975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:33.088004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:33.090954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.091683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.092731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.093524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.100116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.100958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.102518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.104069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.162081 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-baf9273f-7492-430d-9eec-7892eb99c081 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.078907 Nov 20 21:12:33.165568 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3154/6417] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:33 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:33.325110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:33.325810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:33.333463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.333976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.335450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:33.335893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:33.391839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74d25932-0acd-4cb8-a9f7-b0add7ac375a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "POST /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320806 Nov 20 21:12:33.397583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3264/6418] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:12:33 2021] POST /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:12:33.497551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:33.506553 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e450c59-50ba-433c-b47d-4b88ae5c86e7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1528 microversion: 2.1 time: 0.185408 Nov 20 21:12:33.507129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3155/6419] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:33 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1528 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:34.175351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:34.176478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:34.185707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:34.186305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:34.187170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:34.187689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:34.226812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2144e445-513f-4f05-b709-bc9b0772e0ed tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.057322 Nov 20 21:12:34.227552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3265/6420] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:34 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:34.526533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:34.527288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:34.540805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:34.541273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:34.542178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:34.542671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:34.676653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:34.684016 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4547ac23-e85c-4a26-9b73-ea8603bf10d9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1510 microversion: 2.1 time: 0.163085 Nov 20 21:12:34.684595 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3156/6421] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:34 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:35.239474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:35.240463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:35.247711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.248156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.249001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.249522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.287675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c52085b8-a895-4eaa-bcd3-8bc164f745c1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.052182 Nov 20 21:12:35.288497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3266/6422] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:35 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:35.702387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:35.703097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:35.709974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.710550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.711406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.711940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.743037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:35.743620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:35.751691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.752150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.752963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.753409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.836956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lazy-loading 'services' on Instance uuid 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:35.854214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:35.861708 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ecef8ea-5535-4f82-a8b2-45f39de3303d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1510 microversion: 2.1 time: 0.163553 Nov 20 21:12:35.862315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3157/6423] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:35 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:35.903805 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78ae4eaf-0003-42d7-a5cf-606c322142dd tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments/9a35edc4-f036-418e-9ab7-1dc17c833f8c" status: 202 len: 0 microversion: 2.1 time: 0.164677 Nov 20 21:12:35.904387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3267/6424] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:12:35 2021] DELETE /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments/9a35edc4-f036-418e-9ab7-1dc17c833f8c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:12:35.912636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:35.913567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:35.919542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.920010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.921585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:35.922033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:35.953656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af6ded69-b123-414c-bd38-7245bfe344bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044817 Nov 20 21:12:35.954594 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3158/6425] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:35 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:36.300023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:36.300943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:36.307370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.307823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:36.308616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.309231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:36.347232 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af037c70-0a10-4287-a0ac-2c8dc7217c98 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.053188 Nov 20 21:12:36.348162 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3268/6426] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:36 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:36.877940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:36.878633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:36.885718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.886208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:36.886994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.887434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:36.965854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:36.966892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:36.974571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.975024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:36.975809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:36.976245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.006592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65a0467f-87fa-4f20-bc3e-5c1d62499d4a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044780 Nov 20 21:12:37.007495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3269/6427] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:12:36 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:37.025229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:37.033770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3421d20-f653-412c-9207-fff14cc93eca tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1513 microversion: 2.1 time: 0.159451 Nov 20 21:12:37.045336 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3159/6428] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:36 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:37.049822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:37.059774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:37.067287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.068447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.069715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.070475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.243254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:37.244654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a592ae72-de22-4f23-9ad4-63b687a4fab1 req-c8d6ed1a-1f98-41e5-aeb3-1893737911db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "name": "network-vif-unplugged", "status": "completed", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:37.246307 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:37.246307 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:37.253669 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9037f359-c3ad-4d43-b749-bafab2736e32 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1453 microversion: 2.1 time: 0.207585 Nov 20 21:12:37.254406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a592ae72-de22-4f23-9ad4-63b687a4fab1 req-c8d6ed1a-1f98-41e5-aeb3-1893737911db service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.255100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a592ae72-de22-4f23-9ad4-63b687a4fab1 req-c8d6ed1a-1f98-41e5-aeb3-1893737911db service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.258168 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3270/6429] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:37 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1453 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:37.284411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.compute.server_external_events [req-a592ae72-de22-4f23-9ad4-63b687a4fab1 req-c8d6ed1a-1f98-41e5-aeb3-1893737911db service nova] Unable to find a host for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c. Dropping event network-vif-unplugged {{(pid=140942) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:12:37.285435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a592ae72-de22-4f23-9ad4-63b687a4fab1 req-c8d6ed1a-1f98-41e5-aeb3-1893737911db service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044562 Nov 20 21:12:37.286127 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3160/6430] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:37 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 20 21:12:37.327348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:37.327997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:37.336192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.336683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.337582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.338032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.358802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:37.359768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:37.364669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lazy-loading 'flavor' on Instance uuid 4a71a189-4354-4a63-93e2-c1b900b7c25c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:37.365794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.366293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.367276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.367721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.378415 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'shelve' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state shelved_offloaded Nov 20 21:12:37.379133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'shelve' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state shelved_offloaded {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:37.380218 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27c6fe07-9318-40a1-9143-fc1b18ce15f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 155 microversion: 2.1 time: 0.056980 Nov 20 21:12:37.380963 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3271/6431] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:37 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 155 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:12:37.389203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:37.390549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:37.397821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.398436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.399508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.399947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.408207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-adcc55bc-adea-46f5-9c45-d34ea90ca69b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.053597 Nov 20 21:12:37.408861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3161/6432] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:37 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:12:37.480888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-041cf724-1b21-4a43-86af-a0f7f9206863 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.095810 Nov 20 21:12:37.481882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3272/6433] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:37 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:12:37.491797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:37.492939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:37.500883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.501671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.502869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:37.503319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:37.679417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:37.688981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6144989a-bfc5-4063-a6ee-453ac34a3431 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1461 microversion: 2.1 time: 0.201682 Nov 20 21:12:37.689571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3162/6434] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:37 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1461 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:38.212042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:38.212537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:38.219144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.219598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.220392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.220938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.247129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:38.327730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2476f08-59b6-4656-af92-1da8c8fb65bf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 204 len: 0 microversion: 2.1 time: 0.119090 Nov 20 21:12:38.328528 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3273/6435] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:38 2021] DELETE /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:38.336342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:38.337690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:38.346379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.346840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.347739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.348200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.419625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:38.421799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:38.428171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.428510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.429388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.429723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.467346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e18fda16-8bed-4e4d-85ae-392d1ea764ce tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 14 microversion: 2.1 time: 0.051487 Nov 20 21:12:38.467903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3274/6436] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:38 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:12:38.480062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:38.488011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc876bd9-7c92-401c-9b91-918f52d07358 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1513 microversion: 2.1 time: 0.155364 Nov 20 21:12:38.488571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3163/6437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:38 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:38.707011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:38.707742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:38.714694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.715146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.716000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:38.716441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:38.854760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:38.862927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4293145-0e42-422e-8a86-7910ce629cad tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.160287 Nov 20 21:12:38.863495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3275/6438] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:38 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:39.238367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-aec2aef9-b6b4-4f69-9c52-354073708dfd req-d4473cef-1da7-49e1-8f2a-4abfc3e2dc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:39.240111 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:39.240111 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:39.248533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aec2aef9-b6b4-4f69-9c52-354073708dfd req-d4473cef-1da7-49e1-8f2a-4abfc3e2dc18 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.249885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-aec2aef9-b6b4-4f69-9c52-354073708dfd req-d4473cef-1da7-49e1-8f2a-4abfc3e2dc18 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.265127 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-aec2aef9-b6b4-4f69-9c52-354073708dfd req-d4473cef-1da7-49e1-8f2a-4abfc3e2dc18 service nova] Creating event network-changed:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch2-master-1 Nov 20 21:12:39.270475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-aec2aef9-b6b4-4f69-9c52-354073708dfd req-d4473cef-1da7-49e1-8f2a-4abfc3e2dc18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036070 Nov 20 21:12:39.271102 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3164/6439] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:39.478019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:39.478963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:39.487424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.487870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.488657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.489119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.506927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:39.507722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:39.516928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.517686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.518698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.519301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.555053 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77485b71-a3b6-48ce-86f6-fce6a6f70c48 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 8204 microversion: 2.1 time: 0.080489 Nov 20 21:12:39.555739 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3276/6440] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:39 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 8204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:39.742859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:39.750714 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f10ed5e-a3d9-4d5e-9e31-2be41ed5984f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1513 microversion: 2.1 time: 0.249719 Nov 20 21:12:39.751299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3165/6441] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:39 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:39.880836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:39.881676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:39.888695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.889663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:39.890470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:39.890926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:40.039678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:40.048003 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1dd06fd6-a88e-49d8-af47-22dd3cd25a84 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.171489 Nov 20 21:12:40.048589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3277/6442] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:39 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:40.566899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:40.568545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:40.576033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:40.577509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:40.578650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:40.579164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:40.640648 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-582b8bed-c9db-4fb4-ad3d-7ebee150ec23 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 16395 microversion: 2.1 time: 0.077302 Nov 20 21:12:40.641536 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3166/6443] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:40 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 16395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:40.767663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:40.768972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:40.776464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:40.777292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:40.778195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:40.778860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:40.845115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:40.853750 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-789578a1-c8cf-460e-ae06-84e00aa5111e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 200 len: 1303 microversion: 2.1 time: 0.089984 Nov 20 21:12:40.865058 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3278/6444] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:40 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:41.065961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:41.066606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:41.073744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.074230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.075035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.075481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.266613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:41.275844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2cc5df57-e653-4f89-a48f-c346af29b5ee tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.214179 Nov 20 21:12:41.277124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3167/6445] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:41 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:41.300555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e70bc7c6-cc10-4919-9977-812bf010ceea req-e2a221c2-a517-497c-af5a-f3554915c13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6625c47e-b6ab-4422-b493-4bd6f0e5ae0f", "name": "network-vif-deleted", "tag": "ef4f1d76-f6af-45de-a0f8-87123cbee2b9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:41.302434 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:41.302434 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:41.310492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e70bc7c6-cc10-4919-9977-812bf010ceea req-e2a221c2-a517-497c-af5a-f3554915c13f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.311326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e70bc7c6-cc10-4919-9977-812bf010ceea req-e2a221c2-a517-497c-af5a-f3554915c13f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.329432 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e70bc7c6-cc10-4919-9977-812bf010ceea req-e2a221c2-a517-497c-af5a-f3554915c13f service nova] Creating event network-vif-deleted:ef4f1d76-f6af-45de-a0f8-87123cbee2b9 for instance 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f on nch1-master-1 Nov 20 21:12:41.335358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e70bc7c6-cc10-4919-9977-812bf010ceea req-e2a221c2-a517-497c-af5a-f3554915c13f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039525 Nov 20 21:12:41.336218 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3279/6446] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:41.653292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:41.654331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:41.661677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.662175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.662978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.663429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.710522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-679611eb-5d64-4ce2-8bbc-23efc6c44c0c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 16395 microversion: 2.1 time: 0.061370 Nov 20 21:12:41.711433 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3168/6447] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:41 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 16395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:41.872639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:41.873325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:41.881362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.881810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.882643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:41.883079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:41.897348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Instance 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f could not be found. Nov 20 21:12:41.897941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 404 to user: Instance 6625c47e-b6ab-4422-b493-4bd6f0e5ae0f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:41.898799 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3132061-9767-4bb8-bfc8-58aeb2457d61 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f" status: 404 len: 111 microversion: 2.1 time: 0.030305 Nov 20 21:12:41.899351 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3280/6448] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:41 2021] GET /compute/v2.1/servers/6625c47e-b6ab-4422-b493-4bd6f0e5ae0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:42.294549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:42.295376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:42.303790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:42.304308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:42.305269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:42.305722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:42.474112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:42.487463 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7910ea2d-2ffd-4272-b3cf-834c992855a9 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.197285 Nov 20 21:12:42.488437 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3169/6449] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:42 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:42.722977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:42.723942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:42.730116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:42.730572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:42.731347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:42.731778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:42.771503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e38d0aeb-cf9e-4805-a883-0426b9f16b0d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 16395 microversion: 2.1 time: 0.052100 Nov 20 21:12:42.775096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3281/6450] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:42 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 16395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:12:43.059357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:43.060006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:43.068769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.069511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.070342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.070788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.096979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:43.180952 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75d034f5-6e98-4be9-92b2-b58d02f17700 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 204 len: 0 microversion: 2.1 time: 0.126229 Nov 20 21:12:43.181579 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3170/6451] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:43 2021] DELETE /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:43.190946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:43.191647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:43.201039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.201518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.203027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.203468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.359277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:43.366716 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19d01877-427f-49c0-a5a0-7c2a559b9421 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.180646 Nov 20 21:12:43.367284 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3282/6452] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:43 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:43.506481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:43.507099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:43.513721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.514621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.515818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.516455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.665665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:43.674632 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c48aa09a-b13e-486e-bd41-cbbae73e7224 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.172616 Nov 20 21:12:43.675229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3171/6453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:43 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:43.783009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:43.784077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:43.791665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.792116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.792905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:43.793340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:43.835966 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b8a1e7d-121b-4c32-b96d-49a1886ad47f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 16395 microversion: 2.1 time: 0.057179 Nov 20 21:12:43.836592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3283/6454] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:43 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 16395 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:44.386764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:44.387488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:44.399696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.400458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.401827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.402615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.579974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:44.587712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-597a91e2-c75a-435c-a78f-d4f2501ff1c7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.205100 Nov 20 21:12:44.588448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3172/6455] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:44 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:44.692767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:44.693388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:44.701219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.701706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.703491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.703942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.850184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:44.851287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:44.855140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:44.857880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.858968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.859265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:44.859689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:44.863099 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21a345e8-5922-4ee4-b589-64951900a483 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.174508 Nov 20 21:12:44.863687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3284/6456] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:44 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:44.904670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ddf5f1f-5252-4369-aaaa-3850b0d00cd3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 16395 microversion: 2.1 time: 0.060829 Nov 20 21:12:44.905863 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3173/6457] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:44 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 16395 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:45.604833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:45.605439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:45.613578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.614033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.615057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.615604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.772272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:45.779554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0f74fe2-f3c2-42e3-89cd-c133cc2443f4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.178455 Nov 20 21:12:45.780146 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3285/6458] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:45 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:45.882240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:45.882939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:45.890418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.890873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.891669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.892117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.915856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:45.916773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:45.924622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.925074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.925879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:45.926362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:45.983870 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cf05a7b4-0d0a-4e8d-b311-b930eee74e71 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.070050 Nov 20 21:12:45.984869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3286/6459] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:45 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:46.038702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:46.048348 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e421e7b-f6b7-45f6-b813-447311dcc00f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.170391 Nov 20 21:12:46.049160 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3174/6460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:45 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:46.797604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:46.798328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:46.805672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:46.806127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:46.806906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:46.807360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:46.966461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:46.974677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c889b69c-15a0-4728-9548-f2dd4751194c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.181778 Nov 20 21:12:46.975264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3287/6461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:46 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:46.995903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:46.996832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:47.004914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:47.005382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:47.006281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:47.006757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:47.049687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa4f896e-9220-40ea-ad93-11b63ec6e980 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.057707 Nov 20 21:12:47.050299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3175/6462] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:46 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:47.065295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:47.065912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:47.072595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:47.073689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:47.074523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:47.074965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:47.217693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:47.225193 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d99f02ea-fed1-4de1-8f35-688abc9c4b29 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.164430 Nov 20 21:12:47.225770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3288/6463] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:47 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:47.993061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:47.993753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:48.001851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.002532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.003103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.003542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.062301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:48.064678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:48.072660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.073115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.074285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.074726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.115511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da9496b7-fc4d-48cc-8946-c1631318af11 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.058149 Nov 20 21:12:48.116358 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3289/6464] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:48 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:48.149805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:48.157874 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b3d96fa-f3b1-463d-a67a-3b448d9ead1d tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.169032 Nov 20 21:12:48.158541 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3176/6465] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:47 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:48.245063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:48.245791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:48.253479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.253930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.255059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:48.255497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:48.407877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:48.415423 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-746c762c-d285-44d3-ad24-5ba13c880293 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.174414 Nov 20 21:12:48.416333 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3290/6466] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:48 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:49.127036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:49.128139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:49.138773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.139233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.140035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.140645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.177131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:49.177741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:49.184821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.185354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.186355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.186854 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6068b1d6-bdb3-4703-8e82-ee6fd3d92042 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.063444 Nov 20 21:12:49.186981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.188528 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3177/6467] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:49 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:49.323712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:49.332394 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c47e0f8-de16-4a6f-81df-8351133085ac tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.160380 Nov 20 21:12:49.333216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3291/6468] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:49 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:49.433325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:49.433933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:49.440930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.441383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.442209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:49.442649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:49.595161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:49.603069 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28029750-8131-4648-94bd-22fce196cf08 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.173815 Nov 20 21:12:49.604199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3178/6469] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:49 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:50.198447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:50.199427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:50.206904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.207364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.208197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.208639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.248435 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26c07987-3e65-4076-bc47-410aa6701185 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.053560 Nov 20 21:12:50.249064 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3292/6470] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:50 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:50.349640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:50.350313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:50.357012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.357470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.358286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.358724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.493720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:50.501791 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8cf4981-4d95-4b8a-be98-43b1ed7f356a tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.155762 Nov 20 21:12:50.502398 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3179/6471] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:50 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:50.621333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:50.622027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:50.629408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.630148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.630937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:50.631377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:50.762911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:50.770708 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10b00768-adff-485b-ac60-4b9f6e633e58 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.153472 Nov 20 21:12:50.771283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3293/6472] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:50 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:51.260557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:51.261476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:51.268379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.268832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.269612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.270076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.309124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc8f4949-c13d-43a6-b2b1-19c7b67ae94a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.052206 Nov 20 21:12:51.309767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3180/6473] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:51 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:51.519400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:51.519965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:51.526781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.527225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.527998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.528430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.662746 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:51.670085 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f84bbaf3-75ac-4159-acb1-ddd33fbfe879 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.155021 Nov 20 21:12:51.670655 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3294/6474] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:51 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:51.788202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:51.788817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:51.796121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.796572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.797357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.798319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.930750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:51.939146 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a56342cd-94cc-4896-8f8c-b658563f9b75 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.154549 Nov 20 21:12:51.939724 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3181/6475] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:51 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:51.991654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:51.992249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:51.998526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:51.998980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:51.999759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.000197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.076731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lazy-loading 'services' on Instance uuid 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:52.143720 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a4f4bad-544d-41c6-9aa7-af9a5fe0fd3f tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1/os-volume_attachments/8cf4195c-9738-4402-9871-a54b9aa3916c" status: 202 len: 0 microversion: 2.1 time: 0.155705 Nov 20 21:12:52.144309 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3295/6476] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:12:51 2021] DELETE /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1/os-volume_attachments/8cf4195c-9738-4402-9871-a54b9aa3916c => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:12:52.320897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:52.321763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:52.328148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.328626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.330624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.331061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.381514 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e49fe67-d761-4534-ab89-6661ecf4c79f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.064220 Nov 20 21:12:52.382196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3182/6477] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:52 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:52.688675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:52.689373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:52.695608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.696058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.696839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.697279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.841226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:52.849582 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cc92e52-a844-4ad2-a960-c95b84f8ca1f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 200 len: 1514 microversion: 2.1 time: 0.165713 Nov 20 21:12:52.850584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3296/6478] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:52 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:52.958348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:52.959066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:52.966498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.966955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:52.967753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:52.968195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.113294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-785c1b1d-e97c-459b-90da-9c4b4ea415b4 req-f92b90b0-4eb9-4322-901b-4689c11cc199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32cc822b-3909-42b1-bb52-f615e60c135b", "name": "network-vif-deleted", "tag": "ca17f952-be7f-4220-9044-0f40a9ab6058"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:53.115345 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:53.115345 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:12:53.127046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-785c1b1d-e97c-459b-90da-9c4b4ea415b4 req-f92b90b0-4eb9-4322-901b-4689c11cc199 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.128000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-785c1b1d-e97c-459b-90da-9c4b4ea415b4 req-f92b90b0-4eb9-4322-901b-4689c11cc199 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.143089 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-785c1b1d-e97c-459b-90da-9c4b4ea415b4 req-f92b90b0-4eb9-4322-901b-4689c11cc199 service nova] Creating event network-vif-deleted:ca17f952-be7f-4220-9044-0f40a9ab6058 for instance 32cc822b-3909-42b1-bb52-f615e60c135b on nch2-master-1 Nov 20 21:12:53.151668 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-785c1b1d-e97c-459b-90da-9c4b4ea415b4 req-f92b90b0-4eb9-4322-901b-4689c11cc199 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045038 Nov 20 21:12:53.152553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3297/6479] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:53.197254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:53.206873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-daef6056-5503-4400-a61c-149924d950df tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.253584 Nov 20 21:12:53.207848 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3183/6480] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:52 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:53.272892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:53.273470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:53.280667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.281109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.281911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.282607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.306737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:53.381745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18fbcf2e-4875-4c74-84b9-f9f805779d85 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 204 len: 0 microversion: 2.1 time: 0.112448 Nov 20 21:12:53.382497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3298/6481] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:53 2021] DELETE /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:53.390761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:53.391621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:53.393418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:53.394449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:53.397949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.398470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.399294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.399741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.400241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.400696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.401481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.401911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.441705 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8c2b44b-3493-4124-bbc3-74e05929c64e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.052237 Nov 20 21:12:53.442407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3299/6482] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:53 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:53.538783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:53.546442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89ede14e-883d-4259-bd7a-2ae9ae1ed7ad tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1512 microversion: 2.1 time: 0.159394 Nov 20 21:12:53.547061 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3184/6483] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:53 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:53.867180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:53.867877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 32cc822b-3909-42b1-bb52-f615e60c135b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:53.875130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.875577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.876360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.876796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.890596 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Instance 32cc822b-3909-42b1-bb52-f615e60c135b could not be found. Nov 20 21:12:53.891683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 404 to user: Instance 32cc822b-3909-42b1-bb52-f615e60c135b could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:53.892726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3beceb2-7c04-44f7-85fc-8c8be02f7bd6 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b" status: 404 len: 111 microversion: 2.1 time: 0.029654 Nov 20 21:12:53.893258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3300/6484] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:53 2021] GET /compute/v2.1/servers/32cc822b-3909-42b1-bb52-f615e60c135b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:12:53.900952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:53.901445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:53.908688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.909139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.910070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:53.910562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:53.945638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:54.058690 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00c0ebdb-5aa6-42bb-84fb-a63ef0fdea47 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 204 len: 0 microversion: 2.1 time: 0.160947 Nov 20 21:12:54.059546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3185/6485] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:53 2021] DELETE /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:54.068313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:54.068947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:54.075367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.075827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.076611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.077055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.212633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:54.220730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2c07d88-d751-414a-9284-79de2406bde7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1512 microversion: 2.1 time: 0.155534 Nov 20 21:12:54.221312 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3301/6486] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:54 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:54.225306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:54.226008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:54.231792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.232246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.233035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.233477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.368816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:54.376660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0e596bb-1aae-42b4-8d2f-69e26057099e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.155526 Nov 20 21:12:54.377230 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3186/6487] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:54 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:54.453376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:54.455183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:54.461823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.462312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.463106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.463555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.503787 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41e1cf7d-ae24-404f-85a6-ed4b6343f0fe tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.054113 Nov 20 21:12:54.504714 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3302/6488] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:54 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:54.566311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:54.566919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:54.573288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.573737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.574541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:54.574972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:54.712247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:54.719723 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c5b6e31-44c3-48a3-b8d4-e1f0e6509504 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1512 microversion: 2.1 time: 0.157683 Nov 20 21:12:54.720303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3187/6489] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:54 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:55.239952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:55.240579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:55.249200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.249657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.250502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.251301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.396773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0dfb02ed-efd1-46af-9cf1-2f75f1ce17b5 req-7602d589-c9ed-4667-97cc-87dc1c07f4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1", "name": "network-vif-deleted", "tag": "10a38d43-1627-4b21-9693-d4121d894a27"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:55.398750 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:55.398750 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:55.404069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:55.416397 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-71e1870a-2eb3-438c-b4ec-2e176abc7cdf tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 200 len: 1512 microversion: 2.1 time: 0.181516 Nov 20 21:12:55.417013 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3303/6490] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:55 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:55.420958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0dfb02ed-efd1-46af-9cf1-2f75f1ce17b5 req-7602d589-c9ed-4667-97cc-87dc1c07f4f7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.421413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0dfb02ed-efd1-46af-9cf1-2f75f1ce17b5 req-7602d589-c9ed-4667-97cc-87dc1c07f4f7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.429439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:55.430075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:55.434129 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0dfb02ed-efd1-46af-9cf1-2f75f1ce17b5 req-7602d589-c9ed-4667-97cc-87dc1c07f4f7 service nova] Creating event network-vif-deleted:10a38d43-1627-4b21-9693-d4121d894a27 for instance 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 on nch2-master-1 Nov 20 21:12:55.436000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.436459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.437250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.437687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.439970 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0dfb02ed-efd1-46af-9cf1-2f75f1ce17b5 req-7602d589-c9ed-4667-97cc-87dc1c07f4f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047556 Nov 20 21:12:55.440818 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3188/6491] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:12:55.521740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:55.523098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:55.530945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.531545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.533303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.533883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.577670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03805c4d-43a1-46b2-914c-5b19f2f5bbee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.065367 Nov 20 21:12:55.579759 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3189/6492] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:55 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:12:55.608278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:55.615776 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4afe4f0a-4825-4716-b1ea-2bb75225c622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.190959 Nov 20 21:12:55.616366 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3304/6493] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:55 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:55.737270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:55.738090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:55.745023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.745476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.746370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.746810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.797673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:55.798216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:55.798768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lazy-loading 'fault' on Instance uuid 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:12:55.853502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:55.860993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-412a314c-d000-41e6-97cf-7bffa1126a03 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 200 len: 1308 microversion: 2.1 time: 0.127947 Nov 20 21:12:55.861840 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3190/6494] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:55 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:56.433760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:56.434406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: 188c7d5c-dd65-41fd-a579-108829f5bcaa] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:56.442819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.443269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.444087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.444523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.459761 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Instance 188c7d5c-dd65-41fd-a579-108829f5bcaa could not be found. Nov 20 21:12:56.460351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 404 to user: Instance 188c7d5c-dd65-41fd-a579-108829f5bcaa could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:56.461164 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54d42013-17f6-4063-84f2-b9bdd1478396 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa" status: 404 len: 111 microversion: 2.1 time: 0.031192 Nov 20 21:12:56.461708 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3305/6495] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:56 2021] GET /compute/v2.1/servers/188c7d5c-dd65-41fd-a579-108829f5bcaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:12:56.589949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:56.590906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:56.598423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.598892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.599699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.600144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.633129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:56.633768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:56.641399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.642210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.643057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.643496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.646766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0d5467f6-bd06-4930-91f5-e87e0a7cd167 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 24565 microversion: 2.1 time: 0.060388 Nov 20 21:12:56.647621 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3191/6496] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:56 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 24565 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:12:56.800935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:56.810011 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08687cb5-f1e6-47c1-bf4e-302a512072d1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.180829 Nov 20 21:12:56.810802 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3306/6497] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:56 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:56.858544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-721e8044-7c09-40fe-848e-4af338217501 req-4036be23-a58e-4d10-8e98-2180515c15c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "name": "network-vif-plugged", "status": "completed", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:56.860464 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:56.860464 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:56.869174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-721e8044-7c09-40fe-848e-4af338217501 req-4036be23-a58e-4d10-8e98-2180515c15c7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.869699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-721e8044-7c09-40fe-848e-4af338217501 req-4036be23-a58e-4d10-8e98-2180515c15c7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.880069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:56.881044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:56.884949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-721e8044-7c09-40fe-848e-4af338217501 req-4036be23-a58e-4d10-8e98-2180515c15c7 service nova] Creating event network-vif-plugged:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch2-master-1 Nov 20 21:12:56.888550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.889712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.890900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-721e8044-7c09-40fe-848e-4af338217501 req-4036be23-a58e-4d10-8e98-2180515c15c7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036222 Nov 20 21:12:56.892313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:56.892516 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3192/6498] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:56.893697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:56.913791 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] HTTP exception thrown: Instance 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 could not be found. Nov 20 21:12:56.915756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Returning 404 to user: Instance 677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:12:56.917173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-969498da-8f88-44eb-8a27-fca339c095a5 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1" status: 404 len: 111 microversion: 2.1 time: 0.042104 Nov 20 21:12:56.918460 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3307/6499] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:56 2021] GET /compute/v2.1/servers/677f6bd2-bb2f-4de1-8ddb-4c63c429e3b1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:12:57.455712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cd743ca7-9448-4842-b29e-a0d50de35979 req-c2660c51-8a80-4dbb-aa78-6926bf80cda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188c7d5c-dd65-41fd-a579-108829f5bcaa", "name": "network-vif-deleted", "tag": "307c8ef7-854a-498d-8e4d-7bf51ed6c803"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:57.457236 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:57.457236 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:57.464479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd743ca7-9448-4842-b29e-a0d50de35979 req-c2660c51-8a80-4dbb-aa78-6926bf80cda1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.464918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd743ca7-9448-4842-b29e-a0d50de35979 req-c2660c51-8a80-4dbb-aa78-6926bf80cda1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.475719 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cd743ca7-9448-4842-b29e-a0d50de35979 req-c2660c51-8a80-4dbb-aa78-6926bf80cda1 service nova] Creating event network-vif-deleted:307c8ef7-854a-498d-8e4d-7bf51ed6c803 for instance 188c7d5c-dd65-41fd-a579-108829f5bcaa on nch2-master-1 Nov 20 21:12:57.480340 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cd743ca7-9448-4842-b29e-a0d50de35979 req-c2660c51-8a80-4dbb-aa78-6926bf80cda1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029732 Nov 20 21:12:57.480918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3193/6500] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:57.590548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:57.591245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:57.597946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.598667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.599477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.600003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.629804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:12:57.660829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:57.661864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:57.668639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.669348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.670382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.670912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.710527 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87cadd67-367f-451b-9ff3-a66b0ba058d4 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 204 len: 0 microversion: 2.1 time: 0.123420 Nov 20 21:12:57.711135 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3308/6501] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:12:57 2021] DELETE /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:12:57.719985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:57.720712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:57.724272 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-309a468b-fb18-4354-9a16-ce86a5820df5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.069007 Nov 20 21:12:57.725152 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3194/6502] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:57 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:12:57.730451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.731005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.731798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.732238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.827910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:57.829250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:57.836427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.836880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.837704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:57.838177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:57.865671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:57.873313 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33f75d53-047d-4c64-b45d-5f2ae124800e tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1513 microversion: 2.1 time: 0.157808 Nov 20 21:12:57.873888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3309/6503] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:57 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:57.970951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:57.979093 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc28423d-3a91-4665-83ac-b19e91aa2ac7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.155208 Nov 20 21:12:57.979754 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3195/6504] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:57 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:58.737489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:58.738496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:58.744950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:58.745665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:58.746512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:58.747001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:58.788518 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a08c4dc3-a86b-43f1-ae09-0baafb39073a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.055277 Nov 20 21:12:58.789396 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3310/6505] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:58 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:12:58.890307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:58.891058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:58.898983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:58.899438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:58.900237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:58.900731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:58.997069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:12:58.997763 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:59.006028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:59.006504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:59.007300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:59.007736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:59.043578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:59.053261 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2463b92e-442c-4a43-926e-d8a9155d8c3c tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1513 microversion: 2.1 time: 0.166457 Nov 20 21:12:59.054520 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3196/6506] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:58 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:12:59.163998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:12:59.171505 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4352fc0e-19d8-4017-a9d2-cdb1bc6520f8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1519 microversion: 2.1 time: 0.178428 Nov 20 21:12:59.172081 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3311/6507] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:12:58 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:12:59.767149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6b1c78d0-8182-4417-88c5-5540e511ebc9 req-c6693b98-84c3-4732-b848-2b877b2ce31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0ccfd4-6b6e-4899-9ed1-1212c05019b1", "name": "network-vif-deleted", "tag": "fe8ad4f3-a575-4aaa-8adc-9c254dddec31"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:59.769811 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:12:59.769811 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:12:59.777688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b1c78d0-8182-4417-88c5-5540e511ebc9 req-c6693b98-84c3-4732-b848-2b877b2ce31a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:59.778095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b1c78d0-8182-4417-88c5-5540e511ebc9 req-c6693b98-84c3-4732-b848-2b877b2ce31a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:59.792654 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6b1c78d0-8182-4417-88c5-5540e511ebc9 req-c6693b98-84c3-4732-b848-2b877b2ce31a service nova] Creating event network-vif-deleted:fe8ad4f3-a575-4aaa-8adc-9c254dddec31 for instance bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 on nch1-master-1 Nov 20 21:12:59.797451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6b1c78d0-8182-4417-88c5-5540e511ebc9 req-c6693b98-84c3-4732-b848-2b877b2ce31a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033920 Nov 20 21:12:59.798225 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3197/6508] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:12:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:12:59.800977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:12:59.801895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:12:59.809179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:59.809645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:59.810448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:12:59.810881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:12:59.854676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d683ca47-7f6d-4a37-a01d-25455ac7c4bc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.057892 Nov 20 21:12:59.856159 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3312/6509] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:12:59 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:00.072106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.072748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.078968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.079425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.080263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.080779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.110631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.111086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.112215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lazy-loading 'fault' on Instance uuid bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:13:00.154378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '183a75eb42e44f92af23e4a3c5a5d40c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f6f0739f21248e3b3e217472adf0459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:00.161893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-126f136d-3c36-4e57-bb32-49e8ba4549e7 tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 200 len: 1307 microversion: 2.1 time: 0.094344 Nov 20 21:13:00.162487 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3198/6510] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:00.189564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.190874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.197738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.198219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.199012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.199450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.335847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:00.343706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b4e6239-dbe1-44a5-ad05-87f5b75a2732 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.158274 Nov 20 21:13:00.344280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3313/6511] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:00.360562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.361180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.368709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.369173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.369982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.370456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.534489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:00.540317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-722da63b-7518-4d1a-8b4f-addaec523bb7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.183383 Nov 20 21:13:00.541280 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3199/6512] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:00.563811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.564430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.572312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.572767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.573564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.573988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.713252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:00.720536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b2af6eee-23c5-4170-b941-8d54bc36668a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160650 Nov 20 21:13:00.721691 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3314/6513] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:00.737367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce1bbb68-6f7e-46d7-bc4e-cde253c63efb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:00.742810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ce1bbb68-6f7e-46d7-bc4e-cde253c63efb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 14e64c19-7063-4b09-a088-72f171515cff has no mapping to a cell. Nov 20 21:13:00.743383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce1bbb68-6f7e-46d7-bc4e-cde253c63efb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 14e64c19-7063-4b09-a088-72f171515cff has no mapping to a cell. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:00.744202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce1bbb68-6f7e-46d7-bc4e-cde253c63efb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/14e64c19-7063-4b09-a088-72f171515cff/action" status: 404 len: 117 microversion: 2.1 time: 0.010959 Nov 20 21:13:00.744725 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3200/6514] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:00 2021] POST /compute/v2.1/servers/14e64c19-7063-4b09-a088-72f171515cff/action => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:00.752379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.752987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.759091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.759539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.760313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.760775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.866375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:00.867288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.874512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.875838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.876830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.877633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.895537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:00.903196 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0014d8ea-aae2-4ac3-aa70-2ec3e0f89c8e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.154562 Nov 20 21:13:00.903801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3315/6515] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:00.920561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:00.921101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:00.927225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.927679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.928496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:00.928968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:00.929415 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d822b69f-7375-40f1-ae56-9ebd1cd9dce1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.066378 Nov 20 21:13:00.933383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3201/6516] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:00 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:01.059569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:01.067286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b273cf0-27f4-4205-a6f8-aeff14ad23f3 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.150386 Nov 20 21:13:01.067858 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3316/6517] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:00 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:01.085070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-549facec-33d9-4507-89b0-3ff5091f0848 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:01.085683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-549facec-33d9-4507-89b0-3ff5091f0848 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: a08a6a29-4bc0-434b-94a4-b93648a1431b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.092147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-549facec-33d9-4507-89b0-3ff5091f0848 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance a08a6a29-4bc0-434b-94a4-b93648a1431b could not be found. Nov 20 21:13:01.092719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-549facec-33d9-4507-89b0-3ff5091f0848 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance a08a6a29-4bc0-434b-94a4-b93648a1431b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:01.093519 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-549facec-33d9-4507-89b0-3ff5091f0848 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/a08a6a29-4bc0-434b-94a4-b93648a1431b/action" status: 404 len: 111 microversion: 2.1 time: 0.013178 Nov 20 21:13:01.094065 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3202/6518] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:01 2021] POST /compute/v2.1/servers/a08a6a29-4bc0-434b-94a4-b93648a1431b/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:01.101774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:01.102417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.108219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.108672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.109449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.109887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.179821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:01.179821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] [instance: bd0ccfd4-6b6e-4899-9ed1-1212c05019b1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.187598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.188051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.188836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.189272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.203326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] HTTP exception thrown: Instance bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 could not be found. Nov 20 21:13:01.203927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] Returning 404 to user: Instance bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:01.204866 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1046c28c-7ba7-4e5c-8890-eac20560d11f tempest-AttachVolumeNegativeTest-1315300571 tempest-AttachVolumeNegativeTest-1315300571-project] 10.222.0.41 "GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1" status: 404 len: 111 microversion: 2.1 time: 0.029738 Nov 20 21:13:01.206117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3203/6519] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:01 2021] GET /compute/v2.1/servers/bd0ccfd4-6b6e-4899-9ed1-1212c05019b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:01.245963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:01.254163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9978612-40ac-40c4-a047-4b2611bf686d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155969 Nov 20 21:13:01.255006 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3317/6520] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:01.272064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:01.272688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.279050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.279499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.280291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.280736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.521450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:01.534396 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb4f3768-034a-4125-a866-a8b271cd4fc6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.266638 Nov 20 21:13:01.535224 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3204/6521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:01.552895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:01.553782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.560345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.560797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.561586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.562070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.587848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lazy-loading 'flavor' on Instance uuid 4a71a189-4354-4a63-93e2-c1b900b7c25c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:13:01.653442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2048119892", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "db248f70-92ce-470d-a8dd-1b99f1d82f6d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:01.662457 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ddd480c8-5d74-4fb7-9b0b-ad578a228c8f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.113995 Nov 20 21:13:01.663295 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3318/6522] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:01 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:13:01.681883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:01.685250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.696023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.696473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.697270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.697884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.718359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] validate_networks() for [('db248f70-92ce-470d-a8dd-1b99f1d82f6d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:13:01.919112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:01.929789 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c7c4e94-c173-49db-8af3-f99b1cd1ee6e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1514 microversion: 2.1 time: 0.261528 Nov 20 21:13:01.931931 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3319/6523] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:01 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:01.946758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:01.947779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:01.954003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.954575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:01.955465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:01.956086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:02.003134 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1970351d-e056-462a-b799-49e62fff8722 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.065581 Nov 20 21:13:02.007358 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3320/6524] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:01 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:02.092030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:13:02.092570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:13:02.092917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:13:02.093326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:13:02.093743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:13:02.103221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:02.103670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:02.104493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:02.104927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:02.121321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Getting quotas for project 321f486ad3cb47d391a2136722e74f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:13:02.126332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Getting quotas for user f88dfc4cbff24026af90af84ca24d310 and project 321f486ad3cb47d391a2136722e74f0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:13:02.139836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:13:02.142200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:13:02.211311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9463839b-163d-4636-a80f-40f70aeb1fb7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560195 Nov 20 21:13:02.213059 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3205/6525] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:13:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:13:02.225265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dcfbdc74-8c20-4076-adc1-a564ceb039da tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:02.226262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dcfbdc74-8c20-4076-adc1-a564ceb039da tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:02.285365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dcfbdc74-8c20-4076-adc1-a564ceb039da tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:02.293222 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dcfbdc74-8c20-4076-adc1-a564ceb039da tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1219 microversion: 2.1 time: 0.073884 Nov 20 21:13:02.293801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3321/6526] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:02 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:02.948640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:02.949315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:02.959491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:02.960077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:02.960888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:02.961336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.014613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:03.015454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:03.022768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.023222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.024015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.024450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.068960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f99ee26-7664-4a8c-845a-5fcbe955718b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.057476 Nov 20 21:13:03.070242 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3322/6527] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:03 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:03.111086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:03.119698 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-33102ae0-ce83-4698-b4df-f71df3b32786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1497 microversion: 2.1 time: 0.174864 Nov 20 21:13:03.122950 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3206/6528] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:02 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:03.139878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:03.140494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:03.148085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.148538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.149347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.149794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.196001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lazy-loading 'flavor' on Instance uuid 4a71a189-4354-4a63-93e2-c1b900b7c25c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:13:03.211643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'suspend' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state suspended Nov 20 21:13:03.212771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'suspend' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state suspended {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:03.213931 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81e3f906-955d-4761-b720-f302f3993cba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 148 microversion: 2.1 time: 0.078283 Nov 20 21:13:03.214856 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3323/6529] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:03 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 148 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 20 21:13:03.224359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:03.230879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:03.242311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.242804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.243699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.244339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.311528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:03.312463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:03.320428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.321270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.322214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.322905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.346451 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb7e713b-7c35-4282-9238-96d12a75b1ac tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 202 len: 0 microversion: 2.1 time: 0.125472 Nov 20 21:13:03.347276 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3207/6530] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:03 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:13:03.361564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:03.362329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:03.369158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.370109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.371254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:03.371986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:03.405025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:03.418971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-164ac2d7-e482-496c-b020-522a0ef417bb tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1277 microversion: 2.1 time: 0.111655 Nov 20 21:13:03.420025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3324/6531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:03 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1277 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:03.616123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:03.628832 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a677019-460e-4b3d-956a-a2e01d3a8bc7 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1503 microversion: 2.1 time: 0.271911 Nov 20 21:13:03.630982 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3208/6532] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:03 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:04.080795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:04.081725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:04.088526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.089230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.090327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.090935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.132724 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba4225fc-a050-4d3c-af29-4ecac5885016 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.055532 Nov 20 21:13:04.133392 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3325/6533] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:04 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:04.437079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:04.437747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:04.446693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.447163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.448256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.448513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.649099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:04.650584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:04.660510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.661249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.662223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.662912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.707868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:04.716770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a48feec5-ee86-44cf-bb73-a1ca1d37aa1e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.284205 Nov 20 21:13:04.717680 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3209/6534] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:04 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:04.817776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2803e9d5-75f5-4677-8309-23900d953e46 req-8622a63f-33c5-4440-9345-6f3ae775bdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb65f4a-7cc9-4457-94ed-59768969c88d", "tag": "80fdb11c-e36a-4449-853b-09a5b29c799e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:04.819800 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:04.819800 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:13:04.828328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2803e9d5-75f5-4677-8309-23900d953e46 req-8622a63f-33c5-4440-9345-6f3ae775bdda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.829027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2803e9d5-75f5-4677-8309-23900d953e46 req-8622a63f-33c5-4440-9345-6f3ae775bdda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.836698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:04.844363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aca21b97-c22b-443f-b08c-8283da37a273 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.200663 Nov 20 21:13:04.854079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2803e9d5-75f5-4677-8309-23900d953e46 req-8622a63f-33c5-4440-9345-6f3ae775bdda service nova] Creating event network-changed:80fdb11c-e36a-4449-853b-09a5b29c799e for instance 9fb65f4a-7cc9-4457-94ed-59768969c88d on nch2-master-1 Nov 20 21:13:04.854304 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3326/6535] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:04.855644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2803e9d5-75f5-4677-8309-23900d953e46 req-8622a63f-33c5-4440-9345-6f3ae775bdda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045182 Nov 20 21:13:04.856639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3210/6536] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:13:04.863626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:04.864241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:04.870237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.870687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:04.871958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:04.872344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.016688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:05.025365 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df403ce5-20a7-409e-8a12-894f8caa87ba tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.165300 Nov 20 21:13:05.031622 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3327/6537] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:04 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:05.043749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9ac20d2-44df-4fc7-88da-e15ef7b8ffe8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:05.044413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9ac20d2-44df-4fc7-88da-e15ef7b8ffe8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 8400d36e-663b-42ad-8a15-f33f8c7e1a66] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.050038 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-b9ac20d2-44df-4fc7-88da-e15ef7b8ffe8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 8400d36e-663b-42ad-8a15-f33f8c7e1a66 could not be found. Nov 20 21:13:05.050937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9ac20d2-44df-4fc7-88da-e15ef7b8ffe8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 8400d36e-663b-42ad-8a15-f33f8c7e1a66 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:05.051599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9ac20d2-44df-4fc7-88da-e15ef7b8ffe8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/8400d36e-663b-42ad-8a15-f33f8c7e1a66/action" status: 404 len: 111 microversion: 2.1 time: 0.012529 Nov 20 21:13:05.052434 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3211/6538] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:05 2021] POST /compute/v2.1/servers/8400d36e-663b-42ad-8a15-f33f8c7e1a66/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:05.060172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:05.061034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.067620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.068072 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.068861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.069293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.147588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:05.152136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.160053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.160514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.161311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.162081 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.209149 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81037ec5-b70a-41c9-bb91-4b92e3211157 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.067179 Nov 20 21:13:05.210454 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3212/6539] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:05 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:05.222753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:05.230425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db24712e-26bf-495d-80b8-2040c4436272 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.173922 Nov 20 21:13:05.231506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3328/6540] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:05 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:05.253370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:05.254619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.261653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.262266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.263354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.263794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.502069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:05.514930 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56f0b186-7842-4080-be0e-7b5ea6c55589 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.265967 Nov 20 21:13:05.516170 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3213/6541] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:05 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:05.531904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:05.532566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.539589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.540047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.540849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.541293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.565189 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'unpause' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active Nov 20 21:13:05.565820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'unpause' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:05.566756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da30d796-fd77-4e93-974b-c0bc86c5ec5d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 145 microversion: 2.1 time: 0.038911 Nov 20 21:13:05.567326 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3329/6542] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:05 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 145 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:13:05.575664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:05.576415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.583098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.583799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.584609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.585058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.734596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:05.736152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.743929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.744367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.745444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.746147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.815585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:05.826868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dab50960-36e0-434e-9465-e021da04da60 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.253939 Nov 20 21:13:05.837812 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3214/6543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:05 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:05.847454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:05.848322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:05.854462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.855204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.856448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:05.857368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:05.906443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:05.914550 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-545c022a-bd56-4cfa-aa51-580ba5e8c02a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.183519 Nov 20 21:13:05.915231 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3330/6544] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:05 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:06.048535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:06.056929 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ed1de46-d10c-4450-8327-45b1caff721f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.213933 Nov 20 21:13:06.057506 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3215/6545] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:05 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:06.073651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69d77166-5ed4-4857-b5aa-29b631764039 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:06.074293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69d77166-5ed4-4857-b5aa-29b631764039 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 1fb1df0e-a4c1-47e7-b6bf-3c56d4e246da] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.079768 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-69d77166-5ed4-4857-b5aa-29b631764039 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 1fb1df0e-a4c1-47e7-b6bf-3c56d4e246da could not be found. Nov 20 21:13:06.080852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69d77166-5ed4-4857-b5aa-29b631764039 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 1fb1df0e-a4c1-47e7-b6bf-3c56d4e246da could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:06.081868 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69d77166-5ed4-4857-b5aa-29b631764039 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/1fb1df0e-a4c1-47e7-b6bf-3c56d4e246da/action" status: 404 len: 111 microversion: 2.1 time: 0.011968 Nov 20 21:13:06.082455 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3331/6546] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:06 2021] POST /compute/v2.1/servers/1fb1df0e-a4c1-47e7-b6bf-3c56d4e246da/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:06.090388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.091006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.097355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.097813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.098669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.099108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.221924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:06.223050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.230556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.230986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.231710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.232155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.235077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:06.243490 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6c19eb2-b82c-4139-a168-11d2eed3cf7e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.156719 Nov 20 21:13:06.244118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3216/6547] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:06.261031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.261654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.268342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.268917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.269725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.270209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.276036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d8723b81-fc63-4edd-a7b3-9941a9de98db tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.058390 Nov 20 21:13:06.277405 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3332/6548] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:06 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:06.411152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:06.418480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f8230d7-d49e-4bab-9ec6-90ae1441cfcd tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.160984 Nov 20 21:13:06.419048 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3217/6549] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:06.435458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:06.436114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.444207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.444668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.445452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.445896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.471195 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Cannot 'unshelve' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active Nov 20 21:13:06.471986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 409 to user: Cannot 'unshelve' instance 4a71a189-4354-4a63-93e2-c1b900b7c25c while it is in vm_state active {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:06.472823 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-77c29ba7-6236-470d-bb85-30590cfee92b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action" status: 409 len: 146 microversion: 2.1 time: 0.041437 Nov 20 21:13:06.473544 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3333/6550] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:06 2021] POST /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c/action => generated 146 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 20 21:13:06.481551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.482210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.488587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.489067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.489817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.490278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.625076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:06.632978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-946bc924-d276-4b3c-992d-708144f86e1a tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.155024 Nov 20 21:13:06.633473 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3218/6551] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:06.650334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.650819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.661859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.662589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.663908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.664627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.815158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:06.822588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-81f33d22-582c-404d-b040-dd5816eba25e tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.175933 Nov 20 21:13:06.823167 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3334/6552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:06.839916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ea0921a-c84b-4386-8ea0-645c7a05ea1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1830591694_updated"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:06.841062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1ea0921a-c84b-4386-8ea0-645c7a05ea1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: de267e9c-a4dc-4ad5-adc0-4a70c40a729b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.847006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1ea0921a-c84b-4386-8ea0-645c7a05ea1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance de267e9c-a4dc-4ad5-adc0-4a70c40a729b could not be found. Nov 20 21:13:06.847581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1ea0921a-c84b-4386-8ea0-645c7a05ea1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance de267e9c-a4dc-4ad5-adc0-4a70c40a729b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:06.848383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1ea0921a-c84b-4386-8ea0-645c7a05ea1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "PUT /compute/v2.1/servers/de267e9c-a4dc-4ad5-adc0-4a70c40a729b" status: 404 len: 111 microversion: 2.1 time: 0.012217 Nov 20 21:13:06.848918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3219/6553] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 21:13:06 2021] PUT /compute/v2.1/servers/de267e9c-a4dc-4ad5-adc0-4a70c40a729b => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:06.856650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.857261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.863933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.864483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.865304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.865909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.932058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:06.933378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:06.941794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.942327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:06.943130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:06.943572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.008609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.016355 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a446665-7f2e-43d7-a65c-4362174bf696 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.163273 Nov 20 21:13:07.017135 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3335/6554] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:07.035687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:07.036331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:07.042403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.042863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.043667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.044112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.090648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.098597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e330beb-7493-437b-8b31-b4afb5c25ef4 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.170423 Nov 20 21:13:07.099433 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3220/6555] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:06 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:07.187083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.196037 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4b25635-8490-48bc-9f46-d73c88402954 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.165246 Nov 20 21:13:07.196880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3336/6556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:07 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:07.214216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cba2066d-7706-43da-a209-de23550ebc8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:07.215421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cba2066d-7706-43da-a209-de23550ebc8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:07.216260 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cba2066d-7706-43da-a209-de23550ebc8c tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "PUT /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 400 len: 619 microversion: 2.1 time: 0.006745 Nov 20 21:13:07.216959 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3221/6557] 10.222.0.41 () {60 vars in 1256 bytes} [Sat Nov 20 21:13:07 2021] PUT /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:13:07.224852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:07.225463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:07.232094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.232435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.233287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.233724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.288552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:07.289463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:07.296834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.297678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.298511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.299693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.341978 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fc01690-5da9-4944-a95a-471444718344 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.057197 Nov 20 21:13:07.342884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3222/6558] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:07 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:07.375909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.384208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfb64cc2-dd44-4377-ab86-58bd4cef1622 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.163161 Nov 20 21:13:07.385196 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3337/6559] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:07 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:07.402553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:07.403254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:07.411399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.411852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.412781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.413286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.567671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.574993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f27e3a9c-20ab-4b2a-8260-dd0c0ff89786 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.176641 Nov 20 21:13:07.575756 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3223/6560] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:07 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:07.592749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56256fba-8a87-440c-8294-50d39d20ed1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:07.594239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56256fba-8a87-440c-8294-50d39d20ed1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:07.595042 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56256fba-8a87-440c-8294-50d39d20ed1d tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "PUT /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 400 len: 108 microversion: 2.1 time: 0.006685 Nov 20 21:13:07.595607 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3338/6561] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 21:13:07 2021] PUT /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:13:07.605065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:07.605684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:07.611672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.612130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.612935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:07.613396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:07.757222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:07.764635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3be3dd6-4d54-4e67-b0f6-485390b7d5e8 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1506 microversion: 2.1 time: 0.164162 Nov 20 21:13:07.765208 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3224/6562] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:07 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:08.116563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:08.117617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:08.127036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:08.127668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:08.128656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:08.129097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:08.319212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:08.326530 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5a4ec4e2-706c-42c3-b7b4-7fd510965451 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.214556 Nov 20 21:13:08.327108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3339/6563] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:08 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:08.353499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:08.354875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:08.362742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:08.363278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:08.364177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:08.364695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:08.411084 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-292b7286-6126-4e0c-833d-bc10354c0fb4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.061183 Nov 20 21:13:08.412029 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3225/6564] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:08 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:09.346071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:09.347802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:09.364337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:09.364911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:09.365845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:09.366440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:09.425221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:09.426371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:09.435326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:09.436270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:09.437087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:09.437711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:09.487670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-becaeea6-18a6-4619-b9dc-1e0d180a0c53 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.066910 Nov 20 21:13:09.488571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3226/6565] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:09 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:09.547204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:09.555241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed1b4c98-f36c-4f68-9ab6-bd6a8eed3fe7 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.214655 Nov 20 21:13:09.555798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3340/6566] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:09 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:10.050183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:10.050705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.057467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.057924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.058739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.059184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.073264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. Nov 20 21:13:10.073861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:10.074733 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca25f9ad-4dc1-446f-99b8-db1e8fb43beb tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 404 len: 111 microversion: 2.1 time: 0.029392 Nov 20 21:13:10.075344 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3227/6567] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:13:10 2021] DELETE /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:10.083766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:10.084507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: c6ade9c3-e4a1-4c87-88b1-fe6b141392de] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.090660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.091187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.092062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.092578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.106870 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. Nov 20 21:13:10.107761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance c6ade9c3-e4a1-4c87-88b1-fe6b141392de could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:10.108510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d77a34e-9e6c-45fc-a6f3-508bfa45958f tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de" status: 404 len: 111 microversion: 2.1 time: 0.028576 Nov 20 21:13:10.110132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3341/6568] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:10 2021] GET /compute/v2.1/servers/c6ade9c3-e4a1-4c87-88b1-fe6b141392de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:10.117520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:10.118283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.124393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.124855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.125664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.126378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.151970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:13:10.237308 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b8ce605-cb89-456b-a6bd-4c9f03e37371 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 204 len: 0 microversion: 2.1 time: 0.122271 Nov 20 21:13:10.238025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3228/6569] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:13:10 2021] DELETE /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:13:10.245901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:10.246552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.252729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.253191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.253995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.254716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.398175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:10.405591 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bbc6bb58-d366-4f74-9d41-4ba6829faa21 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.163449 Nov 20 21:13:10.406575 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3342/6570] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:10 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:10.500389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:10.501460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.509819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.510307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.511106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.511552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.554472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2381c6eb-e4fa-4466-b916-467102bfcd75 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.057817 Nov 20 21:13:10.558351 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3229/6571] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:10 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:10.572311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:10.572951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:10.579797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.580362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.581185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.581617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.723993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:10.731849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ae68c7e-1ccf-48d4-b512-d5fecf2af7a6 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.163320 Nov 20 21:13:10.733339 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3343/6572] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:10 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:10.892975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d802ac73-9066-45fb-b099-7f7077ecfe6a req-89f85767-bd92-4022-82fa-2c8b4919146e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb65f4a-7cc9-4457-94ed-59768969c88d", "name": "network-vif-plugged", "status": "completed", "tag": "80fdb11c-e36a-4449-853b-09a5b29c799e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:10.895202 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:10.895202 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:13:10.903993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d802ac73-9066-45fb-b099-7f7077ecfe6a req-89f85767-bd92-4022-82fa-2c8b4919146e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:10.904660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d802ac73-9066-45fb-b099-7f7077ecfe6a req-89f85767-bd92-4022-82fa-2c8b4919146e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:10.916660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d802ac73-9066-45fb-b099-7f7077ecfe6a req-89f85767-bd92-4022-82fa-2c8b4919146e service nova] Creating event network-vif-plugged:80fdb11c-e36a-4449-853b-09a5b29c799e for instance 9fb65f4a-7cc9-4457-94ed-59768969c88d on nch2-master-1 Nov 20 21:13:10.921916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d802ac73-9066-45fb-b099-7f7077ecfe6a req-89f85767-bd92-4022-82fa-2c8b4919146e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034728 Nov 20 21:13:10.923379 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3230/6573] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:11.424733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:11.425284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:11.432040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.432578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.433471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.433911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.567510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:11.569216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:11.575275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.576088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.577089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.577734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.578268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:11.586607 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af5b855d-795f-4360-b13f-65e44e49a95b tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1512 microversion: 2.1 time: 0.166170 Nov 20 21:13:11.587197 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3344/6574] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:11 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:11.619083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-044546a9-35cb-4d0e-8629-1c53ef9e706f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.056416 Nov 20 21:13:11.620089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3231/6575] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:11 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:11.749571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:11.750307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:11.757145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.757678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.758411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:11.758847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:11.899187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:11.906722 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-985b894b-9bcb-4f2f-a539-5ceb0c91472d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1319 microversion: 2.1 time: 0.160813 Nov 20 21:13:11.907293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3345/6576] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:11 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:12.618447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:12.619293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:12.635068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:12.637836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:12.644116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.644570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.645369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.645805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.648977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.649687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.651525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.652207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.708995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d7b68ee-be52-4e35-939f-b4801152b06f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.080689 Nov 20 21:13:12.709947 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3346/6577] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:12 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:12.718322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a7ee3f92-8971-40af-acf2-52bb8047422a req-d57b489c-99ef-4fbd-9fef-eaa86416f005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a71a189-4354-4a63-93e2-c1b900b7c25c", "name": "network-vif-deleted", "tag": "ab912177-8646-4446-9392-73928c0f3082"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:12.722002 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:12.722002 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:13:12.730578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a7ee3f92-8971-40af-acf2-52bb8047422a req-d57b489c-99ef-4fbd-9fef-eaa86416f005 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.731029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a7ee3f92-8971-40af-acf2-52bb8047422a req-d57b489c-99ef-4fbd-9fef-eaa86416f005 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.743518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f97aa90193b41ee80433f60dfc5070d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8910f09f22a240eb9a228d72406a608b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:12.743758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a7ee3f92-8971-40af-acf2-52bb8047422a req-d57b489c-99ef-4fbd-9fef-eaa86416f005 service nova] Creating event network-vif-deleted:ab912177-8646-4446-9392-73928c0f3082 for instance 4a71a189-4354-4a63-93e2-c1b900b7c25c on nch2-master-1 Nov 20 21:13:12.748888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a7ee3f92-8971-40af-acf2-52bb8047422a req-d57b489c-99ef-4fbd-9fef-eaa86416f005 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037186 Nov 20 21:13:12.749715 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3347/6578] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:12.751670 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a69288c-37b1-4827-8f21-5642981fd7b6 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 200 len: 1470 microversion: 2.1 time: 0.148906 Nov 20 21:13:12.752448 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3232/6579] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:12 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:12.924939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:12.925638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:12.931726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.932175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:12.932966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:12.933401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.083410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:13.098998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-130d23db-f772-4d9e-b6fa-df6130e4f96a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1507 microversion: 2.1 time: 0.178577 Nov 20 21:13:13.099868 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3348/6580] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:12 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:13.116479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9caac17a-9de9-446c-8f80-5ea71b8d2ccc", "device": "/dev/sdb"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:13.117586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:13.124236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.124878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.125485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.126153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.373938 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f014a98c-072d-4577-8d59-76cbe07a689d tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "POST /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262279 Nov 20 21:13:13.374591 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3233/6581] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:13:13 2021] POST /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:13.721633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:13.722782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:13.730128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.730849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.731915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.733535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.770557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:13.771501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] [instance: 4a71a189-4354-4a63-93e2-c1b900b7c25c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:13.777991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.778472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.778643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5c72740-7ffc-48c5-92db-1d73bf22ad02 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.060854 Nov 20 21:13:13.779589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:13.779740 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3349/6582] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:13 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:13.780422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:13.795977 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] HTTP exception thrown: Instance 4a71a189-4354-4a63-93e2-c1b900b7c25c could not be found. Nov 20 21:13:13.796394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] Returning 404 to user: Instance 4a71a189-4354-4a63-93e2-c1b900b7c25c could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:13.797645 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-473ca137-d130-4b2a-9e9b-d40e2989cfe1 tempest-ServersNegativeTestJSON-1010955703 tempest-ServersNegativeTestJSON-1010955703-project] 10.222.0.41 "GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c" status: 404 len: 111 microversion: 2.1 time: 0.032267 Nov 20 21:13:13.798224 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3234/6583] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:13 2021] GET /compute/v2.1/servers/4a71a189-4354-4a63-93e2-c1b900b7c25c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:14.791685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:14.793429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:14.801486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:14.801931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:14.803046 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:14.803903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:14.856971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b6786c1-146c-401e-a5e3-d981068dcacf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.069233 Nov 20 21:13:14.857908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3350/6584] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:14 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:15.871120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:15.873352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:15.882440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:15.882972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:15.883697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:15.884766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:15.928601 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8164eda7-aa1f-407b-ac58-85d6ad1df795 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.061956 Nov 20 21:13:15.932529 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3235/6585] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:15 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:16.942486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:16.944103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:16.960960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:16.960960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:16.969244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:16.969244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:17.043730 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a234351d-2154-4f43-8737-a6f2be8a05dd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.106711 Nov 20 21:13:17.045828 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3351/6586] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:16 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:17.921475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-776693075", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "db4f19d3-1db4-4478-8a02-4858db09432d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:17.974474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] validate_networks() for [('db4f19d3-1db4-4478-8a02-4858db09432d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:13:18.057778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:18.059161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:18.069279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:18.069812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:18.070901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:18.071330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:18.119984 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff413b0b-85ff-47b4-81fe-122ec8732859 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.066531 Nov 20 21:13:18.120773 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3352/6587] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:18 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:18.596635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:13:18.597306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:13:18.597950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:13:18.598542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:13:18.599194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:13:18.611593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:18.612044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:18.612869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:18.613304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:18.636417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Getting quotas for project 00183dd4f4244acd9508cb18213b9a77. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:13:18.641649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Getting quotas for user 5dbf8bdd48c04a30809c7f22f413cdb3 and project 00183dd4f4244acd9508cb18213b9a77. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:13:18.654487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:13:18.656944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:13:18.703055 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e653f1d-58e1-4023-b5b8-f3808f5fdedb tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899874 Nov 20 21:13:18.703711 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3236/6588] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:13:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:13:18.714992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df68b9f8-7bcd-490f-bf27-ad3904751558 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:18.716067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df68b9f8-7bcd-490f-bf27-ad3904751558 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:18.786425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df68b9f8-7bcd-490f-bf27-ad3904751558 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:18.795463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df68b9f8-7bcd-490f-bf27-ad3904751558 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1227 microversion: 2.1 time: 0.084816 Nov 20 21:13:18.796449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3353/6589] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:18 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:19.134739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:19.136890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:19.146255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:19.147854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:19.149305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:19.150212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:19.225409 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a648f7e-35ef-4071-ac5c-529ab9c3c90b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.096569 Nov 20 21:13:19.227341 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3237/6590] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:19 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:19.813914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:19.814839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:19.822856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:19.823681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:19.825198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:19.825887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:19.914174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:19.924996 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6889b7b-ead0-48e9-a56c-8047b042dca2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1297 microversion: 2.1 time: 0.114604 Nov 20 21:13:19.925954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3354/6591] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:19 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:20.237270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:20.238341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:20.246851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:20.247471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:20.248476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:20.249165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:20.294511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d4699696-69d3-4d17-927b-aa8902d515ee tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.061260 Nov 20 21:13:20.295920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3238/6592] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:20 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:20.943134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:20.943741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:20.955887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:20.956422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:20.957251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:20.957793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:21.107888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:21.116515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56838d3f-1889-4779-926d-0d0bd4fe80f3 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1327 microversion: 2.1 time: 0.177240 Nov 20 21:13:21.117441 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3355/6593] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:20 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:21.306998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:21.308405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:21.316745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:21.317280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:21.318284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:21.319008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:21.359807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1bad9008-0dfa-41bf-aad1-2eba636172f6 req-bf28240c-5e42-40f3-a928-0bafcf22e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e64df0-ebf1-487b-992b-240304269af7", "tag": "a801afc6-ca82-4747-8274-58b1e9329f87"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:21.363169 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:21.363169 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:13:21.370717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f9e3a01-48e2-45c5-8662-c9be930f3c16 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.068031 Nov 20 21:13:21.375825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1bad9008-0dfa-41bf-aad1-2eba636172f6 req-bf28240c-5e42-40f3-a928-0bafcf22e5fd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:21.381337 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3239/6594] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:21 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:21.381525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1bad9008-0dfa-41bf-aad1-2eba636172f6 req-bf28240c-5e42-40f3-a928-0bafcf22e5fd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:21.390346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1bad9008-0dfa-41bf-aad1-2eba636172f6 req-bf28240c-5e42-40f3-a928-0bafcf22e5fd service nova] Creating event network-changed:a801afc6-ca82-4747-8274-58b1e9329f87 for instance 52e64df0-ebf1-487b-992b-240304269af7 on nch1-master-1 Nov 20 21:13:21.396020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1bad9008-0dfa-41bf-aad1-2eba636172f6 req-bf28240c-5e42-40f3-a928-0bafcf22e5fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039748 Nov 20 21:13:21.397101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3356/6595] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:13:22.134968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:22.135812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:22.143206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:22.143741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:22.144540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:22.145006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:22.390255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:22.391533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:22.398955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:22.399409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:22.400667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:22.401494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:22.425324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:22.435524 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-117e86a7-6b18-4212-983b-9f6b4dcf8e9d tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1327 microversion: 2.1 time: 0.305338 Nov 20 21:13:22.436861 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3240/6596] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:22 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1327 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:22.464090 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bad073b5-8ed3-4bd9-a782-2c889a7fb6be tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.078547 Nov 20 21:13:22.468099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3357/6597] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:22 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:23.453092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:23.454375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:23.462109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:23.462572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:23.463364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:23.463803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:23.476349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:23.478177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:23.489410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:23.490157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:23.491500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:23.492175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:23.540922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd4c7441-0160-404d-9ea8-c0feef21290e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.068328 Nov 20 21:13:23.542084 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3358/6598] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:23 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:23.621491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:23.630109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35022756-31a1-4552-aedd-570980780a13 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1327 microversion: 2.1 time: 0.181104 Nov 20 21:13:23.630778 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3241/6599] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:23 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1327 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:24.647906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:24.648650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:24.655673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:24.656477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:24.657276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:24.657932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:24.730855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:24.731855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:24.747238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:24.747693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:24.748503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:24.748952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:24.793214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb47b544-4128-4dac-89ac-5e10037ff0f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.242939 Nov 20 21:13:24.795058 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3359/6600] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:24 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:24.808155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:24.816942 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01573643-69f1-46ca-9700-c48fb5e45d1b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1327 microversion: 2.1 time: 0.173133 Nov 20 21:13:24.818081 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3242/6601] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:24 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1327 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:25.439211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8266551d-3f74-4cbd-bb31-263b2011bf89 req-e2bc05fb-e04c-4286-a0b7-85a2bd15476a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e64df0-ebf1-487b-992b-240304269af7", "name": "network-vif-plugged", "status": "completed", "tag": "a801afc6-ca82-4747-8274-58b1e9329f87"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:25.441892 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:25.441892 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:13:25.451459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8266551d-3f74-4cbd-bb31-263b2011bf89 req-e2bc05fb-e04c-4286-a0b7-85a2bd15476a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:25.452225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8266551d-3f74-4cbd-bb31-263b2011bf89 req-e2bc05fb-e04c-4286-a0b7-85a2bd15476a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:25.465629 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8266551d-3f74-4cbd-bb31-263b2011bf89 req-e2bc05fb-e04c-4286-a0b7-85a2bd15476a service nova] Creating event network-vif-plugged:a801afc6-ca82-4747-8274-58b1e9329f87 for instance 52e64df0-ebf1-487b-992b-240304269af7 on nch1-master-1 Nov 20 21:13:25.471695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8266551d-3f74-4cbd-bb31-263b2011bf89 req-e2bc05fb-e04c-4286-a0b7-85a2bd15476a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038943 Nov 20 21:13:25.472608 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3360/6602] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:13:25.804728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:25.805681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:25.812628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:25.813085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:25.814844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:25.815486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:25.836200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:25.837602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:25.844110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:25.844678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:25.845587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:25.846365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:25.861060 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41849d98-fbe3-47b3-8889-8764d5043d1a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.059888 Nov 20 21:13:25.862238 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3243/6603] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:25 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:25.982764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:25.990342 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22071d6c-0bdd-4b3f-9ca3-9943952111f0 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1327 microversion: 2.1 time: 0.159321 Nov 20 21:13:25.991090 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3361/6604] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:25 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1327 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:26.873777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:26.874886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:26.883425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:26.883972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:26.884842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:26.885384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:26.938125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c77b37f4-9fec-4bb6-9267-bd753803893b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.068696 Nov 20 21:13:26.938787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3244/6605] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:26 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:27.007090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.008018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.015217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.015704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.016507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.017494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.153369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:27.161844 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cb62239-2f69-42ec-8819-130425d8007b tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1528 microversion: 2.1 time: 0.158391 Nov 20 21:13:27.162592 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3362/6606] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:27 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1528 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:27.178959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.179716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.186090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.186551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.187339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.187774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.328420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:27.336768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2dd3a0a0-8e1f-491d-ad21-edb0e3d614cf tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1528 microversion: 2.1 time: 0.161850 Nov 20 21:13:27.337626 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3245/6607] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:27 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1528 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:27.525231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.525866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.532809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.533274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.534092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.534984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.549392 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] HTTP exception thrown: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. Nov 20 21:13:27.550339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Returning 404 to user: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:27.551170 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d49bfb27-c7f3-4be8-904a-cb6c61a97346 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] 10.222.0.41 "DELETE /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 404 len: 111 microversion: 2.1 time: 0.200207 Nov 20 21:13:27.551731 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3363/6608] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:13:27 2021] DELETE /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:27.560594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.561207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.568552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.569009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.569830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.570301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.710787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:27.718983 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f27beb5c-b5a9-4662-ab60-f90f96053ef2 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1528 microversion: 2.1 time: 0.161989 Nov 20 21:13:27.719648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3246/6609] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:27 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1528 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:27.736347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Action: 'update', calling method: >, body: {"server": {"name": "52e64df0-ebf1-487b-992b-240304269af7_new"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:27.737599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.743592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.744185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.745033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.745540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.759622 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] HTTP exception thrown: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. Nov 20 21:13:27.760296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] Returning 404 to user: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:27.761191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63b836cd-ff6e-45b7-86c7-4d2f1184ceb7 tempest-ServersNegativeTestMultiTenantJSON-1551828177 tempest-ServersNegativeTestMultiTenantJSON-1551828177-project] 10.222.0.41 "PUT /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 404 len: 111 microversion: 2.1 time: 0.029023 Nov 20 21:13:27.761837 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3364/6610] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 21:13:27 2021] PUT /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:27.771042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.771590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.777383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.777838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.778671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.779114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.804886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:13:27.890746 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec790a4c-8273-4730-b914-3fe6eafce806 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "DELETE /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 204 len: 0 microversion: 2.1 time: 0.123528 Nov 20 21:13:27.892009 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3247/6611] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:13:27 2021] DELETE /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:13:27.900179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:27.901044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.907782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.908662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.909467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.909907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.951043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:27.952054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:27.961956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.965204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:27.968119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:27.968600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:28.022902 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a818579-c6fb-4fd5-877c-b53e4ecbcf13 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.076022 Nov 20 21:13:28.023872 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3248/6612] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:27 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:28.074719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:28.083325 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cdd43a8-1f57-4fbf-908d-ec2a1000f78a tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1534 microversion: 2.1 time: 0.187498 Nov 20 21:13:28.083954 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3365/6613] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:27 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1534 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:13:29.036471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:29.037426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:29.044731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:29.045193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:29.045989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:29.046448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:29.096087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-22a78062-c0d7-4ce8-a55a-9c9d0228904b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.063535 Nov 20 21:13:29.100252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3249/6614] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:29 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:29.101305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:29.102028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:29.109701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:29.110202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:29.111053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:29.111693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:29.317021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dbf8bdd48c04a30809c7f22f413cdb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00183dd4f4244acd9508cb18213b9a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:13:29.331964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8882b61b-5fc2-428b-827b-8cab902119be tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 200 len: 1534 microversion: 2.1 time: 0.234495 Nov 20 21:13:29.333548 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3366/6615] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:29 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 1534 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:13:29.716640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-62197b75-3aab-47f2-b0ca-8e6b9321223b req-5895cb5b-4b63-465a-aa87-67944a0e5786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e64df0-ebf1-487b-992b-240304269af7", "name": "network-vif-deleted", "tag": "a801afc6-ca82-4747-8274-58b1e9329f87"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:29.718552 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:13:29.718552 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:13:29.727278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-62197b75-3aab-47f2-b0ca-8e6b9321223b req-5895cb5b-4b63-465a-aa87-67944a0e5786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:29.727811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-62197b75-3aab-47f2-b0ca-8e6b9321223b req-5895cb5b-4b63-465a-aa87-67944a0e5786 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:29.743518 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-62197b75-3aab-47f2-b0ca-8e6b9321223b req-5895cb5b-4b63-465a-aa87-67944a0e5786 service nova] Creating event network-vif-deleted:a801afc6-ca82-4747-8274-58b1e9329f87 for instance 52e64df0-ebf1-487b-992b-240304269af7 on nch1-master-1 Nov 20 21:13:29.748233 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-62197b75-3aab-47f2-b0ca-8e6b9321223b req-5895cb5b-4b63-465a-aa87-67944a0e5786 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035814 Nov 20 21:13:29.748934 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3250/6616] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:13:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:30.109032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:30.110186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:30.117422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:30.118383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:30.119816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:30.120154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:30.163317 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c89ec73-6f25-4ea6-be1f-b78e746e9cf9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.058425 Nov 20 21:13:30.165264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3367/6617] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:30 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:30.352387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:30.353753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] [instance: 52e64df0-ebf1-487b-992b-240304269af7] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:30.363884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:30.364574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:30.365485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:30.366039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:30.383321 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] HTTP exception thrown: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. Nov 20 21:13:30.383923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] Returning 404 to user: Instance 52e64df0-ebf1-487b-992b-240304269af7 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:30.384858 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4434a25a-771c-43d0-9366-39040e49de96 tempest-ServersNegativeTestMultiTenantJSON-1483078071 tempest-ServersNegativeTestMultiTenantJSON-1483078071-project] 10.222.0.41 "GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7" status: 404 len: 111 microversion: 2.1 time: 0.038582 Nov 20 21:13:30.385534 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3251/6618] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:13:30 2021] GET /compute/v2.1/servers/52e64df0-ebf1-487b-992b-240304269af7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:31.176573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:31.178352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:31.186252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:31.186855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:31.187743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:31.188418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:31.241633 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7d10131-62f1-4dce-b482-7f9121d22797 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.069052 Nov 20 21:13:31.246065 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3368/6619] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:31 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:32.252954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:32.254335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:32.261623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:32.262318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:32.263122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:32.263739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:32.308923 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.059642 Nov 20 21:13:32.310828 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3252/6620] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:32 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:33.322532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:33.323666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:33.333587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:33.334143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:33.334989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:33.335434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:33.380998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-704c837a-94bf-4ccb-bf5c-dd4222e816d4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.062566 Nov 20 21:13:33.382220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3369/6621] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:33 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:34.364487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:34.365521 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f2d99a1e-ba7f-40c7-8d3b-3679cd145e1f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001537 Nov 20 21:13:34.365932 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3253/6622] 10.222.0.41 () {56 vars in 885 bytes} [Sat Nov 20 21:13:34 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 20 21:13:34.393878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:34.395563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:34.404032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:34.404747 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:34.405753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:34.406227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:34.466589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e8f70fa-d3f8-47e8-9d7b-20125952d464 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.076656 Nov 20 21:13:34.467883 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3370/6623] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:34 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:35.479413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:35.480581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:35.495048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:35.495506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:35.496314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:35.496758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:35.546360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55259239-37ef-42c1-b956-acee39c2d0cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.070980 Nov 20 21:13:35.547118 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3254/6624] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:35 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:36.062836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10f0a852-d37f-498a-bf31-81bcbc20133e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Action: 'create', calling method: .version_select at 0x7f3f98e350d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1254907416"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:36.359856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10f0a852-d37f-498a-bf31-81bcbc20133e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.425025 Nov 20 21:13:36.360681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3371/6625] 10.222.0.41 () {60 vars in 1154 bytes} [Sat Nov 20 21:13:35 2021] POST /compute/v2.1/os-volumes => generated 338 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 20 21:13:36.372869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e0041e5-4482-4ae4-97d7-66dfe04093ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f863aaee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:36.428949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e0041e5-4482-4ae4-97d7-66dfe04093ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 200 len: 338 microversion: 2.1 time: 0.060366 Nov 20 21:13:36.429537 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3255/6626] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:13:36 2021] GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 338 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:36.559002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:36.560200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:36.570873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:36.571694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:36.572588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:36.573006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:36.615457 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ca4a77b-27a4-4ed0-ac14-6911de33f1c6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.060763 Nov 20 21:13:36.616499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3372/6627] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:36 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:37.441862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-48ff5f74-d9e9-4ceb-b7ea-fdca404101f3 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f85fa2940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:37.490636 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-48ff5f74-d9e9-4ceb-b7ea-fdca404101f3 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 200 len: 339 microversion: 2.1 time: 0.053735 Nov 20 21:13:37.491335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3256/6628] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:13:37 2021] GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 339 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:37.502930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1a67f39-ee5c-4937-9516-f2d981c29b76 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Action: 'create', calling method: .version_select at 0x7f3f87864f70>, body: {"snapshot": {"volume_id": "100fba8c-d0ca-483f-adbb-d4f0bae26a32", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-560376886"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:37.627605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:37.629479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:37.636728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:37.637185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:37.637981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:37.638455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:37.680712 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1a67f39-ee5c-4937-9516-f2d981c29b76 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.181334 Nov 20 21:13:37.681580 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3373/6629] 10.222.0.41 () {60 vars in 1161 bytes} [Sat Nov 20 21:13:37 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:37.691824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c7d8c8f-0db3-485f-8839-3c70e08208a2 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f98e35af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:37.700824 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a54a2c1-9bfa-4078-862a-9a4441d7c3c4 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.062890 Nov 20 21:13:37.700824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3257/6630] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:37 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:37.727695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c7d8c8f-0db3-485f-8839-3c70e08208a2 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 200 len: 286 microversion: 2.1 time: 0.040563 Nov 20 21:13:37.728274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3374/6631] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:13:37 2021] GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:13:37.739861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36b0922d-349c-4ef2-96c9-2f28f1d9c610 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f98d92ca0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:37.772374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36b0922d-349c-4ef2-96c9-2f28f1d9c610 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037618 Nov 20 21:13:37.772958 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3258/6632] 10.222.0.41 () {58 vars in 1139 bytes} [Sat Nov 20 21:13:37 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:37.783562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecda426f-3c8c-426d-a43b-9d1a4eb1095d tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f87d31af0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:37.820279 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ecda426f-3c8c-426d-a43b-9d1a4eb1095d tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 200 len: 286 microversion: 2.1 time: 0.041035 Nov 20 21:13:37.820993 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3375/6633] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:13:37 2021] GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:38.709599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:38.710686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:38.716580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:38.717032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:38.717813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:38.718293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:38.758813 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4922a61f-5484-4641-b53d-01d6a17b45bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.054451 Nov 20 21:13:38.759460 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3259/6634] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:38 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:38.833572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4b4a1cb-6b70-4ee3-97cd-adcd0f3b7fa5 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f87f39040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:38.864897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4b4a1cb-6b70-4ee3-97cd-adcd0f3b7fa5 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 200 len: 287 microversion: 2.1 time: 0.036433 Nov 20 21:13:38.865472 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3376/6635] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:13:38 2021] GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:38.875871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-993b0a80-781d-413b-9a5a-2aa1c1980faa tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f85fa5700>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:38.934914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-993b0a80-781d-413b-9a5a-2aa1c1980faa tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 202 len: 0 microversion: 2.1 time: 0.062933 Nov 20 21:13:38.935484 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3260/6636] 10.222.0.41 () {58 vars in 1253 bytes} [Sat Nov 20 21:13:38 2021] DELETE /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:13:38.943525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce6f0dd2-29e8-4ce7-b37f-ccb027f42dab tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f98dfb280>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:38.975237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce6f0dd2-29e8-4ce7-b37f-ccb027f42dab tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 200 len: 286 microversion: 2.1 time: 0.035423 Nov 20 21:13:38.976025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3377/6637] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:13:38 2021] GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:39.772090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:39.773214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:39.779575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:39.780075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:39.780954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:39.781409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:39.825686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05543561-e87c-4628-bca8-08b0aefea8c2 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.058324 Nov 20 21:13:39.829999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3261/6638] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:39 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:39.988498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19f2fae9-486a-48eb-b1ef-9fc7e15ef12e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f98e35dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:40.012134 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-19f2fae9-486a-48eb-b1ef-9fc7e15ef12e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] HTTP exception thrown: Snapshot 18abefd6-5831-4ee8-91ec-fc79a691d4a5 could not be found. Nov 20 21:13:40.012728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-19f2fae9-486a-48eb-b1ef-9fc7e15ef12e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Returning 404 to user: Snapshot 18abefd6-5831-4ee8-91ec-fc79a691d4a5 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:40.013703 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-19f2fae9-486a-48eb-b1ef-9fc7e15ef12e tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5" status: 404 len: 111 microversion: 2.1 time: 0.030519 Nov 20 21:13:40.014291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3378/6639] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:13:39 2021] GET /compute/v2.1/os-snapshots/18abefd6-5831-4ee8-91ec-fc79a691d4a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:13:40.022875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-075f2c06-fc03-4c45-827d-43674aa1d383 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f85fa2820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:40.097121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-075f2c06-fc03-4c45-827d-43674aa1d383 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 202 len: 0 microversion: 2.1 time: 0.078120 Nov 20 21:13:40.102182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3262/6640] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:13:40 2021] DELETE /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:13:40.111652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-096e452b-b70c-4f56-8191-35c03f7fd8a9 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f98e35dc0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:40.166533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-096e452b-b70c-4f56-8191-35c03f7fd8a9 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 200 len: 338 microversion: 2.1 time: 0.059187 Nov 20 21:13:40.170664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3379/6641] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:13:40 2021] GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 338 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:13:40.838299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:40.839428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:40.846150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:40.846608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:40.847396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:40.848026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:40.895989 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eda66b3-e531-4000-8dec-545669e3e81e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.062644 Nov 20 21:13:40.899965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3263/6642] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:40 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:41.180034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a23edf7d-4bbb-427e-970b-4ba1ca96d2ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f876b5430>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:41.206634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-a23edf7d-4bbb-427e-970b-4ba1ca96d2ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] HTTP exception thrown: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. Nov 20 21:13:41.207241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a23edf7d-4bbb-427e-970b-4ba1ca96d2ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Returning 404 to user: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:41.208074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a23edf7d-4bbb-427e-970b-4ba1ca96d2ed tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 404 len: 109 microversion: 2.1 time: 0.032760 Nov 20 21:13:41.208628 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3380/6643] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:13:41 2021] GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:41.218724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd615055-5645-4443-a70b-fdfa1a12dc68 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f85fa2550>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:41.249234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-dd615055-5645-4443-a70b-fdfa1a12dc68 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] HTTP exception thrown: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. Nov 20 21:13:41.249869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd615055-5645-4443-a70b-fdfa1a12dc68 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Returning 404 to user: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:41.250734 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd615055-5645-4443-a70b-fdfa1a12dc68 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 404 len: 109 microversion: 2.1 time: 0.036055 Nov 20 21:13:41.251467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3264/6644] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:13:41 2021] DELETE /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:41.260350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-840b8040-e2ba-456f-9b02-8649503b4e17 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Calling method '.version_select at 0x7f3f86f06e50>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:13:41.287940 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-840b8040-e2ba-456f-9b02-8649503b4e17 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] HTTP exception thrown: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. Nov 20 21:13:41.288547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-840b8040-e2ba-456f-9b02-8649503b4e17 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] Returning 404 to user: Volume 100fba8c-d0ca-483f-adbb-d4f0bae26a32 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:13:41.289438 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-840b8040-e2ba-456f-9b02-8649503b4e17 tempest-VolumesSnapshotsTestJSON-1979916101 tempest-VolumesSnapshotsTestJSON-1979916101-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32" status: 404 len: 109 microversion: 2.1 time: 0.033373 Nov 20 21:13:41.289922 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3381/6645] 10.222.0.41 () {58 vars in 1244 bytes} [Sat Nov 20 21:13:41 2021] GET /compute/v2.1/os-volumes/100fba8c-d0ca-483f-adbb-d4f0bae26a32 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:13:41.909631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:41.911109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:41.917713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:41.918214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:41.919177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:41.919631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:41.973705 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-90b9d49d-764f-49ca-b6c9-1b38e5ef573a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.066197 Nov 20 21:13:41.976213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3265/6646] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:41 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:42.989640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:42.991551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:43.000446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:43.001551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:43.002785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:43.003408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:43.056376 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d49d50f-b0ce-4d8f-94a7-cb94c7abbc61 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.072620 Nov 20 21:13:43.057362 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3382/6647] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:42 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:44.071701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:44.073370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:44.086012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:44.086494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:44.093046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:44.093570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:44.164378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97148033-a8e4-4223-99ac-79501a4c75ff tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.098375 Nov 20 21:13:44.169894 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3266/6648] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:44 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:45.184443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:45.191780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:45.213933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:45.215777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:45.217184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:45.217894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:45.276135 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ff916b7-3667-4581-84d8-857d432d3b3e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.100282 Nov 20 21:13:45.282996 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3383/6649] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:45 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:46.291625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:46.292665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:46.302028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:46.305411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:46.306529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:46.309538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:46.362630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6cdede30-1bda-40c5-a91c-901f9dbe9d3b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.075703 Nov 20 21:13:46.366829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3267/6650] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:46 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:47.374408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:47.376837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:47.386969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:47.388688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:47.389917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:47.390460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:47.439646 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a8abbf3-56bf-438e-8690-f5ca5e6acdc8 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.067563 Nov 20 21:13:47.440640 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3384/6651] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:47 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:13:48.455132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:48.456061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:48.464650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:48.465341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:48.466178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:48.466791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:48.511129 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-194e4738-b5d8-496c-9672-47f227d5743e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.062459 Nov 20 21:13:48.516318 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3268/6652] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:48 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:49.524055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:49.528087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:49.538688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:49.539527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:49.540749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:49.542039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:49.614503 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-437de651-0ea8-48c6-a525-7d8233f497c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.094123 Nov 20 21:13:49.616655 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3385/6653] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:49 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:50.628583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:50.629976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:50.641970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:50.642460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:50.644119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:50.644545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:50.696043 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d1504a6b-95ee-4ccd-84aa-bc33c3193a43 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.073394 Nov 20 21:13:50.696881 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3269/6654] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:50 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:51.710345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:51.712976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:51.724812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:51.737116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:51.738436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:51.739173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:51.803455 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10b3e3de-a4b4-446d-bed5-8b4bc86e3745 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.095692 Nov 20 21:13:51.806238 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3386/6655] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:51 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:52.817351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:52.818416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:52.825855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:52.826641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:52.827440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:52.827881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:52.873681 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af8bf59d-272b-4499-a411-d60cbe6c3ba5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.060951 Nov 20 21:13:52.874744 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3270/6656] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:52 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:53.888200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:53.889344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:53.897974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:53.898511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:53.899449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:53.899973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:53.945009 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6239387-21a5-434b-b4eb-1ffe2cdd2d2b tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.062493 Nov 20 21:13:53.945676 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3387/6657] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:53 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:54.962442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:54.964194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:54.972843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:54.973449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:54.974383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:54.975067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:55.033972 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c317162-3a72-4c0f-90c0-e07387834de1 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.079001 Nov 20 21:13:55.034892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3271/6658] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:54 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:56.048352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:56.050583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:56.060487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:56.061426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:56.072800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:56.073259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:56.122885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-978212af-5ce3-4e27-8c6f-f5e45a4fc0bb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.079996 Nov 20 21:13:56.123553 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3388/6659] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:56 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:57.135859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:57.137036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:57.156319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:57.157269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:57.158309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:57.158822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:57.213630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06cbb1fa-13a6-43e4-8a90-d3f4a2a05d9c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.082012 Nov 20 21:13:57.214736 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3272/6660] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:57 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:58.226610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:58.228198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:58.236439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:58.237146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:58.237937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:58.238587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:58.280405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5cdf1be4-6299-48d5-b143-6f06b984e315 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.057611 Nov 20 21:13:58.285692 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3389/6661] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:58 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:13:59.293965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:13:59.295496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:13:59.304242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:59.305042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:59.306094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:13:59.306796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:13:59.369549 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08f4d251-12a6-4109-9ac3-6a3a0db127f5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.080108 Nov 20 21:13:59.370315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3273/6662] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:13:59 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:14:00.383946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:00.385134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:00.395008 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:00.395456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:00.396478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:00.397085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:00.463060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17832ae8-d4d3-4a05-885a-5d1be5510414 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.084869 Nov 20 21:14:00.463746 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3390/6663] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:00 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:14:01.480301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:01.481546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:01.490957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:01.491505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:01.492354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:01.492798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:01.540635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11cdecbf-c0dc-4cf3-8502-a0ba4aee9d09 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.067861 Nov 20 21:14:01.541300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3274/6664] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:01 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:14:02.553950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:02.555075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:02.565364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:02.565912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:02.566840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:02.567678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:02.618296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89e1b138-fa20-4ab0-b5f8-47a09542e9ab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.068539 Nov 20 21:14:02.619888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3391/6665] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:02 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:14:03.631013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:03.632043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:03.642352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:03.642352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:03.642352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:03.642682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:03.688809 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bcae22bc-30bf-4ce5-9264-7d859a103eb5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.061903 Nov 20 21:14:03.689535 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3275/6666] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:03 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:14:04.701106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:04.703186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:04.711811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:04.712440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:04.713241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:04.713679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:04.757946 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-56065e40-8084-496e-a8c8-4158acc2c615 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 32633 microversion: 2.1 time: 0.060454 Nov 20 21:14:04.762204 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3392/6667] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:04 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 32633 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:14:05.772158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:05.773511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:05.782314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:05.782776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:05.783649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:05.784007 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:05.851722 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e30b8fd-5a83-4868-bd85-5eb947aacad0 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action" status: 200 len: 40789 microversion: 2.1 time: 0.085352 Nov 20 21:14:05.852964 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3276/6668] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:14:05 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/action => generated 40789 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:14:05.865053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:05.866318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:05.876193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:05.876620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:05.877595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:05.878267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:05.905782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-349c38b5-fc5a-4f80-9ebf-a85ae01f10b3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/ips" status: 200 len: 147 microversion: 2.1 time: 0.046090 Nov 20 21:14:05.906757 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3393/6669] 10.222.0.41 () {58 vars in 1247 bytes} [Sat Nov 20 21:14:05 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:07.263265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff002351-c5f6-452e-8aa5-9a714abe58eb"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:07.265152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:07.274126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:07.274824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:07.276205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:07.276655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:07.621026 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-733b4282-ab08-4329-b3ca-aa7efef40ac3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361910 Nov 20 21:14:07.622078 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3277/6670] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:14:07 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:10.963138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:10.964290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:10.971736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:10.972222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:10.973033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:10.973484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:11.007669 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b2ca6a8e-2580-4461-bb8b-5390deb67931 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049026 Nov 20 21:14:11.008521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3394/6671] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:14:10 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:11.021138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:11.022592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:11.028904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:11.029655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:11.030914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:11.031416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:11.068822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-014f2d23-05b6-4719-a2c3-cc12a1f5c24a tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb" status: 200 len: 194 microversion: 2.1 time: 0.054410 Nov 20 21:14:11.069432 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3278/6672] 10.222.0.41 () {58 vars in 1412 bytes} [Sat Nov 20 21:14:11 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:12.405113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deec2fe7-e868-4e58-ab59-21b047591bf9"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:12.406386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:12.420082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:12.420794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:12.421896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:12.422634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:12.702506 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-104eeafb-80fc-4954-b746-efef8de8ecaf tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301490 Nov 20 21:14:12.703151 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3395/6673] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:14:12 2021] POST /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:14.970489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:14.971486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:14.978069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:14.978547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:14.979342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:14.979785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:15.011694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed23f135-c3ba-4289-b916-99e915c6cbab tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045487 Nov 20 21:14:15.012261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3279/6674] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:14:14 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:17.451621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:17.452212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:17.461688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:17.462200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:17.463576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:17.464403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:17.496859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:14:17.584344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b63d1634-e9ce-4e01-9b36-45e9ba8fb734 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 204 len: 0 microversion: 2.1 time: 0.136518 Nov 20 21:14:17.588169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3396/6675] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:17 2021] DELETE /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:14:17.596633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:17.597774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:17.606635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:17.607445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:17.608502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:17.608944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:17.772117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:17.779998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7149050c-b65d-4a13-a92d-5ea171f901fc tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1730 microversion: 2.1 time: 0.190606 Nov 20 21:14:17.781202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3280/6676] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:17 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:19.060591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:19.061335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:19.070271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:19.070928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:19.071733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:19.072155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:19.250779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:19.259964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-481f3c39-5523-4337-8728-34fc6049c37c tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1730 microversion: 2.1 time: 0.465318 Nov 20 21:14:19.269494 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3397/6677] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:18 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1730 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:20.123751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-fdb3a3b7-74fe-4ee5-a5d7-a96fef400fc9 req-5aa465ae-09e2-4c4f-9658-bb96ea8ef1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f7cf2f-0d15-498f-a32c-2fa01b79f22d", "name": "network-vif-deleted", "tag": "3132aec5-17c1-4ad9-a513-e12a061edbf5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:20.126120 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:14:20.126120 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:14:20.142011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fdb3a3b7-74fe-4ee5-a5d7-a96fef400fc9 req-5aa465ae-09e2-4c4f-9658-bb96ea8ef1a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:20.143147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-fdb3a3b7-74fe-4ee5-a5d7-a96fef400fc9 req-5aa465ae-09e2-4c4f-9658-bb96ea8ef1a0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:20.160040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-fdb3a3b7-74fe-4ee5-a5d7-a96fef400fc9 req-5aa465ae-09e2-4c4f-9658-bb96ea8ef1a0 service nova] Creating event network-vif-deleted:3132aec5-17c1-4ad9-a513-e12a061edbf5 for instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d on nch1-master-1 Nov 20 21:14:20.167738 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-fdb3a3b7-74fe-4ee5-a5d7-a96fef400fc9 req-5aa465ae-09e2-4c4f-9658-bb96ea8ef1a0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052885 Nov 20 21:14:20.168717 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3281/6678] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:20.280450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:20.281695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:20.309089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:20.309595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:20.311842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:20.313830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:20.376584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:20.377081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:20.377530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lazy-loading 'fault' on Instance uuid c6f7cf2f-0d15-498f-a32c-2fa01b79f22d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:14:20.431717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e21f61da0f4ac09d66266e3bad99fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76440d312bb547959d5437ce510b515b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:20.441467 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-607df26a-e36e-4877-a382-1886a0479475 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 200 len: 1387 microversion: 2.1 time: 0.167946 Nov 20 21:14:20.451290 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3398/6679] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:20 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 1387 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:21.464754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:21.466258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:21.477082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:21.477636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:21.478627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:21.479232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:21.508339 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] HTTP exception thrown: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. Nov 20 21:14:21.509135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Returning 404 to user: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:21.510298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de3dba28-8054-4b50-ba1c-ec774864357f tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 404 len: 111 microversion: 2.1 time: 0.053121 Nov 20 21:14:21.511616 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3282/6680] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:21 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:22.168222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:22.168784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:22.177433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:22.178252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:22.179367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:22.180078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:22.205600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] HTTP exception thrown: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. Nov 20 21:14:22.206367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Returning 404 to user: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:22.208142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59b4c8f9-80b6-40e1-b67b-d868dd82defe tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 404 len: 111 microversion: 2.1 time: 0.044237 Nov 20 21:14:22.213110 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3399/6681] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:22 2021] DELETE /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:22.217784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:22.219069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] [instance: c6f7cf2f-0d15-498f-a32c-2fa01b79f22d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:22.226133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:22.226593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:22.227679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:22.228412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:22.269718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] HTTP exception thrown: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. Nov 20 21:14:22.269718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Returning 404 to user: Instance c6f7cf2f-0d15-498f-a32c-2fa01b79f22d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:22.270374 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d50c398b-688f-461c-8a97-a1e33eeab0e5 tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d" status: 404 len: 111 microversion: 2.1 time: 0.056660 Nov 20 21:14:22.270948 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3283/6682] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:22 2021] GET /compute/v2.1/servers/c6f7cf2f-0d15-498f-a32c-2fa01b79f22d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:22.443151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02d78669-a2f6-4c9a-9bfe-5ac96ccb9afa tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] Calling method '.version_select at 0x7f3f87b9dee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:22.483999 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02d78669-a2f6-4c9a-9bfe-5ac96ccb9afa tempest-TestServerBasicOps-2108921038 tempest-TestServerBasicOps-2108921038-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-834387733" status: 202 len: 0 microversion: 2.1 time: 0.044888 Nov 20 21:14:22.488423 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3400/6683] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:14:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-834387733 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:14:30.861426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:30.862873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:30.871712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:30.873176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:30.874706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:30.875364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:30.921510 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-24b85158-0420-4a63-81b4-37bc90cab82d tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb" status: 200 len: 194 microversion: 2.1 time: 0.067615 Nov 20 21:14:30.922432 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3284/6684] 10.222.0.41 () {58 vars in 1412 bytes} [Sat Nov 20 21:14:30 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:30.932363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:30.932894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:30.946916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:30.953676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:30.963202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:30.963893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:31.095981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lazy-loading 'services' on Instance uuid 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:14:31.219434 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44c18141-0f5a-4a50-9816-2edaf9bef7d7 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb" status: 202 len: 0 microversion: 2.1 time: 0.291059 Nov 20 21:14:31.238078 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3401/6685] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:14:30 2021] DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/ff002351-c5f6-452e-8aa5-9a714abe58eb => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:14:32.373990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:32.374674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:32.382113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:32.382574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:32.383372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:32.383817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:32.413950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c1acaf0-b20d-4652-b3cc-5a1c51fb01fc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/deec2fe7-e868-4e58-ab59-21b047591bf9" status: 200 len: 194 microversion: 2.1 time: 0.044377 Nov 20 21:14:32.414595 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3285/6686] 10.222.0.41 () {58 vars in 1412 bytes} [Sat Nov 20 21:14:32 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/deec2fe7-e868-4e58-ab59-21b047591bf9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:14:32.425715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:32.426321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:32.432388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:32.432840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:32.433627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:32.434075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:32.520631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lazy-loading 'services' on Instance uuid 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:14:32.635002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-407487fa-c713-48ed-bfb3-ba97d5c71927 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/deec2fe7-e868-4e58-ab59-21b047591bf9" status: 202 len: 0 microversion: 2.1 time: 0.214109 Nov 20 21:14:32.635609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3402/6687] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:14:32 2021] DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments/deec2fe7-e868-4e58-ab59-21b047591bf9 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:14:33.814021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:33.815771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:33.823765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:33.824301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:33.825176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:33.825681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:33.861449 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9268105e-51b3-4eac-a837-94a487843a70 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052095 Nov 20 21:14:33.866103 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3286/6688] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:14:33 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:14:34.012799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:34.013827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:34.021493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.023472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.024516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.025140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.071467 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f467e94-b0f7-4f1b-b30f-a3f81dbce1f6 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063275 Nov 20 21:14:34.072294 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3403/6689] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:14:34 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:14:34.159283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:34.160014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:34.167285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.168826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.169901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.171108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.211001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:14:34.341649 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08325d41-09bf-46ee-8671-be580410dbc9 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 204 len: 0 microversion: 2.1 time: 0.188352 Nov 20 21:14:34.344947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3287/6690] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:34 2021] DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:14:34.353247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:34.353868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:34.363631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.365281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.366160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:34.367510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:34.776552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:34.785108 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f0b82b7-36a9-424b-993a-e26b948717cc tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1673 microversion: 2.1 time: 0.435717 Nov 20 21:14:34.787166 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3404/6691] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:34 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1673 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:35.808351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:35.809149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:35.835194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:35.836111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:35.837245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:35.838015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:36.233540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:36.248482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc63162e-a572-4a49-b50b-c00819ee704c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1673 microversion: 2.1 time: 0.448996 Nov 20 21:14:36.249410 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3288/6692] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:35 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1673 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:37.267436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:37.268662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:37.282630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:37.283379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:37.284409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:37.287640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:37.450455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:37.462425 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16ef9ea6-fb79-4451-bb68-e8387ed0a0cd tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1606 microversion: 2.1 time: 0.199924 Nov 20 21:14:37.463018 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3405/6693] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:37 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1606 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:38.482705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:38.484179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:38.506423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:38.507389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:38.511026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:38.512088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:38.764400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:38.773212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f17c76fa-fa30-4f54-a000-c1da77796eeb tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1606 microversion: 2.1 time: 0.295892 Nov 20 21:14:38.778197 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3289/6694] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:38 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1606 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:38.922143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-125fb625-237c-4bd9-a869-d4cbd9ca7b3c req-78f23047-d792-45ce-bc39-cc84c761f838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1e54ca-e5d2-4b0a-93b4-cafa96759822", "name": "network-vif-deleted", "tag": "fdb38671-0374-4e8c-bd17-2c20287e73f0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:38.924872 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:14:38.924872 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:14:38.976896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-125fb625-237c-4bd9-a869-d4cbd9ca7b3c req-78f23047-d792-45ce-bc39-cc84c761f838 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:38.977752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-125fb625-237c-4bd9-a869-d4cbd9ca7b3c req-78f23047-d792-45ce-bc39-cc84c761f838 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:39.011147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-125fb625-237c-4bd9-a869-d4cbd9ca7b3c req-78f23047-d792-45ce-bc39-cc84c761f838 service nova] Creating event network-vif-deleted:fdb38671-0374-4e8c-bd17-2c20287e73f0 for instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 on nch1-master-1 Nov 20 21:14:39.019410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-125fb625-237c-4bd9-a869-d4cbd9ca7b3c req-78f23047-d792-45ce-bc39-cc84c761f838 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106113 Nov 20 21:14:39.022675 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3406/6695] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:14:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:39.800106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:39.800106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:39.812034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:39.812502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:39.813437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:39.824426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:39.926673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:39.927254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:39.928299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lazy-loading 'fault' on Instance uuid 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:14:40.105399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d305b521dd42ac825783a5f0e0ffcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'badea6f48ba34a31b8c22ca431cfebc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:40.127114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5bf5c9ec-dbca-41ae-bee6-d67c87f4e97f tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 200 len: 1326 microversion: 2.1 time: 0.335683 Nov 20 21:14:40.133872 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3290/6696] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:39 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 1326 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:41.149973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:41.151507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:41.163285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:41.163998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:41.165059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:41.170370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:41.193051 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. Nov 20 21:14:41.193911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:41.195141 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba154716-7273-4671-b1b4-3b5993628f83 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 404 len: 111 microversion: 2.1 time: 0.051024 Nov 20 21:14:41.208379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce2c7325-1a06-4284-8a3b-c3ef4c55eb3c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '.version_select at 0x7f3f8693d160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:41.212841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3407/6697] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:41 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:41.247160 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce2c7325-1a06-4284-8a3b-c3ef4c55eb3c tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632597464" status: 202 len: 0 microversion: 2.1 time: 0.042658 Nov 20 21:14:41.247788 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3291/6698] 10.222.0.41 () {58 vars in 1217 bytes} [Sat Nov 20 21:14:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632597464 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:14:45.199705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:45.201185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:45.209794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:45.210568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:45.211947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:45.213294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:45.241441 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. Nov 20 21:14:45.242603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:45.243716 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78d3dc93-b2d7-440a-b5fd-96bc7162974e tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 404 len: 111 microversion: 2.1 time: 0.047795 Nov 20 21:14:45.254956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:45.256252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: 1b1e54ca-e5d2-4b0a-93b4-cafa96759822] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:45.261506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3408/6699] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:45 2021] DELETE /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:45.265418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:45.266201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:45.267257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:45.267948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:45.282475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. Nov 20 21:14:45.283469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance 1b1e54ca-e5d2-4b0a-93b4-cafa96759822 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:45.284569 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c667b46-add2-4083-a7a0-0a0adec115a3 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822" status: 404 len: 111 microversion: 2.1 time: 0.033660 Nov 20 21:14:45.285371 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3292/6700] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:45 2021] GET /compute/v2.1/servers/1b1e54ca-e5d2-4b0a-93b4-cafa96759822 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:46.569299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:46.569844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:46.586719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:46.587305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:46.588182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:46.588628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:46.634420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. Nov 20 21:14:46.635182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:46.636057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6e73be83-210b-4eb4-8adb-37bcd723d5c5 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 404 len: 111 microversion: 2.1 time: 0.070611 Nov 20 21:14:46.643569 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3409/6701] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:46 2021] DELETE /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:46.650988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:46.651622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] [instance: b01d099b-cd9f-487e-b0ce-4fb5ac9440c0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:46.674363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:46.676954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:46.677862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:46.678343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:46.721316 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] HTTP exception thrown: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. Nov 20 21:14:46.722170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] Returning 404 to user: Instance b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:46.723056 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92aedabe-0928-442b-adef-d4aeeff1d987 tempest-AttachVolumeTestJSON-1552858705 tempest-AttachVolumeTestJSON-1552858705-project] 10.222.0.41 "GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0" status: 404 len: 111 microversion: 2.1 time: 0.078459 Nov 20 21:14:46.730430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3293/6702] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:46 2021] GET /compute/v2.1/servers/b01d099b-cd9f-487e-b0ce-4fb5ac9440c0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:14:51.457969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:51.458552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:51.468996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:51.475221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:51.478240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:51.481648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:51.692106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lazy-loading 'services' on Instance uuid 9fb65f4a-7cc9-4457-94ed-59768969c88d {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:14:51.916508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7e729b8-b540-493b-9aa1-ef3ade7f130a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d/os-volume_attachments/9caac17a-9de9-446c-8f80-5ea71b8d2ccc" status: 202 len: 0 microversion: 2.1 time: 0.462019 Nov 20 21:14:51.924299 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3410/6703] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:14:51 2021] DELETE /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d/os-volume_attachments/9caac17a-9de9-446c-8f80-5ea71b8d2ccc => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:14:52.107246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:52.109119 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:14:52.109119 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:14:52.111494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:52.112877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:52.114038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:52.114499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:52.153404 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c96b0b7-92df-420e-a457-e40ff7307610 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.262267 Nov 20 21:14:52.154386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3294/6704] 10.222.0.41 () {58 vars in 1184 bytes} [Sat Nov 20 21:14:51 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:14:52.318390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-349503972", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "0c8a2fad-e4e3-4cc9-a292-09228f527897"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:52.438808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] validate_networks() for [('0c8a2fad-e4e3-4cc9-a292-09228f527897', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:14:53.098959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:53.099775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:53.117516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.118741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.120633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.128351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.179631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:14:53.314188 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62ea9015-8d6a-486c-9f6d-e0160687a76a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 204 len: 0 microversion: 2.1 time: 0.218931 Nov 20 21:14:53.317953 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3295/6705] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:14:53 2021] DELETE /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:14:53.323267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:53.323964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:53.343503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.343952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.344760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.345196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.693087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:53.703814 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a8b5c86-b23e-43a5-87d1-9c75fd88775e tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1513 microversion: 2.1 time: 0.382120 Nov 20 21:14:53.703814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3296/6706] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:53 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1513 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:14:53.801451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:14:53.801848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:14:53.802344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:14:53.802768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:14:53.803167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:14:53.824460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.824914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.829244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:53.829701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:53.912176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Getting quotas for project c8a69efa9e90416383d57c457241a59e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:14:53.930356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Getting quotas for user 8cbc7e1a6e8c4aa99372a2439013383d and project c8a69efa9e90416383d57c457241a59e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:14:53.951532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:14:53.962683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:14:54.125040 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a6c345fb-de7e-4b75-9a2c-c282d8e7f8e2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814414 Nov 20 21:14:54.127908 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3411/6707] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:14:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:14:54.136733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a1b07df-ecf5-4df7-bea6-0b28deaef268 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:54.137428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a1b07df-ecf5-4df7-bea6-0b28deaef268 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:54.316282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a1b07df-ecf5-4df7-bea6-0b28deaef268 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1328 microversion: 2.1 time: 0.181270 Nov 20 21:14:54.326084 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3297/6708] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:54 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:54.720718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:54.721339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:54.734968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:54.737367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:54.738640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:54.739297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:55.136857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:55.146541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10fed78b-1c3e-4514-9d12-7ab3651378cd tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1513 microversion: 2.1 time: 0.430821 Nov 20 21:14:55.147140 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3412/6709] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:54 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1513 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:55.333031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:55.334221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:55.349155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:55.349634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:55.350496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:55.350940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:55.485798 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-13bb9ca5-be19-4faf-97c9-c425bd9107af tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1337 microversion: 2.1 time: 0.155874 Nov 20 21:14:55.486997 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3298/6710] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:55 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1337 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:56.166245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:56.167108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:56.184632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:56.185302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:56.196970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:56.200511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:56.219913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-82d54e1e-1e12-4a44-8c5a-7da5ed664354 req-d1ed182e-4b09-48bf-a04d-5232a0506083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb65f4a-7cc9-4457-94ed-59768969c88d", "name": "network-vif-deleted", "tag": "80fdb11c-e36a-4449-853b-09a5b29c799e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:56.226035 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:14:56.226035 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:14:56.252778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82d54e1e-1e12-4a44-8c5a-7da5ed664354 req-d1ed182e-4b09-48bf-a04d-5232a0506083 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:56.255404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-82d54e1e-1e12-4a44-8c5a-7da5ed664354 req-d1ed182e-4b09-48bf-a04d-5232a0506083 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:56.284960 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-82d54e1e-1e12-4a44-8c5a-7da5ed664354 req-d1ed182e-4b09-48bf-a04d-5232a0506083 service nova] Creating event network-vif-deleted:80fdb11c-e36a-4449-853b-09a5b29c799e for instance 9fb65f4a-7cc9-4457-94ed-59768969c88d on nch2-master-1 Nov 20 21:14:56.291186 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-82d54e1e-1e12-4a44-8c5a-7da5ed664354 req-d1ed182e-4b09-48bf-a04d-5232a0506083 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080324 Nov 20 21:14:56.292307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3299/6711] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:14:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:56.382178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f88dfc4cbff24026af90af84ca24d310', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f486ad3cb47d391a2136722e74f0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:14:56.391371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dfcd6db5-3e31-4f3f-b53d-21119e4c0036 tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 200 len: 1471 microversion: 2.1 time: 0.231176 Nov 20 21:14:56.394106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3413/6712] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:56 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:56.504722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:56.506097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:56.513115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:56.513814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:56.515726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:56.516334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:56.654221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a47f2ce5-b58e-456c-b09d-73166b8ef169 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1421 microversion: 2.1 time: 0.152648 Nov 20 21:14:56.662868 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3300/6713] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:56 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1421 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:57.412121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:57.413338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] [instance: 9fb65f4a-7cc9-4457-94ed-59768969c88d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:57.427757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:57.430880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:57.433871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:57.434376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:57.477729 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] HTTP exception thrown: Instance 9fb65f4a-7cc9-4457-94ed-59768969c88d could not be found. Nov 20 21:14:57.478423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] Returning 404 to user: Instance 9fb65f4a-7cc9-4457-94ed-59768969c88d could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:14:57.479751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37f98d77-4b7d-45fd-902c-9a9548d4386a tempest-VolumesSnapshotTestJSON-1178343811 tempest-VolumesSnapshotTestJSON-1178343811-project] 10.222.0.41 "GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d" status: 404 len: 111 microversion: 2.1 time: 0.072255 Nov 20 21:14:57.480337 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3414/6714] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:57 2021] GET /compute/v2.1/servers/9fb65f4a-7cc9-4457-94ed-59768969c88d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:14:57.674218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:57.675682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:57.696368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:57.697114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:57.698171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:57.698992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:58.255023 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d21d261-03dc-4cd7-acdc-30beb11649bc tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.586467 Nov 20 21:14:58.257960 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3301/6715] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:57 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:14:58.973751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7f1d13cf-a9b7-4639-95b4-734fc1a60579 req-51adcce5-bf11-4237-90df-3231a78c73f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fac581-cd1f-42fc-a4eb-bffb1acfee25", "tag": "7f0bed02-9e48-40dc-ab62-619528e61f6c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:14:58.975444 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:14:58.975444 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:14:58.985919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7f1d13cf-a9b7-4639-95b4-734fc1a60579 req-51adcce5-bf11-4237-90df-3231a78c73f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:58.986498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7f1d13cf-a9b7-4639-95b4-734fc1a60579 req-51adcce5-bf11-4237-90df-3231a78c73f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:58.999105 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7f1d13cf-a9b7-4639-95b4-734fc1a60579 req-51adcce5-bf11-4237-90df-3231a78c73f2 service nova] Creating event network-changed:7f0bed02-9e48-40dc-ab62-619528e61f6c for instance 40fac581-cd1f-42fc-a4eb-bffb1acfee25 on nch2-master-1 Nov 20 21:14:59.004722 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7f1d13cf-a9b7-4639-95b4-734fc1a60579 req-51adcce5-bf11-4237-90df-3231a78c73f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246181 Nov 20 21:14:59.005912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3415/6716] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:14:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:14:59.274800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:14:59.275414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:14:59.295319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:59.295834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:59.300694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:14:59.301439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:14:59.549825 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87edb82c-ff62-4b58-aab5-55494d8e2a86 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.278697 Nov 20 21:14:59.550461 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3302/6717] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:14:59 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:00.568945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:00.569653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:00.584483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:00.584483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:00.584483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:00.584483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:00.799470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd50bf6d-fe2a-4fab-b442-3c465699f7d2 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.235339 Nov 20 21:15:00.812767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3416/6718] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:00 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:01.819473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:01.820851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:01.839113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:01.839872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:01.841134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:01.842685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:02.071090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e82cda1-b649-46fe-bcc7-62e3631b81c9 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.256615 Nov 20 21:15:02.072049 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3303/6719] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:01 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:03.089892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:03.091458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:03.104024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:03.104797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:03.105970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:03.106941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:03.263334 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-345445b3-dd87-4d1b-9ea9-8eca2cbf7a75 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.177671 Nov 20 21:15:03.263923 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3417/6720] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:03 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:04.282427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:04.286043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:04.296455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:04.296970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:04.297775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:04.298248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:04.480103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a77f7b07-f0a2-427e-ab45-082158bef743 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.203012 Nov 20 21:15:04.481346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3304/6721] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:04 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:05.502688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:05.503571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:05.519889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:05.520383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:05.521221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:05.521656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:05.563609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cf5bede0-1d91-4de5-b471-7f0b050820d2 req-8b0de912-add7-4971-9927-ff5c96958de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fac581-cd1f-42fc-a4eb-bffb1acfee25", "name": "network-vif-plugged", "status": "completed", "tag": "7f0bed02-9e48-40dc-ab62-619528e61f6c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:05.565604 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:05.565604 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:05.589719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf5bede0-1d91-4de5-b471-7f0b050820d2 req-8b0de912-add7-4971-9927-ff5c96958de1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:05.594018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cf5bede0-1d91-4de5-b471-7f0b050820d2 req-8b0de912-add7-4971-9927-ff5c96958de1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:05.610686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cf5bede0-1d91-4de5-b471-7f0b050820d2 req-8b0de912-add7-4971-9927-ff5c96958de1 service nova] Creating event network-vif-plugged:7f0bed02-9e48-40dc-ab62-619528e61f6c for instance 40fac581-cd1f-42fc-a4eb-bffb1acfee25 on nch2-master-1 Nov 20 21:15:05.623330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cf5bede0-1d91-4de5-b471-7f0b050820d2 req-8b0de912-add7-4971-9927-ff5c96958de1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064188 Nov 20 21:15:05.628696 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3305/6722] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:15:05.756523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ccabacd-2f1d-4efa-89c8-d2137f009d17 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.260594 Nov 20 21:15:05.757495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3418/6723] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:05 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:06.783517 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:06.784221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:06.799407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:06.799863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:06.800662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:06.804746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:07.061659 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-efa19d54-b4bc-4c49-b874-58bb9f7d71d7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1463 microversion: 2.1 time: 0.288773 Nov 20 21:15:07.072453 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3306/6724] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:06 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:08.081567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:08.082213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:08.096001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.096521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:08.097366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.100528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:08.358495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-299628ca-2c7a-4b3b-94ee-52d213adac83 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1649 microversion: 2.1 time: 0.276145 Nov 20 21:15:08.358495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3419/6725] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:08 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1649 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:15:08.375177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:08.375845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:08.396173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.396762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:08.398540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.398987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:08.621040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bbc59b24-9318-4729-86db-590118711310 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1649 microversion: 2.1 time: 0.249933 Nov 20 21:15:08.629044 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3307/6726] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:08 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1649 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:08.647964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:08.649020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:08.662635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.663560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:08.665326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:08.668272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:09.016225 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d2ece4f-61c1-47a9-a24c-59c6b065cc71 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1649 microversion: 2.1 time: 0.375849 Nov 20 21:15:09.020514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3420/6727] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:08 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1649 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:09.326654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1847210963", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "0c8a2fad-e4e3-4cc9-a292-09228f527897"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:09.498901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] validate_networks() for [('0c8a2fad-e4e3-4cc9-a292-09228f527897', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:15:10.207611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:15:10.208332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:15:10.209320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:15:10.209871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:15:10.210488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:15:10.223144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:10.223753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:10.224746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:10.225308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:10.249058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Getting quotas for project c8a69efa9e90416383d57c457241a59e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:15:10.254944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Getting quotas for user 8cbc7e1a6e8c4aa99372a2439013383d and project c8a69efa9e90416383d57c457241a59e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:15:10.271582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:15:10.273959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:15:10.353123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a075210b-946e-4356-bb72-8001cb9415f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030979 Nov 20 21:15:10.353803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3308/6728] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:15:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:15:10.366018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-977d2467-488d-43c2-a297-d14c823c5070 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:10.367261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-977d2467-488d-43c2-a297-d14c823c5070 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:10.598134 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-977d2467-488d-43c2-a297-d14c823c5070 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1329 microversion: 2.1 time: 0.236862 Nov 20 21:15:10.599232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3421/6729] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:10 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:11.633941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:11.634645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:11.665702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:11.667580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:11.674304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:11.675624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:11.872212 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1512c219-8cb6-4b7a-b613-9a0bf1e993ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1416 microversion: 2.1 time: 0.256779 Nov 20 21:15:11.874394 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3309/6730] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:11 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1416 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:12.894733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:12.896683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:12.916161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:12.917370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:12.919543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:12.922187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:13.073454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-961cb37b-1963-40ab-af09-b810277f60eb tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1422 microversion: 2.1 time: 0.185287 Nov 20 21:15:13.077280 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3422/6731] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:12 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1422 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:14.095127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:14.095739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:14.112907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:14.116743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:14.120330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:14.120939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:14.416378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c6f7bc8-362e-490e-a3aa-39af95e1d1f0 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.326725 Nov 20 21:15:14.462277 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3310/6732] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:14 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:14.472088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-70e75b55-6925-4721-b4af-56513d96cb15 req-d69c50bb-ea90-4a71-97da-b6de53975ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffeb979-8709-400a-8870-cd16cb311c8c", "tag": "9e51feb2-7acf-48e1-b23d-1e5e36444150"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:14.474531 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:14.474531 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:15:14.495802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-70e75b55-6925-4721-b4af-56513d96cb15 req-d69c50bb-ea90-4a71-97da-b6de53975ccf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:14.496202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-70e75b55-6925-4721-b4af-56513d96cb15 req-d69c50bb-ea90-4a71-97da-b6de53975ccf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:14.520798 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-70e75b55-6925-4721-b4af-56513d96cb15 req-d69c50bb-ea90-4a71-97da-b6de53975ccf service nova] Creating event network-changed:9e51feb2-7acf-48e1-b23d-1e5e36444150 for instance 1ffeb979-8709-400a-8870-cd16cb311c8c on nch1-master-1 Nov 20 21:15:14.546560 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-70e75b55-6925-4721-b4af-56513d96cb15 req-d69c50bb-ea90-4a71-97da-b6de53975ccf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076156 Nov 20 21:15:14.547688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3423/6733] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:15:15.446562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:15.447182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:15.464581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:15.465047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:15.465875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:15.466346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:15.938785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-567e8b28-2bda-4271-896f-c26eebca538e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.495817 Nov 20 21:15:15.945204 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3311/6734] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:15 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:16.959807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:16.961051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:16.969813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:16.970399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:16.971369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:16.971805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:17.272132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba8d20dc-8c8d-402b-bd52-264e06d310e4 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.317216 Nov 20 21:15:17.283350 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3424/6735] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:16 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:15:18.298025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:18.299419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:18.309364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:18.310036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:18.312456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:18.313062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:18.605184 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b57ab7c7-fa0f-4ab3-ba64-39eaf10b44ae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.314609 Nov 20 21:15:18.605787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3312/6736] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:18 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:19.624314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:19.625098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:19.639185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:19.641549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:19.642595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:19.645797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:19.928247 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c68eb8cf-0ad9-4945-b531-b59b80d1695a tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.309218 Nov 20 21:15:19.935016 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3425/6737] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:19 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:20.212090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6e12adb5-edb2-4c8c-abf0-0c2ccd22730b req-3fc478ab-4705-4706-a9df-5256019747e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffeb979-8709-400a-8870-cd16cb311c8c", "name": "network-vif-plugged", "status": "completed", "tag": "9e51feb2-7acf-48e1-b23d-1e5e36444150"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:20.216414 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:20.216414 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:20.236220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6e12adb5-edb2-4c8c-abf0-0c2ccd22730b req-3fc478ab-4705-4706-a9df-5256019747e9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:20.239034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6e12adb5-edb2-4c8c-abf0-0c2ccd22730b req-3fc478ab-4705-4706-a9df-5256019747e9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:20.266640 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6e12adb5-edb2-4c8c-abf0-0c2ccd22730b req-3fc478ab-4705-4706-a9df-5256019747e9 service nova] Creating event network-vif-plugged:9e51feb2-7acf-48e1-b23d-1e5e36444150 for instance 1ffeb979-8709-400a-8870-cd16cb311c8c on nch1-master-1 Nov 20 21:15:20.278430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6e12adb5-edb2-4c8c-abf0-0c2ccd22730b req-3fc478ab-4705-4706-a9df-5256019747e9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070631 Nov 20 21:15:20.280853 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3313/6738] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:20.954493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:20.955449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:20.968599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:20.969465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:20.970461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:20.973953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:21.257187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3aca5a51-f36a-4c37-b2f2-a3bbf5b21f16 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1464 microversion: 2.1 time: 0.307365 Nov 20 21:15:21.258250 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3426/6739] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:20 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1464 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:22.276609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:22.277313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:22.285804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.287214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:22.288244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.288880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:22.537132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8e3a0396-5232-42fb-88f7-f43e384b7b2e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1649 microversion: 2.1 time: 0.264666 Nov 20 21:15:22.537733 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3314/6740] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:22 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1649 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:22.554520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:22.555846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:22.563440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.564154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:22.565169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.565788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:22.747312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02962be4-3365-49c5-aaed-e6a270465385 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1649 microversion: 2.1 time: 0.196344 Nov 20 21:15:22.759713 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3427/6741] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:22 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1649 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:22.765251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:22.766333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:22.774093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.774767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:22.775824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:22.776553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:23.043933 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0b313666-9e88-4416-9e38-544ec5d2943b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1649 microversion: 2.1 time: 0.280898 Nov 20 21:15:23.044951 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3315/6742] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:22 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1649 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:15:23.062657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:23.063495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:23.073422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:23.074881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:23.076642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:23.077490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:23.128576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:15:23.260621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62f412e8-04a9-4993-9e4f-7addfb53e71e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "DELETE /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 204 len: 0 microversion: 2.1 time: 0.202322 Nov 20 21:15:23.262367 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3428/6743] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:15:23 2021] DELETE /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:15:23.274466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:23.275674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:23.293263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:23.294525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:23.295752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:23.297362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:23.480052 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df832987-abf0-4cff-b628-866a21ae304b tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1655 microversion: 2.1 time: 0.212738 Nov 20 21:15:23.491158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3316/6744] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:23 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1655 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:24.505116 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:24.505846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:24.522192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:24.522657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:24.523704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:24.524142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:25.041188 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5777126-e158-4a27-b7d8-142a341d8a3e tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1655 microversion: 2.1 time: 0.546122 Nov 20 21:15:25.044705 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3429/6745] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:24 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1655 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:25.699789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-52704594-f150-43b2-be87-87b0957dea9f req-ca37bc9a-bb31-4df2-bef1-0a45f60df40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffeb979-8709-400a-8870-cd16cb311c8c", "name": "network-vif-deleted", "tag": "9e51feb2-7acf-48e1-b23d-1e5e36444150"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:25.705120 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:25.705120 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:25.728959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-52704594-f150-43b2-be87-87b0957dea9f req-ca37bc9a-bb31-4df2-bef1-0a45f60df40d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:25.729410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-52704594-f150-43b2-be87-87b0957dea9f req-ca37bc9a-bb31-4df2-bef1-0a45f60df40d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:25.759085 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-52704594-f150-43b2-be87-87b0957dea9f req-ca37bc9a-bb31-4df2-bef1-0a45f60df40d service nova] Creating event network-vif-deleted:9e51feb2-7acf-48e1-b23d-1e5e36444150 for instance 1ffeb979-8709-400a-8870-cd16cb311c8c on nch1-master-1 Nov 20 21:15:25.771644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-52704594-f150-43b2-be87-87b0957dea9f req-ca37bc9a-bb31-4df2-bef1-0a45f60df40d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075617 Nov 20 21:15:25.776405 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3317/6746] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:26.060512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:26.061133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:26.073774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:26.074272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:26.075073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:26.075515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:26.169820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:26.170853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:26.172452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lazy-loading 'fault' on Instance uuid 1ffeb979-8709-400a-8870-cd16cb311c8c {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:15:26.261642 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8eb5ad82-5460-4829-965c-eb5a1ce83745 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 200 len: 1454 microversion: 2.1 time: 0.203723 Nov 20 21:15:26.262522 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3430/6747] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:26 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:26.883550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1846387087", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "3a62d484-6489-47c9-ba52-8505cab4c721"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:26.971276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] validate_networks() for [('3a62d484-6489-47c9-ba52-8505cab4c721', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:15:27.280720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:27.281238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 1ffeb979-8709-400a-8870-cd16cb311c8c] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:27.290945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.295700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.297005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.300512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.345014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] HTTP exception thrown: Instance 1ffeb979-8709-400a-8870-cd16cb311c8c could not be found. Nov 20 21:15:27.346913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Returning 404 to user: Instance 1ffeb979-8709-400a-8870-cd16cb311c8c could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:15:27.348060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b15b5f39-8564-4e81-b43a-843fa9259bca tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c" status: 404 len: 111 microversion: 2.1 time: 0.071776 Nov 20 21:15:27.350564 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3431/6748] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:27 2021] GET /compute/v2.1/servers/1ffeb979-8709-400a-8870-cd16cb311c8c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:15:27.362387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:27.367035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:27.382322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.384599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.387106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.389050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.442911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:15:27.611957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91976dc6-05cd-4d80-a43b-d5fa85b2f23f tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "DELETE /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 204 len: 0 microversion: 2.1 time: 0.256321 Nov 20 21:15:27.616235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3432/6749] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:15:27 2021] DELETE /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:15:27.627476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:27.632343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:27.640988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.641442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.643114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.643555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.803692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:15:27.804311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:15:27.804799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:15:27.805423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:15:27.805836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:15:27.816870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.817399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.818537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:27.819038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:27.838937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Getting quotas for project b60cf19d51fe41e1bf404c33f632f316. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:15:27.845458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Getting quotas for user ccbf66394d904a7da5bf30711802de54 and project b60cf19d51fe41e1bf404c33f632f316. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:15:27.873630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:15:27.880747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:15:27.956517 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9398a13-b7d8-4e98-bd6d-ce97d1c44c26 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077240 Nov 20 21:15:27.962883 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3318/6750] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:15:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:15:27.969921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4b08203-0dd8-4dda-a559-a8f113d67d22 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:27.971141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4b08203-0dd8-4dda-a559-a8f113d67d22 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:28.041166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c4b08203-0dd8-4dda-a559-a8f113d67d22 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:28.049863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4b08203-0dd8-4dda-a559-a8f113d67d22 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1214 microversion: 2.1 time: 0.084850 Nov 20 21:15:28.060220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3319/6751] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:27 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:28.320780 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24e6613d-88f0-4445-9ccf-2e409374b8e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1655 microversion: 2.1 time: 0.702783 Nov 20 21:15:28.321381 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3433/6752] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:27 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1655 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:29.069886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:29.070961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:29.080500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:29.081199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:29.082652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:29.083272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:29.251866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:29.262487 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41b09a35-9825-423b-945c-b54af4495167 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1266 microversion: 2.1 time: 0.198204 Nov 20 21:15:29.264607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3320/6753] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:29 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:29.338781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:29.340062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:29.359291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:29.360279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:29.361106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:29.361548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:29.793030 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b8e332f8-c71f-4c54-b341-91fba11d2dae tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 200 len: 1655 microversion: 2.1 time: 0.457900 Nov 20 21:15:29.794779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3434/6754] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:29 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 1655 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:29.900489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1f660c7f-3c62-488f-ade3-6454ac9f2515 req-7ead3e59-7af1-412d-b99c-3a047df0a0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fac581-cd1f-42fc-a4eb-bffb1acfee25", "name": "network-vif-deleted", "tag": "7f0bed02-9e48-40dc-ab62-619528e61f6c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:29.905725 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:29.905725 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:29.933847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1f660c7f-3c62-488f-ade3-6454ac9f2515 req-7ead3e59-7af1-412d-b99c-3a047df0a0b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:29.934635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1f660c7f-3c62-488f-ade3-6454ac9f2515 req-7ead3e59-7af1-412d-b99c-3a047df0a0b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:29.949660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1f660c7f-3c62-488f-ade3-6454ac9f2515 req-7ead3e59-7af1-412d-b99c-3a047df0a0b5 service nova] Creating event network-vif-deleted:7f0bed02-9e48-40dc-ab62-619528e61f6c for instance 40fac581-cd1f-42fc-a4eb-bffb1acfee25 on nch2-master-1 Nov 20 21:15:29.973919 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1f660c7f-3c62-488f-ade3-6454ac9f2515 req-7ead3e59-7af1-412d-b99c-3a047df0a0b5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082150 Nov 20 21:15:29.975440 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3321/6755] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:15:30.283563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:30.285059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:30.293893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:30.294384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:30.295728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:30.296202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:30.719228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:30.733934 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95a1b978-d53f-484a-89d0-b48648b05d3d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.453008 Nov 20 21:15:30.734983 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3435/6756] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:30 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:30.814477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:30.815828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] [instance: 40fac581-cd1f-42fc-a4eb-bffb1acfee25] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:30.825792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:30.827726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:30.828625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:30.829142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:30.845914 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] HTTP exception thrown: Instance 40fac581-cd1f-42fc-a4eb-bffb1acfee25 could not be found. Nov 20 21:15:30.846636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] Returning 404 to user: Instance 40fac581-cd1f-42fc-a4eb-bffb1acfee25 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:15:30.847781 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-393d7b12-c49d-4d16-ba3d-c5416669a1e7 tempest-TestServerMultinode-2068877491 tempest-TestServerMultinode-2068877491-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25" status: 404 len: 111 microversion: 2.1 time: 0.039360 Nov 20 21:15:30.851630 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3322/6757] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:30 2021] GET /compute/v2.1/servers/40fac581-cd1f-42fc-a4eb-bffb1acfee25 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:15:31.255014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-140db181-cbe8-4303-82fe-8407eb9663f3 req-501fa362-35d2-4aa5-ab37-0417b93b7165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd5346d6-8241-4f81-8667-a0b3b50892c8", "tag": "14939fc5-d132-43ee-8d7c-51cbc479909e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:31.256825 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:31.256825 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:15:31.268949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-140db181-cbe8-4303-82fe-8407eb9663f3 req-501fa362-35d2-4aa5-ab37-0417b93b7165 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:31.271257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-140db181-cbe8-4303-82fe-8407eb9663f3 req-501fa362-35d2-4aa5-ab37-0417b93b7165 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:31.293715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-140db181-cbe8-4303-82fe-8407eb9663f3 req-501fa362-35d2-4aa5-ab37-0417b93b7165 service nova] Creating event network-changed:14939fc5-d132-43ee-8d7c-51cbc479909e for instance bd5346d6-8241-4f81-8667-a0b3b50892c8 on nch1-master-1 Nov 20 21:15:31.308536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-140db181-cbe8-4303-82fe-8407eb9663f3 req-501fa362-35d2-4aa5-ab37-0417b93b7165 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057839 Nov 20 21:15:31.309487 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3436/6758] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:31.756633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:31.757908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:31.765630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:31.766382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:31.767403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:31.768288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:32.088363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:32.100799 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ccbc2a0d-da12-4505-8331-2cd31337537d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.351434 Nov 20 21:15:32.102025 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3323/6759] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:31 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:33.121163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:33.121998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:33.137944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:33.139172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:33.141056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:33.141512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:33.452284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:33.466166 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-01e2a707-66da-4a64-b3e8-5de470fee02d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.349378 Nov 20 21:15:33.467458 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3437/6760] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:33 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:34.491197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:34.494730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:34.509122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:34.510013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:34.511074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:34.511856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:34.948358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:34.975684 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-964bcbb5-7abb-470e-81de-887016d95763 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.493248 Nov 20 21:15:34.977514 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3324/6761] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:34 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:35.992863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:35.994496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:36.002990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:36.004444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:36.005687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:36.006308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:36.382691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:36.396060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0ef165b-9383-4bf9-a8df-7536f959ea94 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.406824 Nov 20 21:15:36.397648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3438/6762] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:35 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:37.418708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:37.420648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:37.427971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:37.432782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:37.433655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:37.434129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:37.943071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:37.952076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb3e6230-e3a5-49c5-8844-36a79b188826 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.541081 Nov 20 21:15:37.953123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3325/6763] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:37 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:38.163449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-05da47ee-9922-4ceb-81cb-a2e8994024fe req-f080d1a5-0366-4ff0-84ed-e6ab686bfcae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5346d6-8241-4f81-8667-a0b3b50892c8", "name": "network-vif-plugged", "status": "completed", "tag": "14939fc5-d132-43ee-8d7c-51cbc479909e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:38.165561 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:38.165561 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:15:38.183016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-05da47ee-9922-4ceb-81cb-a2e8994024fe req-f080d1a5-0366-4ff0-84ed-e6ab686bfcae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:38.183873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-05da47ee-9922-4ceb-81cb-a2e8994024fe req-f080d1a5-0366-4ff0-84ed-e6ab686bfcae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:38.196331 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-05da47ee-9922-4ceb-81cb-a2e8994024fe req-f080d1a5-0366-4ff0-84ed-e6ab686bfcae service nova] Creating event network-vif-plugged:14939fc5-d132-43ee-8d7c-51cbc479909e for instance bd5346d6-8241-4f81-8667-a0b3b50892c8 on nch1-master-1 Nov 20 21:15:38.201737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-05da47ee-9922-4ceb-81cb-a2e8994024fe req-f080d1a5-0366-4ff0-84ed-e6ab686bfcae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042627 Nov 20 21:15:38.202915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3439/6764] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:38.969903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:38.972223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:38.984709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:38.985559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:38.986764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:38.987323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:39.327644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:39.348980 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1725577-8174-4cf3-b570-8fd2f67fc51d tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1314 microversion: 2.1 time: 0.383916 Nov 20 21:15:39.350489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3326/6765] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:38 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:40.369415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:40.370138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:40.383890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:40.384348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:40.389063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:40.389580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:40.913051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:40.939774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f015484d-871b-428d-955e-590135abd378 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1498 microversion: 2.1 time: 0.570972 Nov 20 21:15:40.941865 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3440/6766] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:40 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1498 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:41.611755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:41.612903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:41.620827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:41.621502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:41.623087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:41.623683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:41.654237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:15:41.877735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c4100ce-ded0-4158-87a9-b3d6ccd11f49 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 204 len: 0 microversion: 2.1 time: 0.256435 Nov 20 21:15:41.886326 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3327/6767] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:15:41 2021] DELETE /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:15:41.891259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:41.891888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:41.904876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:41.905450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:41.906325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:41.907745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:42.419166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:42.428995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57468332-ef7a-45fc-a14a-a7ec8d887476 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1504 microversion: 2.1 time: 0.541641 Nov 20 21:15:42.432038 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3441/6768] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:41 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:43.450183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:43.450965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:43.469670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:43.469670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:43.470266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:43.470714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:44.074023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:44.089301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64beeedc-7b59-4c4c-af9e-b6f447752daa tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1504 microversion: 2.1 time: 0.643127 Nov 20 21:15:44.090370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3328/6769] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:43 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1504 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:45.111845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:45.112645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:45.135457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:45.135927 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:45.140775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:45.149010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:45.313453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a47a9f9d-ac92-4903-abca-7beba221eea8 req-12bade9d-8db4-4639-9acb-151b3ab22d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd5346d6-8241-4f81-8667-a0b3b50892c8", "name": "network-vif-deleted", "tag": "14939fc5-d132-43ee-8d7c-51cbc479909e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:45.315255 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:45.315255 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:45.342365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a47a9f9d-ac92-4903-abca-7beba221eea8 req-12bade9d-8db4-4639-9acb-151b3ab22d8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:45.346217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a47a9f9d-ac92-4903-abca-7beba221eea8 req-12bade9d-8db4-4639-9acb-151b3ab22d8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:45.392330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a47a9f9d-ac92-4903-abca-7beba221eea8 req-12bade9d-8db4-4639-9acb-151b3ab22d8a service nova] Creating event network-vif-deleted:14939fc5-d132-43ee-8d7c-51cbc479909e for instance bd5346d6-8241-4f81-8667-a0b3b50892c8 on nch1-master-1 Nov 20 21:15:45.422433 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a47a9f9d-ac92-4903-abca-7beba221eea8 req-12bade9d-8db4-4639-9acb-151b3ab22d8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111925 Nov 20 21:15:45.425506 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3329/6770] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:45.483729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:45.520914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa477dd5-86c9-4707-854f-d54eb5f934cf tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 200 len: 1462 microversion: 2.1 time: 0.416841 Nov 20 21:15:45.529750 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3442/6771] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:45 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 1462 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:46.553777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:46.555702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: bd5346d6-8241-4f81-8667-a0b3b50892c8] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:46.570651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:46.571110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:46.575987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:46.578291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:46.609165 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] HTTP exception thrown: Instance bd5346d6-8241-4f81-8667-a0b3b50892c8 could not be found. Nov 20 21:15:46.610134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Returning 404 to user: Instance bd5346d6-8241-4f81-8667-a0b3b50892c8 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:15:46.613506 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18ec3f42-d99a-4b49-8b2b-bc0942002cc4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8" status: 404 len: 111 microversion: 2.1 time: 0.064353 Nov 20 21:15:46.625692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3330/6772] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:46 2021] GET /compute/v2.1/servers/bd5346d6-8241-4f81-8667-a0b3b50892c8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:15:46.800115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-567422375", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "3a62d484-6489-47c9-ba52-8505cab4c721"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:46.895290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] validate_networks() for [('3a62d484-6489-47c9-ba52-8505cab4c721', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:15:47.874205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:15:47.875517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:15:47.877027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:15:47.878335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:15:47.879331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:15:47.892740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:47.893600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:47.895067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:47.895612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:47.923019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Getting quotas for project b60cf19d51fe41e1bf404c33f632f316. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:15:47.930654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Getting quotas for user ccbf66394d904a7da5bf30711802de54 and project b60cf19d51fe41e1bf404c33f632f316. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:15:47.948276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:15:47.948276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:15:48.004190 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7758c55-bf92-400b-9954-ae3fabfa9991 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208016 Nov 20 21:15:48.015322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df0cb862-0b96-4e53-baa8-710e18b0a3fd tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:48.015937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df0cb862-0b96-4e53-baa8-710e18b0a3fd tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:48.020552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3443/6773] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:15:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:15:48.106836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-df0cb862-0b96-4e53-baa8-710e18b0a3fd tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:48.117845 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df0cb862-0b96-4e53-baa8-710e18b0a3fd tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1213 microversion: 2.1 time: 0.106765 Nov 20 21:15:48.129596 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3331/6774] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:48 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:49.136181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:49.136775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:49.147363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:49.147911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:49.149509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:49.150452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:49.298507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:49.324064 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f31f93f-7c2d-4918-bc3a-75dd97589dfb tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1265 microversion: 2.1 time: 0.188119 Nov 20 21:15:49.324775 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3444/6775] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:49 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:50.345994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:50.347299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:50.364500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:50.365333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:50.367154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:50.368443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:50.592386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:50.603379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-03dee030-ac77-4416-b561-f0b61f18c84f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1271 microversion: 2.1 time: 0.262780 Nov 20 21:15:50.607123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3332/6776] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:50 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1271 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:15:51.620897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:51.622749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:51.643791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:51.644508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:51.645539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:51.648812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:52.379355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:52.392437 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e03ba1c3-31c3-4270-b360-a1e5dc0dfb30 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.775286 Nov 20 21:15:52.393058 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3445/6777] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:51 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:52.629128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a75b6264-d59b-494c-a0d7-f8c164dc9e88 req-0d948918-d211-4f4f-a2f8-5aa95156f76d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30fed06-da93-4e0e-8d5f-3ad992427cc5", "tag": "16f40acc-9914-4195-9d9a-e5e98924c577"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:15:52.630725 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:15:52.630725 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:15:52.648672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a75b6264-d59b-494c-a0d7-f8c164dc9e88 req-0d948918-d211-4f4f-a2f8-5aa95156f76d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:52.655322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a75b6264-d59b-494c-a0d7-f8c164dc9e88 req-0d948918-d211-4f4f-a2f8-5aa95156f76d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:52.680240 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a75b6264-d59b-494c-a0d7-f8c164dc9e88 req-0d948918-d211-4f4f-a2f8-5aa95156f76d service nova] Creating event network-changed:16f40acc-9914-4195-9d9a-e5e98924c577 for instance f30fed06-da93-4e0e-8d5f-3ad992427cc5 on nch2-master-1 Nov 20 21:15:52.688804 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a75b6264-d59b-494c-a0d7-f8c164dc9e88 req-0d948918-d211-4f4f-a2f8-5aa95156f76d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066153 Nov 20 21:15:52.690146 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3333/6778] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:15:53.410041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:53.411519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:53.425273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:53.426186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:53.427213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:53.428505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:54.315155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:54.322890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f61262a-421a-46ed-9145-c1c125bc56f0 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.917331 Nov 20 21:15:54.323479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3446/6779] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:53 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:55.353772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:55.355257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:55.367648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:55.369061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:55.371574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:55.373075 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:56.286711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:56.301225 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-446758fb-c0a2-4958-b0af-8fe74928d352 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.957420 Nov 20 21:15:56.303295 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3334/6780] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:55 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:57.322287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:57.323903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:57.342545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:57.343132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:57.345409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:57.347635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:57.826484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:15:57.842393 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-55a46e32-73d7-4a8c-8f0f-92c850ab422e tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.522022 Nov 20 21:15:57.843879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3447/6781] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:57 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:15:58.860749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:15:58.861371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:15:58.878347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:58.881598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:15:58.882602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:15:58.883044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:00.251467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:00.260252 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9aac84bc-6128-4532-b3a7-f2755e10ad5f tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 1.404398 Nov 20 21:16:00.273247 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3335/6782] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:15:58 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:01.277342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:01.277966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:01.292264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:01.292726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:01.293551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:01.297997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:01.598096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:01.607163 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d302346e-1fdb-4c5e-8d65-3cfbd33ed846 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.334175 Nov 20 21:16:01.610187 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3448/6783] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:01 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:02.233588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1653e030-d3f7-4983-8cbf-720267e349ee req-83e95f47-2725-469a-8bed-1d319acf84f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30fed06-da93-4e0e-8d5f-3ad992427cc5", "name": "network-vif-plugged", "status": "completed", "tag": "16f40acc-9914-4195-9d9a-e5e98924c577"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:02.238587 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:02.238587 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:16:02.256574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1653e030-d3f7-4983-8cbf-720267e349ee req-83e95f47-2725-469a-8bed-1d319acf84f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:02.257145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1653e030-d3f7-4983-8cbf-720267e349ee req-83e95f47-2725-469a-8bed-1d319acf84f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:02.277006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1653e030-d3f7-4983-8cbf-720267e349ee req-83e95f47-2725-469a-8bed-1d319acf84f2 service nova] Creating event network-vif-plugged:16f40acc-9914-4195-9d9a-e5e98924c577 for instance f30fed06-da93-4e0e-8d5f-3ad992427cc5 on nch2-master-1 Nov 20 21:16:02.284109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1653e030-d3f7-4983-8cbf-720267e349ee req-83e95f47-2725-469a-8bed-1d319acf84f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067155 Nov 20 21:16:02.284949 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3336/6784] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:02.629990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:02.631203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:02.646968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:02.647595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:02.648580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:02.649164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:03.022899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:03.032796 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ac4fe23-7768-4130-92da-d1094a9f6ab1 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1313 microversion: 2.1 time: 0.411106 Nov 20 21:16:03.033830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3449/6785] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:02 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:04.009931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-311349054", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "addd3daf-d0c7-4498-8cb0-fefe0954833b", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:04.050724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:04.051462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:04.058423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.058865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.060382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.061028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.100230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:16:04.265782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:04.275883 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-16faa4e9-2b6b-4fbf-a23b-5629380a72fe tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1496 microversion: 2.1 time: 0.228595 Nov 20 21:16:04.277806 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3450/6786] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:04 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1496 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:04.807804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:04.808619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:04.821729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.822794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.824395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.825214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.862202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:16:04.914283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:16:04.914968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:16:04.915541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:16:04.916019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:16:04.916445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:16:04.935329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.935894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.938559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:04.939012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:04.985762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:16:04.994792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:16:05.004409 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0cfd916e-0488-4288-aee8-e6bd323428b3 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 204 len: 0 microversion: 2.1 time: 0.200616 Nov 20 21:16:05.005359 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3451/6787] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:16:04 2021] DELETE /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:16:05.019623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:05.020607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:05.031354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:05.031811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:05.032612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:05.033051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:05.034769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:16:05.037498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='addd3daf-d0c7-4498-8cb0-fefe0954833b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:16:05.128755 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d091edb-a9cf-4deb-b1a5-6356ba5c3b10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122918 Nov 20 21:16:05.129423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3337/6788] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:16:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:16:05.139209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5500d41e-e096-4b0c-b43e-5bc937365189 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:05.139824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5500d41e-e096-4b0c-b43e-5bc937365189 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:05.212058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5500d41e-e096-4b0c-b43e-5bc937365189 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:05.220134 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5500d41e-e096-4b0c-b43e-5bc937365189 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1056 microversion: 2.1 time: 0.084515 Nov 20 21:16:05.221368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3338/6789] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:05 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1056 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:05.312415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:05.332581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe20278a-cc38-492c-be86-3745a1cc2370 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1502 microversion: 2.1 time: 0.322572 Nov 20 21:16:05.333221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3452/6790] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:05 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:06.237261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:06.237954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:06.249472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:06.252902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:06.255932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:06.256552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:06.353225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:06.353829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:06.368491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:06.375005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:06.377829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:06.378865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:06.380877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:06.381279 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-952d4501-8fc1-4b85-b817-22a4ea2ef9ba tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1108 microversion: 2.1 time: 0.146316 Nov 20 21:16:06.382632 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3339/6791] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:06 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1108 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:06.784862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:06.804585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b5a53446-f6cd-47e2-91dc-32e5dd8356e4 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1502 microversion: 2.1 time: 0.457285 Nov 20 21:16:06.805824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3453/6792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:06 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1502 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:07.368446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-35450972-f743-4c5c-8064-73f0f32badd2 req-a08f975a-4cae-4dc7-9f7d-eefbbb09c54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30fed06-da93-4e0e-8d5f-3ad992427cc5", "name": "network-vif-deleted", "tag": "16f40acc-9914-4195-9d9a-e5e98924c577"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:07.370023 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:07.370023 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:16:07.398266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-35450972-f743-4c5c-8064-73f0f32badd2 req-a08f975a-4cae-4dc7-9f7d-eefbbb09c54c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.399006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-35450972-f743-4c5c-8064-73f0f32badd2 req-a08f975a-4cae-4dc7-9f7d-eefbbb09c54c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.401395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:07.402070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:07.411284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.412391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.413515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.414463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.441481 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-35450972-f743-4c5c-8064-73f0f32badd2 req-a08f975a-4cae-4dc7-9f7d-eefbbb09c54c service nova] Creating event network-vif-deleted:16f40acc-9914-4195-9d9a-e5e98924c577 for instance f30fed06-da93-4e0e-8d5f-3ad992427cc5 on nch2-master-1 Nov 20 21:16:07.460140 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-35450972-f743-4c5c-8064-73f0f32badd2 req-a08f975a-4cae-4dc7-9f7d-eefbbb09c54c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093999 Nov 20 21:16:07.462176 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3340/6793] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:07.507239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:07.522773 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab722283-f1fd-48a0-849d-2217b55cfedf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1126 microversion: 2.1 time: 0.126780 Nov 20 21:16:07.526816 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3454/6794] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:07 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1126 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:07.823792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:07.824438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:07.831919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.832369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.833169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.833607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.878779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:07.879241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:07.879709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lazy-loading 'fault' on Instance uuid f30fed06-da93-4e0e-8d5f-3ad992427cc5 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:16:08.035816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccbf66394d904a7da5bf30711802de54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60cf19d51fe41e1bf404c33f632f316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:08.043254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94b88c3c-d27a-4337-b0ed-0eb856eea3b5 tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 200 len: 1303 microversion: 2.1 time: 0.224820 Nov 20 21:16:08.054303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3341/6795] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:07 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 1303 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:08.543400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:08.544061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:08.551099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:08.551836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:08.552655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:08.553095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:08.847429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:08.855924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0541e5f4-b2e1-4dd9-990f-2890912db032 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1168 microversion: 2.1 time: 0.316089 Nov 20 21:16:08.856749 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3455/6796] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:08 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1168 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:09.061840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:09.063313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] [instance: f30fed06-da93-4e0e-8d5f-3ad992427cc5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:09.071297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:09.071754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:09.072803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:09.073237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:09.092542 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] HTTP exception thrown: Instance f30fed06-da93-4e0e-8d5f-3ad992427cc5 could not be found. Nov 20 21:16:09.092834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] Returning 404 to user: Instance f30fed06-da93-4e0e-8d5f-3ad992427cc5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:16:09.093718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ca2c196-0233-4e2f-9026-3c9f98b580ab tempest-VolumesActionsTest-1676956077 tempest-VolumesActionsTest-1676956077-project] 10.222.0.41 "GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5" status: 404 len: 111 microversion: 2.1 time: 0.036742 Nov 20 21:16:09.094580 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3342/6797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:09 2021] GET /compute/v2.1/servers/f30fed06-da93-4e0e-8d5f-3ad992427cc5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:16:09.293405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1796f3d8-5014-49a7-b80b-1d49a2fe1a66 req-6dd38b92-8a9d-47d1-9391-f3353822494b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0220ad84-e8df-421f-abf0-42e80c0c2be3", "tag": "d85eaa00-8240-4c27-b734-0d3bd3d51aa2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:09.295407 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:09.295407 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:09.307190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1796f3d8-5014-49a7-b80b-1d49a2fe1a66 req-6dd38b92-8a9d-47d1-9391-f3353822494b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:09.314881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1796f3d8-5014-49a7-b80b-1d49a2fe1a66 req-6dd38b92-8a9d-47d1-9391-f3353822494b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:09.337657 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1796f3d8-5014-49a7-b80b-1d49a2fe1a66 req-6dd38b92-8a9d-47d1-9391-f3353822494b service nova] Creating event network-changed:d85eaa00-8240-4c27-b734-0d3bd3d51aa2 for instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 on nch1-master-1 Nov 20 21:16:09.359481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1796f3d8-5014-49a7-b80b-1d49a2fe1a66 req-6dd38b92-8a9d-47d1-9391-f3353822494b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068501 Nov 20 21:16:09.359481 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3456/6798] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:09.874103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:09.875173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:09.881575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:09.882417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:09.884156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:09.884967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:10.257979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:10.275598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f42504fd-60a3-41f1-afab-26602fd42ab5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1168 microversion: 2.1 time: 0.406872 Nov 20 21:16:10.276201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3343/6799] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:09 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1168 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:11.292964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:11.293638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:11.308924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:11.310357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:11.311373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:11.313135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:11.827817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:11.837366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d11b0d1-dc9c-4cf8-b592-2d7060d6c6b5 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1214 microversion: 2.1 time: 0.548402 Nov 20 21:16:11.851394 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3457/6800] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:11 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1214 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:12.861143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:12.862615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:12.885560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:12.886029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:12.894296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:12.895890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:13.156270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:13.168346 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a33c41ca-2581-4907-8778-b3e6eac4ac9a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1202 microversion: 2.1 time: 0.315081 Nov 20 21:16:13.170830 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3344/6801] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:12 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1202 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:14.187262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:14.189055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:14.197691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:14.204529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:14.205377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:14.205826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:14.480342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:14.490308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2293fbd8-c4d9-4986-b231-e1e363278725 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1202 microversion: 2.1 time: 0.307120 Nov 20 21:16:14.497321 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3458/6802] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:14 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1202 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:15.513996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:15.514567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:15.528017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:15.529371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:15.532129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:15.532578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:15.819793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:15.827838 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-77b80087-242f-41de-ad69-8d55dbd78b35 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1202 microversion: 2.1 time: 0.318438 Nov 20 21:16:15.834978 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3345/6803] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:15 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1202 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:16.424032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0cc5d253-28c9-4f96-a628-6f0b454f5021 req-d5658050-d287-4275-8527-cb3f00647233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0220ad84-e8df-421f-abf0-42e80c0c2be3", "name": "network-vif-plugged", "status": "completed", "tag": "d85eaa00-8240-4c27-b734-0d3bd3d51aa2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:16.426626 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:16.426626 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:16.434860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0cc5d253-28c9-4f96-a628-6f0b454f5021 req-d5658050-d287-4275-8527-cb3f00647233 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:16.435311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0cc5d253-28c9-4f96-a628-6f0b454f5021 req-d5658050-d287-4275-8527-cb3f00647233 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:16.483977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0cc5d253-28c9-4f96-a628-6f0b454f5021 req-d5658050-d287-4275-8527-cb3f00647233 service nova] Creating event network-vif-plugged:d85eaa00-8240-4c27-b734-0d3bd3d51aa2 for instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 on nch1-master-1 Nov 20 21:16:16.493641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0cc5d253-28c9-4f96-a628-6f0b454f5021 req-d5658050-d287-4275-8527-cb3f00647233 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072052 Nov 20 21:16:16.494725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3459/6804] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:16.845766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:16.848074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:16.856959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:16.857506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:16.858790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:16.859469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:17.092694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:17.104389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4dd2302e-7cac-46b3-aa8b-ff6c18a4d71a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1202 microversion: 2.1 time: 0.262740 Nov 20 21:16:17.105201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3346/6805] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:16 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1202 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:18.123585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:18.125069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:18.135491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.136712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:18.138501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.139297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:18.460567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:18.472801 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff0ca524-0085-43cf-a60a-27a5f0188859 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1388 microversion: 2.1 time: 0.355613 Nov 20 21:16:18.487444 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3460/6806] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:18 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1388 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:18.493861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:18.496530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:18.519168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.521054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:18.525713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.527158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:18.880018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:18.892317 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91d21f24-57f1-4a2c-9d2c-5303288b0937 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1388 microversion: 2.1 time: 0.403578 Nov 20 21:16:18.893714 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3347/6807] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:18 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1388 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:18.912761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:18.913675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:18.938923 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.939659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:18.942444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:18.944296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:19.272548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:19.280812 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22e6d794-e0af-49e2-9ac2-1c14224b0fa7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1388 microversion: 2.1 time: 0.374572 Nov 20 21:16:19.284260 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3461/6808] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:18 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1388 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:19.388510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:19.389655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:19.397474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:19.398190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:19.399213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:19.399653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:19.446502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:16:19.645228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-66175c27-ffcb-4397-90b9-4eab84faaa6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 204 len: 0 microversion: 2.1 time: 0.260308 Nov 20 21:16:19.652531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3348/6809] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:16:19 2021] DELETE /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:16:19.655533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:19.656281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:19.664101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:19.665266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:19.670985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:19.671938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:19.953946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:19.967617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd69fb76-21d0-44db-b919-3a19404e1fff tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1394 microversion: 2.1 time: 0.316113 Nov 20 21:16:19.969421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3462/6810] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:19 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1394 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:20.989000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:20.990404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:21.004240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:21.005105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:21.007610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:21.008071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:21.408458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:21.424750 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0314ad66-fae6-438b-848a-54db92419b0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1394 microversion: 2.1 time: 0.440413 Nov 20 21:16:21.425362 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3349/6811] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:20 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1394 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:22.185468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5aba179c-b9ff-4cc6-8dbb-fca1154d0e08 req-9b1a8c61-d94a-405c-9554-e0fefcc63430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0220ad84-e8df-421f-abf0-42e80c0c2be3", "name": "network-vif-deleted", "tag": "d85eaa00-8240-4c27-b734-0d3bd3d51aa2"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:22.187439 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:22.187439 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:22.216669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5aba179c-b9ff-4cc6-8dbb-fca1154d0e08 req-9b1a8c61-d94a-405c-9554-e0fefcc63430 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:22.226870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5aba179c-b9ff-4cc6-8dbb-fca1154d0e08 req-9b1a8c61-d94a-405c-9554-e0fefcc63430 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:22.279533 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5aba179c-b9ff-4cc6-8dbb-fca1154d0e08 req-9b1a8c61-d94a-405c-9554-e0fefcc63430 service nova] Creating event network-vif-deleted:d85eaa00-8240-4c27-b734-0d3bd3d51aa2 for instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 on nch1-master-1 Nov 20 21:16:22.291056 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5aba179c-b9ff-4cc6-8dbb-fca1154d0e08 req-9b1a8c61-d94a-405c-9554-e0fefcc63430 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117548 Nov 20 21:16:22.292896 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3463/6812] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:22.441161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:22.441777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:22.451038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:22.451470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:22.452313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:22.452721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:22.573133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:22.607799 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0eae9b48-849c-4c0f-967d-f96a30f514f7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 200 len: 1187 microversion: 2.1 time: 0.170246 Nov 20 21:16:22.609002 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3350/6813] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:22 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:23.631764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:23.633681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:23.657349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.661230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.666945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.668737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.712241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. Nov 20 21:16:23.714294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:16:23.718317 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e23d5560-3a1c-49d4-8ca2-b56c89ac124d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 404 len: 111 microversion: 2.1 time: 0.093856 Nov 20 21:16:23.720417 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3464/6814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:23 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:16:23.773386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:23.775680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:23.786447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.788169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.789922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.791582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.810242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. Nov 20 21:16:23.811175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:16:23.812197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7c69ee50-709e-4079-95de-70982568e3e7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 404 len: 111 microversion: 2.1 time: 0.044115 Nov 20 21:16:23.823975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:23.825613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 0220ad84-e8df-421f-abf0-42e80c0c2be3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:23.830630 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3351/6815] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:16:23 2021] DELETE /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:16:23.834321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.834956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.835908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:23.836957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:23.855390 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. Nov 20 21:16:23.856300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 0220ad84-e8df-421f-abf0-42e80c0c2be3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:16:23.857632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38cf254f-184e-4e76-a0f8-01aec4df2240 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3" status: 404 len: 111 microversion: 2.1 time: 0.039287 Nov 20 21:16:23.862809 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3465/6816] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:23 2021] GET /compute/v2.1/servers/0220ad84-e8df-421f-abf0-42e80c0c2be3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:16:30.382382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-286829324", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c8ebc1cb-1b9f-4042-95e4-e9b0f9b55411", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:30.501365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:16:31.251413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:16:31.253224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:16:31.253979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:16:31.254643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:16:31.255409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:16:31.275038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:31.275509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:31.276849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:31.277391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:31.304200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:16:31.310918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:16:31.415180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:16:31.421540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8ebc1cb-1b9f-4042-95e4-e9b0f9b55411',volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:16:31.624060 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0f4fe43-9300-4a71-8a0e-0f6d3fd46136 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245354 Nov 20 21:16:31.624909 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3352/6817] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:16:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:16:31.634921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-18e6f84f-db42-420c-9554-fc5146349d29 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:31.635784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-18e6f84f-db42-420c-9554-fc5146349d29 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:31.767908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-18e6f84f-db42-420c-9554-fc5146349d29 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:31.775018 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-18e6f84f-db42-420c-9554-fc5146349d29 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1070 microversion: 2.1 time: 0.143858 Nov 20 21:16:31.779583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3466/6818] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:31 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1070 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:32.793526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:32.794850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:32.806248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:32.807063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:32.808107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:32.808802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:32.929354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:32.939868 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1cdf57b0-f9aa-4e5f-a342-5a95c4a7e293 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1168 microversion: 2.1 time: 0.148941 Nov 20 21:16:32.942300 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3353/6819] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:32 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:33.956672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:33.957245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:33.966711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:33.967164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:33.967966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:33.968404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:34.773624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:34.786160 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0224aa29-8dd8-4ff8-9670-b91c0dd6eb28 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1228 microversion: 2.1 time: 0.828789 Nov 20 21:16:34.786924 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3467/6820] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:33 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1228 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:35.809544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:35.811010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:35.826168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:35.829293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:35.830524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:35.831608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:36.612259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-decb1dfe-d4d0-4212-b69c-72e61166195d req-1cc46126-f659-4960-ac7a-526a68846dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747866d7-cba0-4d23-b826-7358ef315186", "tag": "c3608607-34e9-4165-a57b-a8a271630dad"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:36.613779 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:36.613779 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:36.617882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:36.629831 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-18d72dd4-2ead-4c73-93b7-6860a033ae33 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.829029 Nov 20 21:16:36.630531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3354/6821] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:35 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:36.632965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-decb1dfe-d4d0-4212-b69c-72e61166195d req-1cc46126-f659-4960-ac7a-526a68846dee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:36.633626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-decb1dfe-d4d0-4212-b69c-72e61166195d req-1cc46126-f659-4960-ac7a-526a68846dee service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:36.662000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-decb1dfe-d4d0-4212-b69c-72e61166195d req-1cc46126-f659-4960-ac7a-526a68846dee service nova] Creating event network-changed:c3608607-34e9-4165-a57b-a8a271630dad for instance 747866d7-cba0-4d23-b826-7358ef315186 on nch2-master-1 Nov 20 21:16:36.669934 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-decb1dfe-d4d0-4212-b69c-72e61166195d req-1cc46126-f659-4960-ac7a-526a68846dee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064819 Nov 20 21:16:36.670773 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3468/6822] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:37.648261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:37.649275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:37.664148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:37.669793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:37.676862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:37.677547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:38.028028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:38.037816 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9e2e666-f60b-4220-93ee-77b53f799235 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.393201 Nov 20 21:16:38.038450 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3355/6823] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:37 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:39.058832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:39.059454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:39.086561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:39.087039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:39.087873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:39.088318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:39.310818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:39.319617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-92139948-dde5-4008-bbd0-d4e92adec41e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.266742 Nov 20 21:16:39.320720 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3469/6824] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:39 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:40.341802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:40.342469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:40.354576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:40.357540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:40.358584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:40.359183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:40.619046 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:40.640614 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-575b33e9-6b70-4fca-a9c9-1bc9516e9521 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.297716 Nov 20 21:16:40.643686 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3356/6825] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:40 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:41.663554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:41.664341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:41.675459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:41.676224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:41.677369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:41.677991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:41.932480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:41.940563 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e80b6cdb-5ecb-4a28-b6d3-b6620899a292 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.283211 Nov 20 21:16:41.941777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3470/6826] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:41 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:42.959854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:42.961843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:42.973263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:42.973934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:42.975189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:42.975771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:43.240820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:43.259893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1638f124-2ba4-42c8-a82e-3b9652b07c16 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.303773 Nov 20 21:16:43.260865 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3357/6827] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:42 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:43.990967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-bc37617f-a50e-4429-a5d0-261ec73b2d06 req-e1b019d5-4a74-4daf-bae0-d4068bd83432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747866d7-cba0-4d23-b826-7358ef315186", "name": "network-vif-plugged", "status": "completed", "tag": "c3608607-34e9-4165-a57b-a8a271630dad"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:43.993512 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:43.993512 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:44.000988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bc37617f-a50e-4429-a5d0-261ec73b2d06 req-e1b019d5-4a74-4daf-bae0-d4068bd83432 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:44.001877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bc37617f-a50e-4429-a5d0-261ec73b2d06 req-e1b019d5-4a74-4daf-bae0-d4068bd83432 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:44.014947 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-bc37617f-a50e-4429-a5d0-261ec73b2d06 req-e1b019d5-4a74-4daf-bae0-d4068bd83432 service nova] Creating event network-vif-plugged:c3608607-34e9-4165-a57b-a8a271630dad for instance 747866d7-cba0-4d23-b826-7358ef315186 on nch2-master-1 Nov 20 21:16:44.020502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-bc37617f-a50e-4429-a5d0-261ec73b2d06 req-e1b019d5-4a74-4daf-bae0-d4068bd83432 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228880 Nov 20 21:16:44.020889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3471/6828] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:16:44.276848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:44.277677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:44.284203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:44.284663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:44.285612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:44.286161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:44.638016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:44.646462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a064dcdb-e276-402b-9c4c-9906bff3d8fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1216 microversion: 2.1 time: 0.373465 Nov 20 21:16:44.657783 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3358/6829] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:44 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1216 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:45.671446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:45.673369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:45.680722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:45.681419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:45.682418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:45.683006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:45.990682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:45.999426 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73958b68-1e8b-47e4-9eb3-1252c30be089 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1403 microversion: 2.1 time: 0.339087 Nov 20 21:16:46.003550 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3472/6830] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:45 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1403 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:46.020207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:46.020828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:46.029627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:46.030467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:46.031518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:46.032182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:46.330261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:46.343001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da83bd53-58d2-4e88-b3ca-5572b5bea191 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1403 microversion: 2.1 time: 0.326793 Nov 20 21:16:46.343854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3359/6831] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:46 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1403 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:46.361424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1668345432"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:46.362967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:46.369295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:46.369908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:46.371615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:46.372299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:46.492924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.api [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Attempting to quiesce instance before volume snapshot. Nov 20 21:16:46.548850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.api [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 20 21:16:46.649153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Creating snapshot from volume c8ebc1cb-1b9f-4042-95e4-e9b0f9b55411. {{(pid=140941) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Nov 20 21:16:47.867922 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ab566bc2-ac5a-4fd2-9f8c-330742e9f925 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186/action" status: 202 len: 0 microversion: 2.1 time: 1.511341 Nov 20 21:16:47.870007 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3473/6832] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:16:46 2021] POST /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186/action => generated 0 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 21:16:48.096958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1043662152", "imageRef": "92f03612-f5dd-4d91-ac05-922f0dd1d445", "flavorRef": "452", "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:48.184970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:16:48.298621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-33844533", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:48.381872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] validate_networks() for None {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:16:48.771463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:16:48.771898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:16:48.772530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:16:48.772950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:16:48.773528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:16:48.784712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:48.785204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:48.786090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:48.786534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:48.806560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:16:48.811622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:16:48.826375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:16:48.828816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='bdcca7d9-0af7-4910-9c78-35b3d732f3aa',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:16:48.905662 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c5e54fc6-e17d-4a59-a2bb-1ddfcc20c047 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812457 Nov 20 21:16:48.911601 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3360/6833] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:16:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:16:48.916612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07c52493-f91a-4890-992f-c16ba9036c26 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:48.917826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07c52493-f91a-4890-992f-c16ba9036c26 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:48.930198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:16:48.932632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:16:48.935699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:16:48.937828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:16:48.942259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:16:48.962134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:48.962850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:48.963908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:48.965134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:48.985848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-07c52493-f91a-4890-992f-c16ba9036c26 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:48.989539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Getting quotas for project dc4d63fc40064a2d878ef88ce3e98e07. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:16:48.994113 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07c52493-f91a-4890-992f-c16ba9036c26 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1230 microversion: 2.1 time: 0.081125 Nov 20 21:16:48.996779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Getting quotas for user abd2d201b3fa47a6b511c6d0d2f44447 and project dc4d63fc40064a2d878ef88ce3e98e07. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:16:49.004925 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3361/6834] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:48 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1230 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:49.011682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:16:49.014528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:16:49.072915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94da8627-b5f8-4204-a984-b54de5c57ac6 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782497 Nov 20 21:16:49.074300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3474/6835] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:16:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:16:49.085053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6616e21d-e6cc-4094-a3d6-3cc1b9bdaf4e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:49.085931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6616e21d-e6cc-4094-a3d6-3cc1b9bdaf4e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:49.178305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6616e21d-e6cc-4094-a3d6-3cc1b9bdaf4e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:49.187532 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6616e21d-e6cc-4094-a3d6-3cc1b9bdaf4e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1212 microversion: 2.1 time: 0.106789 Nov 20 21:16:49.188693 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3362/6836] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:49 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1212 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:50.012094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:50.012718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:50.019742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:50.020210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:50.021037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:50.021488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:50.154489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:50.161980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e24a593-b82c-4ed7-becb-95ef66c77db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1282 microversion: 2.1 time: 0.153887 Nov 20 21:16:50.162836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3475/6837] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:50 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:50.204405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:50.205015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:50.222279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:50.228316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:50.229205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:50.229659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:50.333497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:50.341643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9a9179e1-f8fa-4f6f-99e0-e372cbab2783 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1208 microversion: 2.1 time: 0.140920 Nov 20 21:16:50.342252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3363/6838] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:50 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1208 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:51.182907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:51.184245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:51.203345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:51.204216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:51.206453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:51.208448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:51.368549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:51.371267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:51.391091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:51.395591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:51.397327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:51.399126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:51.416637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:51.427694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d662f818-3912-40fc-bc6f-2a34ee36d9d7 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1300 microversion: 2.1 time: 0.250208 Nov 20 21:16:51.428495 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3476/6839] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:51 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1300 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:51.596737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:51.607873 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-524dc085-37d0-42db-9d4c-b2b81745936d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1270 microversion: 2.1 time: 0.251480 Nov 20 21:16:51.609423 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3364/6840] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:51 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1270 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:52.448119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:52.448968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:52.466543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:52.470803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:52.473489 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:52.476647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:52.627006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:52.628180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:52.637612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:52.638311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:52.639362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:52.640058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:52.768889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:52.779642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-503fbe96-0c81-4ffd-b652-92b83684aeb9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1270 microversion: 2.1 time: 0.157573 Nov 20 21:16:52.783022 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3365/6841] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:52 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:52.881700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:52.894259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ef9d561-be61-47b9-a51e-442de809f2f1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1342 microversion: 2.1 time: 0.451407 Nov 20 21:16:52.905632 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3477/6842] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:52 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1342 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:53.798927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:53.799561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:53.814653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:53.815207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:53.821498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:53.821991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:53.911911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:53.913127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:53.932108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:53.932584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:53.933830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:53.935120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:54.307384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:54.332795 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9894afab-66c5-4ac0-ac91-4677aa4d2f1b tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.537872 Nov 20 21:16:54.334831 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3366/6843] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:53 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:54.932794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c63780ed-6371-4083-ba64-88582fe24ac0 req-c7d55cbf-60df-4300-82dc-bb57a8ae46c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb401e0c-e20d-4cae-9584-6c799fb339cc", "tag": "19de894d-4c5d-4143-8a3e-4af0e7fd6160"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:54.937200 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:54.937200 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:16:54.956898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c63780ed-6371-4083-ba64-88582fe24ac0 req-c7d55cbf-60df-4300-82dc-bb57a8ae46c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:54.957462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c63780ed-6371-4083-ba64-88582fe24ac0 req-c7d55cbf-60df-4300-82dc-bb57a8ae46c5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:54.987180 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c63780ed-6371-4083-ba64-88582fe24ac0 req-c7d55cbf-60df-4300-82dc-bb57a8ae46c5 service nova] Creating event network-changed:19de894d-4c5d-4143-8a3e-4af0e7fd6160 for instance fb401e0c-e20d-4cae-9584-6c799fb339cc on nch1-master-1 Nov 20 21:16:55.008994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c63780ed-6371-4083-ba64-88582fe24ac0 req-c7d55cbf-60df-4300-82dc-bb57a8ae46c5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.563458 Nov 20 21:16:55.012432 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3367/6844] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:16:55.085359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:55.094175 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b542deb2-e325-415d-831c-7b5130683514 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1342 microversion: 2.1 time: 1.185833 Nov 20 21:16:55.105362 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3478/6845] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:53 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1342 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:55.358256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:55.359565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:55.367505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:55.369326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:55.371693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:55.373530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:56.114600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:56.116080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:56.134402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:56.136074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:56.138789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:56.139861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:56.376186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:56.386659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c8e3966-aa43-4b7e-90b5-3a3520807cf1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1388 microversion: 2.1 time: 0.277362 Nov 20 21:16:56.387755 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3479/6846] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:56 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1388 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:56.391022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:56.400197 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fcf09f0-290a-457f-a107-ab808186d28f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 1.051831 Nov 20 21:16:56.401474 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3368/6847] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:55 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:57.142770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2f3f81a2-5e8f-4bfd-a8ce-44f76cd0e62c req-e5c84446-002e-4ce6-961e-7ddffcd28904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1818a1-6364-442a-9e38-1492ae3ab2df", "tag": "ac222e14-6807-4816-bbc0-08630a1b4779"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:16:57.147010 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:16:57.147010 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:16:57.164571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f3f81a2-5e8f-4bfd-a8ce-44f76cd0e62c req-e5c84446-002e-4ce6-961e-7ddffcd28904 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:57.165540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2f3f81a2-5e8f-4bfd-a8ce-44f76cd0e62c req-e5c84446-002e-4ce6-961e-7ddffcd28904 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:57.200654 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2f3f81a2-5e8f-4bfd-a8ce-44f76cd0e62c req-e5c84446-002e-4ce6-961e-7ddffcd28904 service nova] Creating event network-changed:ac222e14-6807-4816-bbc0-08630a1b4779 for instance 4a1818a1-6364-442a-9e38-1492ae3ab2df on nch1-master-1 Nov 20 21:16:57.211481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2f3f81a2-5e8f-4bfd-a8ce-44f76cd0e62c req-e5c84446-002e-4ce6-961e-7ddffcd28904 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074988 Nov 20 21:16:57.215390 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3480/6848] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:16:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:16:57.406504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:57.408514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:57.420534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:57.421817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:57.440161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:57.440584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:57.441241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:57.442918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:57.443286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:57.445223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:57.446188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:57.447011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:57.896251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:57.916514 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cc16b2a-5543-4373-8630-8ef2be602def tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.500816 Nov 20 21:16:57.918706 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3481/6849] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:57 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:58.065932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:58.077867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2468a94e-7938-4dbb-9160-c77fa6e157f0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1376 microversion: 2.1 time: 0.677538 Nov 20 21:16:58.093084 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3369/6850] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:57 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1376 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:16:58.936076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:58.945811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:58.965164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:58.967544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:58.968694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:58.971471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:59.100571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:16:59.101788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:16:59.111731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:59.112393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:59.113262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:16:59.113867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:16:59.219812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:59.227712 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-494faca5-0afd-4866-8b77-18281732d25f tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.296405 Nov 20 21:16:59.228460 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3482/6851] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:58 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:16:59.397398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:16:59.408423 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-caf64881-290e-4422-b500-143f8e937431 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1376 microversion: 2.1 time: 0.311868 Nov 20 21:16:59.410641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3370/6852] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:16:59 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1376 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:17:00.244889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:00.246662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:00.255448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:00.256196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:00.257133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:00.257699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:00.426294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:00.427014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:00.440655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:00.441191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:00.442198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:00.442967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:00.786603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:00.797123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-573448c7-37e7-4171-8f79-41e15157d050 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1376 microversion: 2.1 time: 0.374700 Nov 20 21:17:00.800712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3371/6853] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:00 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1376 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:17:00.948264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:00.956998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e265146-6b52-49fb-9294-5c6499755cd4 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.716018 Nov 20 21:17:00.958100 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3483/6854] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:00 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:01.816735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:01.817348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:01.824835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:01.825544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:01.826741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:01.827330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:01.975770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:01.977069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:01.987537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:01.989023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:01.990005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:01.990653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:02.113479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:02.129600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5cdef7b-a6b4-4ca4-862f-01e96e99a9bc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1376 microversion: 2.1 time: 0.316457 Nov 20 21:17:02.130468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3372/6855] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:01 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1376 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:02.157721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:02.165309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce4bbe57-9a4f-4444-a229-a7439be5faf9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.194377 Nov 20 21:17:02.175489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3484/6856] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:01 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:02.828644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-380b9da7-7953-4b9e-8c1e-cdc3fd2b62dd req-5177c992-239d-4ff2-b790-965cbc133c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb401e0c-e20d-4cae-9584-6c799fb339cc", "name": "network-vif-plugged", "status": "completed", "tag": "19de894d-4c5d-4143-8a3e-4af0e7fd6160"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:02.831288 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:02.831288 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:17:02.842783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-380b9da7-7953-4b9e-8c1e-cdc3fd2b62dd req-5177c992-239d-4ff2-b790-965cbc133c99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:02.843735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-380b9da7-7953-4b9e-8c1e-cdc3fd2b62dd req-5177c992-239d-4ff2-b790-965cbc133c99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:02.857235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-380b9da7-7953-4b9e-8c1e-cdc3fd2b62dd req-5177c992-239d-4ff2-b790-965cbc133c99 service nova] Creating event network-vif-plugged:19de894d-4c5d-4143-8a3e-4af0e7fd6160 for instance fb401e0c-e20d-4cae-9584-6c799fb339cc on nch1-master-1 Nov 20 21:17:02.862583 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-380b9da7-7953-4b9e-8c1e-cdc3fd2b62dd req-5177c992-239d-4ff2-b790-965cbc133c99 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039295 Nov 20 21:17:02.863452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3373/6857] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:17:03.147199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:03.147738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:03.157630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:03.158589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:03.160611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:03.161279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:03.183477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:03.184319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:03.193955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:03.195939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:03.196759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:03.197223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:03.346741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:03.356188 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e1854a55-f873-4b3c-9186-76dbe5512907 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1376 microversion: 2.1 time: 0.213127 Nov 20 21:17:03.357083 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3485/6858] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:03 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1376 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:03.370794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:03.379631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e81072ae-15fc-4d85-91d4-eed76488abe1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.200643 Nov 20 21:17:03.380281 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3374/6859] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:03 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:04.380775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:04.382327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:04.399295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:04.400207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:04.407111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.407704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.409566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.410175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.420201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.421039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.421986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.432544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.583928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:04.592478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aaed1a98-a67c-4818-aa73-73aa87815a47 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.198787 Nov 20 21:17:04.593068 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3375/6860] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:04 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:04.652220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:04.668884 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89c78224-cfa5-4c9a-b489-6e966db24a3e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1562 microversion: 2.1 time: 0.298579 Nov 20 21:17:04.669798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3486/6861] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:04 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1562 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:04.685120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:04.685834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:04.694073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.694859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.695907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.696425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.887155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:04.895568 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25b4219b-66c6-4f00-b4b9-1f91b64237cf tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1562 microversion: 2.1 time: 0.214117 Nov 20 21:17:04.896330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3376/6862] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:04 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1562 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:04.905420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d58f881f-a6ed-44f6-a872-49ed9afe4b9c req-72313d96-5486-41b7-bb35-67fb62fa3173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1818a1-6364-442a-9e38-1492ae3ab2df", "name": "network-vif-plugged", "status": "completed", "tag": "ac222e14-6807-4816-bbc0-08630a1b4779"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:04.916589 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:04.916589 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:17:04.930014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d58f881f-a6ed-44f6-a872-49ed9afe4b9c req-72313d96-5486-41b7-bb35-67fb62fa3173 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:04.930499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d58f881f-a6ed-44f6-a872-49ed9afe4b9c req-72313d96-5486-41b7-bb35-67fb62fa3173 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:04.942554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d58f881f-a6ed-44f6-a872-49ed9afe4b9c req-72313d96-5486-41b7-bb35-67fb62fa3173 service nova] Creating event network-vif-plugged:ac222e14-6807-4816-bbc0-08630a1b4779 for instance 4a1818a1-6364-442a-9e38-1492ae3ab2df on nch1-master-1 Nov 20 21:17:04.948866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d58f881f-a6ed-44f6-a872-49ed9afe4b9c req-72313d96-5486-41b7-bb35-67fb62fa3173 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047310 Nov 20 21:17:04.949989 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3487/6863] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:17:04.992631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:04.993129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:04.999876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.000327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.001115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.001974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.038622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:17:05.140138 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70757f63-e9fa-4d12-a7bd-7477bd4f03b8 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 204 len: 0 microversion: 2.1 time: 0.150890 Nov 20 21:17:05.142092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3377/6864] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:17:04 2021] DELETE /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:17:05.150249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:05.151224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:05.159654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.160505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.161598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.162430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.459180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:05.468350 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed34c03c-c59c-494d-91df-0018a91c9099 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1568 microversion: 2.1 time: 0.322782 Nov 20 21:17:05.468945 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3488/6865] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:05 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:05.620050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:05.627626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:05.643599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.644088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.644970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:05.645413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:05.836429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:05.846479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8b13742d-db22-403d-8f2d-19b4f9ba00c9 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1312 microversion: 2.1 time: 0.240706 Nov 20 21:17:05.847920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3378/6866] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:05 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:06.487686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:06.489051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:06.560568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:06.561158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:06.563041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:06.563621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:06.867824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:06.869054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:06.876940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:06.877839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:06.879784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:06.880246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:06.887093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:06.903439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a557b1ca-87e4-4d56-a03f-126033f2a9ad tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1568 microversion: 2.1 time: 0.419883 Nov 20 21:17:06.928245 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3489/6867] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:06 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1568 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:07.159776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:07.170901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb9a7fdf-1711-4dfc-bc5c-6041044b05f1 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1462 microversion: 2.1 time: 0.306147 Nov 20 21:17:07.184262 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3379/6868] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:06 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1462 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:17:07.189261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7db9043d-ea67-4d40-b95e-09a5d3335c47", "device": "/dev/sdb"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:07.190730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:07.201315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:07.202214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:07.203258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:07.204315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:07.666042 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-608434d6-669d-40a4-9d16-a8981308811e tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "POST /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477583 Nov 20 21:17:07.668734 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3490/6869] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:17:07 2021] POST /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:17:07.924053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:07.925324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:07.942391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:07.945373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:07.946445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:07.950183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:08.077311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5f3e9cb9-c27c-43d5-89eb-ccfa7991ee86 req-283bcecc-5f96-4f13-8a15-9ebbe189a0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb401e0c-e20d-4cae-9584-6c799fb339cc", "name": "network-vif-deleted", "tag": "19de894d-4c5d-4143-8a3e-4af0e7fd6160"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:08.086380 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:08.086380 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:17:08.123308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5f3e9cb9-c27c-43d5-89eb-ccfa7991ee86 req-283bcecc-5f96-4f13-8a15-9ebbe189a0a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:08.123918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5f3e9cb9-c27c-43d5-89eb-ccfa7991ee86 req-283bcecc-5f96-4f13-8a15-9ebbe189a0a8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:08.141207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:08.163352 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5f3e9cb9-c27c-43d5-89eb-ccfa7991ee86 req-283bcecc-5f96-4f13-8a15-9ebbe189a0a8 service nova] Creating event network-vif-deleted:19de894d-4c5d-4143-8a3e-4af0e7fd6160 for instance fb401e0c-e20d-4cae-9584-6c799fb339cc on nch1-master-1 Nov 20 21:17:08.166415 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d1c372bb-cae1-40c1-8807-a85d420d79fd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 200 len: 1526 microversion: 2.1 time: 0.246644 Nov 20 21:17:08.169002 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3380/6870] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:07 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 1526 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:08.199557 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5f3e9cb9-c27c-43d5-89eb-ccfa7991ee86 req-283bcecc-5f96-4f13-8a15-9ebbe189a0a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130426 Nov 20 21:17:08.208217 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3491/6871] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:17:09.187461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:09.188065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:09.194578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:09.195274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:09.196074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:09.196518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:09.212666 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. Nov 20 21:17:09.213901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:09.215656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0dd1875a-214f-4381-bf5d-b9884c73e3ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 404 len: 111 microversion: 2.1 time: 0.032939 Nov 20 21:17:09.216826 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3381/6872] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:09 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:15.457931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:15.458754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:15.465359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:15.465817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:15.466658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:15.467103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:15.552274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lazy-loading 'services' on Instance uuid 4a1818a1-6364-442a-9e38-1492ae3ab2df {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:17:15.620475 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a3b759e7-f1c0-47dd-8523-eb3a81083254 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df/os-volume_attachments/7db9043d-ea67-4d40-b95e-09a5d3335c47" status: 202 len: 0 microversion: 2.1 time: 0.167197 Nov 20 21:17:15.621086 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3492/6873] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:17:15 2021] DELETE /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df/os-volume_attachments/7db9043d-ea67-4d40-b95e-09a5d3335c47 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:17:16.760169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:16.761667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:16.769067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:16.769885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:16.770838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:16.771424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:16.801404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:17:16.891513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-887e5b6a-dc3c-4c63-88c3-0ded8bca3ee7 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 204 len: 0 microversion: 2.1 time: 0.134737 Nov 20 21:17:16.892699 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3382/6874] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:17:16 2021] DELETE /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:17:16.905126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:16.906855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:16.915108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:16.915796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:16.917118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:16.917717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:17.077292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:17.101301 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2be42f8-7707-4d90-a7fb-7cf26cd91ed0 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1468 microversion: 2.1 time: 0.203845 Nov 20 21:17:17.101901 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3493/6875] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:16 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1468 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:18.120235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:18.120947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:18.131924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:18.132573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:18.133616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:18.134266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:18.301083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:18.330513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1631fb60-be1d-444a-ab1a-a3980451eff3 tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1468 microversion: 2.1 time: 0.214263 Nov 20 21:17:18.331255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3383/6876] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:18 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:19.102015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e5ac09ba-5d9f-4c91-8bac-32ce04476cf9 req-7dbf826e-ea31-44f6-843d-90e9fc3664ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1818a1-6364-442a-9e38-1492ae3ab2df", "name": "network-vif-deleted", "tag": "ac222e14-6807-4816-bbc0-08630a1b4779"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:19.104503 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:19.104503 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:17:19.118285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e5ac09ba-5d9f-4c91-8bac-32ce04476cf9 req-7dbf826e-ea31-44f6-843d-90e9fc3664ca service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:19.119044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e5ac09ba-5d9f-4c91-8bac-32ce04476cf9 req-7dbf826e-ea31-44f6-843d-90e9fc3664ca service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:19.150084 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e5ac09ba-5d9f-4c91-8bac-32ce04476cf9 req-7dbf826e-ea31-44f6-843d-90e9fc3664ca service nova] Creating event network-vif-deleted:ac222e14-6807-4816-bbc0-08630a1b4779 for instance 4a1818a1-6364-442a-9e38-1492ae3ab2df on nch1-master-1 Nov 20 21:17:19.156756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e5ac09ba-5d9f-4c91-8bac-32ce04476cf9 req-7dbf826e-ea31-44f6-843d-90e9fc3664ca service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058754 Nov 20 21:17:19.161902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3494/6877] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:17:19.349463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:19.350290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:19.358330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:19.359012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:19.359826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:19.360476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:19.398584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:19.400073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:19.400561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lazy-loading 'fault' on Instance uuid 4a1818a1-6364-442a-9e38-1492ae3ab2df {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:17:19.458502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd2d201b3fa47a6b511c6d0d2f44447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4d63fc40064a2d878ef88ce3e98e07', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:19.467565 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6d72da9-901e-4ef3-9007-66b83544b65d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 200 len: 1302 microversion: 2.1 time: 0.122552 Nov 20 21:17:19.468517 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3384/6878] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:19 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:20.487688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:20.488482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] [instance: 4a1818a1-6364-442a-9e38-1492ae3ab2df] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:20.495928 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:20.496474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:20.497439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:20.497899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:20.514211 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] HTTP exception thrown: Instance 4a1818a1-6364-442a-9e38-1492ae3ab2df could not be found. Nov 20 21:17:20.515073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] Returning 404 to user: Instance 4a1818a1-6364-442a-9e38-1492ae3ab2df could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:20.516112 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ba389a2-06fb-4044-b32b-c6adc44b422d tempest-VolumesBackupsTest-964287589 tempest-VolumesBackupsTest-964287589-project] 10.222.0.41 "GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df" status: 404 len: 111 microversion: 2.1 time: 0.034119 Nov 20 21:17:20.516722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3495/6879] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:20 2021] GET /compute/v2.1/servers/4a1818a1-6364-442a-9e38-1492ae3ab2df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:35.260655 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:17:35.261523 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:17:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:17:36.657151 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:17:36.657993 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:17:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:17:40.362922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:40.363616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:40.383397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:40.384190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:40.385526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:40.386626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:40.483832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:17:40.659871 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ed73d6b0-49df-4692-99e9-710775fdd2ca tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 204 len: 0 microversion: 2.1 time: 0.293807 Nov 20 21:17:40.661577 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3385/6880] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:17:40 2021] DELETE /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:17:40.670204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:40.671460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:40.698506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:40.698506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:40.703243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:40.710424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:41.085130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:41.098487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02c5e126-a54e-44a6-9fd4-51b5c37c85b3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1409 microversion: 2.1 time: 0.432569 Nov 20 21:17:41.099644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3496/6881] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:40 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:42.118348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:42.120494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:42.132126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:42.132522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:42.133448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:42.133924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:42.752590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:42.777928 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3461515-f3bf-42b7-9f34-1f8323d27f6d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1409 microversion: 2.1 time: 0.657746 Nov 20 21:17:42.778839 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3386/6882] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:42 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1409 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:43.276555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-37102e73-fdc8-469d-8333-33b22138c038 req-9595d1bd-8e43-40dd-b413-416fcd750a80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747866d7-cba0-4d23-b826-7358ef315186", "name": "network-vif-deleted", "tag": "c3608607-34e9-4165-a57b-a8a271630dad"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:43.278071 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:43.278071 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:17:43.289607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-37102e73-fdc8-469d-8333-33b22138c038 req-9595d1bd-8e43-40dd-b413-416fcd750a80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:43.290513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-37102e73-fdc8-469d-8333-33b22138c038 req-9595d1bd-8e43-40dd-b413-416fcd750a80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:43.308398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-37102e73-fdc8-469d-8333-33b22138c038 req-9595d1bd-8e43-40dd-b413-416fcd750a80 service nova] Creating event network-vif-deleted:c3608607-34e9-4165-a57b-a8a271630dad for instance 747866d7-cba0-4d23-b826-7358ef315186 on nch2-master-1 Nov 20 21:17:43.320675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-37102e73-fdc8-469d-8333-33b22138c038 req-9595d1bd-8e43-40dd-b413-416fcd750a80 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047606 Nov 20 21:17:43.321989 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3497/6883] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:17:43.818801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:43.821002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:43.848214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:43.853230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:43.879133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:43.882698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:44.044883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:44.046153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:44.048436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lazy-loading 'fault' on Instance uuid 747866d7-cba0-4d23-b826-7358ef315186 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:17:44.193523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:44.202597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0278f5c-3152-40b7-8f40-4c69bbf960d0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 200 len: 1160 microversion: 2.1 time: 0.406984 Nov 20 21:17:44.203406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3387/6884] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:43 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 1160 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:45.220539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:45.221234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:45.228441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.228898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.229893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.230801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.246010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. Nov 20 21:17:45.246655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:45.247496 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ae43a5aa-e159-4ce4-a03d-5c6c04652f77 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 404 len: 111 microversion: 2.1 time: 0.031155 Nov 20 21:17:45.248321 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3498/6885] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:45 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:45.279280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:45.279632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:45.287508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.287964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.288761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.289201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.304907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. Nov 20 21:17:45.305521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:45.306382 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abcdc856-3286-4fbf-b42e-c0b9cf71e158 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 404 len: 111 microversion: 2.1 time: 0.031581 Nov 20 21:17:45.307709 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3388/6886] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:17:45 2021] DELETE /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:17:45.316728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:45.317614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: fb401e0c-e20d-4cae-9584-6c799fb339cc] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:45.325210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.325681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.326529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.326978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.342609 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. Nov 20 21:17:45.343216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance fb401e0c-e20d-4cae-9584-6c799fb339cc could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:45.344125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-120efa62-fc17-42ba-9cad-2f39a79a9957 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc" status: 404 len: 111 microversion: 2.1 time: 0.032458 Nov 20 21:17:45.345052 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3499/6887] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:45 2021] GET /compute/v2.1/servers/fb401e0c-e20d-4cae-9584-6c799fb339cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:45.958391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:45.959917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:45.968651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.969393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.970338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:45.970857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:45.990975 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. Nov 20 21:17:45.991893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:45.992993 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56e99408-c4e6-4744-8926-a25742ca99d4 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 404 len: 111 microversion: 2.1 time: 0.039375 Nov 20 21:17:45.994196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3389/6888] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:17:45 2021] DELETE /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:46.002281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:46.003247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: 747866d7-cba0-4d23-b826-7358ef315186] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:46.010372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:46.011340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:46.012653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:46.013336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:46.055882 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. Nov 20 21:17:46.056666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance 747866d7-cba0-4d23-b826-7358ef315186 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:17:46.057915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ace0a26-a9dd-43eb-a9ac-f96f725b397a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186" status: 404 len: 111 microversion: 2.1 time: 0.059691 Nov 20 21:17:46.058899 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3500/6889] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:45 2021] GET /compute/v2.1/servers/747866d7-cba0-4d23-b826-7358ef315186 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:17:46.163742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: .version_select at 0x7f3f85fa51f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1010325959"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:46.183489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:17:46.192466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:17:46.392069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:17:46.407305 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:17:46.437952 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8af749da-153b-4be0-88ec-b7cbac51783f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.279543 Nov 20 21:17:46.440063 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3390/6890] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:17:46 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:51.942439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1170654819", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1010325959", "security_groups": [{"name": "tempest-secgroup-smoke-1225146311"}], "block_device_mapping_v2": [{"uuid": "1c525edb-e9c4-4a6d-98f9-a951189a0927", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:52.140851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:17:52.692351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:17:52.692792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:17:52.693284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:17:52.693707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:17:52.694162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:17:52.704486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:52.705074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:52.705925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:52.706395 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:52.724245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:17:52.730431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:17:52.786787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:17:52.789047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c525edb-e9c4-4a6d-98f9-a951189a0927',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:17:52.919665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c748b5ef-e6bf-4de6-9a23-10d21c925b12 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.981219 Nov 20 21:17:52.920726 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3501/6891] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:17:51 2021] POST /compute/v2.1/servers => generated 406 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:17:52.930990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28b54dc7-e75b-45ff-9abb-736fb4af998c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:52.933201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28b54dc7-e75b-45ff-9abb-736fb4af998c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:53.027476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-28b54dc7-e75b-45ff-9abb-736fb4af998c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:53.037243 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28b54dc7-e75b-45ff-9abb-736fb4af998c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1095 microversion: 2.1 time: 0.109968 Nov 20 21:17:53.039202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3391/6892] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:52 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1095 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:54.060026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:54.061145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:54.069690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:54.070299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:54.071195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:54.072520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:54.186935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:54.204466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-02d00479-5602-462f-a883-f655b1dac745 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1211 microversion: 2.1 time: 0.151716 Nov 20 21:17:54.205286 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3502/6893] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:54 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:55.222209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:55.223419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:55.232422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:55.238710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:55.240962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:55.241419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:55.478333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:55.486851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-182ddc7b-c9b8-4137-960d-7d4c5f73fcdc tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1279 microversion: 2.1 time: 0.268608 Nov 20 21:17:55.487511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3392/6894] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:55 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:56.504459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:56.505141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:56.513574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:56.514274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:56.515298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:56.515938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:56.767944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1cf3cf5c-64e6-43bf-a8d3-76a16c3326d6 req-bc1a621e-255b-462d-bf3f-cddd4e235e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63e6faf-abb2-4827-a8d8-71e39e0309bb", "tag": "39f50585-bcb7-49c3-9bc7-6f2b3717ea5c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:17:56.769791 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:17:56.769791 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:17:56.786646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1cf3cf5c-64e6-43bf-a8d3-76a16c3326d6 req-bc1a621e-255b-462d-bf3f-cddd4e235e54 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:56.787106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1cf3cf5c-64e6-43bf-a8d3-76a16c3326d6 req-bc1a621e-255b-462d-bf3f-cddd4e235e54 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:56.816220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1cf3cf5c-64e6-43bf-a8d3-76a16c3326d6 req-bc1a621e-255b-462d-bf3f-cddd4e235e54 service nova] Creating event network-changed:39f50585-bcb7-49c3-9bc7-6f2b3717ea5c for instance f63e6faf-abb2-4827-a8d8-71e39e0309bb on nch2-master-1 Nov 20 21:17:56.821402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1cf3cf5c-64e6-43bf-a8d3-76a16c3326d6 req-bc1a621e-255b-462d-bf3f-cddd4e235e54 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057508 Nov 20 21:17:56.822599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3393/6895] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:17:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:17:56.852527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:56.874658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1755675-ef7a-4adc-80fd-592c90ac4876 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.374222 Nov 20 21:17:56.875583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3503/6896] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:56 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:57.896622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:57.898312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:57.906969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:57.907483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:57.908333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:57.909008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:58.168115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:58.178338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7328b0d2-bac0-461e-a3fc-38f436f5fb6a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.288057 Nov 20 21:17:58.180846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3394/6897] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:57 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:17:59.200402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:17:59.201697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:17:59.208900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:59.209449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:59.210651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:17:59.211180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:17:59.535143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:17:59.547852 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50204789-5a43-4892-8b6e-e4b7ad214f3a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.354813 Nov 20 21:17:59.557651 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3504/6898] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:17:59 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:00.564969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:00.566087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:00.581855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:00.584665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:00.585745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:00.587030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:00.839949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:00.851203 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5021f6a3-c3ba-44c9-973f-52c62fac41cd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.290244 Nov 20 21:18:00.868196 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3395/6899] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:00 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:01.868169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:01.870345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:01.881678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:01.885900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:01.887059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:01.887755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:02.138954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:02.148058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c2fa99a-c983-48eb-adb3-3a2d0ab3a4f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.283473 Nov 20 21:18:02.149517 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3505/6900] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:01 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:02.214438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-235e29d7-240d-4303-8208-b1594ffbd790 req-666e4867-0e36-4942-a6fb-4972de532ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63e6faf-abb2-4827-a8d8-71e39e0309bb", "name": "network-vif-plugged", "status": "completed", "tag": "39f50585-bcb7-49c3-9bc7-6f2b3717ea5c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:02.216740 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:18:02.216740 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:18:02.229930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-235e29d7-240d-4303-8208-b1594ffbd790 req-666e4867-0e36-4942-a6fb-4972de532ae0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:02.230436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-235e29d7-240d-4303-8208-b1594ffbd790 req-666e4867-0e36-4942-a6fb-4972de532ae0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:02.257992 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-235e29d7-240d-4303-8208-b1594ffbd790 req-666e4867-0e36-4942-a6fb-4972de532ae0 service nova] Creating event network-vif-plugged:39f50585-bcb7-49c3-9bc7-6f2b3717ea5c for instance f63e6faf-abb2-4827-a8d8-71e39e0309bb on nch2-master-1 Nov 20 21:18:02.272586 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-235e29d7-240d-4303-8208-b1594ffbd790 req-666e4867-0e36-4942-a6fb-4972de532ae0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062027 Nov 20 21:18:02.273688 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3396/6901] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:18:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:18:03.166540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:03.167215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:03.185840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:03.186358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:03.187186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:03.187638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:03.356323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:03.364413 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-777225d7-da51-4c71-b334-8a47d2c89f1e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1267 microversion: 2.1 time: 0.202688 Nov 20 21:18:03.364990 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3506/6902] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:03 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:04.385586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:04.387179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:04.396656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:04.398234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:04.399233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:04.400636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:04.581293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:04.589552 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6dcb26bd-61bc-4d46-9ef6-e37f9e7cce7c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1454 microversion: 2.1 time: 0.211735 Nov 20 21:18:04.590155 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3397/6903] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:04 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1454 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:04.607086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:04.607956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:04.615211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:04.615895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:04.616870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:04.617484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:04.891721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:04.899506 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-064e0940-5aec-4d05-922c-deaa1aae4e0f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1454 microversion: 2.1 time: 0.297173 Nov 20 21:18:04.901237 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3507/6904] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:04 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1454 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:07.874940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8c6da400-6e2e-41a9-8c2d-dc72d910f09f req-93c22676-93e0-4a5f-a27b-8921416522af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f63e6faf-abb2-4827-a8d8-71e39e0309bb", "tag": "39f50585-bcb7-49c3-9bc7-6f2b3717ea5c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:07.876115 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:18:07.876115 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:18:07.900498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8c6da400-6e2e-41a9-8c2d-dc72d910f09f req-93c22676-93e0-4a5f-a27b-8921416522af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:07.901362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8c6da400-6e2e-41a9-8c2d-dc72d910f09f req-93c22676-93e0-4a5f-a27b-8921416522af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:07.932419 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8c6da400-6e2e-41a9-8c2d-dc72d910f09f req-93c22676-93e0-4a5f-a27b-8921416522af service nova] Creating event network-changed:39f50585-bcb7-49c3-9bc7-6f2b3717ea5c for instance f63e6faf-abb2-4827-a8d8-71e39e0309bb on nch2-master-1 Nov 20 21:18:07.939145 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8c6da400-6e2e-41a9-8c2d-dc72d910f09f req-93c22676-93e0-4a5f-a27b-8921416522af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068476 Nov 20 21:18:07.940431 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3398/6905] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:18:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:18:10.465899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: .version_select at 0x7f3f87872670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-914323509"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:10.483220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:18:10.488428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:18:10.625080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:18:10.630749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:18:10.648951 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6fb9cb6-9d78-4f07-bee7-d53667f468b6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.426431 Nov 20 21:18:10.649904 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3508/6906] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:18:10 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:18.904714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1067401129", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "9b8a3317-5402-477f-b03e-09482e7e472a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-914323509", "security_groups": [{"name": "tempest-secgroup-smoke-449507451"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:19.141978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] validate_networks() for [('9b8a3317-5402-477f-b03e-09482e7e472a', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:18:19.817674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:18:19.818113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:18:19.818583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:18:19.818987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:18:19.819396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:18:19.829266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:19.829723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:19.830558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:19.830991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:19.867558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:18:19.875027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:18:19.888611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:18:19.891130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:18:19.965132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44c6e76c-6a8d-4b57-812f-c2ae237c734e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.065417 Nov 20 21:18:19.966781 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3399/6907] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:18:18 2021] POST /compute/v2.1/servers => generated 405 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:18:19.981879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24a61601-7820-460f-9716-0212efba2ce6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:19.983316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-24a61601-7820-460f-9716-0212efba2ce6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:20.064647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-24a61601-7820-460f-9716-0212efba2ce6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:20.071814 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24a61601-7820-460f-9716-0212efba2ce6 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1266 microversion: 2.1 time: 0.097725 Nov 20 21:18:20.074520 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3509/6908] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:19 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:21.089907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:21.090712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:21.101814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:21.102298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:21.103161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:21.103641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:21.173265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:21.181987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c7f57442-e2dc-4134-af3b-8ee59d2e58f1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1318 microversion: 2.1 time: 0.096415 Nov 20 21:18:21.182598 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3400/6909] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:21 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:22.199977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:22.201297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:22.208287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:22.208820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:22.209704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:22.210398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:22.376089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:22.389089 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c605b053-af48-41cc-8a39-142edca0c90c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1391 microversion: 2.1 time: 0.193520 Nov 20 21:18:22.389900 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3510/6910] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:22 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1391 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:22.843145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-66fece20-3ca4-4c6c-a7a6-f373393c3e69 req-01f567a2-3537-4f9c-bfdb-26cf9a8a7cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:22.845389 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:18:22.845389 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:18:22.859913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-66fece20-3ca4-4c6c-a7a6-f373393c3e69 req-01f567a2-3537-4f9c-bfdb-26cf9a8a7cfc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:22.860447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-66fece20-3ca4-4c6c-a7a6-f373393c3e69 req-01f567a2-3537-4f9c-bfdb-26cf9a8a7cfc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:22.877971 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-66fece20-3ca4-4c6c-a7a6-f373393c3e69 req-01f567a2-3537-4f9c-bfdb-26cf9a8a7cfc service nova] Creating event network-changed:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch1-master-1 Nov 20 21:18:22.884550 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-66fece20-3ca4-4c6c-a7a6-f373393c3e69 req-01f567a2-3537-4f9c-bfdb-26cf9a8a7cfc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046089 Nov 20 21:18:22.885759 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3401/6911] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:18:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:18:23.408551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:23.409165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:23.416495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:23.416980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:23.417758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:23.418231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:23.555510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:23.573395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27a2a923-92cd-4f65-ab90-84faea2ce631 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1391 microversion: 2.1 time: 0.168438 Nov 20 21:18:23.573997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3511/6912] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:23 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:24.591327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:24.592252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:24.599171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:24.599619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:24.600406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:24.600842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:24.757848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:24.766336 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c09f7f3-5c47-4996-a59b-a8eeabb3c627 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1391 microversion: 2.1 time: 0.179722 Nov 20 21:18:24.767333 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3402/6913] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:24 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:25.784511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:25.785212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:25.794375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:25.794375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:25.795134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:25.795253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:25.943898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:25.953454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a2ac87c-eb10-4eea-b44e-571c1f75468f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1391 microversion: 2.1 time: 0.172771 Nov 20 21:18:25.954072 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3512/6914] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:25 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:26.857873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6b3d26ba-8137-4554-b952-88fb48c2464c req-83666868-5fc2-47fc-9ff9-8f43e97dc7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "name": "network-vif-plugged", "status": "completed", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:26.861545 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:18:26.861545 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:18:26.872371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b3d26ba-8137-4554-b952-88fb48c2464c req-83666868-5fc2-47fc-9ff9-8f43e97dc7c9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:26.873362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b3d26ba-8137-4554-b952-88fb48c2464c req-83666868-5fc2-47fc-9ff9-8f43e97dc7c9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:26.890144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6b3d26ba-8137-4554-b952-88fb48c2464c req-83666868-5fc2-47fc-9ff9-8f43e97dc7c9 service nova] Creating event network-vif-plugged:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch1-master-1 Nov 20 21:18:26.896540 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6b3d26ba-8137-4554-b952-88fb48c2464c req-83666868-5fc2-47fc-9ff9-8f43e97dc7c9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042330 Nov 20 21:18:26.897157 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3403/6915] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:18:26.971879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:26.972586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:26.980464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:26.980931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:26.981799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:26.982239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:27.137952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:27.143758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1da109f5-542d-4f27-a741-62782359ee8c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1391 microversion: 2.1 time: 0.176985 Nov 20 21:18:27.144308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3513/6916] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:26 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:28.161429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:28.162162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:28.169245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:28.169699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:28.170520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:28.171139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:28.373889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:28.381693 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f8082982-9ecb-413f-862f-131d2460286f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1564 microversion: 2.1 time: 0.225106 Nov 20 21:18:28.382303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3404/6917] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:28 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1564 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:28.401161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:28.402096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:28.410690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:28.410690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:28.411156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:28.411623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:28.570147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:28.578524 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69b3af36-d660-46c3-9b98-75bf23a59306 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1564 microversion: 2.1 time: 0.182741 Nov 20 21:18:28.579114 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3514/6918] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:28 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:30.479387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:18:30.480114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:30.482440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7d46d88a-a1f9-41dc-8862-be2483be6036 req-adb26928-6a9c-4bf7-afe2-c80019b39b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:30.483976 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:18:30.483976 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:18:30.492018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7d46d88a-a1f9-41dc-8862-be2483be6036 req-adb26928-6a9c-4bf7-afe2-c80019b39b15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:30.492791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7d46d88a-a1f9-41dc-8862-be2483be6036 req-adb26928-6a9c-4bf7-afe2-c80019b39b15 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:30.499484 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:30.499952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:30.501027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:30.501467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:30.516297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7d46d88a-a1f9-41dc-8862-be2483be6036 req-adb26928-6a9c-4bf7-afe2-c80019b39b15 service nova] Creating event network-changed:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch1-master-1 Nov 20 21:18:30.522755 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7d46d88a-a1f9-41dc-8862-be2483be6036 req-adb26928-6a9c-4bf7-afe2-c80019b39b15 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044284 Nov 20 21:18:30.523744 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3515/6919] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:18:30.834605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:18:30.843765 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-31c8336a-ec08-40f8-a31c-d6fbe1ce1b94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1564 microversion: 2.1 time: 0.369312 Nov 20 21:18:30.844637 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3405/6920] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:18:30 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1564 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:18:54.142367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:18:54.143870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:18:54.152946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:54.154661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:54.155820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:18:54.156443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:18:54.211436 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b968484-92eb-484c-b60a-08a4060af8c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action" status: 200 len: 24576 microversion: 2.1 time: 0.075458 Nov 20 21:18:54.212131 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3516/6921] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:18:54 2021] POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action => generated 24576 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:19:00.642182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:00.642808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:00.649018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:00.649482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:00.650309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:00.650938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:00.885524 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b16d92e9-3cb7-4c3b-a6c1-987656d85781 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1834 microversion: 2.1 time: 0.247887 Nov 20 21:19:00.886551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3406/6922] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:00 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1834 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:00.903212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:00.904523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:00.911518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:00.912005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:00.912793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:00.913241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:01.050327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:01.057768 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c0673091-0518-45ea-a6da-758bdcfcc075 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1683 microversion: 2.1 time: 0.158695 Nov 20 21:19:01.058369 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3517/6923] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:00 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:01.152809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:01.154597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:01.160552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:01.161010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:01.161786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:01.162265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:01.216444 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1d607e9-045c-4a25-b993-af29f9fa6db3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action" status: 200 len: 32649 microversion: 2.1 time: 0.066469 Nov 20 21:19:01.226187 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3407/6924] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:19:01 2021] POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action => generated 32649 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:19:01.429497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:01.430662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:01.437550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:01.438012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:01.438979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:01.439424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:01.482427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c4a93cca2e8478b972cbb29e3287092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a473f08dff447688bf533507566fc40', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:01.483305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] flavor_id is None. Assuming migration. {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 20 21:19:01.483935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:19:02.068774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3a7f3ca-7beb-4b42-9f0a-b6d4a104ae77 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action" status: 202 len: 0 microversion: 2.1 time: 0.643714 Nov 20 21:19:02.072704 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3518/6925] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:19:01 2021] POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:19:02.082268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:02.084202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:02.107764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:02.108797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:02.110985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:02.110985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:02.407009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:02.415693 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b5036a3-7b71-40dc-b9da-7f2703d01091 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1692 microversion: 2.1 time: 0.339702 Nov 20 21:19:02.426858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3408/6926] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:02 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1692 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:03.436525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:03.437738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:03.456645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:03.457502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:03.458617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:03.459575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:03.756765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:03.772306 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff925308-4884-48a2-b4e9-78b96ee82ac4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1692 microversion: 2.1 time: 0.341243 Nov 20 21:19:03.773730 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3519/6927] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:03 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1692 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:04.791798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:04.792496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:04.800000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:04.800460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:04.801259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:04.801702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:05.021991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:05.031067 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89edff8f-fef7-499f-a5cf-c7fbeec9d67e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1692 microversion: 2.1 time: 0.242873 Nov 20 21:19:05.031945 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3409/6928] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:04 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1692 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:05.853612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Action: 'create', calling method: .version_select at 0x7f3f863999d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2073774414"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:05.868764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:19:05.874455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for user 56095e677a6540dc99bc93b9ad8ef368 and project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:19:06.049178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:06.049701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:06.066096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:06.066564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:06.067375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:06.067821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:06.208475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:06.216601 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d657b60c-6a6b-408f-a6bb-b215b42a3b89 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.171300 Nov 20 21:19:06.217175 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3410/6929] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:06 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:06.533861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:19:06.538991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for user 56095e677a6540dc99bc93b9ad8ef368 and project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:19:06.553648 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a97db44-2ce0-4b9d-b4c7-9f39e7d8b484 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.703680 Nov 20 21:19:06.554320 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3520/6930] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:19:05 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:07.234624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:07.235860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:07.244514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:07.244977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:07.245962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:07.247420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:07.420203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:07.427600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0bf93bb7-18ee-415e-95a1-7b1aa89e25ed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.197515 Nov 20 21:19:07.428191 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3411/6931] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:07 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:07.508672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-991397566", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "534ec160-6718-4124-90f8-da2967763760", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2073774414", "security_groups": [{"name": "tempest-secgroup-smoke-767088847"}], "networks": [{"uuid": "ad85d1e6-7942-40af-9024-3a100cf415ae"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:07.621025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] validate_networks() for [('ad85d1e6-7942-40af-9024-3a100cf415ae', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:19:07.995621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:19:07.996055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:19:07.996598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:19:07.997315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:19:07.998025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:19:08.006979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:08.007435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:08.008248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:08.008690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:08.025157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:19:08.030957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Getting quotas for user 56095e677a6540dc99bc93b9ad8ef368 and project bfa4e1f38ed645dc8af56e7abe42b889. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:19:08.086894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:19:08.089113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='534ec160-6718-4124-90f8-da2967763760',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:19:08.211319 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69cc0260-69cb-4049-8862-4040f4fe152f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706940 Nov 20 21:19:08.217617 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3521/6932] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:19:07 2021] POST /compute/v2.1/servers => generated 405 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:19:08.223142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5381a1d9-5874-42db-9abb-4cbeed064d43 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:08.223947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5381a1d9-5874-42db-9abb-4cbeed064d43 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:08.287610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5381a1d9-5874-42db-9abb-4cbeed064d43 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:08.295660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5381a1d9-5874-42db-9abb-4cbeed064d43 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1098 microversion: 2.1 time: 0.076606 Nov 20 21:19:08.296441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3412/6933] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:08 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1098 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:19:08.447141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:08.447267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:08.454079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:08.454568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:08.455404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:08.455866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:08.598760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:08.607170 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c8e1f30-5e44-43bd-8244-fe71549786ff tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.164567 Nov 20 21:19:08.607734 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3522/6934] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:08 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:09.313176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:09.313788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:09.321293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:09.321756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:09.322590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:09.323034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:09.386751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:09.396159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d5238c2-05e4-4180-b098-b7638059bc70 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1214 microversion: 2.1 time: 0.087028 Nov 20 21:19:09.396750 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3413/6935] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:09 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:09.624651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:09.625532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:09.632709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:09.633387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:09.634435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:09.634888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:09.890387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:09.901839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-39bf55de-8d30-426f-ade5-2453164591b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.280835 Nov 20 21:19:09.912713 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3523/6936] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:09 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:10.417141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:10.417891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:10.425733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:10.426567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:10.427470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:10.428263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:10.591180 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:10.599405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8adbae82-daf0-4cde-a1c3-0fbe15aceb94 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.186998 Nov 20 21:19:10.600476 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3414/6937] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:10 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:10.614109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-069e5741-c2b5-4a24-9d34-7825e3528bfb req-ed9e8049-6270-4f9b-8690-4bdb3f055bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:10.615674 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:10.615674 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:19:10.623635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-069e5741-c2b5-4a24-9d34-7825e3528bfb req-ed9e8049-6270-4f9b-8690-4bdb3f055bdd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:10.624145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-069e5741-c2b5-4a24-9d34-7825e3528bfb req-ed9e8049-6270-4f9b-8690-4bdb3f055bdd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:10.636356 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-069e5741-c2b5-4a24-9d34-7825e3528bfb req-ed9e8049-6270-4f9b-8690-4bdb3f055bdd service nova] Creating event network-changed:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:19:10.643025 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-069e5741-c2b5-4a24-9d34-7825e3528bfb req-ed9e8049-6270-4f9b-8690-4bdb3f055bdd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032284 Nov 20 21:19:10.643546 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3524/6938] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:19:10.920652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:10.921579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:10.927668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:10.928131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:10.928955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:10.929379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:11.068718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:11.076822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-459fa96e-aee9-4828-9537-4f991ba27355 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.160754 Nov 20 21:19:11.077604 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3415/6939] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:10 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:11.617053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:11.617754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:11.624526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:11.625252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:11.626039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:11.626510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:11.762837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:11.770204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2dc99f2c-22dd-4b1b-910a-48cdffe0533e tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.157162 Nov 20 21:19:11.770778 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3525/6940] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:11 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:12.094777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:12.095397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:12.102190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:12.102654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:12.103451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:12.103898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:12.240466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:12.247958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a8d4b3b-ceb9-4af0-8640-e5631d3e25dc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.157581 Nov 20 21:19:12.248546 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3416/6941] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:12 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:12.786306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:12.787206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:12.794913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:12.795377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:12.796213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:12.796691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:12.936075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:12.943420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b55b6423-a8e2-46da-99ac-521f66bd7a98 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.160845 Nov 20 21:19:12.943994 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3526/6942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:12 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:13.266325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:13.266943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:13.273655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:13.274145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:13.275219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:13.275669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:13.436027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:13.445118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0387bf7f-5bb0-4c0c-b340-4b6e877d0d9c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.183538 Nov 20 21:19:13.445727 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3417/6943] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:13 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:13.960821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:13.961442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:13.968226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:13.968689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:13.969476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:13.969919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:14.100809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:14.108885 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c5d14284-f65d-4618-ac58-23b6168ba1d6 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.151768 Nov 20 21:19:14.109452 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3527/6944] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:13 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:14.467791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:14.468418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:14.475385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:14.475847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:14.476656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:14.477104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:14.712810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:14.721202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b153033-df94-4464-8f33-62f4b4b30292 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.258928 Nov 20 21:19:14.721791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3418/6945] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:14 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:15.126123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:15.126776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:15.133457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:15.133922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:15.134731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:15.135172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:15.271074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:15.278445 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a02b6606-964b-4e3c-a8df-fb3cb3976839 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.156870 Nov 20 21:19:15.279283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3528/6946] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:15 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:15.738476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:15.739016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:15.745736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:15.746242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:15.747151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:15.747601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:15.886693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:15.894199 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02c33bd0-e979-42f5-bbb8-7f9ff0390efa tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.159516 Nov 20 21:19:15.894780 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3419/6947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:15 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:16.296007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:16.296628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:16.303630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:16.304090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:16.304887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:16.305343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:16.320580 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cc143b0a-0826-4b7f-a2fe-f97da0f3188d req-c1b8ce00-b911-4280-aea2-8b8ea130b802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "name": "network-vif-plugged", "status": "completed", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:16.323560 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:16.323560 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:19:16.331781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cc143b0a-0826-4b7f-a2fe-f97da0f3188d req-c1b8ce00-b911-4280-aea2-8b8ea130b802 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:16.332252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cc143b0a-0826-4b7f-a2fe-f97da0f3188d req-c1b8ce00-b911-4280-aea2-8b8ea130b802 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:16.344745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cc143b0a-0826-4b7f-a2fe-f97da0f3188d req-c1b8ce00-b911-4280-aea2-8b8ea130b802 service nova] Creating event network-vif-plugged:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:19:16.352646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cc143b0a-0826-4b7f-a2fe-f97da0f3188d req-c1b8ce00-b911-4280-aea2-8b8ea130b802 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036595 Nov 20 21:19:16.353561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3420/6948] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:19:16.492346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:16.500256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3161de4-77b2-4eb9-b0d4-710883e2fa8b tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1269 microversion: 2.1 time: 0.208809 Nov 20 21:19:16.500831 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3529/6949] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:16 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:16.913477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:16.914120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:16.920353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:16.920798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:16.921569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:16.922026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:17.058171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:17.066028 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cdceffbf-3642-41cf-abdf-75489a42402b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.157528 Nov 20 21:19:17.066562 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3421/6950] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:16 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:17.516683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:17.517424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:17.524859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:17.525428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:17.526327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:17.526855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:17.668988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:17.676344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2f36c58-a371-41e6-8f4d-842dbd14d8e9 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1458 microversion: 2.1 time: 0.163273 Nov 20 21:19:17.676930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3530/6951] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:17 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:17.692709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:17.693316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:17.699124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:17.699690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:17.700609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:17.701048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:17.830985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:17.838301 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c662af1-2a68-497e-91b4-fc998cc62223 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1458 microversion: 2.1 time: 0.149218 Nov 20 21:19:17.838867 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3422/6952] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:17 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1458 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:18.084323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:18.084988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:18.091471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:18.091936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:18.092721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:18.093165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:18.227306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:18.235107 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22c253d8-5533-4735-adf3-cf56211d49c4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.154600 Nov 20 21:19:18.235783 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3531/6953] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:18 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:19.253910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:19.254469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:19.264051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:19.264585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:19.265458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:19.265979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:19.506973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:19.515589 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4340d2eb-2767-4f4c-80c8-b6874722883b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.265897 Nov 20 21:19:19.516188 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3423/6954] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:19 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:19.580331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-768a4dd4-6ae7-47d1-8fba-90660d86f443 req-2283474e-8cf7-4072-8b07-e131058cff78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:19.581865 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:19.581865 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:19:19.591372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-768a4dd4-6ae7-47d1-8fba-90660d86f443 req-2283474e-8cf7-4072-8b07-e131058cff78 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:19.592371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-768a4dd4-6ae7-47d1-8fba-90660d86f443 req-2283474e-8cf7-4072-8b07-e131058cff78 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:19.604963 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-768a4dd4-6ae7-47d1-8fba-90660d86f443 req-2283474e-8cf7-4072-8b07-e131058cff78 service nova] Creating event network-changed:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:19:19.610754 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-768a4dd4-6ae7-47d1-8fba-90660d86f443 req-2283474e-8cf7-4072-8b07-e131058cff78 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034161 Nov 20 21:19:19.611714 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3532/6955] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:19:20.533895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:20.535195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:20.543765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:20.544870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:20.545898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:20.546561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:20.810923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:20.819598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d6ff5db5-84b2-4774-8f38-3e842ce23402 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.289442 Nov 20 21:19:20.830104 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3424/6956] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:20 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:21.628283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}, {"name": "network-changed", "server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:21.629847 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:21.629847 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:19:21.636941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:21.637407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:21.648128 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] Creating event network-changed:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:19:21.648647 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] Creating event network-changed:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:19:21.654376 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-68d959be-7b9e-4eba-bf2e-7801d7cd0bc8 req-fecce6c2-72bf-4836-8ea1-89a3d11738e1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030969 Nov 20 21:19:21.655178 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3533/6957] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:19:21.836896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:21.837587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:21.845431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:21.845960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:21.847089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:21.847532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:22.030571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:22.038538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-289abbf0-aac1-43c5-ac5b-cbc578874836 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1697 microversion: 2.1 time: 0.205452 Nov 20 21:19:22.039132 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3425/6958] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:21 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1697 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:23.058438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:23.060549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:23.066925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:23.067396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:23.068176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:23.068622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:23.213758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:23.222028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7cf3b6a-dd2b-42b2-9024-dfba99d50f01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1696 microversion: 2.1 time: 0.168894 Nov 20 21:19:23.223358 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3534/6959] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:23 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:23.669568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "name": "network-vif-unplugged", "status": "completed", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}, {"name": "network-changed", "server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:23.672332 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:23.672332 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:19:23.682038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:23.682506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:23.696511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Creating event network-vif-unplugged:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch2-master-1 Nov 20 21:19:23.697105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Creating event network-changed:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch2-master-1 Nov 20 21:19:23.703735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] Instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:19:23.717856 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-c8a03308-6547-4612-b334-9fd53c04ce89 req-562f1ac6-6c74-4961-9660-246656aa0e3b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.052483 Nov 20 21:19:23.718821 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3426/6960] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:23 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:19:24.241638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:24.242587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:24.250850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:24.251316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:24.252143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:24.252567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:24.406368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:24.415312 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d023225-373d-47b8-9b8e-7f037f0ad6c3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1694 microversion: 2.1 time: 0.177990 Nov 20 21:19:24.416096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3535/6961] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:24 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:19:25.433846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:25.435135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:25.441225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.441673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.442500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.442938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.576521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:25.583779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a8f92bec-062c-4754-bd60-9715e9e0be72 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1691 microversion: 2.1 time: 0.154795 Nov 20 21:19:25.584353 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3427/6962] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:25 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:25.599873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:25.600415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:25.607133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.607571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.608356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.608802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.664713 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b26af27a-e643-4746-b4cd-755b2b4980cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action" status: 204 len: 0 microversion: 2.1 time: 0.068379 Nov 20 21:19:25.665580 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3536/6963] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:19:25 2021] POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:19:25.673846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:25.674480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:25.680217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.680666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.681448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:25.681881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:25.926390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:25.933716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-261322a6-4299-498b-8e2e-6cd052817e92 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1691 microversion: 2.1 time: 0.263695 Nov 20 21:19:25.934328 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3428/6964] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:25 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:26.952322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:26.953019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:26.959043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:26.959500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:26.960275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:26.960715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:27.111724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:27.119018 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11a327b1-2f90-4c00-8afe-4b3979a93157 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1683 microversion: 2.1 time: 0.171730 Nov 20 21:19:27.119595 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3537/6965] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:26 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:28.366878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ea444f79-09d6-44be-bce0-15aaca1810be req-769c2e77-4054-4f66-8b5a-0c25ea5cccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "name": "network-vif-plugged", "status": "completed", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:28.368490 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:28.368490 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:19:28.376751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ea444f79-09d6-44be-bce0-15aaca1810be req-769c2e77-4054-4f66-8b5a-0c25ea5cccfa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:28.377215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ea444f79-09d6-44be-bce0-15aaca1810be req-769c2e77-4054-4f66-8b5a-0c25ea5cccfa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:28.389322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ea444f79-09d6-44be-bce0-15aaca1810be req-769c2e77-4054-4f66-8b5a-0c25ea5cccfa service nova] Creating event network-vif-plugged:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch2-master-1 Nov 20 21:19:28.394302 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ea444f79-09d6-44be-bce0-15aaca1810be req-769c2e77-4054-4f66-8b5a-0c25ea5cccfa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Nov 20 21:19:28.395078 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3429/6966] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:19:51.314766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:51.315697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:51.322791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:51.323330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:51.324895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:51.325483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:51.381147 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea4f411a-81ad-49de-8d10-8d6b34faf83b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action" status: 200 len: 24578 microversion: 2.1 time: 0.069726 Nov 20 21:19:51.382470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3538/6967] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:19:51 2021] POST /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0/action => generated 24578 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:19:57.625948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:57.626645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:57.633375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:57.633903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:57.634706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:57.635140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:57.764434 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec648744-6364-495b-95b1-7736dbc391b2 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1834 microversion: 2.1 time: 0.143601 Nov 20 21:19:57.765015 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3430/6968] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:57 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1834 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:58.638290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:58.638883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:58.646593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:58.647057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:58.647884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:58.648789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:58.676814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:19:58.764495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3503e664-c5a7-4795-8120-e93a190f482d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 204 len: 0 microversion: 2.1 time: 0.130057 Nov 20 21:19:58.765517 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3539/6969] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:19:58 2021] DELETE /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:19:58.775798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:58.776519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:58.782565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:58.783037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:58.783842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:58.784296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:58.802455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-89a148d8-6943-41fb-bb12-4568ffbec7ba req-939e4d05-1065-42c2-8747-5e40d866f838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:19:58.804280 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:19:58.804280 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:19:58.812325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-89a148d8-6943-41fb-bb12-4568ffbec7ba req-939e4d05-1065-42c2-8747-5e40d866f838 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:58.813079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-89a148d8-6943-41fb-bb12-4568ffbec7ba req-939e4d05-1065-42c2-8747-5e40d866f838 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:58.825159 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-89a148d8-6943-41fb-bb12-4568ffbec7ba req-939e4d05-1065-42c2-8747-5e40d866f838 service nova] Creating event network-changed:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch2-master-1 Nov 20 21:19:58.831153 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-89a148d8-6943-41fb-bb12-4568ffbec7ba req-939e4d05-1065-42c2-8747-5e40d866f838 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194921 Nov 20 21:19:58.832240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3431/6970] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:19:58.940029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:19:58.949060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00acb760-056e-408a-a844-35cacd63d208 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1689 microversion: 2.1 time: 0.178437 Nov 20 21:19:58.950596 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3540/6971] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:58 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:19:59.967881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:19:59.968498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:19:59.974721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:59.975179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:19:59.976002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:19:59.976713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:00.111392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:00.119491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b2f21b37-7372-4548-8419-54a31eefb0c9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 200 len: 1570 microversion: 2.1 time: 0.156609 Nov 20 21:20:00.120074 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3432/6972] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:19:59 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:00.813462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5a5906b6-4fe1-4b95-92d6-9cd2d2417685 req-71717887-042c-4dd5-8cbb-7ece9fb016f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b99339f-f35d-472b-a048-8ed2ce4cc2f0", "name": "network-vif-deleted", "tag": "e94d1478-befd-479b-af4e-3dd6f60f6faa"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:00.815456 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:00.815456 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:20:00.829249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5a5906b6-4fe1-4b95-92d6-9cd2d2417685 req-71717887-042c-4dd5-8cbb-7ece9fb016f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:00.830413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5a5906b6-4fe1-4b95-92d6-9cd2d2417685 req-71717887-042c-4dd5-8cbb-7ece9fb016f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:00.843641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5a5906b6-4fe1-4b95-92d6-9cd2d2417685 req-71717887-042c-4dd5-8cbb-7ece9fb016f0 service nova] Creating event network-vif-deleted:e94d1478-befd-479b-af4e-3dd6f60f6faa for instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 on nch2-master-1 Nov 20 21:20:00.848371 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5a5906b6-4fe1-4b95-92d6-9cd2d2417685 req-71717887-042c-4dd5-8cbb-7ece9fb016f0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039458 Nov 20 21:20:00.848984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3541/6973] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:01.137935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:01.139009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 8b99339f-f35d-472b-a048-8ed2ce4cc2f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:01.147060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:01.147618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:01.148863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:01.149564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:01.165098 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] HTTP exception thrown: Instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 could not be found. Nov 20 21:20:01.165752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Returning 404 to user: Instance 8b99339f-f35d-472b-a048-8ed2ce4cc2f0 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:20:01.166666 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8c78dfe2-107f-45af-8f27-8d807b86eb73 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0" status: 404 len: 111 microversion: 2.1 time: 0.033232 Nov 20 21:20:01.167256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3433/6974] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:01 2021] GET /compute/v2.1/servers/8b99339f-f35d-472b-a048-8ed2ce4cc2f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:20:04.733328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f4b7a99-12a5-4823-8193-f2ab6554353d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '.version_select at 0x7f3f8649bd30>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:04.757785 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f4b7a99-12a5-4823-8193-f2ab6554353d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914323509" status: 202 len: 0 microversion: 2.1 time: 0.028720 Nov 20 21:20:04.759251 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3542/6975] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:20:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914323509 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:20:04.789203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: .version_select at 0x7f3f85df9670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-207296678"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:04.811041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:20:04.817199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:20:04.991223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:20:04.996905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:20:05.014114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-869bd073-596a-44e6-ab15-cd3b8e045952 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.230332 Nov 20 21:20:05.014719 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3434/6976] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:20:04 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:07.111093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:07.111851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:07.113209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3007dda5-aeb8-4ed3-b92d-c6f4730c5d2a req-ded2c48f-3166-4335-86d7-a8fad574daf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:07.121065 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:07.121065 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:07.121693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:07.122205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:07.123345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:07.123976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:07.136004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3007dda5-aeb8-4ed3-b92d-c6f4730c5d2a req-ded2c48f-3166-4335-86d7-a8fad574daf0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:07.137693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3007dda5-aeb8-4ed3-b92d-c6f4730c5d2a req-ded2c48f-3166-4335-86d7-a8fad574daf0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:07.153172 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3007dda5-aeb8-4ed3-b92d-c6f4730c5d2a req-ded2c48f-3166-4335-86d7-a8fad574daf0 service nova] Creating event network-changed:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:20:07.154637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:20:07.162030 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3007dda5-aeb8-4ed3-b92d-c6f4730c5d2a req-ded2c48f-3166-4335-86d7-a8fad574daf0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054539 Nov 20 21:20:07.164087 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3435/6977] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:07.259715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-917dbada-a614-4ff2-9088-50661d4c41cf tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "DELETE /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 204 len: 0 microversion: 2.1 time: 0.154290 Nov 20 21:20:07.271194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:07.272097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:07.275173 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3543/6978] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:20:07 2021] DELETE /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:20:07.279549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:07.280057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:07.281120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:07.281802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:07.598230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:07.611479 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ce881b30-58e5-4109-8a97-061dd586ef08 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1582 microversion: 2.1 time: 0.344206 Nov 20 21:20:07.612433 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3436/6979] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:07 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1582 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:08.635799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:08.638071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:08.645508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:08.646408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:08.647455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:08.648373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:09.023734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:09.032327 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8baea733-d15f-48a6-a192-5babe19ec0bd tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1464 microversion: 2.1 time: 0.401380 Nov 20 21:20:09.043725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3544/6980] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:08 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:09.464587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7ad3fee0-e17b-4833-95bb-576b03c06779 req-e9dd3f31-4ff7-4f44-a08f-0e0b09476910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91570ff3-344d-4250-b751-70fcb19f046b", "name": "network-vif-deleted", "tag": "aa23ed80-5769-4e18-98f8-88d05c7c82bf"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:09.466214 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:09.466214 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:09.484025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7ad3fee0-e17b-4833-95bb-576b03c06779 req-e9dd3f31-4ff7-4f44-a08f-0e0b09476910 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:09.484485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7ad3fee0-e17b-4833-95bb-576b03c06779 req-e9dd3f31-4ff7-4f44-a08f-0e0b09476910 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:09.499950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7ad3fee0-e17b-4833-95bb-576b03c06779 req-e9dd3f31-4ff7-4f44-a08f-0e0b09476910 service nova] Creating event network-vif-deleted:aa23ed80-5769-4e18-98f8-88d05c7c82bf for instance 91570ff3-344d-4250-b751-70fcb19f046b on nch2-master-1 Nov 20 21:20:09.504973 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7ad3fee0-e17b-4833-95bb-576b03c06779 req-e9dd3f31-4ff7-4f44-a08f-0e0b09476910 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044338 Nov 20 21:20:09.506004 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3437/6981] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:10.051392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:10.053958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:10.080956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:10.081533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:10.091919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:10.092780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:10.144329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:10.144785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:10.145422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lazy-loading 'fault' on Instance uuid 91570ff3-344d-4250-b751-70fcb19f046b {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:20:10.239482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56095e677a6540dc99bc93b9ad8ef368', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfa4e1f38ed645dc8af56e7abe42b889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:10.247358 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2f6c9af-bc38-4536-9ed0-8a42e6efdf0c tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 200 len: 1188 microversion: 2.1 time: 0.201905 Nov 20 21:20:10.252336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3545/6982] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:10 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 1188 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:11.272786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:11.274184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] [instance: 91570ff3-344d-4250-b751-70fcb19f046b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:11.281321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:11.281776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:11.282614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:11.283052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:11.297571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] HTTP exception thrown: Instance 91570ff3-344d-4250-b751-70fcb19f046b could not be found. Nov 20 21:20:11.298211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Returning 404 to user: Instance 91570ff3-344d-4250-b751-70fcb19f046b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:20:11.299048 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-154c8118-742f-46cb-b304-28e550ab610f tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b" status: 404 len: 111 microversion: 2.1 time: 0.032269 Nov 20 21:20:11.299817 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3438/6983] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:11 2021] GET /compute/v2.1/servers/91570ff3-344d-4250-b751-70fcb19f046b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:20:11.493404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7035c0f-01a6-4922-9c2a-575cf46bbe80 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] Calling method '.version_select at 0x7f3f864da040>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:11.524822 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7035c0f-01a6-4922-9c2a-575cf46bbe80 tempest-TestVolumeBackupRestore-667839818 tempest-TestVolumeBackupRestore-667839818-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2073774414" status: 202 len: 0 microversion: 2.1 time: 0.043656 Nov 20 21:20:11.525650 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3546/6984] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 21:20:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2073774414 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:20:11.833830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1030795649", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "849a02a0-5850-4019-99e1-058d08802cd3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-207296678", "security_groups": [{"name": "tempest-secgroup-smoke-719204502"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:11.963223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] validate_networks() for [('849a02a0-5850-4019-99e1-058d08802cd3', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:20:12.467788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:20:12.468391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:20:12.469838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:20:12.470361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:20:12.470849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:20:12.480458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:12.481101 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:12.481902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:12.482453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:12.508099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:20:12.515788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:20:12.531615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:20:12.534406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:20:12.590135 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1bbc7ba-e0d9-4547-b375-1c7358e1e416 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764782 Nov 20 21:20:12.591193 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3439/6985] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:20:11 2021] POST /compute/v2.1/servers => generated 405 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:20:12.601955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d21913e7-b8b2-4705-b19a-00edba25fff8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:12.603269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d21913e7-b8b2-4705-b19a-00edba25fff8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:12.714332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d21913e7-b8b2-4705-b19a-00edba25fff8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:12.728959 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d21913e7-b8b2-4705-b19a-00edba25fff8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1266 microversion: 2.1 time: 0.131857 Nov 20 21:20:12.730734 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3547/6986] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:12 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:20:13.749762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:13.751369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:13.774189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:13.775113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:13.777335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:13.778278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:13.909668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:13.921204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-331d4071-26f1-4251-93c4-8850d6ad7f04 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1318 microversion: 2.1 time: 0.176318 Nov 20 21:20:13.933203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3440/6987] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:13 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:14.649606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:14.650389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:14.661036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.661751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:14.662708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.663971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:14.695324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:20:14.781378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-765af379-2baf-46fd-87a0-5b593af2f613 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 204 len: 0 microversion: 2.1 time: 0.136110 Nov 20 21:20:14.782684 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3548/6988] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:20:14 2021] DELETE /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:20:14.791485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:14.792099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:14.801325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.801971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:14.802819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.803239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:14.958259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:14.959957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:14.975815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.977799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:14.980236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:14.981513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:15.011439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:15.022801 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf506f24-bde9-4c4d-b835-34a1477feefe tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1578 microversion: 2.1 time: 0.235006 Nov 20 21:20:15.035435 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3441/6989] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:14 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1578 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:15.378939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:15.388924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e9ce6252-76b6-4c8f-8f06-a124999896c0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.440218 Nov 20 21:20:15.389870 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3549/6990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:14 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:15.766071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bce925a6-7ab5-4e27-ba9c-2cdebefed67b req-81e86e07-ec24-4f97-8eed-58f16cae1ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:15.767819 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:15.767819 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:15.782959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bce925a6-7ab5-4e27-ba9c-2cdebefed67b req-81e86e07-ec24-4f97-8eed-58f16cae1ba6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:15.784380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bce925a6-7ab5-4e27-ba9c-2cdebefed67b req-81e86e07-ec24-4f97-8eed-58f16cae1ba6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:15.809464 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bce925a6-7ab5-4e27-ba9c-2cdebefed67b req-81e86e07-ec24-4f97-8eed-58f16cae1ba6 service nova] Creating event network-changed:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:20:15.824120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bce925a6-7ab5-4e27-ba9c-2cdebefed67b req-81e86e07-ec24-4f97-8eed-58f16cae1ba6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061565 Nov 20 21:20:15.826785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3442/6991] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:16.042816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:16.044003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:16.050839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:16.051304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:16.052156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:16.052595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:16.410760 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:16.411475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:16.420990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:16.422008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:16.423993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:16.424617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:16.572081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:16.579701 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3091a5a4-bbf8-4bf2-ad5f-7d56956c9755 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1578 microversion: 2.1 time: 0.540902 Nov 20 21:20:16.590439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3550/6992] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:16 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1578 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:16.770879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:16.779515 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-65d63170-8afa-44f7-a7ff-8abf0ac95c25 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.375676 Nov 20 21:20:16.780099 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3443/6993] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:16 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:17.597039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:17.598353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:17.606102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:17.606643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:17.607514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:17.608082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:17.796790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:17.797525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:17.808745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:17.812841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:17.813968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:17.815041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:17.815667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:17.823877 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fa7528fa-866c-4e63-9a7a-f82482fe2c65 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1578 microversion: 2.1 time: 0.230380 Nov 20 21:20:17.835833 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3551/6994] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:17 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:18.144563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:18.152675 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5bb3723-df7e-41a3-8af1-5e56d24e705d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.359644 Nov 20 21:20:18.153256 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3444/6995] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:17 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:20:18.320593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-56b8bc11-d2e0-4d95-9c49-860fd3375a97 req-caf2c595-4843-40b7-baf6-93db99cae195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f63e6faf-abb2-4827-a8d8-71e39e0309bb", "name": "network-vif-deleted", "tag": "39f50585-bcb7-49c3-9bc7-6f2b3717ea5c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:18.326418 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:18.326418 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:20:18.349678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-56b8bc11-d2e0-4d95-9c49-860fd3375a97 req-caf2c595-4843-40b7-baf6-93db99cae195 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:18.351567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-56b8bc11-d2e0-4d95-9c49-860fd3375a97 req-caf2c595-4843-40b7-baf6-93db99cae195 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:18.365843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-56b8bc11-d2e0-4d95-9c49-860fd3375a97 req-caf2c595-4843-40b7-baf6-93db99cae195 service nova] Creating event network-vif-deleted:39f50585-bcb7-49c3-9bc7-6f2b3717ea5c for instance f63e6faf-abb2-4827-a8d8-71e39e0309bb on nch2-master-1 Nov 20 21:20:18.372448 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-56b8bc11-d2e0-4d95-9c49-860fd3375a97 req-caf2c595-4843-40b7-baf6-93db99cae195 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055617 Nov 20 21:20:18.373594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3552/6996] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:18.844340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:18.845230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:18.855617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:18.857391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:18.859011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:18.859684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:18.906341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:18.907616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:18.909090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lazy-loading 'fault' on Instance uuid f63e6faf-abb2-4827-a8d8-71e39e0309bb {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:20:18.977646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:18.985600 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1122e96d-6ed0-46c5-92b5-88520e4340df tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 200 len: 1185 microversion: 2.1 time: 0.146582 Nov 20 21:20:18.988257 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3445/6997] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:18 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 1185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:19.170685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:19.172059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:19.180431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:19.181427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:19.182604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:19.184019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:19.372520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:19.382158 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54401ec0-1443-4aee-b542-56cbc68fdd5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.216407 Nov 20 21:20:19.383690 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3553/6998] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:19 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:20.005708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:20.006536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:20.015550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.016551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.017547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.018430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.036373 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. Nov 20 21:20:20.037248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:20:20.038817 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab2f274e-6a09-41e7-9b81-9ef9a7202b14 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 404 len: 111 microversion: 2.1 time: 0.036972 Nov 20 21:20:20.039924 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3446/6999] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:19 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:20:20.171354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-173406669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1010325959", "security_groups": [{"name": "tempest-secgroup-smoke-1225146311"}], "block_device_mapping_v2": [{"uuid": "1c525edb-e9c4-4a6d-98f9-a951189a0927", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:20.303680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:20:20.399864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:20.400829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:20.410311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.411002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.412027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.412702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.708170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:20.717718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e32e0a83-4c3e-4ed7-a003-030ef178a689 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.321891 Nov 20 21:20:20.722702 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3447/7000] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:20 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:20:20.843843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:20:20.844290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:20:20.845404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:20:20.847160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:20:20.847685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:20:20.857176 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.857780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.861319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.861770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.881467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:20:20.888520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:20:20.903182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4f1fbf2d-ad87-48a8-9b31-3507de78152e req-740118f1-6a2c-4fc3-878d-df7d8684ee90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-plugged", "status": "completed", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:20.906251 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:20.906251 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:20.916893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4f1fbf2d-ad87-48a8-9b31-3507de78152e req-740118f1-6a2c-4fc3-878d-df7d8684ee90 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:20.917762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4f1fbf2d-ad87-48a8-9b31-3507de78152e req-740118f1-6a2c-4fc3-878d-df7d8684ee90 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:20.933979 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4f1fbf2d-ad87-48a8-9b31-3507de78152e req-740118f1-6a2c-4fc3-878d-df7d8684ee90 service nova] Creating event network-vif-plugged:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:20:20.939435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4f1fbf2d-ad87-48a8-9b31-3507de78152e req-740118f1-6a2c-4fc3-878d-df7d8684ee90 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040020 Nov 20 21:20:20.940430 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3448/7001] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:20.981351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:20:20.985558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c525edb-e9c4-4a6d-98f9-a951189a0927',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:20:21.151965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd95ba01-2136-4753-929f-cf965690df5e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.984261 Nov 20 21:20:21.153051 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3554/7002] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:20:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:20:21.165313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9988c840-e33d-49ca-b5d8-629912a714f3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:21.166807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9988c840-e33d-49ca-b5d8-629912a714f3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:21.244570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9988c840-e33d-49ca-b5d8-629912a714f3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:21.256383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9988c840-e33d-49ca-b5d8-629912a714f3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1094 microversion: 2.1 time: 0.097216 Nov 20 21:20:21.257551 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3449/7003] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:21 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:21.744920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:21.745556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:21.752979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:21.753521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:21.754499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:21.754949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:21.960700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:21.968002 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbec24fd-34ab-44a3-9680-3f3458c946cf tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1391 microversion: 2.1 time: 0.233157 Nov 20 21:20:21.968580 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3555/7004] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:21 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:22.276077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:22.277622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:22.287964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:22.288839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:22.289972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:22.290761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:22.409727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:22.418298 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71fdbfff-f209-4d37-a8d9-58c6944c9f10 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1210 microversion: 2.1 time: 0.148230 Nov 20 21:20:22.419814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3450/7005] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:22 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:22.986163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:22.987961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:23.004677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.005572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.007817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.008505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.267419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:23.277565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-733fb5df-51b7-46ad-aa2e-8c26769de6b4 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1564 microversion: 2.1 time: 0.295123 Nov 20 21:20:23.278141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3556/7006] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:22 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1564 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:23.295318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:23.295690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:23.303045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.304747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.305866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.306333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.438291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:23.439300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:23.457295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.458244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.459516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:23.464591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:23.566483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:23.577209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-12a69fff-c4ea-4e86-bbfb-cf8f3f3c2a95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1564 microversion: 2.1 time: 0.286629 Nov 20 21:20:23.597272 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3451/7007] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:23 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1564 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:23.866754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:23.887835 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0650b14a-284d-4426-aef9-1f61b9967344 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1278 microversion: 2.1 time: 0.455318 Nov 20 21:20:23.890231 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3557/7008] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:23 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:24.778617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-187185f7-c5a7-4296-a887-4d681adbee39 req-dd487a54-49d1-462d-ae1b-621757ca71ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec31f22e-7a3c-4e54-9723-717b3c619e29", "tag": "c2292d41-b405-4690-8d85-66a2902c9bd5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:24.781424 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:24.781424 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:24.801004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-187185f7-c5a7-4296-a887-4d681adbee39 req-dd487a54-49d1-462d-ae1b-621757ca71ad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:24.801455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-187185f7-c5a7-4296-a887-4d681adbee39 req-dd487a54-49d1-462d-ae1b-621757ca71ad service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:24.820976 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-187185f7-c5a7-4296-a887-4d681adbee39 req-dd487a54-49d1-462d-ae1b-621757ca71ad service nova] Creating event network-changed:c2292d41-b405-4690-8d85-66a2902c9bd5 for instance ec31f22e-7a3c-4e54-9723-717b3c619e29 on nch1-master-1 Nov 20 21:20:24.834507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-187185f7-c5a7-4296-a887-4d681adbee39 req-dd487a54-49d1-462d-ae1b-621757ca71ad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060415 Nov 20 21:20:24.838824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3452/7009] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:24.908028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:24.910005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:24.944250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:24.949401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:24.952400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:24.953031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:25.285796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:25.294939 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-708bb580-1eec-4e18-ac5e-3225e18a31e6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1266 microversion: 2.1 time: 0.392073 Nov 20 21:20:25.295639 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3558/7010] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:24 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1266 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:26.313934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:26.315554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:26.323495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:26.324175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:26.325381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:26.326078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:27.084973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:27.094899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34c28584-80ac-4d71-bbb2-15036fec6337 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1266 microversion: 2.1 time: 0.785187 Nov 20 21:20:27.096619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3453/7011] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:26 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1266 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:27.298628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:27.299244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:27.306501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6e8dcb8d-6f22-4844-99bb-67418a3594b8 req-5d3f1be1-c615-4094-a254-f21780bb04de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:27.307092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:27.307560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:27.308353 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:27.308353 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:27.308519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:27.308807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:27.315744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6e8dcb8d-6f22-4844-99bb-67418a3594b8 req-5d3f1be1-c615-4094-a254-f21780bb04de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:27.316232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6e8dcb8d-6f22-4844-99bb-67418a3594b8 req-5d3f1be1-c615-4094-a254-f21780bb04de service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:27.331759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6e8dcb8d-6f22-4844-99bb-67418a3594b8 req-5d3f1be1-c615-4094-a254-f21780bb04de service nova] Creating event network-changed:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:20:27.337123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6e8dcb8d-6f22-4844-99bb-67418a3594b8 req-5d3f1be1-c615-4094-a254-f21780bb04de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034796 Nov 20 21:20:27.338177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3454/7012] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:27.466773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:27.475250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45909df8-0378-441e-89c9-2b0c55213efe tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1564 microversion: 2.1 time: 0.180331 Nov 20 21:20:27.476677 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3559/7013] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:27 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:28.112407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:28.113235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:28.119526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:28.119945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:28.120764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:28.121224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:28.261496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:28.268861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1f18da9-0b26-42a0-80ff-51a3a5ea02a0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1266 microversion: 2.1 time: 0.160465 Nov 20 21:20:28.269441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3455/7014] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:28 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:29.286686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:29.287323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:29.294880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:29.295341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:29.296131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:29.296574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:29.324870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8425d8ca-beb1-4e5d-9b21-df87681e7e73 req-d7dfc2d8-0e61-4ade-bf46-371a7a1c7140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec31f22e-7a3c-4e54-9723-717b3c619e29", "name": "network-vif-plugged", "status": "completed", "tag": "c2292d41-b405-4690-8d85-66a2902c9bd5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:29.326447 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:29.326447 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:29.336194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8425d8ca-beb1-4e5d-9b21-df87681e7e73 req-d7dfc2d8-0e61-4ade-bf46-371a7a1c7140 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:29.337300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8425d8ca-beb1-4e5d-9b21-df87681e7e73 req-d7dfc2d8-0e61-4ade-bf46-371a7a1c7140 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:29.349480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8425d8ca-beb1-4e5d-9b21-df87681e7e73 req-d7dfc2d8-0e61-4ade-bf46-371a7a1c7140 service nova] Creating event network-vif-plugged:c2292d41-b405-4690-8d85-66a2902c9bd5 for instance ec31f22e-7a3c-4e54-9723-717b3c619e29 on nch1-master-1 Nov 20 21:20:29.355165 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8425d8ca-beb1-4e5d-9b21-df87681e7e73 req-d7dfc2d8-0e61-4ade-bf46-371a7a1c7140 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033891 Nov 20 21:20:29.356083 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3456/7015] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:20:29.440448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:29.448814 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0ba14eb-d699-444d-81ee-01db8132311d tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1266 microversion: 2.1 time: 0.165749 Nov 20 21:20:29.449682 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3560/7016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:29 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:30.467014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:30.468030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:30.476525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:30.477184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:30.478113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:30.478584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:30.631763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:30.639886 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec13a1bd-b112-4bca-bf8d-62a0a730158b tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1452 microversion: 2.1 time: 0.177111 Nov 20 21:20:30.640471 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3457/7017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:30 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:30.656206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:30.656825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:30.664221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:30.664682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:30.665471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:30.665917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:30.802148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:30.809890 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1beae348-5927-4a28-b549-cb7d1d455e9c tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1452 microversion: 2.1 time: 0.157309 Nov 20 21:20:30.810539 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3561/7018] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:30 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:32.403272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8f5a2c21-b940-4f44-a6cd-381e4dac08fa req-57c9a45e-4535-4ee6-88fa-c7dec1cb51c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec31f22e-7a3c-4e54-9723-717b3c619e29", "tag": "c2292d41-b405-4690-8d85-66a2902c9bd5"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:32.404845 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:20:32.404845 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:20:32.413571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8f5a2c21-b940-4f44-a6cd-381e4dac08fa req-57c9a45e-4535-4ee6-88fa-c7dec1cb51c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:32.414141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8f5a2c21-b940-4f44-a6cd-381e4dac08fa req-57c9a45e-4535-4ee6-88fa-c7dec1cb51c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:32.426822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8f5a2c21-b940-4f44-a6cd-381e4dac08fa req-57c9a45e-4535-4ee6-88fa-c7dec1cb51c1 service nova] Creating event network-changed:c2292d41-b405-4690-8d85-66a2902c9bd5 for instance ec31f22e-7a3c-4e54-9723-717b3c619e29 on nch1-master-1 Nov 20 21:20:32.432170 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8f5a2c21-b940-4f44-a6cd-381e4dac08fa req-57c9a45e-4535-4ee6-88fa-c7dec1cb51c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032787 Nov 20 21:20:32.432918 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3458/7019] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:20:47.793801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:47.794725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:47.801132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:47.801587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:47.802463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:47.803618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:47.852156 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90438d0b-c3e3-4037-9d3c-3dbb2f847c5e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action" status: 200 len: 24570 microversion: 2.1 time: 0.061939 Nov 20 21:20:47.858965 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3562/7020] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:20:47 2021] POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action => generated 24570 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:20:54.220346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:54.221061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:54.228455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.228932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.229708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.230173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.357488 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c91eef5b-be71-42fa-9e63-e8638b93f57f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1834 microversion: 2.1 time: 0.141162 Nov 20 21:20:54.358093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3459/7021] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:54 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1834 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:54.374220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:54.374920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:54.382126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.383139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.384326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.384778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.524251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:54.531714 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3d18649-8a43-4b37-a963-f00af2d61b41 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1683 microversion: 2.1 time: 0.161726 Nov 20 21:20:54.532286 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3563/7022] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:54 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:54.628783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:54.629739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:54.636350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.636803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.637590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.638030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.687939 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-332260af-2090-4913-a407-4c79378f3709 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action" status: 200 len: 32647 microversion: 2.1 time: 0.062701 Nov 20 21:20:54.688623 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3460/7023] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:20:54 2021] POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action => generated 32647 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:20:54.839926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:20:54.840438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:54.846936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.847404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.848199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:54.848653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:54.875936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c4a93cca2e8478b972cbb29e3287092', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a473f08dff447688bf533507566fc40', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:54.876533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] flavor_id is None. Assuming migration. {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4073}} Nov 20 21:20:54.876986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:20:54.986958 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47aaf15b-0fc3-4cc9-96a2-6b828b50e3a1 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action" status: 202 len: 0 microversion: 2.1 time: 0.150816 Nov 20 21:20:54.987733 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3564/7024] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:20:54 2021] POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:20:54.997095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:54.997875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:55.005246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:55.005710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:55.006535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:55.006982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:55.169933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:55.180616 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-633585ca-ed26-48cc-9960-1c83493b9ae7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1692 microversion: 2.1 time: 0.187526 Nov 20 21:20:55.181185 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3461/7025] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:54 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:56.198978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:56.199618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:56.206733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:56.207201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:56.208218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:56.208689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:56.384421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:56.394280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4d75d5a-1b28-4ef2-919c-ad228e699ed3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1692 microversion: 2.1 time: 0.199016 Nov 20 21:20:56.404830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3565/7026] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:56 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:57.412155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:57.412945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:57.421481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:57.421863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:57.422795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:57.423277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:57.574966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:57.583142 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5c55112-72df-420e-9c03-51bcb61ce3ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.174937 Nov 20 21:20:57.583814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3462/7027] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:57 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:58.604476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:58.605097 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:58.612826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:58.613288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:58.614286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:58.614976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:58.766384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:20:58.774531 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3577f259-ff45-46cf-a990-fa3160643611 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.175457 Nov 20 21:20:58.775115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3566/7028] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:58 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:20:59.791795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:20:59.792387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:20:59.799038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:59.799488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:20:59.800262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:20:59.800805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:00.092504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:00.099715 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61e86724-4d1d-41d6-b8a2-6cbc9daf2164 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.312427 Nov 20 21:21:00.100279 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3463/7029] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:20:59 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:21:01.116791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:01.117411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:01.124701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:01.125163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:01.125953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:01.126425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:01.264794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:01.272280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ec13bde-f450-4308-b139-bdbc1d794f95 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.159244 Nov 20 21:21:01.272852 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3567/7030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:01 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:02.289131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:02.290486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:02.297145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:02.297597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:02.298406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:02.298842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:02.435503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:02.442810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-263540ee-0360-4e51-8e8b-111c350c13ae tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.157305 Nov 20 21:21:02.443378 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3464/7031] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:02 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:03.460631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:03.461276 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:03.468740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:03.469194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:03.469973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:03.470439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:03.607495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:03.614864 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9544d75-5a39-42a3-b9f0-7fd46f16eb01 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.157939 Nov 20 21:21:03.615444 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3568/7032] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:03 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:04.636077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:04.636592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:04.643315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:04.643767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:04.644543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:04.644985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:04.777931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:04.785302 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-27a14d68-d2d5-4b86-86ad-c92c1d2e3951 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.153161 Nov 20 21:21:04.785868 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3465/7033] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:04 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:05.802597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:05.803128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:05.810552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:05.811009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:05.811790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:05.812233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:06.006736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:06.014286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c0e0200-cbbd-4eb9-9df0-ef43cf088c0d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.215361 Nov 20 21:21:06.014889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3569/7034] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:05 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:07.031697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:07.032300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:07.038962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:07.039408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:07.040183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:07.040624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:07.171060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:07.178425 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fc38688a-8d81-44ac-bf57-d04b8a333a44 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.150390 Nov 20 21:21:07.178998 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3466/7035] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:07 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:08.195370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:08.196025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:08.203545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:08.204003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:08.204791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:08.205231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:08.342829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:08.349905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9427038f-97f5-4d70-8de4-18ca336e549a tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1697 microversion: 2.1 time: 0.158194 Nov 20 21:21:08.350532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3570/7036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:08 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:09.236473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-unplugged", "status": "completed", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:09.237993 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:09.237993 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:21:09.247113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:09.247577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:09.260083 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] Creating event network-vif-unplugged:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch1-master-1 Nov 20 21:21:09.265608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] Instance f7efd91e-b566-4459-8ec6-c327527a26ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:21:09.276830 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4fffa62e-2d60-4466-9874-3e04989a8d5d req-8d9cc5a7-b916-41b8-ab39-e2a99ddd6e7f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043999 Nov 20 21:21:09.277470 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3467/7037] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:09.366450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:09.367086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:09.374607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:09.375074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:09.375887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:09.376518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:09.535812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:09.544133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99a586d6-a844-4de4-a444-59ddf2dfccbd tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1696 microversion: 2.1 time: 0.181398 Nov 20 21:21:09.544732 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3571/7038] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:09 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:10.563522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:10.564340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:10.571719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:10.572833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:10.573878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:10.574418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:10.715807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:10.723236 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c1197e0-e7db-4688-8a44-7563d760e980 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1696 microversion: 2.1 time: 0.164560 Nov 20 21:21:10.723802 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3468/7039] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:10 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:11.293663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:11.295396 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:11.295396 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:11.302964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:11.303430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:11.314449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] Creating event network-changed:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch1-master-1 Nov 20 21:21:11.319577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] Instance f7efd91e-b566-4459-8ec6-c327527a26ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:21:11.331244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-05d5cc95-734b-4943-bf06-58d19ddb21be req-ad1939f9-9656-4e1f-b5c4-9b9128f5c782 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041769 Nov 20 21:21:11.331866 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3572/7040] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:11.740504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:11.741148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:11.748322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:11.749031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:11.749827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:11.750332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:12.060267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:12.068191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0ac7fd6-5ba1-40d1-8cbf-6bd271949d76 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1694 microversion: 2.1 time: 0.331322 Nov 20 21:21:12.069121 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3469/7041] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:11 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1694 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:13.087381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:13.088782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:13.095495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.095961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.096751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.097200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.236574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:13.244020 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3933ed97-c54b-41d6-9830-7d641c881dc8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1691 microversion: 2.1 time: 0.160736 Nov 20 21:21:13.244746 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3573/7042] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:13 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:13.261147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:13.261697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:13.268402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.268861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.269644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.270111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.377528 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-172ff69e-cfc0-41cf-bece-b81f5d0b7804 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action" status: 202 len: 0 microversion: 2.1 time: 0.120413 Nov 20 21:21:13.378187 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3470/7043] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:21:13 2021] POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:21:13.387748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:13.388658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:13.395305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.396279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.397209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:13.397711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:13.583321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:13.591047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c852a7f-0784-417f-a6d0-7013e2e2bb09 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.208253 Nov 20 21:21:13.591613 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3574/7044] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:13 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:14.610346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:14.611033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:14.617889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:14.618383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:14.619853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:14.620284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:14.757400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:14.764763 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-962d44c0-df63-4d14-b1e3-406143696194 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.159398 Nov 20 21:21:14.765330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3471/7045] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:14 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:21:15.522344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-plugged", "status": "completed", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:15.524097 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:15.524097 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:15.532267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:15.532812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:15.547724 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] Creating event network-vif-plugged:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch1-master-1 Nov 20 21:21:15.553032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] Instance f7efd91e-b566-4459-8ec6-c327527a26ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:21:15.566658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1e4ca6ec-3a11-46da-a690-7a7dc477b04e req-5d663d7a-822e-488c-a8d3-8de7e1521f1f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047722 Nov 20 21:21:15.567274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3575/7046] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:15.783882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:15.784496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:15.792753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:15.793203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:15.793996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:15.794455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:15.935881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:15.943139 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1591f040-b295-4276-b1f8-8a1c3b0389d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.164782 Nov 20 21:21:15.943835 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3472/7047] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:15 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:16.489279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-unplugged", "status": "completed", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:16.490794 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:16.490794 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:16.497883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:16.498602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:16.509909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] Creating event network-vif-unplugged:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:21:16.516967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] Instance f7efd91e-b566-4459-8ec6-c327527a26ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:21:16.528843 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2b4ff992-4a12-4176-9ac4-c51ac7119770 req-d20f63cb-0547-4390-abda-5fd8d08b752b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043427 Nov 20 21:21:16.529456 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3576/7048] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:21:16.960407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:16.961154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:16.968769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:16.969312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:16.970253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:16.970765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:17.297481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:17.310716 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1a908ed8-c993-4816-a1fc-35f8131c3ceb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.353462 Nov 20 21:21:17.312691 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3473/7049] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:16 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:18.329922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:18.330610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:18.336735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:18.337193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:18.338084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:18.338539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:18.474872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:18.482734 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0f51c06-ba9d-4e0b-bb0d-2d1c2a65e70e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.157742 Nov 20 21:21:18.483306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3577/7050] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:18 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:18.544264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:18.545765 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:18.545765 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:21:18.553398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:18.553845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:18.565571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] Creating event network-changed:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:21:18.570763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] Instance f7efd91e-b566-4459-8ec6-c327527a26ef is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:21:18.581054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1cf3f591-ffb8-4af4-933b-778ea0b7ac33 req-1617733e-4b95-4d78-9a84-22aa9e2ff739 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040826 Nov 20 21:21:18.581571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3474/7051] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:19.501169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:19.501811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:19.508487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:19.508942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:19.510192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:19.510655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:19.679947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:19.688381 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b93b20c5-d7de-4f80-9d70-b64f6697381e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1690 microversion: 2.1 time: 0.191525 Nov 20 21:21:19.688996 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3578/7052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:19 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:20.709742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:20.710370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:20.716829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:20.717288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:20.718115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:20.718561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:20.855892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:20.863220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5b5eca6-0735-4605-bd99-2ea0f5233d61 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1683 microversion: 2.1 time: 0.158411 Nov 20 21:21:20.863805 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3475/7053] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:20 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:23.087130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-cef9c918-e69e-43ed-abb3-2c7e8434261f req-28ce1f30-9e52-4e94-841e-210db4e14bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-plugged", "status": "completed", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:23.089190 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:23.089190 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:23.100842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cef9c918-e69e-43ed-abb3-2c7e8434261f req-28ce1f30-9e52-4e94-841e-210db4e14bfc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:23.101889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cef9c918-e69e-43ed-abb3-2c7e8434261f req-28ce1f30-9e52-4e94-841e-210db4e14bfc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:23.115323 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-cef9c918-e69e-43ed-abb3-2c7e8434261f req-28ce1f30-9e52-4e94-841e-210db4e14bfc service nova] Creating event network-vif-plugged:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:21:23.122301 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-cef9c918-e69e-43ed-abb3-2c7e8434261f req-28ce1f30-9e52-4e94-841e-210db4e14bfc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039399 Nov 20 21:21:23.123258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3579/7054] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:21:45.053287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:45.054313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:45.060245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:45.060704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:45.061489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:45.061941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:45.115607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c885229-c2ca-4d81-94f4-6181eb3927d8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action" status: 200 len: 62508 microversion: 2.1 time: 0.066182 Nov 20 21:21:45.116259 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3476/7055] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:21:45 2021] POST /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef/action => generated 62508 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:21:51.665316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:51.665972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:51.672904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:51.673366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:51.674193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:51.674648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:51.802360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aaf3be8e-f56c-4cf4-991d-95c2701434d6 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1834 microversion: 2.1 time: 0.141330 Nov 20 21:21:51.802932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3580/7056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:51 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1834 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:52.664681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:52.665269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:52.671031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-36b62099-256a-4b0e-ad27-919185cc1ef6 req-5cb32924-5d17-4f2a-bf7f-a69cbe113a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:52.673747 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:52.673747 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:52.685633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:52.686112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:52.686243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-36b62099-256a-4b0e-ad27-919185cc1ef6 req-5cb32924-5d17-4f2a-bf7f-a69cbe113a2b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:52.686698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-36b62099-256a-4b0e-ad27-919185cc1ef6 req-5cb32924-5d17-4f2a-bf7f-a69cbe113a2b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:52.686893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:52.687346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:52.697894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-36b62099-256a-4b0e-ad27-919185cc1ef6 req-5cb32924-5d17-4f2a-bf7f-a69cbe113a2b service nova] Creating event network-changed:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:21:52.703381 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-36b62099-256a-4b0e-ad27-919185cc1ef6 req-5cb32924-5d17-4f2a-bf7f-a69cbe113a2b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035940 Nov 20 21:21:52.704611 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3581/7057] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:52.713718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:21:52.798851 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c81743a-66cd-41b5-b6a0-395a3ba4274d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 204 len: 0 microversion: 2.1 time: 0.138380 Nov 20 21:21:52.809199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3477/7058] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:21:52 2021] DELETE /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:21:52.817960 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:52.818766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:52.825049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:52.825518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:52.826351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:52.826798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:52.973897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:52.982961 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30737333-fed0-42c0-ba22-538623d830e9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1689 microversion: 2.1 time: 0.169247 Nov 20 21:21:52.986097 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3582/7059] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:52 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:54.001528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:54.002161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:54.009466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:54.009917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:54.010730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:54.011165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:54.239015 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:21:54.246401 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-817aee06-1ecd-4f60-8970-2bd0eb4369cb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 200 len: 1570 microversion: 2.1 time: 0.249332 Nov 20 21:21:54.247177 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3478/7060] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:53 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 1570 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:21:54.782975 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-052f28c6-4072-46df-ae0b-418cf186bcb2 req-ea3cc8f0-58be-4dca-8633-6204433974c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7efd91e-b566-4459-8ec6-c327527a26ef", "name": "network-vif-deleted", "tag": "992e9d11-a9f7-41c8-8f5b-9f721b985662"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:54.784497 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:21:54.784497 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:21:54.791279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-052f28c6-4072-46df-ae0b-418cf186bcb2 req-ea3cc8f0-58be-4dca-8633-6204433974c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:54.791730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-052f28c6-4072-46df-ae0b-418cf186bcb2 req-ea3cc8f0-58be-4dca-8633-6204433974c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:54.802665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-052f28c6-4072-46df-ae0b-418cf186bcb2 req-ea3cc8f0-58be-4dca-8633-6204433974c8 service nova] Creating event network-vif-deleted:992e9d11-a9f7-41c8-8f5b-9f721b985662 for instance f7efd91e-b566-4459-8ec6-c327527a26ef on nch2-master-1 Nov 20 21:21:54.807286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-052f28c6-4072-46df-ae0b-418cf186bcb2 req-ea3cc8f0-58be-4dca-8633-6204433974c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093214 Nov 20 21:21:54.807880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3583/7061] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:21:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:21:55.264477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:55.265228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: f7efd91e-b566-4459-8ec6-c327527a26ef] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:21:55.271862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:55.272306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:55.273079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:21:55.273511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:21:55.286362 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] HTTP exception thrown: Instance f7efd91e-b566-4459-8ec6-c327527a26ef could not be found. Nov 20 21:21:55.286941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Returning 404 to user: Instance f7efd91e-b566-4459-8ec6-c327527a26ef could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:21:55.287745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86780677-9c21-4306-b4f8-0c4951ca947e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef" status: 404 len: 111 microversion: 2.1 time: 0.027055 Nov 20 21:21:55.288275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3479/7062] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:21:55 2021] GET /compute/v2.1/servers/f7efd91e-b566-4459-8ec6-c327527a26ef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:21:58.663685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79ff5b15-b121-4969-97f8-920aafd6353d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '.version_select at 0x7f3f86420670>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:21:58.682283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79ff5b15-b121-4969-97f8-920aafd6353d tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-207296678" status: 202 len: 0 microversion: 2.1 time: 0.023354 Nov 20 21:21:58.687958 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3584/7063] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:21:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-207296678 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:21:58.712727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: .version_select at 0x7f3f85d009d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-272711047"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:21:58.728486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:21:58.734477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:21:59.336991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:21:59.341755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:21:59.356086 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-816063cb-d383-43b3-afec-eb6b06ac7afc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.647150 Nov 20 21:21:59.356687 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3480/7064] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:21:58 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:04.736669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1757273752", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "b3f86429-0b60-4f10-896d-f73cc2a57195"}], "key_name": "tempest-TestNetworkAdvancedServerOps-272711047", "security_groups": [{"name": "tempest-secgroup-smoke-1997182537"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:04.848915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] validate_networks() for [('b3f86429-0b60-4f10-896d-f73cc2a57195', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:22:05.318427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:22:05.318861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:22:05.319342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:22:05.319761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:22:05.320184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:22:05.333312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:05.333851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:05.334784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:05.335354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:05.352197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:22:05.357576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:22:05.370512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:22:05.373551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:22:05.423589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1a977bf-b35b-493f-9579-07edb1d275f8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691555 Nov 20 21:22:05.424714 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3585/7065] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:22:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:22:05.437197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44f517e9-47ea-4698-bc1f-62094a935def tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:05.437810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44f517e9-47ea-4698-bc1f-62094a935def tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:05.525689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-44f517e9-47ea-4698-bc1f-62094a935def tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:05.539117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44f517e9-47ea-4698-bc1f-62094a935def tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1266 microversion: 2.1 time: 0.106780 Nov 20 21:22:05.549303 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3481/7066] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:05 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:06.556278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:06.559481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:06.583376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:06.583996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:06.584935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:06.586725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:06.694344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:06.703817 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5434f440-836f-4dd4-a326-8f106333f4a8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1336 microversion: 2.1 time: 0.150823 Nov 20 21:22:06.704815 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3586/7067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:06 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1336 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:07.723509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:07.724751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:07.732928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:07.734369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:07.735844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:07.736294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:07.999468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:08.012641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8fecb75-03be-43dc-9e92-af721fcc486c tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.293893 Nov 20 21:22:08.024762 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3482/7068] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:07 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:08.189524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d0e053e2-8e92-4f04-914b-cbe4a1f1bf00 req-5e53367b-83f5-49c3-a859-7eb004154f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:08.191992 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:08.191992 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:08.218730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d0e053e2-8e92-4f04-914b-cbe4a1f1bf00 req-5e53367b-83f5-49c3-a859-7eb004154f94 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:08.219077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d0e053e2-8e92-4f04-914b-cbe4a1f1bf00 req-5e53367b-83f5-49c3-a859-7eb004154f94 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:08.233965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d0e053e2-8e92-4f04-914b-cbe4a1f1bf00 req-5e53367b-83f5-49c3-a859-7eb004154f94 service nova] Creating event network-changed:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:08.242034 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d0e053e2-8e92-4f04-914b-cbe4a1f1bf00 req-5e53367b-83f5-49c3-a859-7eb004154f94 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065564 Nov 20 21:22:08.242672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3587/7069] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:09.031058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:09.031814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:09.038504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:09.038956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:09.039735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:09.040175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:09.244309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:09.252712 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5188cc95-8f8e-40d9-9b2f-107906e5d04e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.225976 Nov 20 21:22:09.253302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3483/7070] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:09 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:10.271721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:10.272461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:10.278612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:10.279066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:10.279845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:10.280290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:10.421153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:10.429301 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-14939416-42a6-480d-8620-c2a51cd9f5ad tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.163178 Nov 20 21:22:10.429884 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3588/7071] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:10 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:11.445652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:11.446375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:11.453136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:11.453610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:11.454427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:11.454862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:11.593295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:11.600761 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e9a315a8-ae30-4cf9-a58b-59a134a442f0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.158866 Nov 20 21:22:11.601335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3484/7072] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:11 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:12.617411 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:12.618029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:12.625037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:12.626403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:12.627453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:12.628304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:12.766951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:12.774762 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da4f79f0-7ef0-4274-8999-dd8494e42d6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.160958 Nov 20 21:22:12.775341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3589/7073] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:12 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:13.284585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-d23a287f-1042-4592-86da-19abb2d6411e req-b02fef69-ed97-4421-9404-100bd8b61826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "name": "network-vif-plugged", "status": "completed", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:13.286171 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:13.286171 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:22:13.294022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d23a287f-1042-4592-86da-19abb2d6411e req-b02fef69-ed97-4421-9404-100bd8b61826 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:13.294670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-d23a287f-1042-4592-86da-19abb2d6411e req-b02fef69-ed97-4421-9404-100bd8b61826 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:13.306808 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-d23a287f-1042-4592-86da-19abb2d6411e req-b02fef69-ed97-4421-9404-100bd8b61826 service nova] Creating event network-vif-plugged:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:13.313027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-d23a287f-1042-4592-86da-19abb2d6411e req-b02fef69-ed97-4421-9404-100bd8b61826 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102551 Nov 20 21:22:13.314805 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3485/7074] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:13.791366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:13.792009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:13.799346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:13.799812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:13.800606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:13.801054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:13.935724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:13.943282 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-060797e6-ab45-4cbf-af74-b135c6b89720 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1392 microversion: 2.1 time: 0.155635 Nov 20 21:22:13.943863 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3590/7075] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:13 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:14.960739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:14.961435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:14.968166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:14.968613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:14.969474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:14.970000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:15.105324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:15.113601 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f67f1f82-a45c-4d82-a8dd-f8b9c72b56db tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1564 microversion: 2.1 time: 0.157031 Nov 20 21:22:15.114217 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3486/7076] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:14 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:15.129703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:15.130342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:15.136958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:15.137420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:15.138231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:15.138676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:15.271090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:15.278348 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfb491f7-8330-4357-a2a4-1bfe2dbd6fed tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1564 microversion: 2.1 time: 0.152413 Nov 20 21:22:15.278914 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3591/7077] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:15 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:17.212742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a13c3487-48e0-4c61-8ee5-94649a92f464 req-8e25ca4b-2884-49ba-97d5-44974cbbc670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:17.214164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:17.214781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:17.217074 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:17.217074 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:17.239802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:17.240776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:17.241117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a13c3487-48e0-4c61-8ee5-94649a92f464 req-8e25ca4b-2884-49ba-97d5-44974cbbc670 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:17.241921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:17.242467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:17.246107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a13c3487-48e0-4c61-8ee5-94649a92f464 req-8e25ca4b-2884-49ba-97d5-44974cbbc670 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:17.263869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a13c3487-48e0-4c61-8ee5-94649a92f464 req-8e25ca4b-2884-49ba-97d5-44974cbbc670 service nova] Creating event network-changed:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:17.271272 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a13c3487-48e0-4c61-8ee5-94649a92f464 req-8e25ca4b-2884-49ba-97d5-44974cbbc670 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063427 Nov 20 21:22:17.272737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3592/7078] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:17.927883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:17.937293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fa3f7aa-7399-4080-8440-f7b19eff223f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1564 microversion: 2.1 time: 0.733355 Nov 20 21:22:17.938403 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3487/7079] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:17 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1564 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:23.686492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1272665917", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1010325959", "security_groups": [{"name": "tempest-secgroup-smoke-1225146311"}], "block_device_mapping_v2": [{"uuid": "da0d5896-ddcd-458d-a28f-29c7f2980025", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ec52e298-c6c7-453e-a2fa-373fbe63335d"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:23.809877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] validate_networks() for [('ec52e298-c6c7-453e-a2fa-373fbe63335d', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:22:24.185286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:22:24.185720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:22:24.186407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:22:24.186836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:22:24.187286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:22:24.195956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:24.196410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:24.197228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:24.197668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:24.213822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:22:24.218856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Getting quotas for user c2784bd65c034a73a10a1d9fb60f8939 and project 6028b150b064464f9c6d8e21d3af617e. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:22:24.274539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:22:24.276756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da0d5896-ddcd-458d-a28f-29c7f2980025',volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:22:24.397522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ec9442d-c120-4b7f-9b65-d734336d5aa6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715024 Nov 20 21:22:24.398201 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3593/7080] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:22:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:22:24.407819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b408d36-a5b3-4ccb-a6b1-e8252e4d525a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:24.408432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b408d36-a5b3-4ccb-a6b1-e8252e4d525a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:24.469036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b408d36-a5b3-4ccb-a6b1-e8252e4d525a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:24.477353 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b408d36-a5b3-4ccb-a6b1-e8252e4d525a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1095 microversion: 2.1 time: 0.072726 Nov 20 21:22:24.478771 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3488/7081] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:24 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:25.496294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:25.496904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:25.503555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:25.504003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:25.504893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:25.505469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:25.570745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:25.578982 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5ce9f3a-5864-4080-8891-f818bb8e4fc0 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1211 microversion: 2.1 time: 0.087353 Nov 20 21:22:25.580169 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3594/7082] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:25 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:26.596972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:26.597640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:26.606525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:26.607199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:26.608321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:26.608775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:26.659866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-cb1bfeac-11c3-4ab0-bd45-409266b2f774 req-9451532f-51f8-4b7e-9b70-a4375c85b674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5e510d-1fa6-4db2-ac2e-ad4225c82111", "tag": "4d6308f8-f047-413a-a967-785ed5bf9bd4"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:26.662429 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:26.662429 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:26.671700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cb1bfeac-11c3-4ab0-bd45-409266b2f774 req-9451532f-51f8-4b7e-9b70-a4375c85b674 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:26.672214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-cb1bfeac-11c3-4ab0-bd45-409266b2f774 req-9451532f-51f8-4b7e-9b70-a4375c85b674 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:26.688952 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-cb1bfeac-11c3-4ab0-bd45-409266b2f774 req-9451532f-51f8-4b7e-9b70-a4375c85b674 service nova] Creating event network-changed:4d6308f8-f047-413a-a967-785ed5bf9bd4 for instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 on nch1-master-1 Nov 20 21:22:26.695815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-cb1bfeac-11c3-4ab0-bd45-409266b2f774 req-9451532f-51f8-4b7e-9b70-a4375c85b674 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040680 Nov 20 21:22:26.696995 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3595/7083] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:26.887822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:26.895863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e76ecd95-4447-4314-9724-d9450d10e185 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.302938 Nov 20 21:22:26.896689 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3489/7084] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:26 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:27.913300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:27.914170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:27.921058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:27.921520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:27.922350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:27.922800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:28.057888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:28.065347 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d6cbeb8-a313-4b2e-8d57-61ba7b712077 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.156158 Nov 20 21:22:28.066435 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3596/7085] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:27 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:29.082335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:29.083456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:29.090138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:29.090593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:29.091372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:29.091809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:29.225476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:29.232968 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45a1dba8-657c-4072-9a47-ea2172a06c4e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.154275 Nov 20 21:22:29.233561 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3490/7086] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:29 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:30.249773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:30.250398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:30.257080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:30.257545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:30.258360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:30.258799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:30.397458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:30.404819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3e7b240-2e5e-42e2-afba-ee04eba4bd0e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.159148 Nov 20 21:22:30.405410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3597/7087] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:30 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:31.422073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:31.422682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:31.429448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:31.429899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:31.430713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:31.431157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:31.569235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:31.576634 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-df3a91a4-135b-4560-ada9-7e04a8ff97f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.158324 Nov 20 21:22:31.577204 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3491/7088] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:31 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:32.593785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:32.594441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:32.601683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:32.602244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:32.603038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:32.603488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:32.736802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:32.744310 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-697278cd-81dc-4ce6-99e6-54beb4aa5d6f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.154245 Nov 20 21:22:32.744879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3598/7089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:32 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:33.760815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:33.761426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:33.768176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:33.769244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:33.769399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:33.769845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:33.904633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:33.913106 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d9e0bb0-6d26-4638-9225-bc923e0156f9 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.155905 Nov 20 21:22:33.914069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3492/7090] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:33 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:33.939855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1acc7ff2-b664-41a3-957b-3adb6d045728 req-bace8cbf-dc8d-433f-98f5-617c2dab2670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5e510d-1fa6-4db2-ac2e-ad4225c82111", "name": "network-vif-plugged", "status": "completed", "tag": "4d6308f8-f047-413a-a967-785ed5bf9bd4"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:33.941523 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:33.941523 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:33.951203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1acc7ff2-b664-41a3-957b-3adb6d045728 req-bace8cbf-dc8d-433f-98f5-617c2dab2670 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:33.952039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1acc7ff2-b664-41a3-957b-3adb6d045728 req-bace8cbf-dc8d-433f-98f5-617c2dab2670 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:33.963461 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1acc7ff2-b664-41a3-957b-3adb6d045728 req-bace8cbf-dc8d-433f-98f5-617c2dab2670 service nova] Creating event network-vif-plugged:4d6308f8-f047-413a-a967-785ed5bf9bd4 for instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 on nch1-master-1 Nov 20 21:22:33.968725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1acc7ff2-b664-41a3-957b-3adb6d045728 req-bace8cbf-dc8d-433f-98f5-617c2dab2670 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Nov 20 21:22:33.969645 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3599/7091] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:34.931975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:34.932586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:34.939339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:34.939796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:34.940573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:34.941010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:35.077092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:35.084472 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62007bab-73fe-4f4e-aba0-f72773b5e34a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1267 microversion: 2.1 time: 0.156133 Nov 20 21:22:35.085042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3493/7092] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:34 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:22:36.102766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:36.103385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:36.109870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:36.110357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:36.111140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:36.111936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:36.246125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:36.253653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d5b65c97-789b-447d-a2ec-b658ceb7d5de tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1454 microversion: 2.1 time: 0.155635 Nov 20 21:22:36.254246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3600/7093] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:36 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:36.269603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:36.270882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:36.277542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:36.277994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:36.278796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:36.279232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:36.411937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:36.419315 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-63fad1e5-8c07-4000-8230-6431685f4709 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1454 microversion: 2.1 time: 0.153264 Nov 20 21:22:36.419880 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3494/7094] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:36 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:22:38.021259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-29a64376-7a02-4776-b720-9b6b3c0eea20 req-e47bb2a6-c921-4a89-97f9-e5c22879fca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5e510d-1fa6-4db2-ac2e-ad4225c82111", "tag": "4d6308f8-f047-413a-a967-785ed5bf9bd4"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:38.022763 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:38.022763 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:38.030089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29a64376-7a02-4776-b720-9b6b3c0eea20 req-e47bb2a6-c921-4a89-97f9-e5c22879fca2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:38.030840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-29a64376-7a02-4776-b720-9b6b3c0eea20 req-e47bb2a6-c921-4a89-97f9-e5c22879fca2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:38.042126 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-29a64376-7a02-4776-b720-9b6b3c0eea20 req-e47bb2a6-c921-4a89-97f9-e5c22879fca2 service nova] Creating event network-changed:4d6308f8-f047-413a-a967-785ed5bf9bd4 for instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 on nch1-master-1 Nov 20 21:22:38.047173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-29a64376-7a02-4776-b720-9b6b3c0eea20 req-e47bb2a6-c921-4a89-97f9-e5c22879fca2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029541 Nov 20 21:22:38.048101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3601/7095] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:39.196579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:39.197553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:39.204323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:39.204778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:39.205557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:39.205988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:39.257491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-efe87297-d160-460d-a03b-39731b225c55 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action" status: 200 len: 24568 microversion: 2.1 time: 0.064438 Nov 20 21:22:39.258192 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3495/7096] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:22:39 2021] POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action => generated 24568 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:22:50.317389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:50.318136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:50.325079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.325542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.326364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.326815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.464995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:50.472295 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08a2d8ba-d14c-4d4b-ac46-2f3c836104cc tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1683 microversion: 2.1 time: 0.159149 Nov 20 21:22:50.473378 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3602/7097] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:50 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:50.564043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:50.565027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:50.572347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.572734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.573507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.573943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.624322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14a114db-3794-4a22-af2b-5617ee9623ee tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action" status: 200 len: 32643 microversion: 2.1 time: 0.064327 Nov 20 21:22:50.624947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3496/7098] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:22:50 2021] POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action => generated 32643 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:22:50.791758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:50.792372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:50.798510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.798999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.799777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.800220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.927574 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03924727-eb83-4606-bcc5-0f0dd9d07308 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1834 microversion: 2.1 time: 0.139352 Nov 20 21:22:50.928141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3603/7099] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:50 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1834 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:50.944859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:50.946076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:50.952847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.953293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:50.954086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:50.954522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:51.234374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lazy-loading 'flavor' on Instance uuid 23113ccc-49b1-4faf-acb2-cf78304602d1 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:22:51.247205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Going to try to live migrate instance to another host {{(pid=140942) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Nov 20 21:22:52.480580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5cf8d8d5-8f57-499d-9fc2-067d91a26c8f tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action" status: 202 len: 0 microversion: 2.1 time: 1.540193 Nov 20 21:22:52.482554 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3497/7100] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:22:50 2021] POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action => generated 0 bytes in 1543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:22:52.489878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:52.490531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:52.497586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:52.498038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:52.498846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:52.499287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:52.636317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:52.645964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-263373db-3650-4cac-a771-eba9185aad48 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.159880 Nov 20 21:22:52.646888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3604/7101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:52 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:22:53.664309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:53.665050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:53.673331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:53.673817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:53.674705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:53.675380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:53.714175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f8b60f4a-1e56-40cc-9c0a-072906de0705 req-4ba55bb7-b009-4dfa-a321-6beefd2607ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:53.716448 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:53.716448 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:53.724564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8b60f4a-1e56-40cc-9c0a-072906de0705 req-4ba55bb7-b009-4dfa-a321-6beefd2607ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:53.725270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8b60f4a-1e56-40cc-9c0a-072906de0705 req-4ba55bb7-b009-4dfa-a321-6beefd2607ae service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:53.736442 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f8b60f4a-1e56-40cc-9c0a-072906de0705 req-4ba55bb7-b009-4dfa-a321-6beefd2607ae service nova] Creating event network-vif-unplugged:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:53.741895 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f8b60f4a-1e56-40cc-9c0a-072906de0705 req-4ba55bb7-b009-4dfa-a321-6beefd2607ae service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034743 Nov 20 21:22:53.742535 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3605/7102] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:53 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:53.960973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:53.971990 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd5fd546-acdd-4613-ad4f-0a5c7183ae0f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.311639 Nov 20 21:22:53.978912 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3498/7103] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:53 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:54.594952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c6b8822a-7856-4466-b844-fb1c265c18ce req-2f90e6ea-d794-4765-bd44-f0fe7a425721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "name": "network-vif-plugged", "status": "completed", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:54.596265 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:54.596265 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:54.609199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c6b8822a-7856-4466-b844-fb1c265c18ce req-2f90e6ea-d794-4765-bd44-f0fe7a425721 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:54.609877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c6b8822a-7856-4466-b844-fb1c265c18ce req-2f90e6ea-d794-4765-bd44-f0fe7a425721 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:54.623694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c6b8822a-7856-4466-b844-fb1c265c18ce req-2f90e6ea-d794-4765-bd44-f0fe7a425721 service nova] Creating event network-vif-plugged:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:54.631487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c6b8822a-7856-4466-b844-fb1c265c18ce req-2f90e6ea-d794-4765-bd44-f0fe7a425721 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Nov 20 21:22:54.632582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3606/7104] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:54.992376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:54.993302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:55.001239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:55.001752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:55.002650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:55.003250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:55.147981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:55.155574 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d3cb88a-8a19-4c8e-9a6a-d7d5389adb53 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.167542 Nov 20 21:22:55.156139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3499/7105] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:54 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:22:55.780505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-4dc49753-445e-4268-8d63-b7ff4cbe9d9b req-ba999cf2-18dd-4620-951a-ec121b239030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:22:55.782136 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:22:55.782136 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:22:55.790427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4dc49753-445e-4268-8d63-b7ff4cbe9d9b req-ba999cf2-18dd-4620-951a-ec121b239030 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:55.790822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-4dc49753-445e-4268-8d63-b7ff4cbe9d9b req-ba999cf2-18dd-4620-951a-ec121b239030 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:55.802862 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-4dc49753-445e-4268-8d63-b7ff4cbe9d9b req-ba999cf2-18dd-4620-951a-ec121b239030 service nova] Creating event network-changed:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:22:55.807671 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-4dc49753-445e-4268-8d63-b7ff4cbe9d9b req-ba999cf2-18dd-4620-951a-ec121b239030 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033266 Nov 20 21:22:55.808241 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3607/7106] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:22:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:22:56.172510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:56.173236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:56.180246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:56.180703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:56.181501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:56.181946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:56.396550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:56.403944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-419f60a0-8212-4bae-ba04-4e06de5a99d9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.235176 Nov 20 21:22:56.404508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3500/7107] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:56 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:57.421826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:57.422592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:57.429732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:57.430236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:57.431035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:57.431482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:57.569160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:57.576523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a06a38f0-e02f-4950-9c34-cb7eeb234577 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.159516 Nov 20 21:22:57.577092 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3608/7108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:57 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:58.594128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:58.594735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:58.601989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:58.602481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:58.603266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:58.603707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:58.737177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:58.744463 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7293a5a3-bf2e-46a8-8e71-c8268a13c273 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.154041 Nov 20 21:22:58.745028 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3501/7109] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:58 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:22:59.763549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:22:59.764161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:22:59.773137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:59.773632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:59.774683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:22:59.775191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:22:59.931292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:22:59.938846 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-835c5b96-01bd-4e13-82fe-f45ee8fb32b2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.178893 Nov 20 21:22:59.939804 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3609/7110] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:22:59 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:00.156455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6b54957b-8fbb-4b63-8538-41eab17c1052 req-dcefd05a-2be0-444d-943e-ae5f120447a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "name": "network-vif-unplugged", "status": "completed", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:00.158221 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:00.158221 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:23:00.167163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b54957b-8fbb-4b63-8538-41eab17c1052 req-dcefd05a-2be0-444d-943e-ae5f120447a7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:00.167664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6b54957b-8fbb-4b63-8538-41eab17c1052 req-dcefd05a-2be0-444d-943e-ae5f120447a7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:00.180078 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6b54957b-8fbb-4b63-8538-41eab17c1052 req-dcefd05a-2be0-444d-943e-ae5f120447a7 service nova] Creating event network-vif-unplugged:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch2-master-1 Nov 20 21:23:00.186516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6b54957b-8fbb-4b63-8538-41eab17c1052 req-dcefd05a-2be0-444d-943e-ae5f120447a7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033325 Nov 20 21:23:00.187040 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3502/7111] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:23:00.956601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:00.957997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:00.964687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:00.965122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:00.965911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:00.966385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:01.107683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:01.115492 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3011def-6922-4bcf-a43f-30cd120f7e0b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1693 microversion: 2.1 time: 0.162618 Nov 20 21:23:01.116075 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3610/7112] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:00 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:02.136684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:02.137364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:02.145624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.146283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:02.147297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.148178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:02.305355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:02.313158 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e57df43b-5915-40d1-af17-17c3acbd8399 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1683 microversion: 2.1 time: 0.182885 Nov 20 21:23:02.313757 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3503/7113] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:02 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:23:02.329491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:02.330084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:02.337644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.338359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:02.339212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.339799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:02.823309 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68f1c082-f1db-455a-ae7b-825a56e330f0 tempest-TestNetworkAdvancedServerOps-668392955 tempest-TestNetworkAdvancedServerOps-668392955-project-admin] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1834 microversion: 2.1 time: 0.497427 Nov 20 21:23:02.824053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3611/7114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:02 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1834 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:02.841488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:02.842174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:02.849161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.850317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:02.851344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:02.851918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:03.001617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:03.011369 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ee3f209-bcbf-4917-a0fd-1c0149acdb26 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1683 microversion: 2.1 time: 0.173743 Nov 20 21:23:03.011923 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3504/7115] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:02 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:23:03.111373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:03.112567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:03.119635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:03.120090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:03.120948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:03.121339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:03.173192 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a99b7250-c3d9-43c6-8cd1-b53910441ab8 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action" status: 200 len: 38621 microversion: 2.1 time: 0.066075 Nov 20 21:23:03.174367 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3612/7116] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:23:03 2021] POST /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1/action => generated 38621 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:23:04.267421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-839e4bc5-b4d8-4926-939a-d6bf20d293ed req-2b3f6eed-9160-4aa5-8a64-114747e69239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:04.271442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:04.272706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:04.274674 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:04.274674 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:23:04.288793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:04.288793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:04.290074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:04.290558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:04.295141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-839e4bc5-b4d8-4926-939a-d6bf20d293ed req-2b3f6eed-9160-4aa5-8a64-114747e69239 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:04.295722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-839e4bc5-b4d8-4926-939a-d6bf20d293ed req-2b3f6eed-9160-4aa5-8a64-114747e69239 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:04.319787 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-839e4bc5-b4d8-4926-939a-d6bf20d293ed req-2b3f6eed-9160-4aa5-8a64-114747e69239 service nova] Creating event network-changed:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch1-master-1 Nov 20 21:23:04.325032 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-839e4bc5-b4d8-4926-939a-d6bf20d293ed req-2b3f6eed-9160-4aa5-8a64-114747e69239 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061978 Nov 20 21:23:04.326069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3613/7117] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:23:04.332448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:23:04.451143 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4b272c5b-de32-472e-b684-df6ea046a6eb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 204 len: 0 microversion: 2.1 time: 0.190416 Nov 20 21:23:04.452428 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3505/7118] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:23:04 2021] DELETE /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:23:04.463026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:04.463679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:04.483166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:04.484071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:04.484925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:04.485685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:04.657680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:04.668757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cdc1a38f-35e3-4d2c-b6fc-32e39d8c9278 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1689 microversion: 2.1 time: 0.211928 Nov 20 21:23:04.669355 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3614/7119] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:04 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:05.512589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4c29447b-bc18-4711-a49f-9dbd5a8a2d86 req-109be8e3-6841-4ee9-9926-1f141369ecb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23113ccc-49b1-4faf-acb2-cf78304602d1", "name": "network-vif-deleted", "tag": "f3d6a2cc-cc15-4826-969d-54e45ea4384b"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:05.514853 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:05.514853 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:23:05.524916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4c29447b-bc18-4711-a49f-9dbd5a8a2d86 req-109be8e3-6841-4ee9-9926-1f141369ecb9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:05.525402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4c29447b-bc18-4711-a49f-9dbd5a8a2d86 req-109be8e3-6841-4ee9-9926-1f141369ecb9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:05.538386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4c29447b-bc18-4711-a49f-9dbd5a8a2d86 req-109be8e3-6841-4ee9-9926-1f141369ecb9 service nova] Creating event network-vif-deleted:f3d6a2cc-cc15-4826-969d-54e45ea4384b for instance 23113ccc-49b1-4faf-acb2-cf78304602d1 on nch1-master-1 Nov 20 21:23:05.544096 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4c29447b-bc18-4711-a49f-9dbd5a8a2d86 req-109be8e3-6841-4ee9-9926-1f141369ecb9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Nov 20 21:23:05.544698 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3506/7120] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:23:05.688532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:05.689391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:05.700114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:05.701019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:05.702221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:05.702943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:05.746098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:05.746503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:05.747611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lazy-loading 'fault' on Instance uuid 23113ccc-49b1-4faf-acb2-cf78304602d1 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:23:05.807244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:05.816083 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-089680ab-227e-48cf-b323-d09635b9ea5b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 200 len: 1356 microversion: 2.1 time: 0.131592 Nov 20 21:23:05.822440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3615/7121] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:05 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 1356 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:06.837847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:06.838488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 23113ccc-49b1-4faf-acb2-cf78304602d1] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:06.844594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:06.845043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:06.845823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:06.846292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:06.859231 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] HTTP exception thrown: Instance 23113ccc-49b1-4faf-acb2-cf78304602d1 could not be found. Nov 20 21:23:06.859810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Returning 404 to user: Instance 23113ccc-49b1-4faf-acb2-cf78304602d1 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:23:06.860610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2962de67-e6d5-4714-b51f-4747c5276b1b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1" status: 404 len: 111 microversion: 2.1 time: 0.028462 Nov 20 21:23:06.861172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3507/7122] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:06 2021] GET /compute/v2.1/servers/23113ccc-49b1-4faf-acb2-cf78304602d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:23:09.963431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76f4393a-e260-43d1-938b-5c4615c027f9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '.version_select at 0x7f3f864b7f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:09.986840 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76f4393a-e260-43d1-938b-5c4615c027f9 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-272711047" status: 202 len: 0 microversion: 2.1 time: 0.028163 Nov 20 21:23:09.991098 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3616/7123] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:23:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-272711047 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:23:10.015000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: .version_select at 0x7f3f85dba430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-315270086"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:10.029786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:23:10.035406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:23:10.177585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:23:10.183125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:23:10.197864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c9f133cd-0264-4daf-8128-77e9da3a4fb7 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.186511 Nov 20 21:23:10.198719 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3508/7124] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:23:10 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:16.308108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2112827304", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "f0823846-b9e6-4832-888e-17b78eb4e4e1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-315270086", "security_groups": [{"name": "tempest-secgroup-smoke-31519588"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:16.426323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] validate_networks() for [('f0823846-b9e6-4832-888e-17b78eb4e4e1', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:23:16.917571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:23:16.918009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:23:16.918523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:23:16.918946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:23:16.919370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:23:16.931877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:16.932532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:16.935416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:16.935999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:16.959749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:23:16.978546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Getting quotas for user 061cf3c92e5040b18ec16196a0fce6d9 and project 9150e5dc713c4519842f75908123d4ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:23:17.012295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:23:17.015932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:23:17.097308 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5ecda18-e4cf-4be5-bf2c-d569dbf7ad83 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.794641 Nov 20 21:23:17.104122 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3617/7125] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:23:16 2021] POST /compute/v2.1/servers => generated 404 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:23:17.109053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0bd8b08-1f95-4241-83b6-9c182c345f90 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:17.110492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0bd8b08-1f95-4241-83b6-9c182c345f90 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:17.219195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c0bd8b08-1f95-4241-83b6-9c182c345f90 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:17.232185 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0bd8b08-1f95-4241-83b6-9c182c345f90 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1266 microversion: 2.1 time: 0.126928 Nov 20 21:23:17.233572 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3509/7126] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:17 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:18.250853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:18.252102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:18.264773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:18.265514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:18.266359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:18.266965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:18.341537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:18.349237 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2ecf518-753d-4c69-a714-9ca16d5d1915 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1324 microversion: 2.1 time: 0.102448 Nov 20 21:23:18.350077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3618/7127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:18 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1324 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:19.366800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:19.367511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:19.375564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:19.376116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:19.377132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:19.377789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:19.757250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:19.767811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05949e58-f86f-4495-8942-3970e6f1c108 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.404815 Nov 20 21:23:19.769691 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3510/7128] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:19 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:20.113651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5152c29d-2e29-4c11-9120-c2da7ab08a8c req-c8f94892-00e0-4f5a-855e-135a0afbbd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:20.116470 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:20.116470 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:23:20.128694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5152c29d-2e29-4c11-9120-c2da7ab08a8c req-c8f94892-00e0-4f5a-855e-135a0afbbd7b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:20.129439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5152c29d-2e29-4c11-9120-c2da7ab08a8c req-c8f94892-00e0-4f5a-855e-135a0afbbd7b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:20.143130 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5152c29d-2e29-4c11-9120-c2da7ab08a8c req-c8f94892-00e0-4f5a-855e-135a0afbbd7b service nova] Creating event network-changed:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:23:20.149711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5152c29d-2e29-4c11-9120-c2da7ab08a8c req-c8f94892-00e0-4f5a-855e-135a0afbbd7b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039843 Nov 20 21:23:20.150419 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3619/7129] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:23:20.785856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:20.786617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:20.793621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:20.794192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:20.795122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:20.795652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:21.028037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:21.035376 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bf1da352-d5e2-49d9-9a42-aa8b43740a98 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.253229 Nov 20 21:23:21.035966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3511/7130] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:20 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:22.053083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:22.053731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:22.061296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:22.061762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:22.062599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:22.063048 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:22.198337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:22.205588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0624f1e2-6e9f-4967-9b05-401117e4e426 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.156621 Nov 20 21:23:22.206177 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3620/7131] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:22 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:23.222813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:23.223549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:23.232110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:23.232568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:23.233364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:23.233803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:23.374607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:23.383110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-055bfc0d-b61a-45bf-8bd5-28eb1c87b881 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.163309 Nov 20 21:23:23.383739 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3512/7132] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:23 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:24.404783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:24.405813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:24.414893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:24.415393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:24.416289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:24.416789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:24.567183 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:24.575867 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7bd51a4f-433d-4b61-b04f-f4c004516938 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.176309 Nov 20 21:23:24.576687 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3621/7133] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:24 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:25.601183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:25.601808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7d4338a7-0ab7-49cf-a4ec-fa739bb1c75d req-ae611e63-caae-44ea-b4d4-2f596a45f883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "name": "network-vif-plugged", "status": "completed", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:25.602793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:25.605634 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:25.605634 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:23:25.617905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:25.618475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:25.619546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:25.620118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:25.620362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7d4338a7-0ab7-49cf-a4ec-fa739bb1c75d req-ae611e63-caae-44ea-b4d4-2f596a45f883 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:25.621255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7d4338a7-0ab7-49cf-a4ec-fa739bb1c75d req-ae611e63-caae-44ea-b4d4-2f596a45f883 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:25.635913 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7d4338a7-0ab7-49cf-a4ec-fa739bb1c75d req-ae611e63-caae-44ea-b4d4-2f596a45f883 service nova] Creating event network-vif-plugged:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:23:25.642641 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7d4338a7-0ab7-49cf-a4ec-fa739bb1c75d req-ae611e63-caae-44ea-b4d4-2f596a45f883 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051978 Nov 20 21:23:25.643774 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3622/7134] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:23:25.810097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:25.821293 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f440cfd9-9622-45a6-b5fd-70df905cbd6e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1390 microversion: 2.1 time: 0.231353 Nov 20 21:23:25.822261 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3513/7135] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:25 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:26.841331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:26.842012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:26.849767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:26.850279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:26.851825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:26.852329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:27.014830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:27.023639 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f2d2842-5663-48bd-b202-3bb470d310ca tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1562 microversion: 2.1 time: 0.187625 Nov 20 21:23:27.024228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3623/7136] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:26 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1562 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:27.043682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:27.044483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:27.051983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:27.052695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:27.053607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:27.055167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:27.205983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:27.214720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39d8cb35-b5bb-44d5-9414-fcb31533f814 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1562 microversion: 2.1 time: 0.175462 Nov 20 21:23:27.215326 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3514/7137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:27 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:29.119973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:29.120909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:29.126932 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a994e8c0-2828-4a7f-993d-058d86dd8da6 req-f3e9571e-42c3-4b5c-b7d0-4bcfe14f947b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:29.128794 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:29.129462 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:23:29.129462 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:23:29.129684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:29.130451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:29.131170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:29.150077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a994e8c0-2828-4a7f-993d-058d86dd8da6 req-f3e9571e-42c3-4b5c-b7d0-4bcfe14f947b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:29.150630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a994e8c0-2828-4a7f-993d-058d86dd8da6 req-f3e9571e-42c3-4b5c-b7d0-4bcfe14f947b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:29.163654 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a994e8c0-2828-4a7f-993d-058d86dd8da6 req-f3e9571e-42c3-4b5c-b7d0-4bcfe14f947b service nova] Creating event network-changed:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:23:29.172229 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a994e8c0-2828-4a7f-993d-058d86dd8da6 req-f3e9571e-42c3-4b5c-b7d0-4bcfe14f947b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049566 Nov 20 21:23:29.172901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3515/7138] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:23:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:23:29.335905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:29.341912 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-252495f2-e21d-4476-97fe-1e5b48514bd1 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1562 microversion: 2.1 time: 0.226366 Nov 20 21:23:29.342678 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3624/7139] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:29 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:23:52.624393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:52.625425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:52.631749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:52.632211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:52.633009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:52.633448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:52.685377 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0132e10c-7124-4430-9ccd-c464f3514464 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action" status: 200 len: 24573 microversion: 2.1 time: 0.066179 Nov 20 21:23:52.686277 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3516/7140] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:23:52 2021] POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action => generated 24573 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:23:59.040744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "89603187-210f-4d54-a40f-71dfff8bc059"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:23:59.042244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:59.048790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.049253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.050073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.050517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.130311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:23:59.130744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:23:59.131224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:23:59.131640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:23:59.132060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:23:59.189552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:59.195322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.195787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.196620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.197073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.221378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47f73be8-60e7-4efd-9407-38759d9362d3 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action" status: 202 len: 1137 microversion: 2.1 time: 0.184473 Nov 20 21:23:59.222449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3625/7141] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:23:59 2021] POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action => generated 1137 bytes in 186 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 20 21:23:59.237252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:23:59.237948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:23:59.245590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.246061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.248034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:23:59.248686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:23:59.386734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:23:59.394644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de65ddae-1efc-46c8-a109-912b6786742f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.161403 Nov 20 21:23:59.395213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3517/7142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:23:59 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:24:00.412707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:00.413328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:00.419974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:00.420439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:00.421235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:00.421680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:00.555655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:00.563349 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-178543c1-0956-4074-8c9c-98beb531ef37 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.154510 Nov 20 21:24:00.563950 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3626/7143] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:00 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:01.579906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:01.580521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:01.590714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:01.591498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:01.592302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:01.592751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:01.728220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:01.736424 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a36f671a-4fe7-4e47-a598-83468fc23268 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.160219 Nov 20 21:24:01.737004 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3518/7144] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:01 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:02.753590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:02.754187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:02.760866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:02.761323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:02.762172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:02.762629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:02.897311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:02.904960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6726a7a9-24d5-4080-b238-871cf1323686 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.155076 Nov 20 21:24:02.905521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3627/7145] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:02 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:03.922033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:03.922702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:03.929445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:03.929903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:03.930725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:03.931167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:04.062255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:04.069495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d8c6b098-41e5-447f-96a3-b13f40b3ded0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.151288 Nov 20 21:24:04.070079 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3519/7146] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:03 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:05.087387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:05.088002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:05.095388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:05.095873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:05.096653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:05.097100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:05.231740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:05.238978 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ce4c3344-769a-4f02-88d4-2b920ec195b5 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.155262 Nov 20 21:24:05.239542 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3628/7147] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:05 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:06.256158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:06.256800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:06.263572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:06.264037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:06.264834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:06.265345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:06.400730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:06.408827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3baca1c0-8848-4495-aeeb-158a50c3f16f tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.156462 Nov 20 21:24:06.409392 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3520/7148] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:06 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:07.425882 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:07.426527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:07.433175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:07.433663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:07.434717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:07.435270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:07.568641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:07.577015 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0f6a98de-688b-414c-9656-0fd687c14beb tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.154938 Nov 20 21:24:07.577586 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3629/7149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:07 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:08.594930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:08.595549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:08.602352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:08.602817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:08.603613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:08.604057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:08.742725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:08.751275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95825d76-66f8-4106-9723-d34b1e765fb2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.161077 Nov 20 21:24:08.751993 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3521/7150] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:08 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:09.768610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:09.769234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:09.775956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:09.776420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:09.777236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:09.777684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:09.919168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:09.926523 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09c6a97e-4f43-40f3-859c-c172eaa58884 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1689 microversion: 2.1 time: 0.161618 Nov 20 21:24:09.927101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3630/7151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:09 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:24:10.942653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:10.943298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:10.950031 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:10.950524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:10.951820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:10.952357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:11.086318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:11.093719 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0dde9b79-63c2-488e-b2a7-a76196e82093 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1695 microversion: 2.1 time: 0.154690 Nov 20 21:24:11.094324 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3522/7152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:10 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:12.111549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:12.112169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:12.118857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:12.119317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:12.120138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:12.120584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:12.254415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:12.262488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e10eb056-2424-4b7f-8864-21aa7eadbf59 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1695 microversion: 2.1 time: 0.155098 Nov 20 21:24:12.263315 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3631/7153] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:12 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:13.280285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:13.280924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:13.287684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:13.288141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:13.288925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:13.289366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:13.421152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:13.428665 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dae91479-d5f7-47dc-b46e-5b4ba21f8969 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1680 microversion: 2.1 time: 0.152722 Nov 20 21:24:13.429236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3523/7154] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:13 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:13.961890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a6de2eb7-cf29-4ffe-8989-ac8f734b1a36 req-c2cc2cf7-fb9d-4551-88ff-a25554a49de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "name": "network-vif-unplugged", "status": "completed", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:13.963495 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:13.963495 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:24:13.971659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a6de2eb7-cf29-4ffe-8989-ac8f734b1a36 req-c2cc2cf7-fb9d-4551-88ff-a25554a49de4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:13.972108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a6de2eb7-cf29-4ffe-8989-ac8f734b1a36 req-c2cc2cf7-fb9d-4551-88ff-a25554a49de4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:13.983253 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a6de2eb7-cf29-4ffe-8989-ac8f734b1a36 req-c2cc2cf7-fb9d-4551-88ff-a25554a49de4 service nova] Creating event network-vif-unplugged:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:24:13.989302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a6de2eb7-cf29-4ffe-8989-ac8f734b1a36 req-c2cc2cf7-fb9d-4551-88ff-a25554a49de4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030735 Nov 20 21:24:13.989920 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3632/7155] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:13 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:16.009788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1627f63b-2ac4-439f-8b47-a26f833eba2f req-9bffc76c-329d-4a46-a081-3eaa6da0faa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "name": "network-vif-plugged", "status": "completed", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:16.011304 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:16.011304 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:24:16.018628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1627f63b-2ac4-439f-8b47-a26f833eba2f req-9bffc76c-329d-4a46-a081-3eaa6da0faa7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:16.019105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1627f63b-2ac4-439f-8b47-a26f833eba2f req-9bffc76c-329d-4a46-a081-3eaa6da0faa7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:16.031861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1627f63b-2ac4-439f-8b47-a26f833eba2f req-9bffc76c-329d-4a46-a081-3eaa6da0faa7 service nova] Creating event network-vif-plugged:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:24:16.036717 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1627f63b-2ac4-439f-8b47-a26f833eba2f req-9bffc76c-329d-4a46-a081-3eaa6da0faa7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030776 Nov 20 21:24:16.037296 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3524/7156] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:20.329982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:20.330601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:20.338983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:20.339528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bedd578e-1bb4-4f16-9a20-620e914d3188 req-b8ce0d17-9073-4523-8886-12181a786483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc5e510d-1fa6-4db2-ac2e-ad4225c82111", "tag": "4d6308f8-f047-413a-a967-785ed5bf9bd4"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:20.339977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:20.340415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:20.340934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:20.341221 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:20.341221 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:24:20.351809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bedd578e-1bb4-4f16-9a20-620e914d3188 req-b8ce0d17-9073-4523-8886-12181a786483 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:20.352258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bedd578e-1bb4-4f16-9a20-620e914d3188 req-b8ce0d17-9073-4523-8886-12181a786483 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:20.363762 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bedd578e-1bb4-4f16-9a20-620e914d3188 req-b8ce0d17-9073-4523-8886-12181a786483 service nova] Creating event network-changed:4d6308f8-f047-413a-a967-785ed5bf9bd4 for instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 on nch1-master-1 Nov 20 21:24:20.370473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bedd578e-1bb4-4f16-9a20-620e914d3188 req-b8ce0d17-9073-4523-8886-12181a786483 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041818 Nov 20 21:24:20.371097 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3525/7157] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:20.375962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:24:20.459023 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8a11f4b4-318a-4e1d-a1af-08efd9d1ef4a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 204 len: 0 microversion: 2.1 time: 0.133900 Nov 20 21:24:20.463341 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3633/7158] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:24:20 2021] DELETE /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:24:20.469471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:20.470678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:20.477755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:20.478362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:20.479604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:20.480597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:20.701669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:20.711238 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d8de1e3-0ef9-4a2d-9d28-236e7c54de8e tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1579 microversion: 2.1 time: 0.246731 Nov 20 21:24:20.711821 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3526/7159] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:20 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1579 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:24:21.730660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:21.731390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:21.738762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:21.739222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:21.740002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:21.740447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:21.872141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:21.879653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2301e7be-9085-4bc3-a082-a7f1cd3d5ac3 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1460 microversion: 2.1 time: 0.153124 Nov 20 21:24:21.880246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3634/7160] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:21 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1460 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:22.516189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7b38c4f1-a5b5-40c2-91a3-cf1ca20ccd45 req-4e00ba36-d73e-497e-a931-f765a57df4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc5e510d-1fa6-4db2-ac2e-ad4225c82111", "name": "network-vif-deleted", "tag": "4d6308f8-f047-413a-a967-785ed5bf9bd4"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:22.518165 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:22.518165 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:24:22.528162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7b38c4f1-a5b5-40c2-91a3-cf1ca20ccd45 req-4e00ba36-d73e-497e-a931-f765a57df4da service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:22.528795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7b38c4f1-a5b5-40c2-91a3-cf1ca20ccd45 req-4e00ba36-d73e-497e-a931-f765a57df4da service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:22.541233 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7b38c4f1-a5b5-40c2-91a3-cf1ca20ccd45 req-4e00ba36-d73e-497e-a931-f765a57df4da service nova] Creating event network-vif-deleted:4d6308f8-f047-413a-a967-785ed5bf9bd4 for instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 on nch1-master-1 Nov 20 21:24:22.546556 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7b38c4f1-a5b5-40c2-91a3-cf1ca20ccd45 req-4e00ba36-d73e-497e-a931-f765a57df4da service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Nov 20 21:24:22.547150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3527/7161] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:22.896623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:22.897565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:22.905382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:22.905843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:22.906679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:22.907154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:22.939639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:22.940098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:22.941110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lazy-loading 'fault' on Instance uuid bc5e510d-1fa6-4db2-ac2e-ad4225c82111 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:24:22.982905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:22.990410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a549147a-b92c-4dd7-9aec-ad004683582a tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 200 len: 1231 microversion: 2.1 time: 0.097468 Nov 20 21:24:22.991039 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3635/7162] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:22 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:24.009657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:24.010384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: bc5e510d-1fa6-4db2-ac2e-ad4225c82111] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:24.017359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:24.017816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:24.018637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:24.019108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:24.032495 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 could not be found. Nov 20 21:24:24.033084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance bc5e510d-1fa6-4db2-ac2e-ad4225c82111 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:24:24.033900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-55b635bc-2b1e-4046-9f43-f861d4b68227 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111" status: 404 len: 111 microversion: 2.1 time: 0.029177 Nov 20 21:24:24.034468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3528/7163] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:24 2021] GET /compute/v2.1/servers/bc5e510d-1fa6-4db2-ac2e-ad4225c82111 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:24:37.626157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:37.627207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:37.633134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:37.633582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:37.634392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:37.634835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:37.685576 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5fc376f7-3da6-4e86-8175-41fd371e6cea tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action" status: 200 len: 24572 microversion: 2.1 time: 0.063566 Nov 20 21:24:37.686437 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3636/7164] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:24:37 2021] POST /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd/action => generated 24572 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:24:49.546167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:49.546724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:49.550027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0aafefc3-ff5d-406a-bd03-ef58a1883a8a req-1f8eef56-1904-4584-9ba8-ab1f90a41136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:49.552402 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:49.552402 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:24:49.553301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:49.553834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:49.554750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:49.555260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:49.562560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0aafefc3-ff5d-406a-bd03-ef58a1883a8a req-1f8eef56-1904-4584-9ba8-ab1f90a41136 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:49.563192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0aafefc3-ff5d-406a-bd03-ef58a1883a8a req-1f8eef56-1904-4584-9ba8-ab1f90a41136 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:49.577490 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0aafefc3-ff5d-406a-bd03-ef58a1883a8a req-1f8eef56-1904-4584-9ba8-ab1f90a41136 service nova] Creating event network-changed:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:24:49.582317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:24:49.582717 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0aafefc3-ff5d-406a-bd03-ef58a1883a8a req-1f8eef56-1904-4584-9ba8-ab1f90a41136 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038076 Nov 20 21:24:49.583525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3637/7165] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:24:49.674811 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-46cde00a-d564-4d44-9151-35a05c57967e tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 204 len: 0 microversion: 2.1 time: 0.131587 Nov 20 21:24:49.677599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3529/7166] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:24:49 2021] DELETE /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:24:49.686717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:49.687674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:49.694895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:49.695357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:49.696312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:49.697233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:49.846086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:49.853793 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2e7e9ab-3ba9-414a-bfb6-61da241f7eb0 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1686 microversion: 2.1 time: 0.172166 Nov 20 21:24:49.854719 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3638/7167] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:49 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:50.872249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:50.873433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:50.880254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:50.880708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:50.881490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:50.881933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:51.049066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '061cf3c92e5040b18ec16196a0fce6d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9150e5dc713c4519842f75908123d4ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:51.056607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41536e9a-b288-446d-be9a-b6794a719c94 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 200 len: 1568 microversion: 2.1 time: 0.188658 Nov 20 21:24:51.057221 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3530/7168] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:50 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:51.597200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-88f6fda0-5718-417c-be37-b04b9e766182 req-fe32e9ff-bfab-4995-8f8c-e9ba02a6b9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98a948a3-e7ab-453a-b6ad-78e78c3d49fd", "name": "network-vif-deleted", "tag": "2f307067-6781-4cc6-b9cf-9eaa06862074"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:51.598832 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:51.598832 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:24:51.606590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88f6fda0-5718-417c-be37-b04b9e766182 req-fe32e9ff-bfab-4995-8f8c-e9ba02a6b9dd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:51.607111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88f6fda0-5718-417c-be37-b04b9e766182 req-fe32e9ff-bfab-4995-8f8c-e9ba02a6b9dd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:51.617869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-88f6fda0-5718-417c-be37-b04b9e766182 req-fe32e9ff-bfab-4995-8f8c-e9ba02a6b9dd service nova] Creating event network-vif-deleted:2f307067-6781-4cc6-b9cf-9eaa06862074 for instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd on nch2-master-1 Nov 20 21:24:51.623673 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-88f6fda0-5718-417c-be37-b04b9e766182 req-fe32e9ff-bfab-4995-8f8c-e9ba02a6b9dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029442 Nov 20 21:24:51.624488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3639/7169] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:52.074669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:52.075202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] [instance: 98a948a3-e7ab-453a-b6ad-78e78c3d49fd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:52.082353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:52.082810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:52.083616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:52.084056 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:52.097644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] HTTP exception thrown: Instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd could not be found. Nov 20 21:24:52.098246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Returning 404 to user: Instance 98a948a3-e7ab-453a-b6ad-78e78c3d49fd could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:24:52.099054 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fc3d15f-857a-4c73-b9ea-bf63d80328c2 tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd" status: 404 len: 111 microversion: 2.1 time: 0.028223 Nov 20 21:24:52.099574 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3531/7170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:52 2021] GET /compute/v2.1/servers/98a948a3-e7ab-453a-b6ad-78e78c3d49fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:24:55.517032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc9499b9-7698-45ba-8a43-06e5b2952c8b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] Calling method '.version_select at 0x7f3f862db0d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:55.543228 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc9499b9-7698-45ba-8a43-06e5b2952c8b tempest-TestNetworkAdvancedServerOps-1608411578 tempest-TestNetworkAdvancedServerOps-1608411578-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-315270086" status: 202 len: 0 microversion: 2.1 time: 0.030580 Nov 20 21:24:55.544532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3640/7171] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:24:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-315270086 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:24:57.328508 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:57.329051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:57.333394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-48c5bac7-08e4-40a7-9cc5-8dcac339f172 req-433672e1-3106-4c8c-933d-26543fd70d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec31f22e-7a3c-4e54-9723-717b3c619e29", "tag": "c2292d41-b405-4690-8d85-66a2902c9bd5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:57.335499 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:57.335499 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:24:57.346637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:57.348461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:57.349277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:57.350696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-48c5bac7-08e4-40a7-9cc5-8dcac339f172 req-433672e1-3106-4c8c-933d-26543fd70d64 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:57.351162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-48c5bac7-08e4-40a7-9cc5-8dcac339f172 req-433672e1-3106-4c8c-933d-26543fd70d64 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:57.351914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:57.373879 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-48c5bac7-08e4-40a7-9cc5-8dcac339f172 req-433672e1-3106-4c8c-933d-26543fd70d64 service nova] Creating event network-changed:c2292d41-b405-4690-8d85-66a2902c9bd5 for instance ec31f22e-7a3c-4e54-9723-717b3c619e29 on nch1-master-1 Nov 20 21:24:57.390945 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-48c5bac7-08e4-40a7-9cc5-8dcac339f172 req-433672e1-3106-4c8c-933d-26543fd70d64 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063021 Nov 20 21:24:57.391917 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3641/7172] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:24:57.398888 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:24:57.489103 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-41f9fc73-d899-4d22-ac10-ae5a42236ecd tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 204 len: 0 microversion: 2.1 time: 0.169139 Nov 20 21:24:57.492875 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3532/7173] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:24:57 2021] DELETE /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:24:57.500662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:57.501496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:57.508790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:57.509259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:57.510125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:57.510576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:57.700196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:57.709788 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07e2da1f-70c4-4c5c-bfa0-f962dc9e073f tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1577 microversion: 2.1 time: 0.215106 Nov 20 21:24:57.710449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3642/7174] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:57 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:24:58.730603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:58.732098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:58.740124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:58.740922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:58.741980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:58.742673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:58.905293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:24:58.914141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-057f331d-b425-496d-a5d9-574373469141 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1458 microversion: 2.1 time: 0.188895 Nov 20 21:24:58.914798 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3533/7175] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:58 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1458 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:24:59.611602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f87ebc93-c001-49d7-84af-b9c8fd719f35 req-2af70688-f687-4540-9730-1026663902e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec31f22e-7a3c-4e54-9723-717b3c619e29", "name": "network-vif-deleted", "tag": "c2292d41-b405-4690-8d85-66a2902c9bd5"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:24:59.614570 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:24:59.614570 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:24:59.624936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f87ebc93-c001-49d7-84af-b9c8fd719f35 req-2af70688-f687-4540-9730-1026663902e0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:59.625386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f87ebc93-c001-49d7-84af-b9c8fd719f35 req-2af70688-f687-4540-9730-1026663902e0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:59.640831 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f87ebc93-c001-49d7-84af-b9c8fd719f35 req-2af70688-f687-4540-9730-1026663902e0 service nova] Creating event network-vif-deleted:c2292d41-b405-4690-8d85-66a2902c9bd5 for instance ec31f22e-7a3c-4e54-9723-717b3c619e29 on nch1-master-1 Nov 20 21:24:59.646590 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f87ebc93-c001-49d7-84af-b9c8fd719f35 req-2af70688-f687-4540-9730-1026663902e0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041882 Nov 20 21:24:59.647480 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3643/7176] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:24:59.932115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:24:59.933460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:24:59.943151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:59.943739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:59.945094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:59.945890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:59.986010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:24:59.986823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:24:59.987486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lazy-loading 'fault' on Instance uuid ec31f22e-7a3c-4e54-9723-717b3c619e29 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:25:00.037546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2784bd65c034a73a10a1d9fb60f8939', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6028b150b064464f9c6d8e21d3af617e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:00.047403 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76017ecd-8035-4013-94a6-147d4c3d0012 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 200 len: 1230 microversion: 2.1 time: 0.120148 Nov 20 21:25:00.057725 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3534/7177] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:24:59 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 1230 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:00.169150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-873466876", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "d4b6685a-c91b-44a0-99c2-191bfd87e908"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:00.224669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] validate_networks() for [('d4b6685a-c91b-44a0-99c2-191bfd87e908', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:25:00.571733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:25:00.572157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:25:00.572632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:25:00.573043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:25:00.573483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:25:00.582196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:00.582652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:00.583491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:00.583934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:00.600909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Getting quotas for project 9ae4c865270648c8a4551befa186f2d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:25:00.605947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Getting quotas for user 74d76d7e8983442da6f501e463d0c644 and project 9ae4c865270648c8a4551befa186f2d7. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:25:00.618144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:25:00.620511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:25:00.663816 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f9c5089-e468-46d2-9261-9b4130233d84 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645747 Nov 20 21:25:00.664465 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3644/7178] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:25:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:25:00.674909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d629c1d6-b415-406e-933f-7d8eac96b805 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:00.675614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d629c1d6-b415-406e-933f-7d8eac96b805 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:00.729296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d629c1d6-b415-406e-933f-7d8eac96b805 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:00.736561 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d629c1d6-b415-406e-933f-7d8eac96b805 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1214 microversion: 2.1 time: 0.065402 Nov 20 21:25:00.737129 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3535/7179] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:00 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:25:01.065228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:01.065767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: ec31f22e-7a3c-4e54-9723-717b3c619e29] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:01.072027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.072479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.073291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.073721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.087045 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance ec31f22e-7a3c-4e54-9723-717b3c619e29 could not be found. Nov 20 21:25:01.087631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance ec31f22e-7a3c-4e54-9723-717b3c619e29 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:01.088438 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-306f3f16-7f22-4c57-936b-848a847dae85 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29" status: 404 len: 111 microversion: 2.1 time: 0.027024 Nov 20 21:25:01.088959 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3645/7180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:01 2021] GET /compute/v2.1/servers/ec31f22e-7a3c-4e54-9723-717b3c619e29 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:01.547218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:01.547755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:01.555127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.555577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.556359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.556798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.570082 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. Nov 20 21:25:01.570670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:01.571477 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c875034-01b3-4ea9-8d66-208a58629db6 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 404 len: 111 microversion: 2.1 time: 0.028064 Nov 20 21:25:01.572012 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3536/7181] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:25:01 2021] DELETE /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:01.580519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:01.581135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] [instance: f63e6faf-abb2-4827-a8d8-71e39e0309bb] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:01.587028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.587477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.588249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:01.588693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:01.601869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] HTTP exception thrown: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. Nov 20 21:25:01.602480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Returning 404 to user: Instance f63e6faf-abb2-4827-a8d8-71e39e0309bb could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:01.603311 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a4eac79-ec3a-48c4-a87f-f2cddd90dec1 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb" status: 404 len: 111 microversion: 2.1 time: 0.026501 Nov 20 21:25:01.603822 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3646/7182] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:01 2021] GET /compute/v2.1/servers/f63e6faf-abb2-4827-a8d8-71e39e0309bb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:01.753915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-caf463d1-e821-4687-b913-365c20a46bc4 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:01.754556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-caf463d1-e821-4687-b913-365c20a46bc4 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:01.824544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-caf463d1-e821-4687-b913-365c20a46bc4 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:01.832254 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-caf463d1-e821-4687-b913-365c20a46bc4 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1214 microversion: 2.1 time: 0.082007 Nov 20 21:25:01.833024 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3537/7183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:01 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:02.849962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acfb6df8-0251-4998-b25c-18ce53af52d6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:02.850575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acfb6df8-0251-4998-b25c-18ce53af52d6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:02.905156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-acfb6df8-0251-4998-b25c-18ce53af52d6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:02.913109 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acfb6df8-0251-4998-b25c-18ce53af52d6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1214 microversion: 2.1 time: 0.067190 Nov 20 21:25:02.913672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3647/7184] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:02 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:03.930746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:03.932199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:03.940226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-26f9c7c8-015b-4f5c-9508-9221b867c778 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] Calling method '.version_select at 0x7f3f864da0d0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:03.941442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:03.942185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:03.943089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:03.943969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:03.970372 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-26f9c7c8-015b-4f5c-9508-9221b867c778 tempest-TestVolumeBootPattern-1052726415 tempest-TestVolumeBootPattern-1052726415-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1010325959" status: 202 len: 0 microversion: 2.1 time: 0.033643 Nov 20 21:25:03.971618 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3648/7185] 10.222.0.41 () {58 vars in 1262 bytes} [Sat Nov 20 21:25:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1010325959 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:04.042832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:04.051287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97300f08-0adc-4fc9-92fd-624d0b5e3bcc tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1272 microversion: 2.1 time: 0.124737 Nov 20 21:25:04.052182 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3538/7186] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:03 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:04.948522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-80cae7c9-e474-4221-afad-c2119ad18a03 req-f2303dbe-a97d-4b8a-bf4c-0ebfdc1e8383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b368e691-c6a1-4206-8b33-bb2568432076", "tag": "953195c9-0ffc-41df-aad5-7d80d2a2c7e0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:04.950901 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:04.950901 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:04.971012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-80cae7c9-e474-4221-afad-c2119ad18a03 req-f2303dbe-a97d-4b8a-bf4c-0ebfdc1e8383 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:04.971546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-80cae7c9-e474-4221-afad-c2119ad18a03 req-f2303dbe-a97d-4b8a-bf4c-0ebfdc1e8383 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:04.984205 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-80cae7c9-e474-4221-afad-c2119ad18a03 req-f2303dbe-a97d-4b8a-bf4c-0ebfdc1e8383 service nova] Creating event network-changed:953195c9-0ffc-41df-aad5-7d80d2a2c7e0 for instance b368e691-c6a1-4206-8b33-bb2568432076 on nch2-master-1 Nov 20 21:25:04.989391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-80cae7c9-e474-4221-afad-c2119ad18a03 req-f2303dbe-a97d-4b8a-bf4c-0ebfdc1e8383 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046536 Nov 20 21:25:04.990161 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3649/7187] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:05.071310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:05.071931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:05.080287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:05.080758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:05.081594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:05.082084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:05.336557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:05.344981 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d9fc568-f424-4424-bd6c-9f71cbf06f5b tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1314 microversion: 2.1 time: 0.277411 Nov 20 21:25:05.346822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3539/7188] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:05 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:06.362837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:06.363592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:06.371503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:06.371974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:06.373800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:06.374332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:06.952237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:06.959624 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7569bddb-91dc-4f1a-8355-31a03454539e tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1314 microversion: 2.1 time: 0.601543 Nov 20 21:25:06.960212 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3650/7189] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:06 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:07.980690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:07.982583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:07.991333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:07.992440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:07.993637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:07.994343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:08.445307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:08.457399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dbe9b997-6ce5-4df1-9c12-3427a8da0d88 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1314 microversion: 2.1 time: 0.484530 Nov 20 21:25:08.462075 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3540/7190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:07 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:09.475544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:09.476842 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:09.484245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:09.484703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:09.485496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:09.485939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:09.623862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:09.632460 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9f5cbc5-b4e5-4646-9f7d-61685659fa36 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1314 microversion: 2.1 time: 0.160634 Nov 20 21:25:09.633348 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3651/7191] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:09 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:10.229343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-2744f657-2107-4d4c-83a2-6cc0c7733570 req-ee0e420c-f83d-4290-b39c-f42ba0858d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b368e691-c6a1-4206-8b33-bb2568432076", "name": "network-vif-plugged", "status": "completed", "tag": "953195c9-0ffc-41df-aad5-7d80d2a2c7e0"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:10.232143 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:10.232143 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:10.239958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2744f657-2107-4d4c-83a2-6cc0c7733570 req-ee0e420c-f83d-4290-b39c-f42ba0858d4c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:10.240432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-2744f657-2107-4d4c-83a2-6cc0c7733570 req-ee0e420c-f83d-4290-b39c-f42ba0858d4c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:10.255571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-2744f657-2107-4d4c-83a2-6cc0c7733570 req-ee0e420c-f83d-4290-b39c-f42ba0858d4c service nova] Creating event network-vif-plugged:953195c9-0ffc-41df-aad5-7d80d2a2c7e0 for instance b368e691-c6a1-4206-8b33-bb2568432076 on nch2-master-1 Nov 20 21:25:10.261005 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-2744f657-2107-4d4c-83a2-6cc0c7733570 req-ee0e420c-f83d-4290-b39c-f42ba0858d4c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Nov 20 21:25:10.261553 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3541/7192] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:25:10.650915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:10.651705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:10.658661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:10.660533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:10.661457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:10.662067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:10.844678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:10.851960 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2a3aa7e-4d13-4ad7-8c97-d4085af099cd tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1314 microversion: 2.1 time: 0.205188 Nov 20 21:25:10.852542 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3652/7193] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:10 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:11.869909 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:11.870962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:11.878415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:11.878870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:11.879723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:11.880166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.015026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:12.022694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92bdca13-52f9-4f22-8a42-c23699a245de tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1502 microversion: 2.1 time: 0.156892 Nov 20 21:25:12.023492 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3542/7194] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:11 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:12.039885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:12.040589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:12.048055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.048569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.049378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.049836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.191542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:12.198983 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0cb56ab-7a77-4bea-9867-28f8831002cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1502 microversion: 2.1 time: 0.162929 Nov 20 21:25:12.199642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3653/7195] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:12 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:12.217240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:12.217973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:12.227121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.227902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.229185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.229891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.270218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lazy-loading 'flavor' on Instance uuid b368e691-c6a1-4206-8b33-bb2568432076 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:25:12.356311 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43d01863-3711-4a09-b2e5-320af7ca81e6 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action" status: 202 len: 0 microversion: 2.1 time: 0.143228 Nov 20 21:25:12.358236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3543/7196] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:12 2021] POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:12.365571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:12.366241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:12.372913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.373432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.374357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:12.374863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:12.524005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:12.533848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12c249e5-a92d-46ca-bfcc-b482d6288c06 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1510 microversion: 2.1 time: 0.171969 Nov 20 21:25:12.545045 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3654/7197] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:12 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:13.552686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:13.553434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:13.560131 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.560590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:13.561387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.561819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:13.693157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:13.700731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-573319a5-29ba-46b6-910c-7ab609ce510a tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1493 microversion: 2.1 time: 0.152856 Nov 20 21:25:13.701310 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3544/7198] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:13 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1493 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:13.716865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:13.717416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:13.724035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.724494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:13.725283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.725729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:13.790376 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5430464a-edf8-4b72-957d-cfb530bb7265 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action" status: 202 len: 0 microversion: 2.1 time: 0.076848 Nov 20 21:25:13.790921 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3655/7199] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:13 2021] POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:13.799562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:13.800170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:13.806029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.806523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:13.807292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:13.807781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:14.036712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:14.044097 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bc95150-a25d-40cb-bc14-7cba33c24f34 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1499 microversion: 2.1 time: 0.248219 Nov 20 21:25:14.044619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3545/7200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:13 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1499 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:15.061989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:15.062722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:15.069039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.069526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.070348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.070820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.209104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:15.217224 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9be53a61-6059-4995-9040-2dc6774ab6af tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1502 microversion: 2.1 time: 0.159930 Nov 20 21:25:15.217782 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3656/7201] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:15 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:25:15.233735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:15.234394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:15.241092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.241548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.242364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.242806 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.265740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lazy-loading 'flavor' on Instance uuid b368e691-c6a1-4206-8b33-bb2568432076 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:25:15.327656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e7ce5bf-8df9-44f3-a43a-2872819d5095 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action" status: 202 len: 0 microversion: 2.1 time: 0.097508 Nov 20 21:25:15.328452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3546/7202] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:15 2021] POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:15.337690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:15.338336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:15.345793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.347326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.348520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:15.348966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:15.478860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:15.486383 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-910d1c4e-edba-4a7c-9e70-5e93e0afded9 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1510 microversion: 2.1 time: 0.152356 Nov 20 21:25:15.486941 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3657/7203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:15 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:16.505829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:16.506616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:16.513889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.514507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:16.515325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.515775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:16.735585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:16.744565 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9412b4f4-d20a-4dc7-aa84-38e9bc836c5f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1493 microversion: 2.1 time: 0.243872 Nov 20 21:25:16.745252 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3547/7204] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:16 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1493 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:16.762601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:16.763104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:16.769743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.770242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:16.771033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.771587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:16.837604 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-52a5797d-bb25-442d-a9cf-faa595b35d39 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action" status: 202 len: 0 microversion: 2.1 time: 0.078531 Nov 20 21:25:16.841300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3658/7205] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:16 2021] POST /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:16.846436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:16.847055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:16.853547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.854406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:16.854784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:16.855224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:17.079038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:17.086468 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ea44715-b58b-46ca-95e0-4053e8b78c3c tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1499 microversion: 2.1 time: 0.243678 Nov 20 21:25:17.087057 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3548/7206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:16 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1499 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:18.105807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:18.107082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:18.113179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.113634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.114462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.114910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.250188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:18.257510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-241e24ea-22f7-4a36-a464-2b1e1efc38cf tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1502 microversion: 2.1 time: 0.156504 Nov 20 21:25:18.258152 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3659/7207] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:18 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:18.273713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:18.274246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:18.280949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.281414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.282237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.282685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.307596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:25:18.380305 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0a7eb65-65f7-430c-8ecd-1921cc286801 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 204 len: 0 microversion: 2.1 time: 0.110014 Nov 20 21:25:18.380924 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3549/7208] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:25:18 2021] DELETE /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:25:18.389069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:18.389724 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:18.395674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.396135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.396921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:18.397370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:18.529720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:18.537225 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37266c31-5cf3-43b0-84d9-371a7217a0ca tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1508 microversion: 2.1 time: 0.151924 Nov 20 21:25:18.537788 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3660/7209] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:18 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:19.555274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:19.555980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:19.563288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:19.563745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:19.564528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:19.564971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:19.698327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:19.706132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17d28511-b1bc-462a-a787-4e0db94b86c7 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1508 microversion: 2.1 time: 0.154966 Nov 20 21:25:19.706714 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3550/7210] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:19 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:20.634979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e92abcb5-94c2-43d1-8c90-43939bc8f352 req-7873ad75-2a79-420b-a333-2d353954bb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b368e691-c6a1-4206-8b33-bb2568432076", "name": "network-vif-deleted", "tag": "953195c9-0ffc-41df-aad5-7d80d2a2c7e0"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:20.636646 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:20.636646 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:20.645617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e92abcb5-94c2-43d1-8c90-43939bc8f352 req-7873ad75-2a79-420b-a333-2d353954bb06 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:20.646133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e92abcb5-94c2-43d1-8c90-43939bc8f352 req-7873ad75-2a79-420b-a333-2d353954bb06 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:20.658832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e92abcb5-94c2-43d1-8c90-43939bc8f352 req-7873ad75-2a79-420b-a333-2d353954bb06 service nova] Creating event network-vif-deleted:953195c9-0ffc-41df-aad5-7d80d2a2c7e0 for instance b368e691-c6a1-4206-8b33-bb2568432076 on nch2-master-1 Nov 20 21:25:20.663742 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e92abcb5-94c2-43d1-8c90-43939bc8f352 req-7873ad75-2a79-420b-a333-2d353954bb06 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Nov 20 21:25:20.664353 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3661/7211] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:20.723607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:20.724250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:20.731170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:20.731626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:20.732419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:20.732858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:20.765486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:20.765850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:20.766321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lazy-loading 'fault' on Instance uuid b368e691-c6a1-4206-8b33-bb2568432076 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:25:20.804300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74d76d7e8983442da6f501e463d0c644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae4c865270648c8a4551befa186f2d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:20.812193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0cf166da-bae2-4b90-af06-067212e8f02f tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 200 len: 1304 microversion: 2.1 time: 0.093294 Nov 20 21:25:20.812754 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3551/7212] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:20 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:21.830627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:21.831238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] [instance: b368e691-c6a1-4206-8b33-bb2568432076] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:21.837522 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:21.837984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:21.838827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:21.839271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:21.852668 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] HTTP exception thrown: Instance b368e691-c6a1-4206-8b33-bb2568432076 could not be found. Nov 20 21:25:21.853263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] Returning 404 to user: Instance b368e691-c6a1-4206-8b33-bb2568432076 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:21.854105 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4443e910-cc43-4f31-99e8-8a65e5d68910 tempest-TestServerAdvancedOps-1973945794 tempest-TestServerAdvancedOps-1973945794-project] 10.222.0.41 "GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076" status: 404 len: 111 microversion: 2.1 time: 0.029157 Nov 20 21:25:21.854688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3662/7213] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:21 2021] GET /compute/v2.1/servers/b368e691-c6a1-4206-8b33-bb2568432076 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:35.008916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2097994844", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:35.058016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] validate_networks() for None {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:25:35.243996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:25:35.244427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:25:35.244906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:25:35.245608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:25:35.246025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:25:35.255087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:35.255540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:35.256363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:35.256809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:35.273083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Getting quotas for project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:25:35.278714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Getting quotas for user cfa40b899bbc40fd86f43cbb89fe1e41 and project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:25:35.290385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:25:35.292660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:25:35.334959 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [52e6491c-9311-4838-a373-9f2b3650022a] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:25:36.352597 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [52e6491c-9311-4838-a373-9f2b3650022a] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45644. Nov 20 21:25:36.357385 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d9fc7c0-e07e-4401-9b19-3813adc28f55 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462542 Nov 20 21:25:36.358034 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3552/7214] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:25:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:25:36.368083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-efacf338-50d3-470d-b513-9967a064c2ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:36.368731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-efacf338-50d3-470d-b513-9967a064c2ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:36.421612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-efacf338-50d3-470d-b513-9967a064c2ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:36.428080 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-efacf338-50d3-470d-b513-9967a064c2ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1222 microversion: 2.1 time: 0.063771 Nov 20 21:25:36.428638 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3663/7215] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:36 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:37.446344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c7503a6c-4068-4045-8c12-970d70031263 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:37.446962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c7503a6c-4068-4045-8c12-970d70031263 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:37.499435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c7503a6c-4068-4045-8c12-970d70031263 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:37.506365 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c7503a6c-4068-4045-8c12-970d70031263 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1222 microversion: 2.1 time: 0.064301 Nov 20 21:25:37.506747 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3553/7216] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:37 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1222 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:38.524900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:38.525684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:38.533691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:38.534185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:38.534999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:38.535849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:38.596781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:38.605026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-962affff-1266-4ebb-9ba0-40304fc6e540 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1280 microversion: 2.1 time: 0.084547 Nov 20 21:25:38.605672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3664/7217] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:38 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1280 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:39.623612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:39.624236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:39.634542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:39.635229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:39.636402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:39.636830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:39.821045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-309aeae5-971d-4f0d-b795-b386e6d7f93a req-8ee95a53-2400-46ea-9f2e-e378c6a881c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28432994-7e61-4223-97fb-e69373e8179f", "tag": "48c52e0e-448e-429d-9918-e3af76441087"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:39.829439 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:39.829439 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:39.837459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-309aeae5-971d-4f0d-b795-b386e6d7f93a req-8ee95a53-2400-46ea-9f2e-e378c6a881c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:39.837916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-309aeae5-971d-4f0d-b795-b386e6d7f93a req-8ee95a53-2400-46ea-9f2e-e378c6a881c1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:39.859683 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-309aeae5-971d-4f0d-b795-b386e6d7f93a req-8ee95a53-2400-46ea-9f2e-e378c6a881c1 service nova] Creating event network-changed:48c52e0e-448e-429d-9918-e3af76441087 for instance 28432994-7e61-4223-97fb-e69373e8179f on nch2-master-1 Nov 20 21:25:39.865744 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-309aeae5-971d-4f0d-b795-b386e6d7f93a req-8ee95a53-2400-46ea-9f2e-e378c6a881c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048220 Nov 20 21:25:39.866400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3665/7218] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:39.892831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:39.909012 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e5afd849-42a4-49eb-9bb5-f84e15f538a1 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1322 microversion: 2.1 time: 0.290184 Nov 20 21:25:39.909597 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3554/7219] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:39 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:40.926646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:40.927339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:40.934721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:40.935173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:40.935956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:40.936400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:41.067035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:41.074242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12dfae9b-d87c-4d95-b29f-82a885b6198a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1322 microversion: 2.1 time: 0.151540 Nov 20 21:25:41.075649 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3666/7220] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:40 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:42.092557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:42.093829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:42.101061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:42.101514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:42.102351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:42.102792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:42.245022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:42.252512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64382d9d-3cf7-406c-9bcc-b910117b7968 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1322 microversion: 2.1 time: 0.164371 Nov 20 21:25:42.253085 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3555/7221] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:42 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:43.269123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:43.269740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:43.276534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:43.276992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:43.278361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:43.278964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:43.413329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:43.421287 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47d5b0ee-d6b1-424a-9e97-5df96f67872e tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1322 microversion: 2.1 time: 0.155900 Nov 20 21:25:43.421860 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3667/7222] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:43 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:44.172959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-062f03e7-bad2-4a95-a2fa-507cdf341144 req-a339c4d4-08a1-484f-a0d4-8986521596f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28432994-7e61-4223-97fb-e69373e8179f", "name": "network-vif-plugged", "status": "completed", "tag": "48c52e0e-448e-429d-9918-e3af76441087"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:44.174602 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:44.174602 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:44.182451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-062f03e7-bad2-4a95-a2fa-507cdf341144 req-a339c4d4-08a1-484f-a0d4-8986521596f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:44.182839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-062f03e7-bad2-4a95-a2fa-507cdf341144 req-a339c4d4-08a1-484f-a0d4-8986521596f2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:44.197271 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-062f03e7-bad2-4a95-a2fa-507cdf341144 req-a339c4d4-08a1-484f-a0d4-8986521596f2 service nova] Creating event network-vif-plugged:48c52e0e-448e-429d-9918-e3af76441087 for instance 28432994-7e61-4223-97fb-e69373e8179f on nch2-master-1 Nov 20 21:25:44.203300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-062f03e7-bad2-4a95-a2fa-507cdf341144 req-a339c4d4-08a1-484f-a0d4-8986521596f2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034622 Nov 20 21:25:44.203904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3556/7223] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:44.439444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:44.440062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:44.446663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:44.447121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:44.448082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:44.448561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:44.582968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:44.590592 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-11196c04-34ec-4e0f-a84d-3b3862be06fc tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1322 microversion: 2.1 time: 0.154403 Nov 20 21:25:44.591150 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3668/7224] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:44 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:45.607496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:45.608220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:45.615083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:45.615568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:45.616342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:45.616779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:45.752383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:45.759905 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-952e54fd-ab9b-47f4-809e-fa0ec0b88f8a tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1472 microversion: 2.1 time: 0.156562 Nov 20 21:25:45.760480 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3557/7225] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:45 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:45.833989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5acb393a-35a4-412c-9de5-818013956561 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '.version_select at 0x7f3f863ca940>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:45.900221 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5acb393a-35a4-412c-9de5-818013956561 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/af701f3825304a3fa7755171a65cef00" status: 200 len: 371 microversion: 2.1 time: 0.125494 Nov 20 21:25:45.900781 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3669/7226] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 21:25:45 2021] GET /compute/v2.1/os-quota-sets/af701f3825304a3fa7755171a65cef00 => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:45.910880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-925b66c1-dbff-446f-b632-b4e9ef317b32 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1456890755", "id": 775666561, "os-flavor-access:is_public": "True"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:45.912445 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:45.912445 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:45.927645 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-925b66c1-dbff-446f-b632-b4e9ef317b32 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.020429 Nov 20 21:25:45.928215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3558/7227] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:25:45 2021] POST /compute/v2.1/flavors => generated 435 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:45.939130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "775666561"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:45.940080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:45.946068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:45.946549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:45.947327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:45.947771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.029243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd040351ac40648a3928bce8b2c9395fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af701f3825304a3fa7755171a65cef00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:46.035341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1456890755 {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:25:46.036387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.036834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.037636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.038098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.057981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Getting quotas for project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:25:46.063364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Getting quotas for user cfa40b899bbc40fd86f43cbb89fe1e41 and project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:25:46.074800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.compute.api [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] ram quota exceeded for af701f3825304a3fa7755171a65cef00, tried to resize instance. Nov 20 21:25:46.075324 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 20 21:25:46.075910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:46.076737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f89eaa1-6adf-46cc-b201-513ef0c50519 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f/action" status: 403 len: 118 microversion: 2.1 time: 0.141430 Nov 20 21:25:46.077301 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3670/7228] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:45 2021] POST /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f/action => generated 118 bytes in 143 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:46.085378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ab2dfdaf-0ffa-470a-b004-52e731c3784a tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.086145 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:46.086145 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:46.102411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ab2dfdaf-0ffa-470a-b004-52e731c3784a tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/775666561" status: 202 len: 0 microversion: 2.1 time: 0.020519 Nov 20 21:25:46.102980 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3559/7229] 10.222.0.41 () {58 vars in 1157 bytes} [Sat Nov 20 21:25:46 2021] DELETE /compute/v2.1/flavors/775666561 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:46.111252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c84ccd1b-aa90-4256-bf4b-40e94ea1d81a tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.130420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c84ccd1b-aa90-4256-bf4b-40e94ea1d81a tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022677 Nov 20 21:25:46.130981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3671/7230] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:25:46 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:25:46.147506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-38603036-7f69-4913-8843-009c8ab617e4 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '.version_select at 0x7f3f86ae4940>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.214506 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-38603036-7f69-4913-8843-009c8ab617e4 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "GET /compute/v2.1/os-quota-sets/af701f3825304a3fa7755171a65cef00" status: 200 len: 371 microversion: 2.1 time: 0.070844 Nov 20 21:25:46.215706 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3560/7231] 10.222.0.41 () {58 vars in 1241 bytes} [Sat Nov 20 21:25:46 2021] GET /compute/v2.1/os-quota-sets/af701f3825304a3fa7755171a65cef00 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:46.225578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9355441c-1995-4d1c-8ee4-2c01fa81bd04 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1052383528", "id": 1880835976, "os-flavor-access:is_public": "True"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:46.227173 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:46.227173 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:46.242560 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9355441c-1995-4d1c-8ee4-2c01fa81bd04 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.020572 Nov 20 21:25:46.243128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3672/7232] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:25:46 2021] POST /compute/v2.1/flavors => generated 437 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:46.254251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1880835976"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:46.255204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:46.261051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.261501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.262348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.262855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.443914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd040351ac40648a3928bce8b2c9395fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af701f3825304a3fa7755171a65cef00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:46.450933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1052383528 {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:25:46.452156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.452642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.453541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.454105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.474361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Getting quotas for project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:25:46.479144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Getting quotas for user cfa40b899bbc40fd86f43cbb89fe1e41 and project 48e7e28717f146dea2631786e9b47e0a. Resources: {'cores', 'ram'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:25:46.490829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] cores quota exceeded for af701f3825304a3fa7755171a65cef00, tried to resize instance. Nov 20 21:25:46.491367 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 20 21:25:46.491958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:46.492788 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1967401-b335-40e7-9796-2ba3e90e4ded tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "POST /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f/action" status: 403 len: 113 microversion: 2.1 time: 0.242482 Nov 20 21:25:46.493408 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3561/7233] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:25:46 2021] POST /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f/action => generated 113 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:25:46.502301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd6bc95b-71f4-4ff5-8cf4-c26f4ea3cd83 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.503132 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:46.503132 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:46.520204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd6bc95b-71f4-4ff5-8cf4-c26f4ea3cd83 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "DELETE /compute/v2.1/flavors/1880835976" status: 202 len: 0 microversion: 2.1 time: 0.021439 Nov 20 21:25:46.520769 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3673/7234] 10.222.0.41 () {58 vars in 1160 bytes} [Sat Nov 20 21:25:46 2021] DELETE /compute/v2.1/flavors/1880835976 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:25:46.529230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c3b40fff-453f-4577-8550-12caa9ed8941 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.551093 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c3b40fff-453f-4577-8550-12caa9ed8941 tempest-ServersAdminNegativeTestJSON-151557011 tempest-ServersAdminNegativeTestJSON-151557011-project-admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026024 Nov 20 21:25:46.551669 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3562/7235] 10.222.0.41 () {58 vars in 1145 bytes} [Sat Nov 20 21:25:46 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:46.568562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.569069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:46.575875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.576334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.577407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.577867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.605228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:25:46.680866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-019e24cc-ad07-4b07-b1c7-5a97eb0fcce8 tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "DELETE /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 204 len: 0 microversion: 2.1 time: 0.115478 Nov 20 21:25:46.681617 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3674/7236] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:25:46 2021] DELETE /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:25:46.690103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:46.690716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:46.697564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.698019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.698819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:46.699365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:46.834922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:46.842735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1afa3177-762d-4024-8def-9d9fac2cd8ff tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1478 microversion: 2.1 time: 0.156321 Nov 20 21:25:46.843319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3563/7237] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:46 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:47.859637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:47.860340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:47.866986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:47.867442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:47.868222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:47.868662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:48.005460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa40b899bbc40fd86f43cbb89fe1e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e7e28717f146dea2631786e9b47e0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:48.013748 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ee555e75-e73b-40b6-8c23-50fd92618e2d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 200 len: 1478 microversion: 2.1 time: 0.158051 Nov 20 21:25:48.014368 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3675/7238] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:47 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:48.464290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-889b8b68-4aac-461a-95bc-c8f55090170e req-af1e3f55-3162-4fb5-8488-115611a16a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28432994-7e61-4223-97fb-e69373e8179f", "name": "network-vif-deleted", "tag": "48c52e0e-448e-429d-9918-e3af76441087"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:48.467455 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:48.467455 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:48.477436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-889b8b68-4aac-461a-95bc-c8f55090170e req-af1e3f55-3162-4fb5-8488-115611a16a90 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:48.477892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-889b8b68-4aac-461a-95bc-c8f55090170e req-af1e3f55-3162-4fb5-8488-115611a16a90 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:48.490375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-889b8b68-4aac-461a-95bc-c8f55090170e req-af1e3f55-3162-4fb5-8488-115611a16a90 service nova] Creating event network-vif-deleted:48c52e0e-448e-429d-9918-e3af76441087 for instance 28432994-7e61-4223-97fb-e69373e8179f on nch2-master-1 Nov 20 21:25:48.495578 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-889b8b68-4aac-461a-95bc-c8f55090170e req-af1e3f55-3162-4fb5-8488-115611a16a90 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034873 Nov 20 21:25:48.496923 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3564/7239] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:49.031600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:49.032142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] [instance: 28432994-7e61-4223-97fb-e69373e8179f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:49.039185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:49.039577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:49.040359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:49.040803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:49.053879 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] HTTP exception thrown: Instance 28432994-7e61-4223-97fb-e69373e8179f could not be found. Nov 20 21:25:49.054499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] Returning 404 to user: Instance 28432994-7e61-4223-97fb-e69373e8179f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:25:49.055314 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-91e80342-fa38-4069-a16e-3c3be4fd746d tempest-ServersAdminNegativeTestJSON-291309874 tempest-ServersAdminNegativeTestJSON-291309874-project] 10.222.0.41 "GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f" status: 404 len: 111 microversion: 2.1 time: 0.028306 Nov 20 21:25:49.055846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3676/7240] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:49 2021] GET /compute/v2.1/servers/28432994-7e61-4223-97fb-e69373e8179f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:25:51.667665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1667975417", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "e6cc01b7-a8f8-45bc-ba36-665d99c7ac8f"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:51.718311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] validate_networks() for [('e6cc01b7-a8f8-45bc-ba36-665d99c7ac8f', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:25:52.062103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:25:52.062625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:25:52.063174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:25:52.063794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:25:52.064210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:25:52.073199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:52.073653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:52.075017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:52.075451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:52.092050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Getting quotas for project f4206c1665154df4b6276fff2783e771. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:25:52.097036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Getting quotas for user 63b51c9812574f6b8e78a3a3dab0a178 and project f4206c1665154df4b6276fff2783e771. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:25:52.108601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:25:52.111030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:25:52.155338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5a1dc240-e2e6-4faf-880e-9ef3ba392677 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604821 Nov 20 21:25:52.156003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3565/7241] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:25:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:25:52.166086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-413cc461-87e4-4846-9efb-eb70b62493b6 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:52.166800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-413cc461-87e4-4846-9efb-eb70b62493b6 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:52.220361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-413cc461-87e4-4846-9efb-eb70b62493b6 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:52.227698 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-413cc461-87e4-4846-9efb-eb70b62493b6 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1215 microversion: 2.1 time: 0.065336 Nov 20 21:25:52.228763 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3677/7242] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:52 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:53.245753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:53.246990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:53.253771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:53.254283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:53.255088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:53.255523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:53.327252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:53.335007 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9535ea3e-e184-4fdb-b977-47a6d8a2c1cf tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1273 microversion: 2.1 time: 0.094150 Nov 20 21:25:53.335591 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3566/7243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:53 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:54.329113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-37509150-a138-4e98-a38d-46edf6e3c3dc req-6ccab0a4-5353-4f4b-b4b9-def88623b37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6e7b1a-8abb-41ce-857f-17eda5ddffc3", "tag": "1befbb7f-1091-4fa6-b06c-07da815531c1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:54.331526 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:54.331526 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:25:54.340410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-37509150-a138-4e98-a38d-46edf6e3c3dc req-6ccab0a4-5353-4f4b-b4b9-def88623b37e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:54.341146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-37509150-a138-4e98-a38d-46edf6e3c3dc req-6ccab0a4-5353-4f4b-b4b9-def88623b37e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:54.351741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:54.352915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:54.359595 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-37509150-a138-4e98-a38d-46edf6e3c3dc req-6ccab0a4-5353-4f4b-b4b9-def88623b37e service nova] Creating event network-changed:1befbb7f-1091-4fa6-b06c-07da815531c1 for instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 on nch2-master-1 Nov 20 21:25:54.359977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:54.360616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:54.361418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:54.361861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:54.366241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-37509150-a138-4e98-a38d-46edf6e3c3dc req-6ccab0a4-5353-4f4b-b4b9-def88623b37e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040402 Nov 20 21:25:54.367279 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3678/7244] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:54.601446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:54.608944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70477f70-4d46-4cca-b9c4-a897a20c340d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1315 microversion: 2.1 time: 0.260945 Nov 20 21:25:54.609530 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3567/7245] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:54 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:55.627130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:55.627829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:55.633943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:55.634431 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:55.635208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:55.635648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:55.768609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:55.775888 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6b2ef81a-12d7-4775-b117-939f783be7f7 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1315 microversion: 2.1 time: 0.153605 Nov 20 21:25:55.776488 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3679/7246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:55 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:25:56.681684 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:25:56.682319 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:25:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:25:56.792683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:56.793804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:56.800442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:56.800894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:56.801680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:56.802151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:56.931643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:56.939278 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c65b5d2-c5e3-4d59-978a-835ec20aa4b2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1315 microversion: 2.1 time: 0.150423 Nov 20 21:25:56.939856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3568/7247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:56 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:25:57.955963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:57.956579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:57.963251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:57.963708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:57.964495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:57.965173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:58.099022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:58.106882 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac3fe180-24c3-4312-8555-03d713bd4b03 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1315 microversion: 2.1 time: 0.154612 Nov 20 21:25:58.107461 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3680/7248] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:57 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:25:58.256927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-da71f763-a950-4c51-ba17-611c9998a85e req-03021ea0-a06b-4186-9125-d2dac2e9d4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6e7b1a-8abb-41ce-857f-17eda5ddffc3", "name": "network-vif-plugged", "status": "completed", "tag": "1befbb7f-1091-4fa6-b06c-07da815531c1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:25:58.258701 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:25:58.258701 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:25:58.268224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-da71f763-a950-4c51-ba17-611c9998a85e req-03021ea0-a06b-4186-9125-d2dac2e9d4df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:58.268680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-da71f763-a950-4c51-ba17-611c9998a85e req-03021ea0-a06b-4186-9125-d2dac2e9d4df service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:58.280635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-da71f763-a950-4c51-ba17-611c9998a85e req-03021ea0-a06b-4186-9125-d2dac2e9d4df service nova] Creating event network-vif-plugged:1befbb7f-1091-4fa6-b06c-07da815531c1 for instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 on nch2-master-1 Nov 20 21:25:58.285575 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-da71f763-a950-4c51-ba17-611c9998a85e req-03021ea0-a06b-4186-9125-d2dac2e9d4df service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 Nov 20 21:25:58.286684 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3569/7249] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:25:59.124268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:25:59.124883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:25:59.131517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:59.131967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:59.132745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:25:59.133185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:25:59.525519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:25:59.533603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7fd7934-dd20-4128-98cb-98549c5cb7ba tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1315 microversion: 2.1 time: 0.413721 Nov 20 21:25:59.534329 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3681/7250] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:25:59 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:00.551639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:00.552336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:00.560137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.560596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:00.561384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.561826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:00.754820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:00.762803 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9d81b30d-4ddc-4c90-80b9-500350171b90 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1503 microversion: 2.1 time: 0.215262 Nov 20 21:26:00.763559 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3570/7251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:00 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:00.779340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:00.780315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:00.786934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.787345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:00.788147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.788604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:00.861719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:00.867402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Old instance type m1.heat2, new instance type m1.heat {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:26:00.874349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:26:00.874783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:26:00.875271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:26:00.875689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:26:00.876109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:26:00.979133 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-455163cb-cef6-4537-a585-5877ad2df878 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "POST /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3/action" status: 202 len: 0 microversion: 2.1 time: 0.203733 Nov 20 21:26:00.980665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3682/7252] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:26:00 2021] POST /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:26:00.988312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:00.988876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:00.995231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.995766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:00.997242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:00.997740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:01.157754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:01.165256 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-979fc772-e20c-46d6-83d3-b6a2b8b8bf41 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1512 microversion: 2.1 time: 0.180728 Nov 20 21:26:01.165833 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3571/7253] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:00 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:26:02.183425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:02.184052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:02.194672 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:02.195133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:02.195942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:02.196401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:02.329298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:02.336657 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9ee2fc3d-35a6-4ea4-804a-c5a2f6a2aed9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1512 microversion: 2.1 time: 0.157799 Nov 20 21:26:02.337449 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3683/7254] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:02 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:03.354138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:03.354679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:03.362416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:03.362868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:03.363645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:03.364115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:03.500605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:03.507859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-340d23e2-3419-43ff-bed4-76ac2448c704 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.157526 Nov 20 21:26:03.508426 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3572/7255] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:03 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:04.525859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:04.526525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:04.534185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:04.534707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:04.535869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:04.535869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:04.669210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:04.676491 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b4dc232-f694-4472-a696-be05fe83516a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.154308 Nov 20 21:26:04.677053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3684/7256] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:04 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:05.693289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:05.693931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:05.701382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:05.701829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:05.702667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:05.703109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:05.833656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:05.841003 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd8633af-7916-42e4-83d7-b7c03e10a870 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.151399 Nov 20 21:26:05.841573 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3573/7257] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:05 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:06.858576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:06.859241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:06.865770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:06.866266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:06.867069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:06.867521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:07.059080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:07.067143 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f6ac486-982e-4f5f-85bc-ea54da8cddfa tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.213051 Nov 20 21:26:07.067718 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3685/7258] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:06 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:08.083890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:08.084500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:08.091292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:08.091733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:08.092514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:08.092951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:08.223189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:08.230907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b333587a-cbe5-4bf3-adb0-05a44796fbfb tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.150365 Nov 20 21:26:08.231599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3574/7259] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:08 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:09.247924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:09.248588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:09.255359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:09.255824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:09.256626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:09.257082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:09.396114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:09.404326 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed8172b6-272e-476b-b3fd-9736a32847ef tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.160473 Nov 20 21:26:09.404896 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3686/7260] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:09 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:10.421222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:10.421839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:10.428764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:10.429226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:10.430570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:10.431048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:10.571297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:10.578917 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b14be911-01ad-4b0e-a300-a6db8469c423 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.161503 Nov 20 21:26:10.579489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3575/7261] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:10 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:11.596653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:11.597278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:11.604056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:11.604526 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:11.605319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:11.605770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:11.736577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:11.745511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c3f1de7-a7c4-4480-907d-6146b1b16f3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.152470 Nov 20 21:26:11.746119 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3687/7262] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:11 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:12.764060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:12.764713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:12.772123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:12.772583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:12.773422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:12.773933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:12.908631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:12.916033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a39507c-fce6-4772-9ba4-e162afa49b2a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.156715 Nov 20 21:26:12.916607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3576/7263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:12 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:13.933268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:13.933925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:13.941364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:13.941827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:13.942654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:13.943103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:14.076364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:14.083677 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e433037-1b15-4b40-90da-f53c74355993 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.154428 Nov 20 21:26:14.084254 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3688/7264] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:13 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:15.101592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:15.102208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:15.109775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:15.110262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:15.111104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:15.111547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:15.605032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:15.613190 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-645fa76a-0dc8-45e2-a075-2e1a919993fd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.515597 Nov 20 21:26:15.613762 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3577/7265] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:15 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:16.630815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:16.631442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:16.638508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:16.639027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:16.639823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:16.640273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:16.774592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:16.782259 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d0483418-050d-42ac-a00c-f4024e1adb3a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.155409 Nov 20 21:26:16.782832 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3689/7266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:16 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:17.799194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:17.799742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:17.806469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:17.806922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:17.807771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:17.808218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:17.937097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:17.944469 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f62f39b9-9341-469d-a319-d80e731dfd59 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.149047 Nov 20 21:26:17.945069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3578/7267] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:17 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:18.961632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:18.962302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:18.969766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:18.970272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:18.971076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:18.971529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:19.103813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:19.111222 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44e7464e-1f30-4be2-81d7-744aadaa17e2 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.153307 Nov 20 21:26:19.111838 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3690/7268] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:18 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:26:20.128416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:20.129057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:20.135841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:20.136295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:20.137077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:20.137538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:20.270608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:20.278642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42d35ba9-9183-4364-819a-e6e4b2e367bd tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.153260 Nov 20 21:26:20.279237 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3579/7269] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:20 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:21.296875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:21.297527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:21.304310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:21.304772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:21.305625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:21.306099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:21.440514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:21.449532 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eb10c540-c21b-4bcf-ad32-a4b4e27b1a5e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.156911 Nov 20 21:26:21.450431 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3691/7270] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:21 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:22.466957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:22.467579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:22.474340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:22.474795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:22.475569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:22.476011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:22.610466 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:22.617768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8a04c46-eeab-428d-8309-f3b7553f9fab tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.154534 Nov 20 21:26:22.618380 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3580/7271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:22 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:26:23.635710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:23.636359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:23.643336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:23.643803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:23.644613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:23.645065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:23.780576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:23.788004 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93c5c041-dd79-4ea2-9cad-41a7caa74c8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.155957 Nov 20 21:26:23.788514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3692/7272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:23 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:24.804875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:24.805410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:24.812924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:24.813383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:24.814198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:24.814643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:24.943357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:24.950792 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81385e9a-73df-4a61-8871-074b839d528a tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.149704 Nov 20 21:26:24.951365 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3581/7273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:24 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:25.967463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:25.968087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:25.974864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:25.975326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:25.976121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:25.976570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:26.107762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:26.115152 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6ea81c2f-b19d-4640-8897-6996ce758c2d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.151438 Nov 20 21:26:26.116062 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3693/7274] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:25 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:27.132654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:27.133263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:27.140299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:27.140750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:27.141543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:27.141985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:27.277236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:27.284491 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02467ac1-4784-4322-a39a-8e46ac323e1d tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.155736 Nov 20 21:26:27.285067 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3582/7275] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:27 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:28.301832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:28.302506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:28.309945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:28.310466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:28.311271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:28.311717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:28.439919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:28.447329 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61e9dd42-dd33-48f5-b83a-525ec8d6eee9 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1517 microversion: 2.1 time: 0.149238 Nov 20 21:26:28.447930 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3694/7276] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:28 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:29.465710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:29.466507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:29.474502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:29.474953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:29.475738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:29.476173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:29.693610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:29.701743 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-97c4fccc-9f95-4b35-84db-dd1822da5171 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1516 microversion: 2.1 time: 0.239314 Nov 20 21:26:29.702397 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3583/7277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:29 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:29.984187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6e7b1a-8abb-41ce-857f-17eda5ddffc3", "name": "network-vif-unplugged", "status": "completed", "tag": "1befbb7f-1091-4fa6-b06c-07da815531c1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:29.985787 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:26:29.985787 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:26:29.993504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:29.994101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:30.009886 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] Creating event network-vif-unplugged:1befbb7f-1091-4fa6-b06c-07da815531c1 for instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 on nch1-master-1 Nov 20 21:26:30.016140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:26:30.028101 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-da7c06d8-fa17-4abb-9005-8ba7c46cd78e req-efcaf7e4-b718-448e-9607-f47ebb244dc5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048917 Nov 20 21:26:30.028882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3695/7278] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:26:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:26:30.720230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:30.720920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:30.727860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:30.728313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:30.729096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:30.729557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:30.864327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:30.871829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-76bf60a6-2251-4c45-97f9-6af454d83d72 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1516 microversion: 2.1 time: 0.156521 Nov 20 21:26:30.872419 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3584/7279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:30 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:31.889358 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:31.890374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:31.897339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:31.897796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:31.898610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:31.899054 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:32.044157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:32.044340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d6e7b1a-8abb-41ce-857f-17eda5ddffc3", "tag": "1befbb7f-1091-4fa6-b06c-07da815531c1"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:32.046371 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:26:32.046371 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:26:32.051628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c842b7c4-9cfd-4e0c-a298-94131b6c8f3c tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1514 microversion: 2.1 time: 0.166235 Nov 20 21:26:32.052705 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3696/7280] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:31 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:32.055013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:32.055631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:32.068105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] Creating event network-changed:1befbb7f-1091-4fa6-b06c-07da815531c1 for instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 on nch1-master-1 Nov 20 21:26:32.073912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:26:32.086017 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-04e655b8-eb25-4beb-af0c-2f225359476b req-2362ba30-080c-4b5d-b6c7-34287f054b0a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045242 Nov 20 21:26:32.086665 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3585/7281] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:26:33.068618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:33.069175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:33.075955 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:33.076413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:33.077748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:33.078215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:33.211187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:33.219008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d4f1b90-d835-4f15-8bdc-cee66ba42675 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1511 microversion: 2.1 time: 0.154245 Nov 20 21:26:33.219578 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3697/7282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:33 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:33.236388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:33.237009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:33.243226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:33.243680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:33.244469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:33.245163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:33.270925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:26:33.319893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Found an unconfirmed migration during delete, id: 16, status: finished Nov 20 21:26:34.593282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91596aab-309e-4c2f-966f-853d5ad3a797 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 204 len: 0 microversion: 2.1 time: 1.361455 Nov 20 21:26:34.594399 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3586/7283] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:26:33 2021] DELETE /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 0 bytes in 1364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:26:34.602093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:34.602803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:34.610035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:34.610525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:34.611319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:34.611767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:34.765211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:34.774519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7ed9638-04b3-4723-aa2c-c9fb29c36f8e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1503 microversion: 2.1 time: 0.175976 Nov 20 21:26:34.775107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3698/7284] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:34 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:35.792550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:35.793193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:35.799958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:35.800410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:35.801201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:35.801639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:36.029855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b51c9812574f6b8e78a3a3dab0a178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4206c1665154df4b6276fff2783e771', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:36.037373 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e3490f07-3ec5-4911-82ff-e4df6b41be8b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 200 len: 1503 microversion: 2.1 time: 0.249127 Nov 20 21:26:36.038038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3587/7285] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:35 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:36.379440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6ca44879-b66b-4110-b302-9d638301463f req-81d87aa8-b392-4ef9-8e9f-c20edf09e59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d6e7b1a-8abb-41ce-857f-17eda5ddffc3", "name": "network-vif-deleted", "tag": "1befbb7f-1091-4fa6-b06c-07da815531c1"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:36.381535 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:26:36.381535 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:26:36.392641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6ca44879-b66b-4110-b302-9d638301463f req-81d87aa8-b392-4ef9-8e9f-c20edf09e59a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:36.393099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6ca44879-b66b-4110-b302-9d638301463f req-81d87aa8-b392-4ef9-8e9f-c20edf09e59a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:36.406637 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6ca44879-b66b-4110-b302-9d638301463f req-81d87aa8-b392-4ef9-8e9f-c20edf09e59a service nova] Creating event network-vif-deleted:1befbb7f-1091-4fa6-b06c-07da815531c1 for instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 on nch1-master-1 Nov 20 21:26:36.411703 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6ca44879-b66b-4110-b302-9d638301463f req-81d87aa8-b392-4ef9-8e9f-c20edf09e59a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036319 Nov 20 21:26:36.412318 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3699/7286] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:26:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:26:37.055043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:37.055695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:37.063217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.063678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.064473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.064911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.078395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] HTTP exception thrown: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. Nov 20 21:26:37.078988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Returning 404 to user: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:26:37.079844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cef0dea3-d34d-497f-93d6-de02a5ccbd20 tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 404 len: 111 microversion: 2.1 time: 0.028560 Nov 20 21:26:37.080381 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3588/7287] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:37 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:26:37.095646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:37.096233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:37.102576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.103034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.103826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.104271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.117982 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] HTTP exception thrown: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. Nov 20 21:26:37.118596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Returning 404 to user: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:26:37.119415 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b9aad28-e955-40bd-8aa4-2e1cbb5c5b3b tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 404 len: 111 microversion: 2.1 time: 0.028612 Nov 20 21:26:37.120200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3700/7288] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:26:37 2021] DELETE /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:26:37.128058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:37.128673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] [instance: 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:37.134610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.135099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.135885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:37.136328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:37.152230 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] HTTP exception thrown: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. Nov 20 21:26:37.152841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] Returning 404 to user: Instance 3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:26:37.153654 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e3c0df2-45a1-4307-ae1f-dda41432257e tempest-DeleteServersTestJSON-1857013875 tempest-DeleteServersTestJSON-1857013875-project] 10.222.0.41 "GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3" status: 404 len: 111 microversion: 2.1 time: 0.029360 Nov 20 21:26:37.154214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3589/7289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:37 2021] GET /compute/v2.1/servers/3d6e7b1a-8abb-41ce-857f-17eda5ddffc3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:26:39.527922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-376162768", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c491c6ef-afa4-46dc-9be7-aafd9ce4ca37"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:39.579563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] validate_networks() for [('c491c6ef-afa4-46dc-9be7-aafd9ce4ca37', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:26:39.921456 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:26:39.921886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:26:39.922398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:26:39.922810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:26:39.923229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:26:39.931957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:39.932415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:39.933229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:39.933673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:39.950637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Getting quotas for project 125aa0037bff4a39b23180aa19a58b44. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:26:39.956004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Getting quotas for user 55b3c17b364f42eb8a1bb0d423de6dca and project 125aa0037bff4a39b23180aa19a58b44. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:26:39.967780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:26:39.970091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:26:40.012893 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42592297-b050-4b09-a049-1dd69228d0ea tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601471 Nov 20 21:26:40.013548 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3701/7290] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:26:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:26:40.023407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-81255c50-2b5f-4d64-81f1-950a3d13e73d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:40.024073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-81255c50-2b5f-4d64-81f1-950a3d13e73d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:40.076281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-81255c50-2b5f-4d64-81f1-950a3d13e73d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:40.083251 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-81255c50-2b5f-4d64-81f1-950a3d13e73d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1217 microversion: 2.1 time: 0.063519 Nov 20 21:26:40.083758 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3590/7291] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:40 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:41.101450 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:41.102098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:41.108780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:41.109237 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:41.110032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:41.110506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:41.175827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:41.183731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-22034254-28a5-4a79-a4d0-29e172196bc7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1275 microversion: 2.1 time: 0.086985 Nov 20 21:26:41.184681 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3702/7292] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:41 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:42.202396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:42.203017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:42.210921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:42.211388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:42.212185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:42.212804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:42.436187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:42.443504 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f9f1cba1-d972-42e5-aa50-e9bef4b6667a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.245342 Nov 20 21:26:42.444100 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3591/7293] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:42 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:42.564534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f4b2cdb6-df9f-4459-86a6-9aa233645d45 req-4e6bd733-8044-437d-b23f-cd4f87b18107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:42.566912 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:26:42.566912 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:26:42.578302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4b2cdb6-df9f-4459-86a6-9aa233645d45 req-4e6bd733-8044-437d-b23f-cd4f87b18107 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:42.578848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f4b2cdb6-df9f-4459-86a6-9aa233645d45 req-4e6bd733-8044-437d-b23f-cd4f87b18107 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:42.595352 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f4b2cdb6-df9f-4459-86a6-9aa233645d45 req-4e6bd733-8044-437d-b23f-cd4f87b18107 service nova] Creating event network-changed:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch1-master-1 Nov 20 21:26:42.600450 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f4b2cdb6-df9f-4459-86a6-9aa233645d45 req-4e6bd733-8044-437d-b23f-cd4f87b18107 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039711 Nov 20 21:26:42.601067 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3703/7294] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:26:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:26:43.460899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:43.461544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:43.469471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:43.469931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:43.470755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:43.471201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:43.604488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:43.612187 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb0979b9-255b-4fba-b552-f5cbb9ee97cb tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.155050 Nov 20 21:26:43.612753 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3592/7295] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:43 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:44.629167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:44.629867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:44.636776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:44.637231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:44.638017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:44.638555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:44.773012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:44.781045 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2234428a-d8e7-4282-9335-5a77742af3f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.155899 Nov 20 21:26:44.781645 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3704/7296] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:44 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:45.797825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:45.798440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:45.804970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:45.805425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:45.806237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:45.806674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:45.939603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:45.946773 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34dd8679-8bf5-4ed6-b321-c8e24dc79577 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.152776 Nov 20 21:26:45.947339 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3593/7297] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:45 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:46.964033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:46.964651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:46.971885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:46.972344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:46.973129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:46.973883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:47.103700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:47.111835 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8cec27b-3a04-4170-b839-e9124b1f06c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.151451 Nov 20 21:26:47.112323 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3705/7298] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:46 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:48.128447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:48.129044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:48.135746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:48.136192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:48.136968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:48.137400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:48.267271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:48.274523 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-736eaa58-42be-448f-9493-d3ee20c7f8f7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.149706 Nov 20 21:26:48.275079 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3594/7299] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:48 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:49.293441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:49.294197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:49.302921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:49.303419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1dff6b74-619c-4a00-b886-c66c81e1fb8c req-63d569b2-6d69-46b3-b9ce-85d66f19c0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "name": "network-vif-plugged", "status": "completed", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:49.303899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:49.304360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:49.304992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:49.305135 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:26:49.305135 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:26:49.314495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1dff6b74-619c-4a00-b886-c66c81e1fb8c req-63d569b2-6d69-46b3-b9ce-85d66f19c0f1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:49.315058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1dff6b74-619c-4a00-b886-c66c81e1fb8c req-63d569b2-6d69-46b3-b9ce-85d66f19c0f1 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:49.328754 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1dff6b74-619c-4a00-b886-c66c81e1fb8c req-63d569b2-6d69-46b3-b9ce-85d66f19c0f1 service nova] Creating event network-vif-plugged:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch1-master-1 Nov 20 21:26:49.334273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1dff6b74-619c-4a00-b886-c66c81e1fb8c req-63d569b2-6d69-46b3-b9ce-85d66f19c0f1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Nov 20 21:26:49.334947 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3595/7300] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:26:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:26:49.443933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:49.451357 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dabf30a5-dcd7-4047-9383-03745bfa23c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1317 microversion: 2.1 time: 0.162817 Nov 20 21:26:49.452702 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3706/7301] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:49 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:26:50.470849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:50.471546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:50.478858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.479430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.480232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.480672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.616877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:50.625124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-28b86542-5fed-4525-9c90-54a2b6826c0b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1508 microversion: 2.1 time: 0.158529 Nov 20 21:26:50.625701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3596/7302] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:50 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:50.641807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:50.642559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:50.649239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.649703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.650527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.650973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.780264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:50.787573 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-65631c1e-d07d-4c5d-b819-79e0c1b22b42 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1508 microversion: 2.1 time: 0.150157 Nov 20 21:26:50.788147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3707/7303] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:50 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:50.803662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:50.804775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:50.811213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.811773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.812562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.813001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.875876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-488ca1a2-1145-4944-b1e5-56152021fddd tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "PUT /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1080 microversion: 2.1 time: 0.075839 Nov 20 21:26:50.876515 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3597/7304] 10.222.0.41 () {60 vars in 1255 bytes} [Sat Nov 20 21:26:50 2021] PUT /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1080 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:50.890658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:50.891305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:50.897260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.897716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:50.898748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:50.899228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.028058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:51.035693 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd6a9c32-b726-4841-8a68-23953146e5c9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1506 microversion: 2.1 time: 0.149372 Nov 20 21:26:51.036259 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3708/7305] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:50 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:51.051807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:51.052428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:51.058350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.058808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.059626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.060071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.190676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:51.198025 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c67310e4-0d60-410e-8df3-460d4ade9614 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1506 microversion: 2.1 time: 0.149949 Nov 20 21:26:51.198619 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3598/7306] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:51 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:51.214624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:26:51.215671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:51.221619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.222098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.222888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.223328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.250952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:51.256636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Old instance type m1.heat2, new instance type m1.heat {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:26:51.262702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:26:51.263127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:26:51.263602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:26:51.264142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:26:51.264556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:26:51.328498 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-128ae712-9264-46a3-b9d6-db7dc85df233 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3/action" status: 202 len: 0 microversion: 2.1 time: 0.117563 Nov 20 21:26:51.329025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3709/7307] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:26:51 2021] POST /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:26:51.336911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:51.337644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:51.344947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.345404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.346248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:51.346695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:51.508657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:51.516270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17d7eae0-42d4-4727-9dea-efb90814f3bc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1517 microversion: 2.1 time: 0.183019 Nov 20 21:26:51.516851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3599/7308] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:51 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:52.533451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:52.534132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:52.540716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:52.541182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:52.541980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:52.543080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:52.680862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:52.688362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a5cd01f-a773-4fdd-ac50-750be8d79e5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1517 microversion: 2.1 time: 0.159525 Nov 20 21:26:52.689029 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3710/7309] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:52 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:53.704520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:53.705129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:53.711889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:53.712339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:53.713115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:53.713551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:53.845573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:53.852969 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9864f2c7-5fa4-425a-8290-72fd440a39f9 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.152203 Nov 20 21:26:53.853542 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3600/7310] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:53 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:54.871021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:54.871648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:54.879647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:54.880111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:54.880914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:54.881361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:55.011290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:55.019359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2e9e8609-f27c-4f5a-8216-c1e337498b72 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.152431 Nov 20 21:26:55.019963 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3711/7311] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:54 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:56.036342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:56.036986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:56.043730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:56.044182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:56.045591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:56.046036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:56.179336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:56.186635 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4897ecf5-11c8-467a-9c05-0757add19370 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.154026 Nov 20 21:26:56.187205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3601/7312] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:56 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:57.204487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:57.205110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:57.211896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:57.212356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:57.213153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:57.213600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:57.346388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:57.353977 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31fad1a0-966c-42a7-abfc-b0c2fc209a55 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.154091 Nov 20 21:26:57.354589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3712/7313] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:57 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:58.371383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:58.371977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:58.378738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:58.379192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:58.379975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:58.380409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:58.510114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:58.518414 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30f3a8e8-5ce1-4880-9913-71bddd8ebc47 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.150954 Nov 20 21:26:58.518994 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3602/7314] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:58 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:26:59.535399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:26:59.536023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:26:59.542874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:59.543334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:59.544127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:26:59.544573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:26:59.673904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:26:59.681250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-23c7a145-132c-4713-9ca5-3664dcb9d29a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.149549 Nov 20 21:26:59.681832 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3713/7315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:26:59 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:00.697353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:00.697963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:00.705412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:00.705860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:00.706657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:00.707091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:00.837338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:00.844644 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5159d60-88e8-4bbe-900d-33e9b7d730d2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.151015 Nov 20 21:27:00.845209 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3603/7316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:00 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:01.861391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:01.862023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:01.868773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:01.869488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:01.870320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:01.870800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:02.002874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:02.010330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63a25830-9649-4f4e-9bfa-966b0ae34b23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.152796 Nov 20 21:27:02.010936 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3714/7317] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:01 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:03.028057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:03.028675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:03.036465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:03.036939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:03.037731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:03.038208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:03.177743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:03.185108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9eb7854d-5c83-4e6c-976f-318eccdb567c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.160855 Nov 20 21:27:03.185662 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3604/7318] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:03 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:04.202398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:04.203027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:04.209826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:04.210328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:04.211127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:04.211578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:04.351880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:04.359898 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5ba8e9d-7000-4ebe-90c1-3a47a3e79f5d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.161427 Nov 20 21:27:04.360466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3715/7319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:04 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:05.377534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:05.378162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:05.385111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:05.385562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:05.386367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:05.386802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:05.518304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:05.525759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fe1f4a66-1187-44e1-a0d2-874cd6f44ba3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.152457 Nov 20 21:27:05.526369 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3605/7320] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:05 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:06.543158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:06.543824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:06.551649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:06.552139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:06.552999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:06.553475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:06.683458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:06.690811 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-21545dfb-7f1d-4477-8c17-2b0025aad918 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.151883 Nov 20 21:27:06.691381 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3716/7321] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:06 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:07.708733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:07.709403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:07.716463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:07.716919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:07.718592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:07.719040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:07.854278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:07.861890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a58e6838-e95a-4da5-8b6b-4a1b69f31f90 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.156972 Nov 20 21:27:07.862499 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3606/7322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:07 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:08.879536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:08.880162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:08.886958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:08.887420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:08.888212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:08.888661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:09.021995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:09.029330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3ac6a2d-f5bc-4793-a34e-463ad4933246 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.153675 Nov 20 21:27:09.029920 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3717/7323] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:08 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:10.046247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:10.046895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:10.053667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:10.054162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:10.054960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:10.055410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:10.185922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:10.194096 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30a3e752-c9d4-4b14-b341-c50525e50720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.151659 Nov 20 21:27:10.194687 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3607/7324] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:10 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:11.211845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:11.212472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:11.219816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:11.220268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:11.221081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:11.221520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:11.354306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:11.361765 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b7723f3-3011-412d-9497-f0a7459d724b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.153585 Nov 20 21:27:11.362374 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3718/7325] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:11 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:12.379684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:12.380293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:12.387088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:12.387543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:12.388322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:12.388795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:12.521476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:12.528769 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb83e808-1c21-4521-a85b-43cdd70040e3 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.152808 Nov 20 21:27:12.529342 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3608/7326] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:12 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:13.545899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:13.547142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:13.553852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:13.554374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:13.555174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:13.555625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:13.688797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:13.696120 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ae74cc8-618b-4039-8842-71578e04adae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.153923 Nov 20 21:27:13.696696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3719/7327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:13 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:14.713146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:14.713789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:14.721399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:14.721852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:14.722672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:14.723115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:14.857841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:14.865893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e912aa8c-a881-4d65-bb4c-a6e574a81874 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.156600 Nov 20 21:27:14.866491 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3609/7328] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:14 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:15.883234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:15.883933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:15.891433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:15.891950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:15.892825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:15.893298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:16.027425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:16.035573 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93a21981-aaa6-4a3a-b846-b7b5ed3874a6 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.156423 Nov 20 21:27:16.036206 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3720/7329] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:15 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:17.053200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:17.053811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:17.060534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:17.060986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:17.062344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:17.062990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:17.196649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:17.204252 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-621ae005-4ec9-4ed6-abff-2bdd94bd11de tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.154753 Nov 20 21:27:17.204822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3610/7330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:17 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:18.220824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:18.221446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:18.228174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:18.228640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:18.229434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:18.229884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:18.360324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:18.367606 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9413e205-255c-4aef-b084-9ae6b9d5850f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.151144 Nov 20 21:27:18.368180 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3721/7331] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:18 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:19.384986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:19.385590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:19.392552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:19.393002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:19.393825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:19.394327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:19.531283 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:19.538881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c5506b6-5760-4e15-af6f-b8e736ff8d3f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1522 microversion: 2.1 time: 0.157614 Nov 20 21:27:19.539461 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3611/7332] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:19 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:20.505312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "name": "network-vif-unplugged", "status": "completed", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:20.506854 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:20.506854 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:27:20.514000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:20.514503 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:20.529507 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] Creating event network-vif-unplugged:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch2-master-1 Nov 20 21:27:20.535631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:27:20.547144 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2cc1a3e3-a48e-431d-aa58-22476525c9bd req-14d213fa-45f6-4f75-a794-9f7448b0e655 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136028 Nov 20 21:27:20.547772 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3722/7333] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:27:20.555979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:20.556590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:20.564133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:20.564589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:20.565376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:20.565812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:20.798659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:20.806106 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20773923-1105-4db3-a89c-2f73b190ec23 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1521 microversion: 2.1 time: 0.253752 Nov 20 21:27:20.806688 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3612/7334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:20 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:21.825332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:21.825949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:21.832333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:21.832790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:21.833574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:21.834020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:21.968930 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:21.976545 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9933c6fc-4a35-44d5-9704-bf80047d7720 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1519 microversion: 2.1 time: 0.156206 Nov 20 21:27:21.977131 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3723/7335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:21 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:22.562671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:22.566255 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:22.566255 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:27:22.574093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:22.574983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:22.587091 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] Creating event network-changed:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch2-master-1 Nov 20 21:27:22.592651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:27:22.603622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-79ad219e-2484-4034-8639-dedb082d331b req-2ebddc3b-7e6d-49b0-8ec6-f3781fe21b09 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045509 Nov 20 21:27:22.604302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3613/7336] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:27:22.995311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:22.996197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:23.003149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.003614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.004418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.005041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.142602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:23.150911 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad19728a-ca5f-4f8f-997c-bb14af076076 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1516 microversion: 2.1 time: 0.160032 Nov 20 21:27:23.151517 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3724/7337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:22 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:23.168766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:23.169382 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:23.176151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.176602 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.177429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.177868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.234838 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-188f71fb-eb1b-4970-a8bd-e04b0c5512db tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3/action" status: 204 len: 0 microversion: 2.1 time: 0.070060 Nov 20 21:27:23.235852 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3614/7338] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:27:23 2021] POST /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:27:23.245107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:23.245730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:23.251966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.252428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.253452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:23.254160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:23.404156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:23.411679 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a0cedd4-a6b7-468a-aacb-588b955677c0 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1516 microversion: 2.1 time: 0.171635 Nov 20 21:27:23.412270 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3725/7339] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:23 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:24.429503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:24.430251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:24.437749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.438256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.439150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.439590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.588759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:24.598465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-902c3df7-8081-4660-a9cd-7a747004d644 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1508 microversion: 2.1 time: 0.172815 Nov 20 21:27:24.599064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3615/7340] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:24 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:24.616486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:24.617108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:24.624216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.624671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.625488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.625926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.764550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:24.773976 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98577d16-d820-469d-ad02-b39146981a0c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1508 microversion: 2.1 time: 0.161117 Nov 20 21:27:24.774974 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3726/7341] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:24 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:24.792442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:24.793064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:24.799579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.800037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.800621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-21f73f89-d1b2-416a-9abd-0a5b347b5db9 req-36a898c6-3a12-413d-a209-05a67b94f28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "name": "network-vif-plugged", "status": "completed", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:24.800839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.801284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.803065 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:24.803065 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:27:24.810129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21f73f89-d1b2-416a-9abd-0a5b347b5db9 req-36a898c6-3a12-413d-a209-05a67b94f28a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.810586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21f73f89-d1b2-416a-9abd-0a5b347b5db9 req-36a898c6-3a12-413d-a209-05a67b94f28a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.821538 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-21f73f89-d1b2-416a-9abd-0a5b347b5db9 req-36a898c6-3a12-413d-a209-05a67b94f28a service nova] Creating event network-vif-plugged:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch2-master-1 Nov 20 21:27:24.826357 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-21f73f89-d1b2-416a-9abd-0a5b347b5db9 req-36a898c6-3a12-413d-a209-05a67b94f28a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105973 Nov 20 21:27:24.826962 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3616/7342] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:27:24.941138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:24.948649 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a849e0ca-067a-48a0-808b-1b7aa5f34d46 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 200 len: 1508 microversion: 2.1 time: 0.159878 Nov 20 21:27:24.949228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3727/7343] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:24 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:27:24.965628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:24.966253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:24.973192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.973646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:24.974462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:24.974907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:25.001782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:27:25.075894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5e29be8-4dc4-4541-b544-2fce94d8a852 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 204 len: 0 microversion: 2.1 time: 0.113981 Nov 20 21:27:25.076516 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3617/7344] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:27:24 2021] DELETE /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:27:25.132225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-736040754", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "c491c6ef-afa4-46dc-9be7-aafd9ce4ca37"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:25.184680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] validate_networks() for [('c491c6ef-afa4-46dc-9be7-aafd9ce4ca37', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:27:25.611891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:27:25.612351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:27:25.612831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:27:25.613248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:27:25.613665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:27:25.624867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:25.625468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:25.626191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:25.626635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:25.642768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Getting quotas for project 125aa0037bff4a39b23180aa19a58b44. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:27:25.647751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Getting quotas for user 55b3c17b364f42eb8a1bb0d423de6dca and project 125aa0037bff4a39b23180aa19a58b44. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:27:25.661074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:27:25.663520 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:27:25.708541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f4e6220a-4e50-4e49-9659-0941cd8af6f8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579889 Nov 20 21:27:25.709200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3728/7345] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:27:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 20 21:27:25.719681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ebca58d9-e46f-42a6-923c-25cc9b29385e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:25.720397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ebca58d9-e46f-42a6-923c-25cc9b29385e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:25.773951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ebca58d9-e46f-42a6-923c-25cc9b29385e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:25.781625 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ebca58d9-e46f-42a6-923c-25cc9b29385e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1217 microversion: 2.1 time: 0.066041 Nov 20 21:27:25.782587 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3618/7346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:25 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:26.800002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:26.800575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:26.806911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:26.807378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:26.808202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:26.808654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:26.879053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:26.887156 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88926c95-af88-467d-8fda-df8d364279ce tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1275 microversion: 2.1 time: 0.092025 Nov 20 21:27:26.887754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3729/7347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:26 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:27:27.336776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a2f708f9-7a2f-4385-986d-8f26c6b2cecd req-8c6e0722-8f2a-4577-b819-af7f583e4b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d81719a-543b-4e13-94d3-9c500b2f7ec3", "name": "network-vif-deleted", "tag": "d041a7ed-c3dc-44e5-9f4c-d1d12848a606"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:27.338679 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:27.338679 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:27:27.350835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a2f708f9-7a2f-4385-986d-8f26c6b2cecd req-8c6e0722-8f2a-4577-b819-af7f583e4b67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:27.351296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a2f708f9-7a2f-4385-986d-8f26c6b2cecd req-8c6e0722-8f2a-4577-b819-af7f583e4b67 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:27.364473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a2f708f9-7a2f-4385-986d-8f26c6b2cecd req-8c6e0722-8f2a-4577-b819-af7f583e4b67 service nova] Creating event network-vif-deleted:d041a7ed-c3dc-44e5-9f4c-d1d12848a606 for instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 on nch2-master-1 Nov 20 21:27:27.371522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a2f708f9-7a2f-4385-986d-8f26c6b2cecd req-8c6e0722-8f2a-4577-b819-af7f583e4b67 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038606 Nov 20 21:27:27.372064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3619/7348] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:27:27.905160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:27.906444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:27.913294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:27.913753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:27.914578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:27.915028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:28.051018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:28.058521 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53d75cb2-96fc-45ce-8b6b-1ecb9d227807 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.157217 Nov 20 21:27:28.059113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3730/7349] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:27 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:29.076599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:29.077325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:29.084295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:29.084747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:29.085528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:29.085966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:29.218562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:29.225783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-04a41ddb-7824-424d-9145-728c58a739d1 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.153359 Nov 20 21:27:29.226395 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3620/7350] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:29 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:29.386979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9ac984bf-b721-48e5-8712-2ed93ba6edff req-282c9d4b-2ac0-4536-8b40-81a4fa48a327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:29.388540 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:29.388540 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:27:29.396925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9ac984bf-b721-48e5-8712-2ed93ba6edff req-282c9d4b-2ac0-4536-8b40-81a4fa48a327 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:29.397378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9ac984bf-b721-48e5-8712-2ed93ba6edff req-282c9d4b-2ac0-4536-8b40-81a4fa48a327 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:29.408729 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9ac984bf-b721-48e5-8712-2ed93ba6edff req-282c9d4b-2ac0-4536-8b40-81a4fa48a327 service nova] Creating event network-changed:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch1-master-1 Nov 20 21:27:29.413859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9ac984bf-b721-48e5-8712-2ed93ba6edff req-282c9d4b-2ac0-4536-8b40-81a4fa48a327 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030870 Nov 20 21:27:29.414476 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3731/7351] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:27:30.242488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:30.243113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:30.250821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:30.251278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:30.252065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:30.252504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:30.384748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:30.392271 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f56562f-a4c9-4e89-8628-2b27d1edfb43 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.153528 Nov 20 21:27:30.392834 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3621/7352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:30 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:31.409421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:31.410164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:31.416703 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:31.417161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:31.417953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:31.418458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:31.563728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:31.571192 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d42910ab-6553-4d40-8214-6df987f0d71c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.166023 Nov 20 21:27:31.571767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3732/7353] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:31 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:32.589168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:32.589788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:32.597213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:32.597690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:32.598493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:32.598940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:32.734601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:32.742593 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c07240b-63df-46c0-9048-9da07b2a210b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.157091 Nov 20 21:27:32.743172 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3622/7354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:32 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:33.476827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-2922d057-3b14-4178-bd8b-f88ad8b70c98 req-e3ef3694-1932-4b85-be5d-182273cbc04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "name": "network-vif-plugged", "status": "completed", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:33.478437 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:27:33.478437 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:27:33.488135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2922d057-3b14-4178-bd8b-f88ad8b70c98 req-e3ef3694-1932-4b85-be5d-182273cbc04a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:33.488632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-2922d057-3b14-4178-bd8b-f88ad8b70c98 req-e3ef3694-1932-4b85-be5d-182273cbc04a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:33.501063 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-2922d057-3b14-4178-bd8b-f88ad8b70c98 req-e3ef3694-1932-4b85-be5d-182273cbc04a service nova] Creating event network-vif-plugged:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch1-master-1 Nov 20 21:27:33.505980 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-2922d057-3b14-4178-bd8b-f88ad8b70c98 req-e3ef3694-1932-4b85-be5d-182273cbc04a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033240 Nov 20 21:27:33.506616 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3733/7355] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:27:33.759387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:33.759996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:33.767600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:33.768115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:33.768924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:33.769369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:33.903969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:33.911991 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f1c65d6-1cc5-48ec-967c-edfce5cef15a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1317 microversion: 2.1 time: 0.156276 Nov 20 21:27:33.912564 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3623/7356] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:33 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:34.929119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:34.929831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:34.936970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:34.937436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:34.938425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:34.938890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.079581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:35.087180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cde95abe-2c85-4cc0-814c-1155554c1c06 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1508 microversion: 2.1 time: 0.162153 Nov 20 21:27:35.087770 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3734/7357] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:34 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:35.104238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:35.104849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:35.112724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.113216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.114008 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.114468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.268112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:35.275739 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40914563-0ebf-4b04-93f8-9f8e5ae20a70 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1508 microversion: 2.1 time: 0.175168 Nov 20 21:27:35.276319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3624/7358] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:35 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:35.292800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:27:35.293791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:35.300169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.300626 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.301436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.301864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.330667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:35.337339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:27:35.344342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:27:35.344761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:27:35.345235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:27:35.345649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:27:35.346077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:27:35.407243 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-119cb5af-0e14-42d6-a90d-5b65c72db634 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b/action" status: 202 len: 0 microversion: 2.1 time: 0.118347 Nov 20 21:27:35.407881 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3735/7359] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:27:35 2021] POST /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:27:35.415691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:35.416296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:35.422222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.422879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.423831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:35.424271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:35.589967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:35.597641 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2bc6ca9b-5d5c-4206-88c8-b9583b007266 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1515 microversion: 2.1 time: 0.185547 Nov 20 21:27:35.598232 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3625/7360] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:35 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:27:36.617625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:36.618519 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:36.625080 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:36.625557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:36.626405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:36.626859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:36.762528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:36.770521 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-13308edd-4d18-47f4-ad75-8821617e7ed8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1515 microversion: 2.1 time: 0.157655 Nov 20 21:27:36.771101 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3736/7361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:36 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:37.788748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:37.789643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:37.796120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:37.796685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:37.797479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:37.797923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:37.932352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:37.940196 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e2e6fbf-a742-4dbd-97bf-44be7f248e95 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155710 Nov 20 21:27:37.940777 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3626/7362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:37 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:38.957915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:38.958569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:38.965375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:38.965837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:38.966661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:38.967112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:39.102367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:39.109878 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-652a93cf-ec80-40b7-a2bc-34737a10b007 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155687 Nov 20 21:27:39.110489 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3737/7363] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:38 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:40.126726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:40.127338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:40.134202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:40.134554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:40.135329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:40.135770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:40.263859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:40.271676 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-420291c2-39aa-4a24-871a-feed90a6cd6c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.148736 Nov 20 21:27:40.272363 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3627/7364] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:40 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:41.288570 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:41.289187 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:41.296885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:41.297342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:41.298204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:41.298689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:41.428006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:41.435372 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-08830129-fd9a-4e8f-841f-943cd02cebe2 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.150537 Nov 20 21:27:41.435943 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3738/7365] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:41 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:42.453247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:42.453864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:42.460894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:42.461468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:42.462354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:42.462793 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:42.597041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:42.604386 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5579fdea-ddf1-458a-a97c-4065520af863 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155515 Nov 20 21:27:42.604961 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3628/7366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:42 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:43.621065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:43.621685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:43.628759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:43.629212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:43.630000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:43.630473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:43.766238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:43.774018 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aef2b365-9d24-4c0c-8498-11e30f40d4ec tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.156963 Nov 20 21:27:43.774660 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3739/7367] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:43 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:44.791052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:44.791589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:44.798853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:44.799307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:44.800093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:44.800534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:44.928298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:44.935515 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-406039c2-a6cb-48b3-a690-9431332b70ef tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.148327 Nov 20 21:27:44.936288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3629/7368] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:44 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:45.951971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:45.952600 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:45.959561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:45.960026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:45.960858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:45.961316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:46.089850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:46.097914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-10df4178-e786-40e8-b692-a47a3750fb44 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.149764 Nov 20 21:27:46.098518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3740/7369] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:45 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:27:47.114946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:47.115500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:47.122422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:47.122878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:47.124170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:47.124606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:47.257441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:47.264859 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fa7398b-4707-484f-9242-adb07ce2c9ed tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.153544 Nov 20 21:27:47.265429 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3630/7370] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:47 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:48.281835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:48.282530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:48.289225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:48.289684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:48.290499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:48.290951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:48.423736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:48.431128 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-829bfeac-40f6-4366-bc00-69f843449c48 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.153735 Nov 20 21:27:48.431701 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3741/7371] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:48 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:49.448630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:49.449254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:49.456589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:49.457047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:49.457835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:49.458303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:49.595509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:49.602853 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a2322d92-2c35-4922-832f-0536232ba647 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.158011 Nov 20 21:27:49.603420 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3631/7372] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:49 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:50.619560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:50.620208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:50.627081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:50.627535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:50.628319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:50.628764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:50.760372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:50.768059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-841b0c83-5d37-4839-80bd-b9078748d768 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.152484 Nov 20 21:27:50.768644 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3742/7373] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:50 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:51.784641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:51.785195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:51.791918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:51.792365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:51.793139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:51.793572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:51.923425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:51.930842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78bca9ad-b0a0-4317-a7b7-8d1f6b4b547b tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.150021 Nov 20 21:27:51.931415 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3632/7374] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:51 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:52.948662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:52.949271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:52.956131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:52.956595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:52.957385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:52.957827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:53.092466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:53.099924 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac87e8db-b31e-4201-a0cb-2f1e4c2858ae tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155091 Nov 20 21:27:53.100501 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3743/7375] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:52 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:54.117746 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:54.118393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:54.125724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:54.126222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:54.127016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:54.127470 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:54.259900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:54.267844 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2298284f-5715-452f-a6eb-e40ab80a3622 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.153833 Nov 20 21:27:54.268414 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3633/7376] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:54 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:55.285266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:55.285906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:55.292775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:55.293242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:55.294031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:55.294507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:55.428110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:55.435366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f5964b9-f20e-4cfb-97b0-a85ded04c52d tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.153862 Nov 20 21:27:55.436034 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3744/7377] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:55 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:56.451946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:56.452561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:56.459129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:56.459582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:56.460365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:56.460812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:56.591106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:56.600240 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2fd8e85e-caab-4a31-893b-67ba8a613e2a tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.152045 Nov 20 21:27:56.600755 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3634/7378] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:56 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:57.617739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:57.618407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:57.625877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:57.626357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:57.627143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:57.627586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:57.761750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:57.769511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-00f6d10a-f124-4565-b344-6956cab75b3c tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155547 Nov 20 21:27:57.770103 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3745/7379] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:57 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:58.787064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:58.787631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:58.795485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:58.795943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:58.796913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:58.797223 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:58.931505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:27:58.938876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-af0149de-8d5a-42ce-86a2-9e206d514e82 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.155647 Nov 20 21:27:58.939483 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3635/7380] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:58 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:27:59.956055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:27:59.956678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:27:59.963073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:59.963533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:27:59.964331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:27:59.964778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:00.098160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:00.105451 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f719d38-e083-4496-933a-1bfe795675c8 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.153369 Nov 20 21:28:00.106026 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3746/7381] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:27:59 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:01.122239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:01.122887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:01.129647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:01.130141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:01.130933 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:01.131378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:01.260030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:01.267388 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-307a0d8b-f1b8-4895-9e65-0e0ac7815735 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.149156 Nov 20 21:28:01.267962 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3636/7382] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:01 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:02.283898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:02.284529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:02.291328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:02.291797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:02.292597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:02.293052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:02.422921 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:02.430292 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1155c9af-aeee-4c12-bd4d-51a5183a77da tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.150327 Nov 20 21:28:02.430869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3747/7383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:02 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:03.447134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:03.447747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:03.455168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:03.455621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:03.456412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:03.456854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:03.593114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:03.600494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80df714b-c82d-4f3e-a06d-d3e83187ca7f tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1520 microversion: 2.1 time: 0.157081 Nov 20 21:28:03.601077 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3637/7384] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:03 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:04.446437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "name": "network-vif-unplugged", "status": "completed", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:04.447983 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:04.447983 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:28:04.455837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:04.456297 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:04.468341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] Creating event network-vif-unplugged:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch2-master-1 Nov 20 21:28:04.473872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] Instance 455c0939-0c40-4018-8a6d-74cc41a8581b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:28:04.485439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-eac4d1f2-51f2-41c1-a269-0a26b65def0a req-b2c4eba0-85d3-4a2a-9e48-e3e2d4dc05bc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042599 Nov 20 21:28:04.486234 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3748/7385] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:28:04.616549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:04.617165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:04.624904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:04.625365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:04.626192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:04.626637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:04.854950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:04.863441 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b85424d2-2e91-4591-8be9-5024e7919a6e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1519 microversion: 2.1 time: 0.250575 Nov 20 21:28:04.864124 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3638/7386] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:04 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:05.882229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:05.882936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:05.889495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:05.889954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:05.890770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:05.891215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:06.024255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:06.032502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4cb3b58e-f6b3-48aa-9f98-e4608e7d6e37 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1517 microversion: 2.1 time: 0.155343 Nov 20 21:28:06.033077 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3749/7387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:05 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:06.501400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:06.503007 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:06.503007 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:28:06.510700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:06.511198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:06.523411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] Creating event network-changed:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch2-master-1 Nov 20 21:28:06.528676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] Instance 455c0939-0c40-4018-8a6d-74cc41a8581b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:28:06.539516 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6c1a6ee1-ca8f-4137-9c29-7516dcfa0640 req-1d44ea6f-1939-4c82-b865-f3f735c8ffcd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042343 Nov 20 21:28:06.540117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3639/7388] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:28:07.050592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:07.051222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:07.058463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.058838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.059655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.060316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.207756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:07.217261 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37a8092a-a0b7-4fc8-ad03-c10ea00ea481 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1514 microversion: 2.1 time: 0.169885 Nov 20 21:28:07.217854 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3750/7389] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:07 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:07.235138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:07.236202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:07.242583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.243042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.244285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.244905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.308615 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-532475b7-3f79-414e-a55e-2516e7cacd25 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "POST /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b/action" status: 204 len: 0 microversion: 2.1 time: 0.077851 Nov 20 21:28:07.309358 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3640/7390] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:07 2021] POST /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:28:07.317333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:07.317956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:07.324163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.324647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.325380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:07.325821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:07.465866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:07.473411 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1557ca76-290d-4608-9e2b-663ea9ed4dd5 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1514 microversion: 2.1 time: 0.159827 Nov 20 21:28:07.473992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3751/7391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:07 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:08.492523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:08.493231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:08.499824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:08.500289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:08.501085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:08.501529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:08.645991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:08.653643 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a256c719-322a-48a0-b1c3-032020270276 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1514 microversion: 2.1 time: 0.166080 Nov 20 21:28:08.654319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3641/7392] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:08 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:08.926366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-30877d88-71c4-40d3-9143-39c6d727550a req-9b7044fa-8994-4cbc-a9e4-259b061fadd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "name": "network-vif-plugged", "status": "completed", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:08.927873 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:08.927873 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:28:08.936255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-30877d88-71c4-40d3-9143-39c6d727550a req-9b7044fa-8994-4cbc-a9e4-259b061fadd7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:08.936925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-30877d88-71c4-40d3-9143-39c6d727550a req-9b7044fa-8994-4cbc-a9e4-259b061fadd7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:08.949499 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-30877d88-71c4-40d3-9143-39c6d727550a req-9b7044fa-8994-4cbc-a9e4-259b061fadd7 service nova] Creating event network-vif-plugged:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch2-master-1 Nov 20 21:28:08.954579 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-30877d88-71c4-40d3-9143-39c6d727550a req-9b7044fa-8994-4cbc-a9e4-259b061fadd7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031959 Nov 20 21:28:08.955352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3752/7393] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:28:09.670384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:09.670996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:09.678566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:09.679021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:09.679804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:09.680241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:09.814232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:09.821523 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2deab51c-769c-4ecb-82e8-0ea4fb0d1453 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1506 microversion: 2.1 time: 0.154850 Nov 20 21:28:09.822108 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3642/7394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:09 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:09.838683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:09.839394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:09.846377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:09.846844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:09.847639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:09.848110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.302167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:10.309580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a603bb2f-4ed7-4fde-9fb6-9ade75640d35 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1506 microversion: 2.1 time: 0.474867 Nov 20 21:28:10.310708 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3753/7395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:09 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:10.325712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:10.327097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:10.332965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.333417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.334226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.334665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.469995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:10.477352 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e88a97c6-4054-4462-99f2-7815b71287fc tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1506 microversion: 2.1 time: 0.155389 Nov 20 21:28:10.477920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3643/7396] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:10 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:10.494205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:10.494752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:10.501444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.501906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.502725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.503175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.528844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:28:10.604014 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d586d98a-53b3-4d13-bec4-88d66349bd4e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 204 len: 0 microversion: 2.1 time: 0.113348 Nov 20 21:28:10.604743 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3754/7397] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:28:10 2021] DELETE /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:28:10.621886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:10.622455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:10.629232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.629688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.630518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.630961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.657192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:28:10.700989 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.compute.api [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Instance is already in deleting state, ignoring this request Nov 20 21:28:10.702011 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1275a7ed-1ba4-4f34-af76-e2affbb72761 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 204 len: 0 microversion: 2.1 time: 0.084133 Nov 20 21:28:10.702623 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3644/7398] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:28:10 2021] DELETE /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:28:10.711099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:10.711814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:10.718099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.718574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.719372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:10.719828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:10.852762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:10.860743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d04d90a-8f1a-4700-9d6b-bceb22335387 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1512 microversion: 2.1 time: 0.153807 Nov 20 21:28:10.861312 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3755/7399] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:10 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:11.878471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:11.879150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:11.885837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:11.886318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:11.887099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:11.887537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:12.100199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b3c17b364f42eb8a1bb0d423de6dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '125aa0037bff4a39b23180aa19a58b44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:12.108079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-77a54e25-7693-4eae-8e1b-d35d1d2adfa7 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 200 len: 1512 microversion: 2.1 time: 0.233249 Nov 20 21:28:12.108879 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3645/7400] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:11 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:12.440807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0bdc87e8-a2e4-46e3-bac7-a7f3d311fe8b req-b6aded7a-ce02-4a12-8781-2311398c90eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455c0939-0c40-4018-8a6d-74cc41a8581b", "name": "network-vif-deleted", "tag": "4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:12.442763 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:12.442763 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:28:12.453153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0bdc87e8-a2e4-46e3-bac7-a7f3d311fe8b req-b6aded7a-ce02-4a12-8781-2311398c90eb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:12.453664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0bdc87e8-a2e4-46e3-bac7-a7f3d311fe8b req-b6aded7a-ce02-4a12-8781-2311398c90eb service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:12.468315 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0bdc87e8-a2e4-46e3-bac7-a7f3d311fe8b req-b6aded7a-ce02-4a12-8781-2311398c90eb service nova] Creating event network-vif-deleted:4f90b8a8-1dd3-482e-8d0b-eea9d5aa75d6 for instance 455c0939-0c40-4018-8a6d-74cc41a8581b on nch2-master-1 Nov 20 21:28:12.473723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0bdc87e8-a2e4-46e3-bac7-a7f3d311fe8b req-b6aded7a-ce02-4a12-8781-2311398c90eb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037414 Nov 20 21:28:12.474364 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3756/7401] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:28:13.125649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:13.126308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 455c0939-0c40-4018-8a6d-74cc41a8581b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:13.133084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.133584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.134411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.134858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.148619 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] HTTP exception thrown: Instance 455c0939-0c40-4018-8a6d-74cc41a8581b could not be found. Nov 20 21:28:13.149208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Returning 404 to user: Instance 455c0939-0c40-4018-8a6d-74cc41a8581b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:28:13.150026 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7997ecf-962d-4f09-8916-f945e5a6df5e tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b" status: 404 len: 111 microversion: 2.1 time: 0.028682 Nov 20 21:28:13.150589 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3646/7402] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:13 2021] GET /compute/v2.1/servers/455c0939-0c40-4018-8a6d-74cc41a8581b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:28:13.159078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:13.159681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:13.165867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.166382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.167182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.167621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.180725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] HTTP exception thrown: Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 could not be found. Nov 20 21:28:13.181327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Returning 404 to user: Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:28:13.182185 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66ab49e4-24f9-4bd0-bf05-3a0c130c8451 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "DELETE /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 404 len: 111 microversion: 2.1 time: 0.027163 Nov 20 21:28:13.182725 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3757/7403] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:28:13 2021] DELETE /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:28:13.190901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:13.191519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] [instance: 7d81719a-543b-4e13-94d3-9c500b2f7ec3] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:13.197428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.197886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.198712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:13.199157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:13.212998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] HTTP exception thrown: Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 could not be found. Nov 20 21:28:13.213584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] Returning 404 to user: Instance 7d81719a-543b-4e13-94d3-9c500b2f7ec3 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:28:13.214435 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50ee3bfc-81e0-4fbe-8ada-8fbd40460635 tempest-ServerDiskConfigTestJSON-251186677 tempest-ServerDiskConfigTestJSON-251186677-project] 10.222.0.41 "GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3" status: 404 len: 111 microversion: 2.1 time: 0.027195 Nov 20 21:28:13.214971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3647/7404] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:13 2021] GET /compute/v2.1/servers/7d81719a-543b-4e13-94d3-9c500b2f7ec3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:28:18.933584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: .version_select at 0x7f3f87bad550>, body: {"keypair": {"name": "tempest-keypair-1679284054"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:18.949688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:28:18.956770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:28:19.095577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:28:19.100624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:28:19.114773 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-24d215e4-cbc2-4e85-b6ba-7627ffe7d9a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.325482 Nov 20 21:28:19.115389 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3758/7405] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:28:18 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:20.718664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1182368217", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c5f91b7-b565-4458-971f-538d019cd893"}], "security_groups": [{"name": "tempest-securitygroup--329218344"}], "key_name": "tempest-keypair-1679284054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:20.834410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] validate_networks() for [('4c5f91b7-b565-4458-971f-538d019cd893', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:28:21.248958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:28:21.249972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:28:21.250480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:28:21.250919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:28:21.251335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:28:21.260231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:21.260682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:21.261509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:21.261967 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:21.278850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:28:21.284966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:28:21.298085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:28:21.300443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:28:21.346909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba93e8f1-5eb1-4144-a069-b4a7a91b5dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.633530 Nov 20 21:28:21.347891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3648/7406] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:28:20 2021] POST /compute/v2.1/servers => generated 408 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:28:21.359573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-29e97114-29cf-423a-bdef-c2387dff6e1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:21.360982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-29e97114-29cf-423a-bdef-c2387dff6e1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:21.417421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-29e97114-29cf-423a-bdef-c2387dff6e1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:21.425074 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-29e97114-29cf-423a-bdef-c2387dff6e1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1239 microversion: 2.1 time: 0.071045 Nov 20 21:28:21.425664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3759/7407] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:21 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:22.443271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:22.443271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:22.450855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:22.451326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:22.452753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:22.453450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:22.547938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:22.556708 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb7756dc-85da-4bb1-ae2b-aafec37c9daa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1309 microversion: 2.1 time: 0.118486 Nov 20 21:28:22.557342 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3649/7408] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:22 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:23.575511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:23.580691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:23.591160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:23.591910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:23.593135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:23.593628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:23.757275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:23.765538 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e3171ccd-5555-48d5-8389-40edb409e0a4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.193829 Nov 20 21:28:23.766164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3760/7409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:23 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:23.800284 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-95cee88c-995e-47a9-9ac3-2ff9cdb7741a req-b14435b3-8923-4649-887b-5a4e9c61523b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:23.802028 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:23.802028 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:28:23.812690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-95cee88c-995e-47a9-9ac3-2ff9cdb7741a req-b14435b3-8923-4649-887b-5a4e9c61523b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:23.813353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-95cee88c-995e-47a9-9ac3-2ff9cdb7741a req-b14435b3-8923-4649-887b-5a4e9c61523b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:23.831770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-95cee88c-995e-47a9-9ac3-2ff9cdb7741a req-b14435b3-8923-4649-887b-5a4e9c61523b service nova] Creating event network-changed:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch2-master-1 Nov 20 21:28:23.837361 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-95cee88c-995e-47a9-9ac3-2ff9cdb7741a req-b14435b3-8923-4649-887b-5a4e9c61523b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041684 Nov 20 21:28:23.838302 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3650/7410] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:28:24.782887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:24.783501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:24.790651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:24.791112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:24.791946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:24.792354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:24.925071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:24.932344 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b34b615e-b444-48e2-9345-2d779ceada63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.153931 Nov 20 21:28:24.932944 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3761/7411] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:24 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:25.950210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:25.950910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:25.957769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:25.958269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:25.959058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:25.959502 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:26.095325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:26.102642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fd7dfa86-2761-4873-99fd-e91a76c701d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.157356 Nov 20 21:28:26.103255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3651/7412] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:25 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:27.119845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:27.120409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:27.127334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:27.127797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:27.128591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:27.129040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:27.260745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:27.268362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da1e8bc8-d360-403b-93db-72514618725d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.152487 Nov 20 21:28:27.268981 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3762/7413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:27 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:28.285004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:28.285623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:28.292272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:28.292738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:28.293530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:28.294006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:28.428036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:28.435404 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da4fb957-480a-461b-8ff5-789a36027dc2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.154224 Nov 20 21:28:28.435984 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3652/7414] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:28 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:29.039879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-787671c0-74f0-49df-8a1f-971fbd59973f req-41b9387f-6462-4fde-afb4-d2c32d8253c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "name": "network-vif-plugged", "status": "completed", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:29.041467 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:29.041467 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:28:29.050316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-787671c0-74f0-49df-8a1f-971fbd59973f req-41b9387f-6462-4fde-afb4-d2c32d8253c9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:29.050772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-787671c0-74f0-49df-8a1f-971fbd59973f req-41b9387f-6462-4fde-afb4-d2c32d8253c9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:29.062883 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-787671c0-74f0-49df-8a1f-971fbd59973f req-41b9387f-6462-4fde-afb4-d2c32d8253c9 service nova] Creating event network-vif-plugged:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch2-master-1 Nov 20 21:28:29.068060 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-787671c0-74f0-49df-8a1f-971fbd59973f req-41b9387f-6462-4fde-afb4-d2c32d8253c9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Nov 20 21:28:29.069175 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3763/7415] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:28:29.453613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:29.454213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:29.460941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:29.461399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:29.462222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:29.462670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:29.596355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:29.603584 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d876c10-2c49-44e0-b3d0-b0b5948d2d55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1364 microversion: 2.1 time: 0.154596 Nov 20 21:28:29.604158 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3653/7416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:29 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:28:30.621364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:30.622166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:30.629325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:30.629788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:30.630668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:30.631120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:30.769823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:28:30.777206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-82054c6f-582c-426b-81e5-7e2630f5cc00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1551 microversion: 2.1 time: 0.160265 Nov 20 21:28:30.777807 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3764/7417] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:28:30 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:30.794009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:28:30.794545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:30.801145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:30.801600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:30.802412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:30.802854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:30.882207 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-78219ff3-239e-477b-bb39-820d45f1d856 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091964 Nov 20 21:28:30.882829 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3654/7418] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:28:30 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:28:31.815122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:31.816607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:31.818135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-459b5efa-5a9b-4dd2-a691-52d7258ec7cf req-88e3140b-65a6-4bdb-8441-077069997f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:31.819514 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:28:31.819514 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:28:31.824770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:31.825441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:31.826280 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:31.826505 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-459b5efa-5a9b-4dd2-a691-52d7258ec7cf req-88e3140b-65a6-4bdb-8441-077069997f28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:31.826729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:31.826954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-459b5efa-5a9b-4dd2-a691-52d7258ec7cf req-88e3140b-65a6-4bdb-8441-077069997f28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:31.838692 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-459b5efa-5a9b-4dd2-a691-52d7258ec7cf req-88e3140b-65a6-4bdb-8441-077069997f28 service nova] Creating event network-changed:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch2-master-1 Nov 20 21:28:31.845220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-459b5efa-5a9b-4dd2-a691-52d7258ec7cf req-88e3140b-65a6-4bdb-8441-077069997f28 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031637 Nov 20 21:28:31.846095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3655/7419] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:28:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:28:31.866726 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-324de20e-687a-4864-aa20-9d43d000288a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.055303 Nov 20 21:28:31.867613 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3765/7420] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:31 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:32.879312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:32.881096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:32.887977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:32.888367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:32.889193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:32.890318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:32.928368 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f092095c-dd55-4866-8490-810cf6a83be7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.054320 Nov 20 21:28:32.929404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3656/7421] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:32 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:33.939841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:33.940870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:33.948227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:33.948714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:33.949508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:33.949956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:33.987283 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9833251f-a038-4955-98eb-44e4bea3ce78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.051435 Nov 20 21:28:33.987906 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3766/7422] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:33 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:28:34.998464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:35.000132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:35.008468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:35.008917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:35.009709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:35.010182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:35.049105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5e4329c-75cb-4df2-bf89-9f119cdbeb92 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.054679 Nov 20 21:28:35.049748 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3657/7423] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:34 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:36.060617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:36.061670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:36.069007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:36.069473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:36.070301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:36.070757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:36.109101 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76e12e47-51da-45bb-b9d3-c7181848e36d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.052439 Nov 20 21:28:36.109717 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3767/7424] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:36 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:37.119960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:37.120964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:37.128366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:37.128820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:37.129605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:37.130058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:37.174240 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c8fcedb-6cc7-47e3-9cc6-0ceec09101e3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.058486 Nov 20 21:28:37.174860 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3658/7425] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:37 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:38.185357 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:38.187078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:38.194458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:38.194920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:38.195714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:38.196166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:38.232187 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f2028676-8c4d-4d05-9ea0-0e822b354afb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.050886 Nov 20 21:28:38.232846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3768/7426] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:38 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:39.244405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:39.245365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:39.253331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:39.253783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:39.254600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:39.255049 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:39.294150 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf854e46-2a11-40fc-903e-9c33e3aa967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.053956 Nov 20 21:28:39.294797 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3659/7427] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:39 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:40.305641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:40.306760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:40.314865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:40.315423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:40.316228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:40.316683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:40.353900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d78ac28-3437-4df1-9ceb-357cddd72ec1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.052343 Nov 20 21:28:40.354574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3769/7428] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:40 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:41.365260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:41.366297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:41.373980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:41.374456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:41.375230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:41.375665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:41.413023 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e17a72ba-9fa6-45af-b5f9-d354f7d9b49e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.051729 Nov 20 21:28:41.413827 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3660/7429] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:41 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:42.425445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:42.426488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:42.433830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:42.434320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:42.435111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:42.435563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:42.474215 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a97a2c0-dfbf-40e7-b82b-e83cea0148c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 14 microversion: 2.1 time: 0.053583 Nov 20 21:28:42.474844 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3770/7430] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:42 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:28:43.485995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:43.487013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:43.494569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:43.495017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:43.495798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:43.496231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:43.545863 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b4695fa4-7cf8-4546-ab58-19f610498d23 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 8203 microversion: 2.1 time: 0.063852 Nov 20 21:28:43.546540 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3661/7431] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:43 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 8203 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:28:44.558566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:44.559655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:44.568638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:44.569113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:44.569914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:44.570507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:44.621197 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b343f3f0-4a84-4082-934e-73c42078e9ec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 16394 microversion: 2.1 time: 0.067729 Nov 20 21:28:44.622022 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3771/7432] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:44 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 16394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:45.633389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:45.634441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:45.642073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:45.642530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:45.643308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:45.643748 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:45.680987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ddc93f11-b8c5-4abe-af93-d851f4f6bde7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 16394 microversion: 2.1 time: 0.051689 Nov 20 21:28:45.681824 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3662/7433] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:45 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 16394 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:46.693476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:46.694531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:46.701843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:46.702330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:46.703123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:46.703571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:46.742026 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d41c193d-a5c7-4244-ae0a-0986df6a9645 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 16394 microversion: 2.1 time: 0.052550 Nov 20 21:28:46.742676 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3772/7434] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:46 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:47.753771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:47.754825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:47.762209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:47.762671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:47.763459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:47.763910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:47.801968 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8245ae0-ed2a-42e5-a104-546974a5a0b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 16394 microversion: 2.1 time: 0.052296 Nov 20 21:28:47.802701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3663/7435] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:47 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:48.814890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:48.815871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:48.823348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:48.823813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:48.824618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:48.825071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:48.871558 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-33a31f62-8072-4515-bc86-e44659c4d0e9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.062051 Nov 20 21:28:48.872232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3773/7436] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:48 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:49.884351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:49.885396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:49.893501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:49.893953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:49.894766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:49.895207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:49.941109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-66f9a4f9-e56a-422e-b852-3b0cc3fd3c3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.060750 Nov 20 21:28:49.941793 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3664/7437] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:49 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:50.953422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:50.954462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:50.961764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:50.962272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:50.963069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:50.963518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:51.002900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32eebdfb-f8ff-4aed-9881-bcd4307aa357 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.053668 Nov 20 21:28:51.003545 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3774/7438] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:50 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:52.014373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:52.015998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:52.023364 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:52.023820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:52.024612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:52.025053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:52.065564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52625679-620d-4083-953d-88c4be50eb39 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.055183 Nov 20 21:28:52.066485 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3665/7439] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:52 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:53.077989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:53.079126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:53.086369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:53.086826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:53.087611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:53.088085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:53.126284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8835193-d3c7-4616-9711-c66baf1acf10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.052766 Nov 20 21:28:53.126915 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3775/7440] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:53 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:54.138440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:54.139438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:54.147419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:54.147873 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:54.148655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:54.149097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:54.188202 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-04456c17-d81a-4a56-ae0b-a3bf736bdd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.053719 Nov 20 21:28:54.189064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3666/7441] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:54 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:55.200252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:55.201254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:55.208615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:55.209093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:55.209857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:55.210323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:55.249453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68037c1f-a85f-4887-8dcd-36701176476d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.053080 Nov 20 21:28:55.250129 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3776/7442] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:55 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:56.261351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:56.262380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:56.269838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:56.270320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:56.271160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:56.271604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:56.311027 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e40293fa-f275-4ebc-a541-6ba831888ffc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.053645 Nov 20 21:28:56.312439 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3667/7443] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:56 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:57.323884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:57.324887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:57.332023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:57.332486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:57.333265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:57.333739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:57.375935 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-98f32a21-49c3-40bb-a7b9-234ee9b7a4d8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.056056 Nov 20 21:28:57.376591 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3777/7444] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:57 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:58.387914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:58.388947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:58.396290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:58.396741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:58.397518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:58.397956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:58.437511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b396876a-e5e7-4ba5-9261-a1c89d4b1372 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.052875 Nov 20 21:28:58.438441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3668/7445] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:58 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:28:59.449516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:28:59.450560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:28:59.458422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:59.458884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:59.459675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:28:59.460126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:28:59.500045 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-243f887b-fd26-4968-90c5-091bb03f43fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 24568 microversion: 2.1 time: 0.053856 Nov 20 21:28:59.500903 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3778/7446] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:28:59 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 24568 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:00.512130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:00.513154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:00.521233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:00.521693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:00.522527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:00.522972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:00.573563 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7e7801c-2350-4d55-8160-407e3fff49f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.065453 Nov 20 21:29:00.574240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3669/7447] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:00 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:01.586038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:01.587084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:01.594348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:01.594814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:01.595612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:01.596065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:01.636580 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e8227ef-2c54-4ce1-8d18-f6819b0acfd2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054686 Nov 20 21:29:01.637220 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3779/7448] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:01 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:02.648750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:02.649790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:02.658142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:02.658593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:02.659399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:02.659840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:02.699774 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-87f1176d-27f7-4a90-8cb6-8351776fbc67 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054968 Nov 20 21:29:02.700427 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3670/7449] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:02 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:03.711876 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:03.712881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:03.720920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:03.721373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:03.722191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:03.722638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:03.761233 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-54c140d8-3aac-4d29-a749-c0fe970d503d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053283 Nov 20 21:29:03.761889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3780/7450] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:03 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:04.774123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:04.775127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:04.782562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:04.783017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:04.783797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:04.784231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:04.829507 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c69309a7-9d9c-4e5b-bc96-3beb27dadb63 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.059218 Nov 20 21:29:04.830109 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3671/7451] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:04 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:05.841750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:05.842713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:05.850781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:05.851245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:05.852074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:05.852527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:05.894585 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e1779dd-8163-45c8-abfa-fc929f5e19cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056807 Nov 20 21:29:05.895491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3781/7452] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:05 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:06.906898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:06.907917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:06.915214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:06.915699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:06.916472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:06.916912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:06.956498 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cf287bee-9c13-47a4-a0a5-671e7d7652b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053718 Nov 20 21:29:06.957132 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3672/7453] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:06 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:07.968736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:07.969807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:07.977404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:07.977869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:07.978752 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:07.979197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:08.020302 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d30824a5-fed0-4e44-9be0-6530d9cf8132 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055609 Nov 20 21:29:08.020973 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3782/7454] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:07 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:09.033074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:09.034084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:09.041577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:09.042032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:09.042848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:09.043287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:09.083056 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6f19161-a669-4d07-8bcd-ae1cf445f708 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054546 Nov 20 21:29:09.083717 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3673/7455] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:09 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:10.095919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:10.097214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:10.104832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:10.105303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:10.106154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:10.106620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:10.150771 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9c53cf80-aff8-4126-a67c-6a9bb2ff2c2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.059471 Nov 20 21:29:10.151428 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3783/7456] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:10 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:11.163130 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:11.164139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:11.172065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:11.172530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:11.173321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:11.173764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:11.215389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9bc2da8f-22c4-4b35-b88b-017c28846c2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056324 Nov 20 21:29:11.216296 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3674/7457] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:11 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:12.227730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:12.228740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:12.236772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:12.237233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:12.238029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:12.238502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:12.278526 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b6cb220-5f86-42b3-8be2-ba94d1acbcd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054663 Nov 20 21:29:12.279182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3784/7458] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:12 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:13.291397 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:13.292393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:13.299991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:13.300439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:13.301222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:13.301675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:13.343534 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cd1bb21a-ac2c-477a-b65f-16c2f1b07a43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055926 Nov 20 21:29:13.344258 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3675/7459] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:13 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:14.355850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:14.356854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:14.364856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:14.365313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:14.366128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:14.366578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:14.406572 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a188a910-a7bb-4e1f-88af-3d6ef53d6f7d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054572 Nov 20 21:29:14.407214 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3785/7460] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:14 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:15.417993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:15.419010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:15.426351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:15.426809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:15.427596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:15.428043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:15.468291 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4760386a-121f-4495-a4de-46431b0890cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054063 Nov 20 21:29:15.468895 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3676/7461] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:15 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:16.480806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:16.481850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:16.489320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:16.489781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:16.490598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:16.491045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:16.532757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27f55b65-726f-4a2d-8344-07a32fcfff8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055925 Nov 20 21:29:16.535170 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3786/7462] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:16 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:16.699394 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:29:16.699871 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:29:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:29:17.545199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:17.546239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:17.554859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:17.555306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:17.556079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:17.556513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:17.598169 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-535ba70f-e1b0-468a-8fd6-ff36b9c249cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056925 Nov 20 21:29:17.599072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3677/7463] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:17 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:18.611003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:18.612079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:18.619748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:18.620210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:18.621004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:18.621454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:18.661536 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-374bc791-bbb9-4b9b-98c9-eb320edee008 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055124 Nov 20 21:29:18.662215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3787/7464] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:18 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:19.673595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:19.674642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:19.681871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:19.682352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:19.683132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:19.683567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:19.723446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f69572c2-d207-4393-8568-94795fc8b065 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053838 Nov 20 21:29:19.724356 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3678/7465] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:19 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:20.736227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:20.737262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:20.744791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:20.745246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:20.746030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:20.746495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:20.785096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea168144-ef76-4161-9b32-5ca26db95fb9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053368 Nov 20 21:29:20.785679 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3788/7466] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:20 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:21.796307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:21.797282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:21.805363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:21.805818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:21.806635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:21.807072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:21.846787 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ea1edde-fb89-4f92-936f-0078b2aa2a81 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054476 Nov 20 21:29:21.847429 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3679/7467] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:21 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:22.859235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:22.860260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:22.869099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:22.869567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:22.870391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:22.870846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:22.914658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31abd07c-028e-46c2-9772-4c9a84f0de59 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.059402 Nov 20 21:29:22.915314 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3789/7468] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:22 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:23.927082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:23.928077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:23.935761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:23.936215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:23.937004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:23.937445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:23.978032 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-db318c29-fee0-48e7-b5ed-f9cc4bb8fb3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055420 Nov 20 21:29:23.978699 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3680/7469] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:23 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:24.989956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:24.991013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:24.998582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:24.999041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:24.999830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:25.000275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:25.040826 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-78bcea74-cc4d-413f-a5f3-7eb2e562806d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054783 Nov 20 21:29:25.041737 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3790/7470] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:24 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:26.052504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:26.053512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:26.060927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:26.061389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:26.062211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:26.062662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:26.103163 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bcdf926e-89df-42f0-8999-9438e4002471 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054816 Nov 20 21:29:26.103801 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3681/7471] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:26 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:27.115459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:27.116470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:27.124052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:27.124507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:27.125291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:27.125735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:27.167173 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-41f02787-d110-4f0f-bfab-01c31a354610 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056297 Nov 20 21:29:27.167823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3791/7472] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:27 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:28.179170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:28.180192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:28.187507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:28.187959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:28.188738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:28.189673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:28.229402 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1927f5a1-920d-4a54-b4bd-7235bbfc6069 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054138 Nov 20 21:29:28.230038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3682/7473] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:28 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:29.242063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:29.243348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:29.250715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:29.251164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:29.252950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:29.253409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:29.293363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9260a52c-5e16-4076-84c3-2fbe473741a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055354 Nov 20 21:29:29.294012 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3792/7474] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:29 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:30.305296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:30.306404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:30.313707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:30.314828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:30.315622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:30.316066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:30.360497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26f1778d-6264-40bb-a69f-74f197274dec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.059199 Nov 20 21:29:30.361161 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3683/7475] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:30 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:31.373308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:31.374394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:31.381917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:31.382407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:31.383229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:31.383668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:31.422431 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-492e32f6-eb42-4fb5-ae05-5a70e0c6edd4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053246 Nov 20 21:29:31.423080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3793/7476] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:31 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:32.435281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:32.436306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:32.443975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:32.444433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:32.445230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:32.445673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:32.485595 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2f19f81b-322c-46e0-9eef-006c81c41919 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054312 Nov 20 21:29:32.487226 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3684/7477] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:32 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:33.498360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:33.499410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:33.507593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:33.508055 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:33.508849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:33.509308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:33.549346 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4311f253-2fe3-4c05-bbf6-0801c527d614 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054232 Nov 20 21:29:33.550025 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3794/7478] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:33 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:34.560943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:34.561958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:34.570093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:34.570562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:34.571391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:34.571839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:34.611864 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4422821e-0600-4e85-8669-6eaac9c2b089 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054821 Nov 20 21:29:34.612508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3685/7479] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:34 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:35.624305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:35.625314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:35.633185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:35.633641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:35.634463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:35.634907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:35.676694 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cbed0367-f70a-45b9-bd3b-4a1ed6eb1af6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056267 Nov 20 21:29:35.677385 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3795/7480] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:35 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:36.688907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:36.689953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:36.697330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:36.697788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:36.698611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:36.699060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:36.739150 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-35657f82-58ea-412d-b36e-040f10e50524 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054296 Nov 20 21:29:36.739858 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3686/7481] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:36 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:37.752060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:37.753083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:37.760506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:37.760963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:37.761768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:37.762250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:37.804832 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76d9b3fc-a6ae-4674-81e9-7769947a1fe8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.057029 Nov 20 21:29:37.805407 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3796/7482] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:37 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:38.819175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:38.820311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:38.828234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:38.828749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:38.830256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:38.830914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:38.873075 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3fb7b8b0-99fa-479d-8ec9-09aca8e4f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.058519 Nov 20 21:29:38.874035 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3687/7483] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:38 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:39.885332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:39.886412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:39.894478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:39.894944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:39.895748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:39.896195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:39.935053 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd5c6c47-96f6-451d-a54a-89c43b9f2729 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053645 Nov 20 21:29:39.935694 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3797/7484] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:39 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:40.947920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:40.948915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:40.956252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:40.956702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:40.957476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:40.957913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:40.997755 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52978311-30fe-4360-a7af-b6cbc4268422 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053796 Nov 20 21:29:40.998443 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3688/7485] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:40 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:42.009380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:42.010546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:42.017878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:42.018362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:42.019157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:42.019608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:42.057268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a10031da-985c-489f-92da-6a96884e2b84 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.051859 Nov 20 21:29:42.057910 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3798/7486] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:42 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:43.069959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:43.070983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:43.078310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:43.078767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:43.080384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:43.080828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:43.122437 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7aed9dc7-7dc0-4a83-8cfe-303f66dd1b25 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056399 Nov 20 21:29:43.123404 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3689/7487] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:43 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:44.135123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:44.136136 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:44.143988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:44.144452 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:44.145272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:44.145722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:44.185877 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df23f81d-f95c-47fb-8630-15509f4c35f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054714 Nov 20 21:29:44.186557 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3799/7488] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:44 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:45.197953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:45.198980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:45.206111 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:45.206571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:45.207350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:45.207791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:45.247607 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30b5a947-f776-4645-b28e-55183641e69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053698 Nov 20 21:29:45.248242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3690/7489] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:45 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:46.259326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:46.260329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:46.268405 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:46.268863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:46.269646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:46.270113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:46.309551 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2710538f-0898-41bd-ae5b-79c934b167d1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054229 Nov 20 21:29:46.310219 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3800/7490] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:46 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:47.321820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:47.322848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:47.330176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:47.330633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:47.331415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:47.331855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:47.370531 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e3125f2-277d-4a8e-9ee9-39df89381bbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.052642 Nov 20 21:29:47.371163 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3691/7491] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:47 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:48.383512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:48.384524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:48.392775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:48.393225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:48.394011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:48.394481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:48.437578 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8c7e52e6-fd73-4bee-ac8d-51e37748a192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.058026 Nov 20 21:29:48.438736 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3801/7492] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:48 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:49.450421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:49.451414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:49.459306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:49.459751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:49.460526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:49.460959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:49.501442 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f46e9c68-cca6-4628-9b4e-77e975b85482 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054794 Nov 20 21:29:49.502166 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3692/7493] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:49 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:50.513376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:50.514440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:50.522421 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:50.522887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:50.523692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:50.524145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:50.564816 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7c192337-204e-4e90-a0ba-727a3ae8003b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055352 Nov 20 21:29:50.565468 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3802/7494] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:50 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:51.576483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:51.577485 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:51.585380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:51.585835 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:51.586661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:51.587102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:51.627021 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4712fb3d-4476-4e6f-8748-0efd9545e79f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054473 Nov 20 21:29:51.627790 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3693/7495] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:51 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:52.638568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:52.639592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:52.647020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:52.647485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:52.648274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:52.648727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:52.689727 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-27e19547-8029-4ea0-a878-dbe48df55b5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055092 Nov 20 21:29:52.690446 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3803/7496] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:52 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:53.700986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:53.701978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:53.709740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:53.710219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:53.710999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:53.711434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:53.752006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8cd4db87-777b-4d3b-ba8b-aeffffc27025 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054915 Nov 20 21:29:53.752689 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3694/7497] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:53 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:54.764509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:54.765550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:54.773106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:54.773563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:54.774388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:54.774832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:54.817148 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a02b5396-647c-4a91-97dc-aad969f93526 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056154 Nov 20 21:29:54.820883 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3804/7498] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:54 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:55.829691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:55.831347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:55.838693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:55.839141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:55.839918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:55.840359 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:55.881999 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6c43c9ff-1b26-432d-8f3a-d0de3c6bdcde tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056393 Nov 20 21:29:55.882695 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3695/7499] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:55 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:56.894835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:56.895894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:56.903403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:56.903915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:56.904702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:56.905150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:56.945813 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eba87581-70b8-472e-bef5-c21df2dc6576 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.056194 Nov 20 21:29:56.949864 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3805/7500] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:56 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:29:57.957394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:57.958418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:57.965725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:57.966202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:57.966986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:57.967425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:58.007480 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89331c7f-ba1a-452f-97f3-8d3e9a77d108 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054105 Nov 20 21:29:58.008147 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3696/7501] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:57 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:29:59.019563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:29:59.020611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:29:59.027944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:59.028416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:59.029222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:29:59.029676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:29:59.069879 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a412406-421b-4dc7-ae8c-8329736fc8ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054531 Nov 20 21:29:59.070583 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3806/7502] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:29:59 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:00.081916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:00.082948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:00.090240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:00.090694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:00.091473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:00.091914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:00.130984 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a112bd19-26e5-48a2-9143-d0eae0640485 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053630 Nov 20 21:30:00.131637 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3697/7503] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:00 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:01.144425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:01.145426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:01.152356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:01.152818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:01.153602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:01.154068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:01.195453 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-975cd73d-a280-4031-9605-3963cfee0d08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055185 Nov 20 21:30:01.196125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3807/7504] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:01 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:02.207751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:02.208739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:02.215966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:02.216416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:02.217191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:02.217628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:02.257473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5434dc41-35df-4f23-b2a6-4348fd7b804f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053836 Nov 20 21:30:02.258141 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3698/7505] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:02 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:03.270312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:03.271322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:03.278612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:03.279071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:03.279855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:03.280298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:03.318873 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-164940a2-f078-4ff9-b15c-708749571375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.053311 Nov 20 21:30:03.319492 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3808/7506] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:03 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:04.331259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:04.332251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:04.339839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:04.340299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:04.341153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:04.341610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:04.382264 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5c6f0a96-fc04-4729-927b-26fd12a91d71 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055348 Nov 20 21:30:04.382922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3699/7507] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:04 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:05.394545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:05.395564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:05.402988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:05.403462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:05.404302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:05.404758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:05.445320 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aef53d46-b5f3-43eb-9f9e-7d5e6eb12274 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054885 Nov 20 21:30:05.445966 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3809/7508] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:05 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:30:06.458614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:06.459655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:06.467027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:06.467486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:06.468281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:06.468726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:06.508699 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de1d7433-52b2-42aa-8ac8-3f0d3b0b4a6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.054875 Nov 20 21:30:06.509354 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3700/7509] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:06 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:07.521557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:07.522625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:07.530032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:07.530521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:07.531351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:07.531802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:07.572697 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d264906c-7d89-41db-a5c8-0757db8ae549 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 32637 microversion: 2.1 time: 0.055631 Nov 20 21:30:07.573340 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3810/7510] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:07 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:30:08.585655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:08.586685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:08.593865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.594340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.595118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.595551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.651418 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49f09610-aec0-43b1-8cd0-b7246e022403 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 200 len: 40785 microversion: 2.1 time: 0.069928 Nov 20 21:30:08.652077 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3701/7511] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:08 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 40785 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:08.662984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:08.663729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:08.671135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.671604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.672397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.672849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.805636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:08.813294 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f0dcf389-4fc7-400e-954d-34e71da732fd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1670 microversion: 2.1 time: 0.154428 Nov 20 21:30:08.813879 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3811/7512] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:08 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:08.831186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:08.832219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:08.839549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.840012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.840893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.841335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.869681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:08.875734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Old instance type m1.heat2, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:30:08.882393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:30:08.882824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:30:08.883299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:30:08.883710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:30:08.884126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:30:08.945756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1f4c966f-5a17-4dbc-9fa8-93b19d7fc47c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 202 len: 0 microversion: 2.1 time: 0.118409 Nov 20 21:30:08.946529 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3702/7513] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:08 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:30:08.954335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:08.954969 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:08.962000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.962499 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:08.963307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:08.963762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:09.106775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:09.115013 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-408dc9c2-2a68-493d-9621-4673ae4f0abc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1679 microversion: 2.1 time: 0.164363 Nov 20 21:30:09.115577 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3812/7514] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:08 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:10.133563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:10.134335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:10.142663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:10.143687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:10.144513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:10.144954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:10.382336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:10.391151 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-43e5a830-0a9d-4a36-8ecc-e38dc0e73252 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1679 microversion: 2.1 time: 0.261368 Nov 20 21:30:10.391823 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3703/7515] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:10 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:11.408418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:11.409126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:11.415847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:11.416304 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:11.417125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:11.417564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:11.554433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:11.561795 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e586a014-00d5-4a3d-b1d8-a24ec79f3da0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.157319 Nov 20 21:30:11.562411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3813/7516] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:11 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:12.579777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:12.580944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:12.587681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:12.588138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:12.588926 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:12.589366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:12.729665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:12.737275 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0bbe574d-040b-49cd-a5cb-79e56ef51054 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.161231 Nov 20 21:30:12.737850 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3704/7517] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:12 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:13.754649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:13.755249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:13.761900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:13.762388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:13.763172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:13.763616 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:13.897240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:13.904659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-015dc14a-20d6-48b5-8b4f-909bb5380e22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.153788 Nov 20 21:30:13.905235 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3814/7518] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:13 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:14.922648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:14.923256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:14.929941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:14.930425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:14.931198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:14.931636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:15.061542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:15.068770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-86f41006-edfc-43b0-8628-956e82e6e019 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.149992 Nov 20 21:30:15.069345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3705/7519] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:14 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:16.085943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:16.086647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:16.093384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:16.093850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:16.094684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:16.095139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:16.227222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:16.234567 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c865cd6-3abc-4cea-9c90-325cde161280 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.152379 Nov 20 21:30:16.235137 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3815/7520] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:16 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:17.253393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:17.253958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:17.260769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:17.261224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:17.262005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:17.262474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:17.391280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:17.399074 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be26079a-8faa-42fd-96ee-11273f42842f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.150287 Nov 20 21:30:17.400498 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3706/7521] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:17 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:18.416859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:18.417476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:18.424437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:18.424891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:18.425674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:18.426147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:18.558627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:18.567110 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5893e29b-b8ee-4298-b55a-5ded1895f1b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.153931 Nov 20 21:30:18.567696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3816/7522] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:18 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:19.584853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:19.585388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:19.592320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:19.592772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:19.593554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:19.593988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:19.729313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:19.737136 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f3ad498-25d2-4e2d-9209-a4a73c6d1f35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.156083 Nov 20 21:30:19.737977 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3707/7523] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:19 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:20.755306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:20.755934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:20.763208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:20.763708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:20.764521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:20.764973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:20.902467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:20.910420 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c649920a-8b46-4872-9e77-7c19a6012831 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.159337 Nov 20 21:30:20.910992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3817/7524] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:20 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:21.928287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:21.928928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:21.935679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:21.936132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:21.936922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:21.937361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:22.066887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:22.074205 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80440a5b-d8a9-4dfa-8b58-0ced8edb4658 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1684 microversion: 2.1 time: 0.150405 Nov 20 21:30:22.074786 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3708/7525] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:21 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:30:23.091830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:23.092592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:23.100319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:23.100784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:23.101585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:23.102035 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:23.235409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:23.243644 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42acba8b-24aa-45ec-9b40-b40fae1f3212 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1683 microversion: 2.1 time: 0.155847 Nov 20 21:30:23.244229 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3818/7526] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:23 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:23.265797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "name": "network-vif-unplugged", "status": "completed", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:23.267860 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:23.267860 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:30:23.276072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:23.276524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:23.288820 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] Creating event network-vif-unplugged:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch1-master-1 Nov 20 21:30:23.294236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:30:23.304842 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a1a4c286-acb9-4123-8971-06a4549a65be req-96f3154b-0efe-4d14-a6d1-c7d642c190a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042696 Nov 20 21:30:23.305607 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3709/7527] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:30:24.261886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:24.262547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:24.270623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:24.271096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:24.271942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:24.272399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:24.422508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:24.430273 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-799a6d21-e540-4ab8-8afc-724f07739a5b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1683 microversion: 2.1 time: 0.172083 Nov 20 21:30:24.430856 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3819/7528] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:24 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:25.322355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:25.323845 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:25.323845 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:30:25.331796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:25.332246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:25.343706 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] Creating event network-changed:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch1-master-1 Nov 20 21:30:25.349685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:30:25.361191 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-6da45c92-e7d4-4699-b49f-78b96f73ca84 req-fcee3692-4967-430f-9d00-71b544c225fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043677 Nov 20 21:30:25.361787 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3710/7529] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:30:25.448365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:25.448992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:25.456642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:25.457099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:25.457903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:25.458374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:25.591944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:25.600511 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-081e3520-24f0-428a-9154-ba6d8a63add1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1681 microversion: 2.1 time: 0.155840 Nov 20 21:30:25.601104 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3820/7530] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:25 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:26.618900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:26.619596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:26.626631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.627373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:26.628176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.628620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:26.851680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:26.859196 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50ac22c3-4ff9-46b1-b116-b2611a3968e8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1678 microversion: 2.1 time: 0.244671 Nov 20 21:30:26.859785 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3711/7531] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:26 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:26.876670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:26.877493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:26.884143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.884617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:26.885414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.885869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:26.945463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e900d6b-2e72-43f0-a829-fedb5e4b5c43 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action" status: 204 len: 0 microversion: 2.1 time: 0.072408 Nov 20 21:30:26.946140 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3821/7532] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:26 2021] POST /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:30:26.955942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:26.956560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:26.963009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.963816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:26.964646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:26.965149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:27.178226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:27.185511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-de9958c0-ad46-4ba9-8425-ba277f48d348 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1678 microversion: 2.1 time: 0.235208 Nov 20 21:30:27.186104 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3712/7533] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:26 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:28.203909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:28.204729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:28.210902 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.211361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.212152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.212597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.348263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:28.355495 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a57dd54f-ef0a-4f30-b8d2-612b160c6985 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1670 microversion: 2.1 time: 0.156459 Nov 20 21:30:28.356066 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3822/7534] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:28 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:28.371968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:28.372581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:28.379503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.379958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.380749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.381190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.518214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:28.525916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-40af4a54-d211-4e06-b056-50ff23d4ed9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1670 microversion: 2.1 time: 0.157655 Nov 20 21:30:28.526529 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3713/7535] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:28 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:30:28.542218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:28.542914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:28.549628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.550100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.550917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.551363 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.686180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:28.693711 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a539a3a6-1d87-41b0-9fa8-ff08e864d62d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1670 microversion: 2.1 time: 0.155522 Nov 20 21:30:28.694313 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3823/7536] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:28 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:28.709858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:28.710386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:28.716371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.716825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.717614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.718080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.747048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:30:28.827953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08910a6b-f312-4f9f-a5e0-fa441fe020ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 204 len: 0 microversion: 2.1 time: 0.120458 Nov 20 21:30:28.828820 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3714/7537] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:30:28 2021] DELETE /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:30:28.837469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:28.838841 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:28.846313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.846936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.847789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:28.848245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:28.980318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:28.988257 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5c2a912e-d85f-4556-bb47-c3e3a491873d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1676 microversion: 2.1 time: 0.154670 Nov 20 21:30:28.988767 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3824/7538] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:28 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:30.006010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:30.006737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:30.013433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:30.013911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:30.014723 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:30.015204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:30.146020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:30.153439 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0bbf2752-a524-4190-ad28-e81077095a8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1676 microversion: 2.1 time: 0.152196 Nov 20 21:30:30.154014 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3715/7539] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:29 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:30.430958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-73fd7064-4b53-4751-8cce-a2eab438e135 req-1247e39e-1f9c-4544-89fa-c122ac9c1843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "name": "network-vif-plugged", "status": "completed", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:30.432615 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:30.432615 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:30:30.440944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-73fd7064-4b53-4751-8cce-a2eab438e135 req-1247e39e-1f9c-4544-89fa-c122ac9c1843 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:30.441508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-73fd7064-4b53-4751-8cce-a2eab438e135 req-1247e39e-1f9c-4544-89fa-c122ac9c1843 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:30.453645 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-73fd7064-4b53-4751-8cce-a2eab438e135 req-1247e39e-1f9c-4544-89fa-c122ac9c1843 service nova] Creating event network-vif-plugged:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch1-master-1 Nov 20 21:30:30.465620 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-73fd7064-4b53-4751-8cce-a2eab438e135 req-1247e39e-1f9c-4544-89fa-c122ac9c1843 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039112 Nov 20 21:30:30.466361 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3825/7540] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:30:31.045890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-16c9828b-3259-4eb9-81d4-672020d3d1cf req-16da5210-232c-4032-813c-3b48c888a303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1187118-c4d6-4cd7-81c9-b04213c8a1fe", "name": "network-vif-deleted", "tag": "7bb20b8b-e8de-4f22-ab90-0e46063be52d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:31.047783 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:31.047783 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:30:31.060398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-16c9828b-3259-4eb9-81d4-672020d3d1cf req-16da5210-232c-4032-813c-3b48c888a303 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:31.060867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-16c9828b-3259-4eb9-81d4-672020d3d1cf req-16da5210-232c-4032-813c-3b48c888a303 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:31.076182 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-16c9828b-3259-4eb9-81d4-672020d3d1cf req-16da5210-232c-4032-813c-3b48c888a303 service nova] Creating event network-vif-deleted:7bb20b8b-e8de-4f22-ab90-0e46063be52d for instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe on nch1-master-1 Nov 20 21:30:31.081598 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-16c9828b-3259-4eb9-81d4-672020d3d1cf req-16da5210-232c-4032-813c-3b48c888a303 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039963 Nov 20 21:30:31.082379 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3716/7541] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:30:31.171189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:31.171911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:31.178508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:31.178978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:31.179779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:31.180229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:31.214042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:31.214540 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:31.215002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lazy-loading 'fault' on Instance uuid c1187118-c4d6-4cd7-81c9-b04213c8a1fe {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:30:31.256870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:31.264296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e00f3a51-4938-4c80-a924-d549be3945a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 200 len: 1329 microversion: 2.1 time: 0.097240 Nov 20 21:30:31.264872 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3826/7542] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:31 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:32.281658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:32.282421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:32.289954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:32.290440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:32.291258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:32.291699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:32.304642 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. Nov 20 21:30:32.305238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:30:32.306143 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3eef05e6-2715-4a7d-912a-31b2dda58ce0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 404 len: 111 microversion: 2.1 time: 0.028551 Nov 20 21:30:32.306691 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3717/7543] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:32 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:30:32.318289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:32.318916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:32.325601 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:32.326088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:32.326885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:32.327334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:32.341068 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. Nov 20 21:30:32.341669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:30:32.342566 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c1ff528-2a8e-42f6-b973-36d4d4c7ecf0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 404 len: 111 microversion: 2.1 time: 0.028289 Nov 20 21:30:32.343106 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3827/7544] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:32 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:30:32.389975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-468592754", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "4c5f91b7-b565-4458-971f-538d019cd893"}], "security_groups": [{"name": "tempest-securitygroup--329218344"}], "key_name": "tempest-keypair-1679284054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:32.492476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] validate_networks() for [('4c5f91b7-b565-4458-971f-538d019cd893', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:30:33.222815 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:30:33.223252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:30:33.223711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:30:33.224127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:30:33.224543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:30:33.233207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:33.233658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:33.234519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:33.234959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:33.252559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:30:33.257488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:30:33.269472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:30:33.271812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:30:33.316994 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-38cba0a7-26f8-4d78-a34f-aec9078626ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.930628 Nov 20 21:30:33.322342 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3718/7545] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:30:32 2021] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:30:33.327559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-57dd3669-cb76-403f-8032-cc2cb2f8c3ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:33.328179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-57dd3669-cb76-403f-8032-cc2cb2f8c3ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:33.386507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-57dd3669-cb76-403f-8032-cc2cb2f8c3ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:33.393382 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-57dd3669-cb76-403f-8032-cc2cb2f8c3ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1238 microversion: 2.1 time: 0.069441 Nov 20 21:30:33.393965 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3828/7546] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:33 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:30:34.412258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:34.412879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:34.419958 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:34.420425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:34.421263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:34.421749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:34.487341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:34.495147 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f8b206b-19c0-4246-b9f0-acc0677fe238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1296 microversion: 2.1 time: 0.088203 Nov 20 21:30:34.495745 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3719/7547] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:34 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:35.520613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:35.521647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:35.537039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:35.537809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:35.538823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:35.539843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:35.548782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8e1c4005-e5c7-46ba-bd32-8f31b2437bed req-9c6e6715-ba74-44b4-9f45-02ac1d754329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:35.551501 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:35.551501 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:30:35.564204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8e1c4005-e5c7-46ba-bd32-8f31b2437bed req-9c6e6715-ba74-44b4-9f45-02ac1d754329 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:35.564784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8e1c4005-e5c7-46ba-bd32-8f31b2437bed req-9c6e6715-ba74-44b4-9f45-02ac1d754329 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:35.580363 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8e1c4005-e5c7-46ba-bd32-8f31b2437bed req-9c6e6715-ba74-44b4-9f45-02ac1d754329 service nova] Creating event network-changed:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch1-master-1 Nov 20 21:30:35.587033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8e1c4005-e5c7-46ba-bd32-8f31b2437bed req-9c6e6715-ba74-44b4-9f45-02ac1d754329 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042940 Nov 20 21:30:35.587612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3720/7548] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:30:35.705305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:35.713394 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ab891b0-0ecd-46fe-b6b9-c28cdbfc61e2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.204294 Nov 20 21:30:35.714262 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3829/7549] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:35 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:36.733279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:36.733889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:36.740666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:36.741117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:36.742182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:36.742619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:36.881176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:36.888652 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-341aaf31-5e98-459e-b241-38696a950fd7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.160420 Nov 20 21:30:36.889222 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3721/7550] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:36 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:37.906351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:37.907210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:37.915895 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:37.916362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:37.917170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:37.917621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:38.066602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:38.074562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e67b724a-5198-4869-bd9f-6b963ac7ef95 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.172202 Nov 20 21:30:38.075148 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3830/7551] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:37 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:39.091445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:39.092086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:39.099565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:39.100018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:39.100799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:39.101235 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:39.233980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:39.242180 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8dd0b6d7-9f43-4fa6-8f84-babe9e903504 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.154090 Nov 20 21:30:39.242786 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3722/7552] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:39 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:40.259844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:40.260466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:40.267906 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:40.268366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:40.269162 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:40.269610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:40.412185 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:40.419508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4ad74a80-025a-47f4-9929-6adab0950313 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.163363 Nov 20 21:30:40.420090 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3831/7553] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:40 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:40.484775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8a989fc6-6ad9-48c9-b31e-8748e754ed17 req-c6547659-2ae2-4450-90a8-7a1210dceb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "name": "network-vif-plugged", "status": "completed", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:40.486452 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:40.486452 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:30:40.495035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a989fc6-6ad9-48c9-b31e-8748e754ed17 req-c6547659-2ae2-4450-90a8-7a1210dceb8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:40.495480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8a989fc6-6ad9-48c9-b31e-8748e754ed17 req-c6547659-2ae2-4450-90a8-7a1210dceb8a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:40.506703 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8a989fc6-6ad9-48c9-b31e-8748e754ed17 req-c6547659-2ae2-4450-90a8-7a1210dceb8a service nova] Creating event network-vif-plugged:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch1-master-1 Nov 20 21:30:40.511850 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8a989fc6-6ad9-48c9-b31e-8748e754ed17 req-c6547659-2ae2-4450-90a8-7a1210dceb8a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Nov 20 21:30:40.512383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3723/7554] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:30:41.437255 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:41.437903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:41.445582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:41.446441 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:41.447891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:41.448629 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:41.581290 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:41.589204 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c50b9bf3-d640-4b7e-9a35-41abfba2c355 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1363 microversion: 2.1 time: 0.155950 Nov 20 21:30:41.589783 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3832/7555] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:41 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:42.606988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:42.607682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:42.614816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:42.615265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:42.616035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:42.616468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:42.747396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:30:42.755273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bab3c2d7-7988-4171-a1ab-426984667cf6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1550 microversion: 2.1 time: 0.152334 Nov 20 21:30:42.755851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3724/7556] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:30:42 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:42.772865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:30:42.773376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:42.780075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:42.780536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:42.781354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:42.781795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:42.865360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-225cab08-7509-4284-84e0-ea05e5501c5c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096367 Nov 20 21:30:42.865965 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3833/7557] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:30:42 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:30:43.806656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:43.808298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:43.816090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:43.816551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:43.817349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:43.817918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:43.857916 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b87b903b-521b-47aa-9841-bdeff16846ea tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.055701 Nov 20 21:30:43.862220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3725/7558] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:43 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:43.891986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8c9b5c9d-6084-4c1c-8c9b-40a6c1344e99 req-fb75637d-27d3-4ce5-99bb-b1d3605fcdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:43.893627 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:30:43.893627 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:30:43.900799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8c9b5c9d-6084-4c1c-8c9b-40a6c1344e99 req-fb75637d-27d3-4ce5-99bb-b1d3605fcdda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:43.901324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8c9b5c9d-6084-4c1c-8c9b-40a6c1344e99 req-fb75637d-27d3-4ce5-99bb-b1d3605fcdda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:43.913059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8c9b5c9d-6084-4c1c-8c9b-40a6c1344e99 req-fb75637d-27d3-4ce5-99bb-b1d3605fcdda service nova] Creating event network-changed:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch1-master-1 Nov 20 21:30:43.918268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8c9b5c9d-6084-4c1c-8c9b-40a6c1344e99 req-fb75637d-27d3-4ce5-99bb-b1d3605fcdda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113570 Nov 20 21:30:43.918958 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3834/7559] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:30:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:30:44.869556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:44.870593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:44.878922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:44.879386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:44.880192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:44.880668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:44.917962 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1be3c798-494e-4c52-8ab9-a5ea40771a57 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.052563 Nov 20 21:30:44.921095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3726/7560] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:44 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:45.928640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:45.929653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:45.936550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:45.937005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:45.937789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:45.938260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:45.977493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b9934825-766d-4c02-a6bf-9665209def38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.052829 Nov 20 21:30:45.978281 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3835/7561] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:45 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:46.989226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:46.990245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:46.998200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:46.998762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:46.999637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:47.000090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:47.037570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-183243ba-ac97-41d8-bd5b-2db7438e26a8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.053185 Nov 20 21:30:47.038215 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3727/7562] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:46 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:48.050114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:48.051213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:48.059231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:48.059735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:48.060644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:48.061096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:48.102565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e2dc7e3b-21e1-464d-8c72-f8eff39e3fec tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.057203 Nov 20 21:30:48.103240 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3836/7563] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:48 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:49.114472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:49.115684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:49.123711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:49.124171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:49.124961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:49.125405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:49.162785 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b42a49f0-5b53-46d0-8f78-dd27ef708617 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.053172 Nov 20 21:30:49.163585 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3728/7564] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:49 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:50.173776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:50.174808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:50.182271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:50.182681 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:50.183471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:50.183918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:50.221461 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a514786c-efff-4f5c-8e17-aac3c7d8d8e7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.051861 Nov 20 21:30:50.222096 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3837/7565] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:50 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:51.232934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:51.233869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:51.241838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:51.242309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:51.243333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:51.243790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:51.284169 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f74fa40-d1eb-45f7-bcd7-99bd8d43f8f6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.055279 Nov 20 21:30:51.284791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3729/7566] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:51 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:52.296166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:52.297184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:52.304874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:52.305345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:52.306159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:52.306610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:52.343007 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ec217c16-6551-498a-842c-daa226966079 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.050852 Nov 20 21:30:52.343663 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3838/7567] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:52 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:53.355084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:53.356079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:53.364429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:53.364885 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:53.365669 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:53.366138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:53.404840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49be2a1a-fcf0-4fdb-9390-91311f7055a5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 14 microversion: 2.1 time: 0.053661 Nov 20 21:30:53.405466 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3730/7568] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:53 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:30:54.417184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:54.418245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:54.425822 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:54.426387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:54.427188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:54.427635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:54.475522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7611d8f5-cc06-4b91-8fac-4f643ae44700 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 8207 microversion: 2.1 time: 0.062328 Nov 20 21:30:54.476258 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3839/7569] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:54 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 8207 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:30:55.291602 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:30:55.291797 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:30:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:30:55.313228 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:30:55.313375 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:30:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:30:55.487319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:55.488325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:55.496005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:55.496455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:55.497247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:55.497689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:55.554095 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84b1bb6c-dd70-4ec2-bb3f-b53ed3ae82ac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 16401 microversion: 2.1 time: 0.070710 Nov 20 21:30:55.554752 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3731/7570] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:55 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 16401 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:56.566273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:56.567646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:56.577700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:56.578194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:56.579271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:56.579800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:56.617364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ba2f07d-a2cc-4dc0-9915-6c03da1db461 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 16401 microversion: 2.1 time: 0.055131 Nov 20 21:30:56.618001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3840/7571] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:56 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 16401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:57.629150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:57.630181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:57.637503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:57.637952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:57.638754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:57.639192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:57.676369 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1aba9674-bf8e-4cfe-847a-2a1294ed19bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 16401 microversion: 2.1 time: 0.051797 Nov 20 21:30:57.677214 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3732/7572] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:57 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 16401 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:58.688805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:58.690018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:58.697299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:58.697759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:58.698572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:58.699017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:58.740877 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d0bf2e8-7b73-4f37-948d-2607998880ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 16401 microversion: 2.1 time: 0.056549 Nov 20 21:30:58.741780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3841/7573] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:58 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 16401 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:30:59.752841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:30:59.753840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:30:59.761155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:59.761604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:59.762405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:30:59.762847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:30:59.813163 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68254435-f585-4c83-b492-5fd9b642dec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.064229 Nov 20 21:30:59.813712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3733/7574] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:30:59 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:00.825425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:00.826436 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:00.833442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:00.833899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:00.834718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:00.835163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:00.875378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ee100d1-d970-4309-bbdf-fd763fc98047 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054135 Nov 20 21:31:00.876665 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3842/7575] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:00 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:01.888943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:01.889975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:01.898006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:01.898477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:01.899265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:01.899706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:01.939758 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4223584f-b325-48c9-b3a2-7b0239f6587c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054591 Nov 20 21:31:01.940412 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3734/7576] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:01 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:02.951999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:02.953471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:02.961200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:02.961661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:02.962471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:02.962919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:03.001621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2eeb401-334c-492c-a68d-0d4b9decd091 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.053583 Nov 20 21:31:03.002294 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3843/7577] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:02 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:04.013856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:04.014891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:04.022812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:04.023272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:04.024066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:04.024506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:04.067046 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c67c7cc-8c57-4be6-bb08-6bcee4af4e01 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.057123 Nov 20 21:31:04.067916 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3735/7578] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:04 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:05.079414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:05.080417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:05.087753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:05.088218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:05.089010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:05.089455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:05.128965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e44b9e8-f90e-4085-a781-a56a5dd2608c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.053622 Nov 20 21:31:05.129600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3844/7579] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:05 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:06.141874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:06.142893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:06.150195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:06.150651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:06.151438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:06.151916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:06.191518 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bdfd2dab-ada1-41ca-844f-7e8a0e79b8f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054299 Nov 20 21:31:06.192154 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3736/7580] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:06 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:07.203597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:07.204605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:07.211827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:07.212287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:07.213071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:07.213517 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:07.254314 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb6d2937-23cc-4076-b6a9-fd67f7541e30 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054741 Nov 20 21:31:07.254942 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3845/7581] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:07 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:08.266431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:08.267494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:08.275019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:08.275472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:08.276268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:08.276698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:08.317082 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-54b5dbce-f86c-45e9-8611-570d800482fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054705 Nov 20 21:31:08.317728 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3737/7582] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:08 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:09.329254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:09.330423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:09.337853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:09.338359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:09.339160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:09.339610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:09.378800 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c33b2b2-1abe-46a3-a8a0-3acbb716c011 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.054138 Nov 20 21:31:09.379439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3846/7583] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:09 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:10.390927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:10.392675 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:10.400082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:10.400537 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:10.401322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:10.401765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:10.443329 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f7fa08d0-f729-4185-b3ed-227f762635b2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 24565 microversion: 2.1 time: 0.056412 Nov 20 21:31:10.443970 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3738/7584] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:10 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:11.455496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:11.456509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:11.463840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:11.464305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:11.465094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:11.465543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:11.519109 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9f7bb847-9a5b-40f1-89f0-c44942c9edce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.067574 Nov 20 21:31:11.519795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3847/7585] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:11 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:12.531394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:12.533262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:12.540830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:12.541282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:12.542105 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:12.542553 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:12.582898 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a48b55f9-b256-4bef-bc7a-b52abfbdbad5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055489 Nov 20 21:31:12.583543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3739/7586] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:12 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:13.595893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:13.596907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:13.604211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:13.604673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:13.605459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:13.605907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:13.648382 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b73771f0-2e91-4306-8b85-878e1a65b684 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.057167 Nov 20 21:31:13.649038 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3848/7587] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:13 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:14.660985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:14.662017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:14.668994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:14.669446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:14.670271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:14.670711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:14.711529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-56afe279-6023-42e5-b5b4-fc47958e319b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054732 Nov 20 21:31:14.712441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3740/7588] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:14 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:15.726399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:15.727417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:15.734676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:15.735202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:15.735965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:15.736409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:15.775599 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-141d65aa-2d4d-4c7f-8e4f-50727606412d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054220 Nov 20 21:31:15.776246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3849/7589] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:15 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:16.788320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:16.789237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:16.796594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:16.797044 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:16.798623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:16.799064 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:16.842030 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca80c635-0f17-470e-bbd5-145b0951772c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.057308 Nov 20 21:31:16.842813 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3741/7590] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:16 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:17.855439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:17.856492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:17.864376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:17.864839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:17.865634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:17.866139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:17.906364 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3422be9e-443a-4347-9d17-0e84b135a7d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054995 Nov 20 21:31:17.907014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3850/7591] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:17 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:18.918614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:18.919627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:18.927783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:18.928239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:18.929034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:18.929478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:18.972314 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec0cce66-3f6f-48b7-bcba-a0af04be2b55 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.057713 Nov 20 21:31:18.972967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3742/7592] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:18 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:19.984621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:19.986382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:19.993936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:19.994439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:19.995234 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:19.995698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:20.035957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-629e583f-3250-425a-bc56-d7ec2d57d773 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055300 Nov 20 21:31:20.036598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3851/7593] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:19 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:21.048428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:21.049425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:21.056718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:21.057170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:21.057953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:21.058420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:21.099162 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad4edec2-fb8e-4b67-af21-7045fb3a3d64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054944 Nov 20 21:31:21.099795 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3743/7594] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:21 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:22.112125 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:22.113130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:22.120632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:22.121086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:22.121873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:22.122337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:22.161734 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-348e2572-b213-4946-bb75-a1e9104eaabd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054281 Nov 20 21:31:22.162439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3852/7595] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:22 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:23.174830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:23.175838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:23.183334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:23.183792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:23.184584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:23.185032 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:23.225096 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-380b620a-8684-4d7f-83b3-e24fffffa494 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055060 Nov 20 21:31:23.225741 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3744/7596] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:23 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:24.237612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:24.238653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:24.246295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:24.246764 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:24.247555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:24.248006 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:24.289850 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68a97f10-b777-4ed4-bfa0-2266491ee04b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.056377 Nov 20 21:31:24.290520 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3853/7597] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:24 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:25.302393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:25.303448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:25.310783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:25.311243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:25.312035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:25.312481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:25.351378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb74f773-bde4-45d4-b103-3abb8098aeeb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053163 Nov 20 21:31:25.352022 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3745/7598] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:25 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:26.363375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:26.364375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:26.371879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:26.372336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:26.373129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:26.373568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:26.413745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-995c384d-d3c9-4f99-98e3-80dd18b8041c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054376 Nov 20 21:31:26.417891 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3854/7599] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:26 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:27.425596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:27.426650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:27.433860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:27.434349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:27.435127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:27.435564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:27.474879 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d5a57e0b-3688-4f6a-aa73-b7c978ee4978 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053386 Nov 20 21:31:27.475513 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3746/7600] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:27 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:28.487433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:28.488474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:28.496375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:28.496838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:28.497659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:28.498127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:28.539058 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68f00566-d3f6-4d9b-9501-19034050b8c9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055611 Nov 20 21:31:28.539728 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3855/7601] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:28 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:29.552170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:29.553186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:29.560482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:29.560938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:29.561726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:29.562194 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:29.603378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a23e6b7d-6adf-408a-a67b-058e710ceba7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055891 Nov 20 21:31:29.604038 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3747/7602] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:29 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:30.616643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:30.617643 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:30.624550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:30.625011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:30.626458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:30.626925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:30.665894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-525dc86a-4edd-4368-b7cd-da09c4c8df1a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053646 Nov 20 21:31:30.666572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3856/7603] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:30 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:31.677968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:31.678985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:31.686300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:31.686753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:31.687535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:31.688486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:31.728720 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-25b18244-da6d-4b2f-9599-2e9f8306b060 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054589 Nov 20 21:31:31.729383 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3748/7604] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:31 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:32.742004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:32.743038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:32.750648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:32.751114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:32.751905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:32.752359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:32.798153 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fd63473f-b93c-4299-97af-5347542eb696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.060290 Nov 20 21:31:32.798717 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3857/7605] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:32 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:33.810480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:33.811398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:33.818706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:33.819159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:33.819939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:33.820376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:33.862117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3c9539a0-f871-40e6-ae0b-a35d1b25b32f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055687 Nov 20 21:31:33.862767 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3749/7606] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:33 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:34.874741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:34.876514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:34.883881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:34.884348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:34.885140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:34.885591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:34.925942 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5d4b1707-d031-40ee-b245-fd2a1cfe967f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055259 Nov 20 21:31:34.926652 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3858/7607] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:34 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:35.938141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:35.939302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:35.946704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:35.947168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:35.947960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:35.948406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:35.988630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-044d355e-aabd-4fe4-bb02-7403de4cfe4c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054761 Nov 20 21:31:35.989286 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3750/7608] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:35 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:37.001261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:37.002312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:37.009676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:37.010174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:37.010976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:37.011429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:37.053373 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88ce788d-5cd8-4ad1-b3b3-077979196206 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.056064 Nov 20 21:31:37.054043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3859/7609] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:36 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:38.065785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:38.066817 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:38.074121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:38.074572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:38.075350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:38.075788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:38.118631 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f6dfb0bc-6a07-40f2-98b2-1f7222baeec7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.056815 Nov 20 21:31:38.119285 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3751/7610] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:38 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:39.131611 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:39.133577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:39.139950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:39.140406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:39.141278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:39.141730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:39.183267 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-94d42bdc-4ca5-426d-a7d9-5e687ef19177 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055714 Nov 20 21:31:39.183951 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3860/7611] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:39 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:40.195871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:40.196896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:40.204830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:40.205276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:40.206069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:40.206607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:40.247013 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc61bc7b-5fcd-4632-a0bd-5439dd1efff3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055076 Nov 20 21:31:40.247692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3752/7612] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:40 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:41.259940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:41.260974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:41.268319 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:41.268781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:41.269583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:41.270038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:41.308321 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c7fd6ebe-951e-4939-b997-8fdab6c887b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.052361 Nov 20 21:31:41.309232 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3861/7613] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:41 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:42.320030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:42.321028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:42.328388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:42.328837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:42.329613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:42.330079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:42.371589 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-da74330f-cf96-4e99-be9d-dec22c3f90fc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055441 Nov 20 21:31:42.372272 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3753/7614] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:42 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:43.383950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:43.384974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:43.392879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:43.393341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:43.394159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:43.394609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:43.434624 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-551d657e-1f9d-4517-9ad6-021d19fc11c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054584 Nov 20 21:31:43.435292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3862/7615] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:43 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:44.447273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:44.448266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:44.455244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:44.455691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:44.456468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:44.456905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:44.498330 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8cfe5c76-fd17-49fd-8a94-44bc83d9be07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055223 Nov 20 21:31:44.498987 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3754/7616] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:44 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:45.510639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:45.511645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:45.519218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:45.519674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:45.520466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:45.520912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:45.561706 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bfd5f45c-7222-48cf-8894-6bd4ab1982d7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054994 Nov 20 21:31:45.562997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3863/7617] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:45 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:46.574991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:46.575988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:46.583739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:46.584218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:46.584990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:46.585429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:46.631779 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a200dda-73a4-4c1c-8615-db45204b11a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.060717 Nov 20 21:31:46.632725 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3755/7618] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:46 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:47.644197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:47.645134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:47.652483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:47.652949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:47.653730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:47.654207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:47.695761 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7f5448a2-ac2d-4946-95ab-5d1c9358466c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055600 Nov 20 21:31:47.696411 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3864/7619] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:47 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:48.708169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:48.709159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:48.716596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:48.717051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:48.717845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:48.718318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:48.757722 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cccc6a5d-dc58-4548-b964-545f4c8742d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053529 Nov 20 21:31:48.758409 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3756/7620] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:48 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:49.770076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:49.771087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:49.778464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:49.778926 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:49.779717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:49.780159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:49.822490 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e79ae884-9a78-449b-94f1-a2b134daaedf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.056352 Nov 20 21:31:49.823159 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3865/7621] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:49 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:31:50.835321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:50.836286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:50.844244 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:50.844707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:50.845481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:50.845921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:50.885665 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-811173c5-f38d-4ac6-afc9-0899236ef632 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054316 Nov 20 21:31:50.886368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3757/7622] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:50 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:51.898013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:51.899050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:51.906816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:51.907271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:51.908044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:51.908483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:51.947263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-34738fae-5a0f-4e83-8a6d-4068dd86de2d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053331 Nov 20 21:31:51.947886 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3866/7623] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:51 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:52.960557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:52.961550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:52.968901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:52.969354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:52.970164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:52.970603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:53.009465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d7040e18-c35f-4214-b882-dabf0d2bd8f9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.052905 Nov 20 21:31:53.010126 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3758/7624] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:52 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:54.021494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:54.022524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:54.029819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:54.030307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:54.031203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:54.031731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:54.070913 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bc2606e8-a429-4ac4-a3ac-331092b4187c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053452 Nov 20 21:31:54.071552 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3867/7625] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:54 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:55.084050 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:55.085067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:55.092375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:55.092823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:55.093604 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:55.094275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:55.135289 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-91d207c0-b8f4-40b2-a107-308add3432cb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055214 Nov 20 21:31:55.135965 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3759/7626] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:55 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:56.147880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:56.148890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:56.157023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:56.157477 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:56.158298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:56.158751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:56.197160 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1255865d-1ce1-4c19-b134-328568a50adc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053201 Nov 20 21:31:56.198037 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3868/7627] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:56 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:57.209212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:57.210263 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:57.217601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:57.218067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:57.219539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:57.219970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:57.259416 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b220941a-d2e9-48b5-b77e-993c0281a799 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053938 Nov 20 21:31:57.260197 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3760/7628] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:57 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:58.272179 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:58.273188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:58.280563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:58.281050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:58.281837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:58.282310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:58.321754 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-70068616-81d4-4d97-92a4-ecb299ea59a9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053548 Nov 20 21:31:58.322481 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3869/7629] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:58 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:31:59.334404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:31:59.335431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:31:59.342779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:59.343831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:59.344775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:31:59.345215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:31:59.384526 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-308baaa9-1088-4779-9736-75188652d3f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054134 Nov 20 21:31:59.385160 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3761/7630] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:31:59 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:00.396893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:00.397941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:00.405064 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:00.406069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:00.406873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:00.407324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:00.446525 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0caf0e46-207f-4d50-8757-8913fe05508e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053569 Nov 20 21:32:00.447417 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3870/7631] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:00 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:32:01.458946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:01.459946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:01.467277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:01.467729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:01.468529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:01.468968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:01.511887 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-193070eb-86ea-41d3-8567-958fd335224e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.056895 Nov 20 21:32:01.512803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3762/7632] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:01 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:02.524060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:02.525077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:02.532577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:02.533019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:02.533799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:02.534288 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:02.575918 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e7b1c3c-26e1-43bc-9940-97feaaa9bca5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055823 Nov 20 21:32:02.576561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3871/7633] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:02 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:32:03.589098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:03.590148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:03.597504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:03.597972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:03.598759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:03.599197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:03.644246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd311428-7e09-40da-be79-8982ac64e752 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.059118 Nov 20 21:32:03.644884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3763/7634] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:03 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:04.656124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:04.657133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:04.664543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:04.665010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:04.665804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:04.666289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:04.706898 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-610180f8-973f-44a2-bfa6-f2b3dd129d21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054782 Nov 20 21:32:04.707546 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3872/7635] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:04 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:05.721812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:05.722844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:05.730107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:05.730564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:05.731346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:05.731787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:05.773318 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c18541d9-5451-49cf-a57a-c2e73682e26f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055947 Nov 20 21:32:05.773971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3764/7636] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:05 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:06.785688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:06.786656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:06.794160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:06.794653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:06.795455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:06.795940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:06.836833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dc119d87-b98f-4b1c-8ffa-b50fbe26c49c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055555 Nov 20 21:32:06.837480 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3873/7637] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:06 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:07.848988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:07.849966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:07.857290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:07.857740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:07.858568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:07.859014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:07.902575 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6243ba1d-c7f7-4a20-8257-e6e7a1e31188 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.057600 Nov 20 21:32:07.903220 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3765/7638] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:07 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:08.914996 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:08.916011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:08.923855 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:08.924327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:08.925118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:08.925572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:08.964971 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0703327e-3d1b-47d3-b44d-4087ff782e96 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054004 Nov 20 21:32:08.965601 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3874/7639] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:08 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:09.977078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:09.978095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:09.985656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:09.986135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:09.986916 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:09.987352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:10.028179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5e9a44e1-6e7a-42f4-a35b-513f99ee986e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055104 Nov 20 21:32:10.028841 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3766/7640] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:09 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:11.040700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:11.041712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:11.049227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:11.049692 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:11.050511 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:11.050991 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:11.090380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1db88abd-01c1-48e3-b412-7cd7fcf2848f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.053637 Nov 20 21:32:11.091044 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3875/7641] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:11 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:12.103415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:12.105062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:12.113141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:12.113638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:12.114465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:12.114912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:12.154615 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-253f1d7e-40c1-4d45-b951-b227e515b21a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055116 Nov 20 21:32:12.155796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3767/7642] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:12 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:13.167281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:13.168324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:13.176360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:13.176825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:13.177620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:13.178091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:13.217708 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8571f6c-1358-41d8-b0f7-d453ca7b6426 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054423 Nov 20 21:32:13.219094 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3876/7643] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:13 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:14.230763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:14.231758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:14.239195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:14.239644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:14.240423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:14.241129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:14.281193 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3fe9acc-c312-4501-9624-a1dcbfc78a0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054527 Nov 20 21:32:14.281854 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3768/7644] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:14 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:15.293463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:15.294507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:15.303107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:15.303578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:15.304377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:15.304826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:15.347471 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-09e1961e-be21-49f7-8a6b-f470f1ccf55c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.058187 Nov 20 21:32:15.348133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3877/7645] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:15 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:16.359545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:16.360528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:16.368027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:16.368477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:16.369254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:16.369689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:16.409440 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8a541a7-340e-494f-b3b2-cdc87b741f8b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.054194 Nov 20 21:32:16.411581 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3769/7646] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:16 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:17.422409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:17.423453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:17.431118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:17.431574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:17.432362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:17.432802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:17.473022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-562c83b4-072d-415d-8ab9-58acae1b12e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 32637 microversion: 2.1 time: 0.055114 Nov 20 21:32:17.473677 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3878/7647] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:17 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 32637 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:18.486701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:18.487718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:18.495258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:18.495707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:18.496486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:18.496923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:18.549371 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-11f2a3f7-88b1-4847-96ab-96054694c582 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 200 len: 40781 microversion: 2.1 time: 0.067923 Nov 20 21:32:18.550032 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3770/7648] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:18 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 40781 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:32:18.561887 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30fec600-8e08-4c99-813c-31f2a3f3ec10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:18.569202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30fec600-8e08-4c99-813c-31f2a3f3ec10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:18.569664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30fec600-8e08-4c99-813c-31f2a3f3ec10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:18.592465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30fec600-8e08-4c99-813c-31f2a3f3ec10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:32:18.633072 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30fec600-8e08-4c99-813c-31f2a3f3ec10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 202 len: 0 microversion: 2.1 time: 0.075212 Nov 20 21:32:18.633688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3879/7649] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:18 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:32:18.643965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:18.644774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:18.652174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:18.653463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:18.654676 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:18.655134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:18.865765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:18.874590 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a75988c6-7683-413d-82b9-59dad1185a76 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.234585 Nov 20 21:32:18.875212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3771/7650] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:18 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:19.893350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:19.894107 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:19.900199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:19.900650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:19.901435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:19.901879 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:20.091571 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:20.099508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a1de82e-8d69-4c3a-b221-64dd6ef525ce tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.211231 Nov 20 21:32:20.100132 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3880/7651] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:19 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:21.117014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:21.117657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:21.126383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:21.126839 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:21.127629 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:21.128073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:21.258298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:21.266004 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-813b2823-6769-4ed8-9f15-5ab8fc6d0c78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.152978 Nov 20 21:32:21.266605 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3772/7652] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:21 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:22.284416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:22.285086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:22.291909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:22.292371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:22.293160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:22.293610 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:22.423904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:22.431282 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b22eeb3d-84ee-456b-81d0-1d4669610d4e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.151350 Nov 20 21:32:22.431890 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3881/7653] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:22 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:23.448439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:23.449077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:23.455901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:23.456350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:23.457126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:23.457561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:23.589188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:23.597228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5ac72e53-00c4-4d89-8ae2-a6aa968b4f0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.152509 Nov 20 21:32:23.597799 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3773/7654] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:23 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:24.614402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:24.615021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:24.622089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:24.622560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:24.623348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:24.623797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:25.070795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:25.078132 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0ec20bef-ffb7-4b33-8003-5d04deb886c8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.467500 Nov 20 21:32:25.079283 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3882/7655] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:24 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:32:26.096121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:26.096718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:26.103545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:26.103998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:26.104767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:26.105208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:26.241749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:26.249130 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e60ac93-a2f9-42d3-ada3-9668b049e100 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.157217 Nov 20 21:32:26.249803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3774/7656] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:26 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:27.266302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:27.266934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:27.273760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:27.274265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:27.275066 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:27.275521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:27.407140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:27.414488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f9b50bc-97f3-4960-be09-c44f661e6460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.152102 Nov 20 21:32:27.415083 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3883/7657] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:27 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:28.432042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:28.432753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:28.440309 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:28.440763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:28.441558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:28.442005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:28.651685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:28.659117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0654a290-a402-4355-8210-a4627cc24a7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.230787 Nov 20 21:32:28.659903 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3775/7658] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:28 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:29.677248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:29.677784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:29.684197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.684650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:29.685433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.685871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:29.819366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:29.826684 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4a1898fd-e0b3-4e60-bb7e-546fd2b9b555 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1656 microversion: 2.1 time: 0.153275 Nov 20 21:32:29.827256 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3884/7659] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:29 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1656 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:29.843400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:29.845077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:29.851848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.852303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:29.853091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.853535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:29.880128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:29.885705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Old instance type m1.heat2, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:32:29.892140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:32:29.892564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:32:29.893039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:32:29.893449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:32:29.893863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:32:29.952577 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-96afd298-d98c-46c1-9b00-b49453540d3d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 202 len: 0 microversion: 2.1 time: 0.112800 Nov 20 21:32:29.953892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3776/7660] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:29 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:32:29.961543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:29.962282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:29.968339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.969653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:29.970645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:29.971090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:30.104221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:30.112284 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c56ad6c4-4229-49b7-89f3-491de3c43278 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.154397 Nov 20 21:32:30.112869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3885/7661] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:29 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:31.130171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:31.130842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:31.140724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:31.141188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:31.141987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:31.142452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:31.379834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:31.387354 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0d04fbd-0ca6-4624-b8ce-0a51944046d4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1679 microversion: 2.1 time: 0.261689 Nov 20 21:32:31.387857 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3777/7662] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:31 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:32.404460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:32.405077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:32.412475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:32.412932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:32.413718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:32.414190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:32.546165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:32.554352 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fcfcf3c7-b953-4458-9e4e-e481d325cc21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1684 microversion: 2.1 time: 0.153537 Nov 20 21:32:32.554932 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3886/7663] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:32 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:33.573626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:33.574437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:33.581298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:33.581787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:33.582624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:33.583360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:33.769463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:33.776845 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-273da5a9-b1e4-4ec9-b40c-2c4c8688c9b6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1683 microversion: 2.1 time: 0.208852 Nov 20 21:32:33.777429 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3778/7664] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:33 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:34.177221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "name": "network-vif-unplugged", "status": "completed", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:34.178775 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:34.178775 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:32:34.185994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:34.186513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:34.199844 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] Creating event network-vif-unplugged:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch2-master-1 Nov 20 21:32:34.205788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] Instance 15807139-1482-45f2-bba9-2c1fae724944 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:32:34.217183 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f63735b8-21ac-4ba2-81ae-134c929c440d req-56436a41-412c-49dc-94d2-6175c8b00ba9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112252 Nov 20 21:32:34.218150 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3887/7665] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:32:34.794619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:34.795132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:34.802093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:34.802534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:34.803532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:34.803970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:35.027152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:35.034488 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3d72c8fc-cb93-49bc-9fd5-cd37797faa29 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1683 microversion: 2.1 time: 0.243576 Nov 20 21:32:35.035065 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3779/7666] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:34 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:36.052929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:36.053635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:36.060032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:36.060429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:36.061216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:36.061662 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:36.195720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:36.203021 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d05fbb2-5213-4fec-89e8-e5e66dc461f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1681 microversion: 2.1 time: 0.155170 Nov 20 21:32:36.203600 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3888/7667] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:36 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:36.232600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:36.234132 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:36.234132 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:32:36.242253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:36.242698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:36.254678 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] Creating event network-changed:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch2-master-1 Nov 20 21:32:36.259798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] Instance 15807139-1482-45f2-bba9-2c1fae724944 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:32:36.271455 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-330346b4-5870-402c-a407-8394de0f263e req-b5552357-e59d-42de-843d-7a123f90a128 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042694 Nov 20 21:32:36.272297 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3780/7668] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:36.717942 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:32:36.718221 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:32:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:32:37.221504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:37.222083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:37.228792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.229253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.230063 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.230521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.361212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:37.368838 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-706cf172-4d40-4b2f-bf9c-82feaa2fde85 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1677 microversion: 2.1 time: 0.151998 Nov 20 21:32:37.369422 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3889/7669] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:37 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:37.387206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:37.387850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:37.394686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.395138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.395911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.396346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.452328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0c197cb3-436b-44be-83c9-3576375f55e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 204 len: 0 microversion: 2.1 time: 0.070032 Nov 20 21:32:37.452969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3781/7670] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:37 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:32:37.470676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:37.471335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:37.477602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.478041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.478886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:37.479342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:37.624195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:37.633155 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d968303-336b-486d-afb8-832cdbbe29b4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1677 microversion: 2.1 time: 0.175204 Nov 20 21:32:37.633743 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3890/7671] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:37 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:38.652389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:38.652997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:38.659125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:38.659574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:38.660358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:38.660800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:38.810041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:38.818010 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02399975-c47f-4ab8-8867-61bbab3ae696 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1656 microversion: 2.1 time: 0.170585 Nov 20 21:32:38.818608 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3782/7672] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:38 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:38.834273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:38.834903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:38.841759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:38.842253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:38.843073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:38.843538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:38.974715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:38.982081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7b2e0695-6344-414b-a543-7c6dc0032be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1656 microversion: 2.1 time: 0.151528 Nov 20 21:32:38.982680 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3891/7673] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:38 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:38.998905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-281b0263-40ed-4814-ad1e-b4fd39d24233 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:39.005601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-281b0263-40ed-4814-ad1e-b4fd39d24233 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:39.006085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-281b0263-40ed-4814-ad1e-b4fd39d24233 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:39.027712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-281b0263-40ed-4814-ad1e-b4fd39d24233 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Going to try to start instance {{(pid=140942) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:32:39.071274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-281b0263-40ed-4814-ad1e-b4fd39d24233 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action" status: 202 len: 0 microversion: 2.1 time: 0.075889 Nov 20 21:32:39.071891 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3783/7674] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:38 2021] POST /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:32:39.080196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:39.083407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:39.090268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:39.090898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:39.091860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:39.092281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:39.229654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:39.239458 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-607c86a0-e614-4934-bbd9-7678b6384d3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1665 microversion: 2.1 time: 0.162771 Nov 20 21:32:39.240812 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3892/7675] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:39 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1665 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:40.261761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:40.262637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:40.269142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.269593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.270420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.270863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.404231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:40.412324 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4eb7106a-d862-4f88-a8d4-88d44b1ac43a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1669 microversion: 2.1 time: 0.155456 Nov 20 21:32:40.412903 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3784/7676] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:40 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:40.429933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:40.430580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:40.437148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.437591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.438892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.439761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.467346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:32:40.518086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a3164311-63db-49af-929f-b0abe28ce5d3 req-75aacb61-7242-45e4-8317-22e3f7b921b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "name": "network-vif-plugged", "status": "completed", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:40.520359 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:40.520359 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:32:40.529301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a3164311-63db-49af-929f-b0abe28ce5d3 req-75aacb61-7242-45e4-8317-22e3f7b921b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.529757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a3164311-63db-49af-929f-b0abe28ce5d3 req-75aacb61-7242-45e4-8317-22e3f7b921b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.543731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a3164311-63db-49af-929f-b0abe28ce5d3 req-75aacb61-7242-45e4-8317-22e3f7b921b6 service nova] Creating event network-vif-plugged:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch2-master-1 Nov 20 21:32:40.548628 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a3164311-63db-49af-929f-b0abe28ce5d3 req-75aacb61-7242-45e4-8317-22e3f7b921b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119648 Nov 20 21:32:40.549315 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3785/7677] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:40.561731 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0b3fda4-ebc5-4c97-8802-2ff046c6cb80 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 204 len: 0 microversion: 2.1 time: 0.135858 Nov 20 21:32:40.563136 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3893/7678] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:32:40 2021] DELETE /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:32:40.572037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:40.572734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:40.579854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.580352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.581197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:40.581639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:40.712590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:40.720104 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32aaf6eb-652a-49dd-984f-0a9c29f5d122 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1675 microversion: 2.1 time: 0.152103 Nov 20 21:32:40.720817 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3786/7679] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:40 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:32:41.737757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:41.738483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:41.745399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:41.745861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:41.746755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:41.747206 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:41.881420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:41.889094 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff824d62-bd22-483a-bbbd-d0baf072d5cc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 200 len: 1675 microversion: 2.1 time: 0.155693 Nov 20 21:32:41.889672 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3894/7680] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:41 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:42.698292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1013c193-3f4d-4ccb-bb55-61557367534f req-300d057f-177c-4fd0-8c52-f4ec8aab9f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15807139-1482-45f2-bba9-2c1fae724944", "name": "network-vif-deleted", "tag": "2c8be03d-8f8c-464a-900f-e21e7b690b9e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:42.700650 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:42.700650 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:32:42.711385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1013c193-3f4d-4ccb-bb55-61557367534f req-300d057f-177c-4fd0-8c52-f4ec8aab9f28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:42.711833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1013c193-3f4d-4ccb-bb55-61557367534f req-300d057f-177c-4fd0-8c52-f4ec8aab9f28 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:42.725384 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1013c193-3f4d-4ccb-bb55-61557367534f req-300d057f-177c-4fd0-8c52-f4ec8aab9f28 service nova] Creating event network-vif-deleted:2c8be03d-8f8c-464a-900f-e21e7b690b9e for instance 15807139-1482-45f2-bba9-2c1fae724944 on nch2-master-1 Nov 20 21:32:42.730936 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1013c193-3f4d-4ccb-bb55-61557367534f req-300d057f-177c-4fd0-8c52-f4ec8aab9f28 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036396 Nov 20 21:32:42.731548 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3787/7681] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:42.907753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:42.909142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:42.929659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:42.933207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:42.934092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:42.934567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:42.949335 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. Nov 20 21:32:42.949942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:32:42.950829 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5ef99064-9204-41a0-83f1-1a442b06a330 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 404 len: 111 microversion: 2.1 time: 0.047208 Nov 20 21:32:42.951389 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3895/7682] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:42 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:32:43.004523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:43.005489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:43.011747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:43.012202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:43.013173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:43.013615 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:43.027659 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. Nov 20 21:32:43.028259 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:32:43.029232 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59604e08-aa54-4339-869c-471f715da5a0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 404 len: 111 microversion: 2.1 time: 0.030002 Nov 20 21:32:43.029790 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3788/7683] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:42 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:32:43.077111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-723764457", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "4c5f91b7-b565-4458-971f-538d019cd893"}], "security_groups": [{"name": "tempest-securitygroup--329218344"}], "key_name": "tempest-keypair-1679284054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:43.179937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] validate_networks() for [('4c5f91b7-b565-4458-971f-538d019cd893', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:32:43.639007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:32:43.639512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:32:43.640096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:32:43.640518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:32:43.640934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:32:43.650664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:43.651129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:43.651968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:43.652479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:43.669470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:32:43.674779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:32:43.687101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:32:43.690252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:32:43.742748 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d2c75853-988d-4755-ae6d-e37ca414cd31 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.669243 Nov 20 21:32:43.743651 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3896/7684] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:32:43 2021] POST /compute/v2.1/servers => generated 405 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:32:43.754724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e616cf7c-df09-4891-960c-d1c2c66693d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:43.755340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e616cf7c-df09-4891-960c-d1c2c66693d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:43.812774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e616cf7c-df09-4891-960c-d1c2c66693d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:43.820336 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e616cf7c-df09-4891-960c-d1c2c66693d5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1238 microversion: 2.1 time: 0.070603 Nov 20 21:32:43.820911 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3789/7685] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:43 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:44.839242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:44.839884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:44.847523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:44.847986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:44.848783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:44.849233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:44.912513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:44.924628 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-eea2c5f4-4b2e-45d8-91b4-a6675ee69def tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1296 microversion: 2.1 time: 0.089638 Nov 20 21:32:44.925236 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3897/7686] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:44 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:45.942688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:45.943285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:45.950577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:45.951276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:45.952354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:45.953394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:45.974796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-83e456ec-4eff-4494-94d8-25214dceeba3 req-1454ea5e-ca5c-4faa-9357-47141df91b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:45.979086 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:45.979086 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:32:46.001803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-83e456ec-4eff-4494-94d8-25214dceeba3 req-1454ea5e-ca5c-4faa-9357-47141df91b81 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:46.002376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-83e456ec-4eff-4494-94d8-25214dceeba3 req-1454ea5e-ca5c-4faa-9357-47141df91b81 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:46.016182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-83e456ec-4eff-4494-94d8-25214dceeba3 req-1454ea5e-ca5c-4faa-9357-47141df91b81 service nova] Creating event network-changed:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:32:46.023766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-83e456ec-4eff-4494-94d8-25214dceeba3 req-1454ea5e-ca5c-4faa-9357-47141df91b81 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053650 Nov 20 21:32:46.024466 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3898/7687] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:46.205985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:46.213624 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2309e283-713e-4cf8-b429-e20608866255 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.275328 Nov 20 21:32:46.218906 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3790/7688] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:45 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:47.232535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:47.233152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:47.239488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:47.239952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:47.241004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:47.241453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:47.377158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:47.384485 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f41d9337-fccf-45ca-ac48-9c2929bedd8f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.156951 Nov 20 21:32:47.385066 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3899/7689] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:47 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:48.402204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:48.402847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:48.409637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:48.410128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:48.410921 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:48.411366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:48.548993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:48.556666 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2e00541e-a72e-4c71-9ce3-6b12e5259eb3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.158248 Nov 20 21:32:48.557242 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3791/7690] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:48 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:49.574195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:49.574748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:49.582217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:49.582690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:49.583490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:49.583943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:49.713860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:49.721179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-513da093-3bf9-4554-9d37-9998314b29dd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.150850 Nov 20 21:32:49.721754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3900/7691] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:49 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:50.738417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:50.739592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:50.746065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:50.746538 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:50.747326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:50.747767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:50.881355 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:50.889295 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3eb20599-b0b3-46ce-8a76-d57cac4009e4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.154738 Nov 20 21:32:50.889882 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3792/7692] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:50 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:51.232652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-24ab69a0-ddad-403c-a25f-966e3a8b0260 req-3c7d3119-9f13-474b-acda-05145a6b9bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "name": "network-vif-plugged", "status": "completed", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:51.234395 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:51.234395 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:32:51.244687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-24ab69a0-ddad-403c-a25f-966e3a8b0260 req-3c7d3119-9f13-474b-acda-05145a6b9bd9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:51.245132 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-24ab69a0-ddad-403c-a25f-966e3a8b0260 req-3c7d3119-9f13-474b-acda-05145a6b9bd9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:51.257382 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-24ab69a0-ddad-403c-a25f-966e3a8b0260 req-3c7d3119-9f13-474b-acda-05145a6b9bd9 service nova] Creating event network-vif-plugged:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:32:51.262375 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-24ab69a0-ddad-403c-a25f-966e3a8b0260 req-3c7d3119-9f13-474b-acda-05145a6b9bd9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033520 Nov 20 21:32:51.262982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3901/7693] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:51.906526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:51.907627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:51.914376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:51.914827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:51.915598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:51.916034 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:52.048878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:52.056084 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d263c18-5765-46e6-a77c-f9f827d35393 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1363 microversion: 2.1 time: 0.153290 Nov 20 21:32:52.056655 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3793/7694] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:51 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:53.073937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:53.074665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:53.080868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:53.081327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:53.082137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:53.082579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:53.218322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:32:53.226440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-69f6410f-e189-443d-816e-5bcc79f0dbfb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1551 microversion: 2.1 time: 0.157324 Nov 20 21:32:53.227016 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3902/7695] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:32:53 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:32:53.244117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:32:53.244593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:53.251808 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:53.252252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:53.253027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:53.253462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:53.331375 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4211cb11-0109-421a-8eef-58be2281d40f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091121 Nov 20 21:32:53.331971 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3794/7696] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:32:53 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:54.602732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:54.604258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:54.605518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4400a857-bbc1-4ef7-9dfd-cb3ed40edba0 req-cb30298a-4506-4ec2-913d-e74d71930a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:54.607556 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:32:54.607556 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:32:54.611512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:54.611983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:54.613062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:54.617772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:54.620562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4400a857-bbc1-4ef7-9dfd-cb3ed40edba0 req-cb30298a-4506-4ec2-913d-e74d71930a5b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:54.621255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4400a857-bbc1-4ef7-9dfd-cb3ed40edba0 req-cb30298a-4506-4ec2-913d-e74d71930a5b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:54.633360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4400a857-bbc1-4ef7-9dfd-cb3ed40edba0 req-cb30298a-4506-4ec2-913d-e74d71930a5b service nova] Creating event network-changed:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:32:54.638533 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4400a857-bbc1-4ef7-9dfd-cb3ed40edba0 req-cb30298a-4506-4ec2-913d-e74d71930a5b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Nov 20 21:32:54.639715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3795/7697] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:32:54.654992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c3b2702-269d-4473-8015-d2b2d055d5f8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.056276 Nov 20 21:32:54.659114 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3903/7698] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:54 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:32:55.668475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:55.669389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:55.676645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:55.677102 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:55.677915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:55.678361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:55.722498 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bfbc680d-f07b-439d-b7d3-1f7ba21ac57f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.058848 Nov 20 21:32:55.725734 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3796/7699] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:55 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:32:56.733279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:56.734346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:56.742807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:56.742980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:56.743782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:56.744230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:56.785719 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af9fc9b6-e36e-41ad-bc6e-65c588a910b7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.056298 Nov 20 21:32:56.786304 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3904/7700] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:56 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:32:57.797141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:57.798831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:57.806550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:57.807012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:57.807812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:57.808265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:57.847585 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee8d6859-19d6-4a19-8c90-b2b0b34365ad tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.054563 Nov 20 21:32:57.848203 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3797/7701] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:57 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:32:58.859225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:58.860858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:58.868580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:58.869042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:58.869827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:58.870302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:58.909898 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af201951-3116-4df5-82cd-db818d54874c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.054623 Nov 20 21:32:58.910572 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3905/7702] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:58 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:32:59.921311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:32:59.922910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:32:59.930266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:59.930715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:59.931496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:32:59.931934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:32:59.968512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b728b38b-ac05-453f-aa6a-3cd13b2dee7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.051242 Nov 20 21:32:59.969237 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3798/7703] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:32:59 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:33:00.980364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:00.981373 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:00.988636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:00.989102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:00.989899 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:00.990717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:01.028929 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-86b153dd-e16e-4fc9-8e9e-6b22777d2a35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.052462 Nov 20 21:33:01.029567 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3906/7704] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:00 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:33:02.040450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:02.041474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:02.048765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:02.049216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:02.049993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:02.050467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:02.089957 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b02c53f4-0c23-42df-8a10-32901b65964d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.053447 Nov 20 21:33:02.090617 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3799/7705] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:02 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:33:03.101661 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:03.103025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:03.111301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:03.111850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:03.112637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:03.113092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:03.153651 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0050cf9-b8e7-449a-8e1d-1f9dbf140964 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.054590 Nov 20 21:33:03.154521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3907/7706] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:03 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:33:04.166197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:04.167199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:04.175115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:04.175570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:04.176356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:04.176797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:04.216372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-447c1ee3-8ecc-4453-8adc-1a427554f69d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 14 microversion: 2.1 time: 0.054273 Nov 20 21:33:04.216998 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3800/7707] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:04 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:33:05.227916 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:05.228919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:05.236494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:05.236961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:05.237757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:05.238265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:05.288041 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b80978e-3c0c-411e-9dfa-93d214c0cc53 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 8203 microversion: 2.1 time: 0.064044 Nov 20 21:33:05.288671 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3908/7708] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:05 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 8203 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:33:06.300300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:06.301291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:06.308709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:06.309165 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:06.309950 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:06.310420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:06.361372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98532287-4a4b-4a1f-863a-8361546c6e9b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 16394 microversion: 2.1 time: 0.065590 Nov 20 21:33:06.362011 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3801/7709] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:06 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 16394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:07.372525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:07.373535 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:07.381569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:07.382056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:07.382861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:07.383310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:07.421142 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7d60144-188b-4232-ac4d-6a4e36b5fa3a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 16394 microversion: 2.1 time: 0.052555 Nov 20 21:33:07.421786 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3909/7710] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:07 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 16394 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:33:08.432563 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:08.433588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:08.441371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:08.441822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:08.442703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:08.443139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:08.483366 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3923446-e7d4-45f5-814d-44a1d1119d10 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 16394 microversion: 2.1 time: 0.054781 Nov 20 21:33:08.483985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3802/7711] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:08 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 16394 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:09.496039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:09.497041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:09.504292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:09.504755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:09.505541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:09.505984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:09.551759 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9926e777-a585-46af-9264-701cbda0b178 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 16394 microversion: 2.1 time: 0.059654 Nov 20 21:33:09.552414 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3910/7712] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:09 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 16394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:10.563345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:10.564336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:10.571639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:10.572087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:10.572863 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:10.573304 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:10.621192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6a0c167b-9ded-4f1c-a73d-9d4bf8eb1a42 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.061885 Nov 20 21:33:10.621954 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3803/7713] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:10 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:11.633283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:11.634351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:11.642422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:11.642889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:11.643683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:11.644134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:11.682955 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-078f10f6-c90c-4460-a891-c804cfe0a6fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.053691 Nov 20 21:33:11.683811 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3911/7714] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:11 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:12.695635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:12.696717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:12.704861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:12.705306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:12.706110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:12.706551 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:12.746287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3f20778-397c-434f-b481-76558e798795 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.055051 Nov 20 21:33:12.746968 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3804/7715] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:12 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:13.758665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:13.759678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:13.767103 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:13.767566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:13.768355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:13.768804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:13.808675 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17a7b3ee-9709-471a-b207-5685574ed41d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.053962 Nov 20 21:33:13.809244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3912/7716] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:13 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:14.821411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:14.822380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:14.829327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:14.829778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:14.830579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:14.831017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:14.873832 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec141cf3-ba92-4191-b3c4-546dad457e17 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.056752 Nov 20 21:33:14.874721 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3805/7717] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:14 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:15.886388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:15.887428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:15.895175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:15.895633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:15.896422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:15.896868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:15.935180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2c6926d-feb7-41fd-a259-8e1a5d3ef7df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.052773 Nov 20 21:33:15.935818 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3913/7718] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:15 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:16.947659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:16.948666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:16.956790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:16.957243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:16.958027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:16.958495 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:16.999535 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-17fb514f-c92a-4390-ac1b-6a16660d007a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.055609 Nov 20 21:33:17.000624 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3806/7719] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:16 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:18.011365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:18.012382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:18.019884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:18.020350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:18.021140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:18.021589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:18.061672 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e920fbce-bafb-440b-8be6-90eab91c06b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.054294 Nov 20 21:33:18.062351 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3914/7720] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:18 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:19.123161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:19.124172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:19.131783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:19.132234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:19.133006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:19.133446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:19.170772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e166cc3-db22-4ae5-8864-cc1e7b4457e6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.100941 Nov 20 21:33:19.171380 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3807/7721] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:19 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:20.183313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:20.184332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:20.191954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:20.192415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:20.193208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:20.193657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:20.234304 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b22fbbc-4a1d-4272-8702-232f4f7e6fa4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.054882 Nov 20 21:33:20.234934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3915/7722] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:20 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:21.246520 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:21.247578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:21.255087 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:21.255549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:21.256343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:21.256791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:21.297336 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-809ff43c-8c60-4aaa-953d-5ba9b35c25ef tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.054131 Nov 20 21:33:21.298288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3808/7723] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:21 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:22.309736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:22.310780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:22.318635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:22.319126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:22.319919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:22.320365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:22.362113 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d922078-3501-49f2-b4ba-ae7b570e93c0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 24566 microversion: 2.1 time: 0.056386 Nov 20 21:33:22.362836 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3916/7724] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:22 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 24566 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:23.374459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:23.376011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:23.383276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:23.383725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:23.384507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:23.384946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:23.433902 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-757a7963-670f-4c69-b2b7-fe034455d8b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.063436 Nov 20 21:33:23.434579 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3809/7725] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:23 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:24.446961 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:24.447967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:24.455896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:24.456416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:24.457210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:24.457655 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:24.497487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe7a845d-b401-4974-a3cc-8e9719c7fb35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054434 Nov 20 21:33:24.498141 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3917/7726] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:24 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:25.509399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:25.510461 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:25.518526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:25.519020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:25.519820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:25.520262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:25.560110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7562193a-0c3a-4a8a-8130-52d88698e554 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054696 Nov 20 21:33:25.560751 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3810/7727] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:25 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:26.573375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:26.574454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:26.581758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:26.582267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:26.583059 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:26.583509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:26.624176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-180cd07f-6d1d-458b-8e20-26e630903272 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054786 Nov 20 21:33:26.624869 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3918/7728] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:26 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:27.636679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:27.637689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:27.645268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:27.645727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:27.646543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:27.646987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:27.689327 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c4fd84d0-b8de-4d08-be5f-c1038f08a60f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056602 Nov 20 21:33:27.689985 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3811/7729] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:27 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:28.701686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:28.703348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:28.710869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:28.711278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:28.712086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:28.712548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:28.754506 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ac5d48cf-0192-4c01-b366-ca2775ae5409 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056769 Nov 20 21:33:28.755642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3919/7730] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:28 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:29.767567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:29.768609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:29.776043 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:29.776499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:29.777281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:29.777722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:29.818350 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4ff2cdde-0793-4e38-9ccd-8823cfe83b21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055392 Nov 20 21:33:29.818941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3812/7731] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:29 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:33:30.830568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:30.831617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:30.838751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:30.839217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:30.840042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:30.840482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:30.880680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a1f689b3-3d1e-4e33-83d1-189a2b127fb1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054161 Nov 20 21:33:30.881330 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3920/7732] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:30 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:31.893665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:31.894695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:31.902018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:31.902504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:31.903294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:31.903735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:31.942552 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-186b5b7f-844f-458e-8fe9-2c41f34d4c8c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053583 Nov 20 21:33:31.943186 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3813/7733] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:31 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:32.955529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:32.956545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:32.963785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:32.964244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:32.965034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:32.965481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:33.005964 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2d6a7bc5-e221-4db0-ad71-39c78fc60a22 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055142 Nov 20 21:33:33.006642 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3921/7734] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:32 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:34.017278 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:34.018318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:34.025644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:34.026132 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:34.026929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:34.027378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:34.069511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f3ca3998-5240-4f2f-a9c0-e26c357c3783 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056276 Nov 20 21:33:34.070176 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3814/7735] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:34 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:35.081818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:35.082851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:35.090033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:35.090529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:35.091315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:35.091762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:35.135125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e70c3ed6-0e8d-44c6-bc00-3e9203aa25f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.057848 Nov 20 21:33:35.135798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3922/7736] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:35 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:36.147296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:36.148289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:36.156066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:36.156526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:36.157302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:36.157742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:36.196383 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69b03a12-c42e-4174-900d-ae6cff91f230 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053020 Nov 20 21:33:36.197012 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3815/7737] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:36 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:37.209076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:37.210150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:37.217311 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:37.217772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:37.219400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:37.219849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:37.259157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4193c805-c7f7-4837-ad59-3724d3875e11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054027 Nov 20 21:33:37.259779 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3923/7738] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:37 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:38.271947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:38.272987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:38.280383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:38.281389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:38.282206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:38.282649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:38.321963 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57113882-6059-43b8-8801-48a1e93ece87 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054115 Nov 20 21:33:38.322648 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3816/7739] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:38 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:33:39.333999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:39.335024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:39.342299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:39.342760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:39.343547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:39.343989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:39.384412 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9681227-5aff-4c83-bd5a-da2b3574ed2b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054338 Nov 20 21:33:39.385057 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3924/7740] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:39 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:33:40.398292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:40.399291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:40.407155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:40.407610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:40.408399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:40.408841 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:40.450921 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c0de7a4-0602-4012-a099-ea5e103f3820 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.058084 Nov 20 21:33:40.451575 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3817/7741] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:40 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:41.463707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:41.464727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:41.472835 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:41.473298 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:41.474122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:41.474579 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:41.514833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2ad22f5c-7fb3-4d67-a367-2a5a1fed7e0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054962 Nov 20 21:33:41.515535 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3925/7742] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:41 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:42.527268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:42.528332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:42.535986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:42.536437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:42.537225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:42.537663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:42.577313 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3ecc898-1370-4379-8a0c-bb36a0ab0869 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054012 Nov 20 21:33:42.577942 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3818/7743] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:42 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:43.588917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:43.589937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:43.598641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:43.599057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:43.599884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:43.600332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:43.641360 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3cd088fd-6248-4cb1-bdb5-ba65c382ad13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056425 Nov 20 21:33:43.642314 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3926/7744] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:43 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:44.653331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:44.654366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:44.662076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:44.662545 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:44.663332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:44.663774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:44.701862 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0c51ca9-30d8-492e-9e9c-7f3a0a1b42c6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.052571 Nov 20 21:33:44.703089 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3819/7745] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:44 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:45.715086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:45.716126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:45.723801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:45.724415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:45.725262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:45.725715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:45.769979 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d813bcb6-d8a4-4fb0-9c2f-5859a5d79769 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.059309 Nov 20 21:33:45.770654 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3927/7746] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:45 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:46.782549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:46.783564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:46.791167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:46.791561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:46.792351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:46.792802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:46.833018 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd33764a-046a-4ea8-ab47-a0b85629f24b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054458 Nov 20 21:33:46.833671 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3820/7747] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:46 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:47.846145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:47.847051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:47.854343 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:47.854801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:47.855593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:47.856043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:47.898867 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-62a77b1b-87d9-4eba-b500-24a053f72570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.057528 Nov 20 21:33:47.899518 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3928/7748] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:47 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:48.911686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:48.912715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:48.920210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:48.920728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:48.921653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:48.922830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:48.965768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-616207b5-8523-43a1-b19d-773f7446901b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.058012 Nov 20 21:33:48.966461 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3821/7749] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:48 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:49.979361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:49.980391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:49.988212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:49.988671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:49.989716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:49.990190 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:50.030241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bcd43e61-d0d1-47f4-b1dd-4ac3ea1d127e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054797 Nov 20 21:33:50.030892 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3929/7750] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:49 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:51.041852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:51.042899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:51.051070 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:51.051534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:51.052325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:51.052777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:51.091768 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bec4ea69-2bba-461e-a803-316c841b48a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053962 Nov 20 21:33:51.092411 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3822/7751] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:51 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:52.104666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:52.105684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:52.113711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:52.114191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:52.115244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:52.115689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:52.155630 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7e235e2-47d0-40ef-87a5-613b60b77492 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054937 Nov 20 21:33:52.156274 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3930/7752] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:52 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:53.168109 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:53.169115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:53.176467 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:53.176930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:53.177724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:53.178225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:53.220221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d4fbc03-0f0b-40ff-8d49-578062d3196b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056143 Nov 20 21:33:53.220892 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3823/7753] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:53 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:33:54.232965 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:54.234020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:54.242569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:54.243040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:54.243839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:54.244295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:54.283022 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-53fcae40-5c50-4bcd-9445-10ee943c55cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054067 Nov 20 21:33:54.283667 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3931/7754] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:54 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:55.295277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:55.296281 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:55.304207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:55.304664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:55.305449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:55.305891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:55.346839 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2348ed41-b97d-47b8-b56b-9b6fe6907074 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055461 Nov 20 21:33:55.347538 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3824/7755] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:55 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:56.359258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:56.360301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:56.368123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:56.368589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:56.369380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:56.369830 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:56.410756 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1285b32c-146f-4560-927c-b19d35a6f944 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055392 Nov 20 21:33:56.411574 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3932/7756] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:56 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:57.423293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:57.424323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:57.432125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:57.432576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:57.433365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:57.433833 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:57.474814 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b7a277c1-b206-42bb-af6f-941ddb850e08 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054839 Nov 20 21:33:57.475456 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3825/7757] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:57 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:58.487218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:58.488228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:58.497409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:58.497863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:58.498677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:58.499154 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:58.539839 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bca7f504-eb76-4121-9d7e-93045e81f09a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056588 Nov 20 21:33:58.540494 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3933/7758] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:58 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:33:59.552250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:33:59.553578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:33:59.561221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:59.561673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:59.562489 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:33:59.562925 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:33:59.603843 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57ecddaa-15ee-4ca4-b534-144c9e106345 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055730 Nov 20 21:33:59.604488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3826/7759] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:33:59 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:00.617079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:00.618155 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:00.625018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:00.625468 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:00.626309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:00.626779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:00.668140 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e52892a7-8537-4348-8ba2-9e2d71e30ee4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056046 Nov 20 21:34:00.668786 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3934/7760] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:00 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:01.680836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:01.681868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:01.689160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:01.689620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:01.690440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:01.690882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:01.730731 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-53a07033-0e0e-4823-a4b9-1a39d3bddee1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054073 Nov 20 21:34:01.731368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3827/7761] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:01 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:02.743807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:02.745417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:02.752982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:02.753439 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:02.754263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:02.754705 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:02.795676 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a727f77b-6d01-4883-9bd3-4cd00d1cf893 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056541 Nov 20 21:34:02.796481 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3935/7762] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:02 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:03.808039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:03.808939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:03.816279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:03.816738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:03.817523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:03.817969 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:03.856872 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7021d73d-57d9-4b7c-ac51-11ca4deb9f64 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.052876 Nov 20 21:34:03.857531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3828/7763] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:03 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:04.869573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:04.870619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:04.878109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:04.878577 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:04.879401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:04.879850 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:04.920296 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a7958adc-2efb-4aa4-9b69-a156b540d3a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054731 Nov 20 21:34:04.920934 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3936/7764] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:04 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:05.932257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:05.933256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:05.940516 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:05.940970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:05.941751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:05.942221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:05.984673 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dbc6d997-56b5-4d6f-bb74-632287e38864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056360 Nov 20 21:34:05.985337 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3829/7765] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:05 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:06.997051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:06.998087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:07.006009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:07.006506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:07.007403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:07.007849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:07.047612 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cc0ef6a4-8e8b-4416-9d83-013cc40ea09f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054657 Nov 20 21:34:07.048244 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3937/7766] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:06 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:08.060030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:08.061023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:08.068286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:08.069372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:08.070181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:08.070621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:08.109180 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f5e92cfb-63b5-4b9a-8dde-9b4e705401c5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053118 Nov 20 21:34:08.109819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3830/7767] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:08 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:09.121562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:09.122592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:09.129802 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:09.130291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:09.131622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:09.132086 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:09.171405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7b7d8ee0-2a44-4abf-ba04-25cf12592b35 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053815 Nov 20 21:34:09.172078 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3938/7768] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:09 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:10.184190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:10.185209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:10.192566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:10.193026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:10.194459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:10.195067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:10.233790 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-089ecb3c-4ede-4c0d-8b75-468e4935709c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053600 Nov 20 21:34:10.234467 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3831/7769] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:10 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:11.246380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:11.247407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:11.254631 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:11.255092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:11.255874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:11.256807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:11.295752 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-74f047bb-329f-4dd9-bd33-b0f3cf45e5bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053338 Nov 20 21:34:11.296397 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3939/7770] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:11 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:12.308656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:12.309652 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:12.316997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:12.317453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:12.318277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:12.319405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:12.357912 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5f9ace2a-2433-44dd-bed5-cb461ecf590c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053212 Nov 20 21:34:12.358589 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3832/7771] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:12 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:13.370491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:13.371496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:13.378815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:13.379273 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:13.380050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:13.380490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:13.423096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-80817bc2-f85d-403e-963b-6d85ddd573f1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056592 Nov 20 21:34:13.423684 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3940/7772] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:13 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:14.435890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:14.436891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:14.443889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:14.444343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:14.445128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:14.445571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:14.484879 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-71f22cdf-ac99-41a1-a288-754e3657585f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053195 Nov 20 21:34:14.485511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3833/7773] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:14 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:34:15.309344 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:34:15.309897 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:34:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:34:15.497924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:15.498897 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:15.506801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:15.507263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:15.508056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:15.508497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:15.547687 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-13449c5d-f1da-4088-bcbb-fdb5a68fdc09 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053955 Nov 20 21:34:15.548334 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3941/7774] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:15 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:16.560213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:16.561222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:16.569140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:16.569656 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:16.570539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:16.570984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:16.609860 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f998f58-f22b-4dff-8724-c1aa90c400a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053661 Nov 20 21:34:16.610524 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3834/7775] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:16 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:17.621701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:17.622790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:17.630126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:17.630597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:17.631566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:17.631970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:17.671059 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60c7a9f1-ac93-4ef3-b684-e85b5f4aac13 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053325 Nov 20 21:34:17.671881 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3942/7776] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:17 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:18.683990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:18.685003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:18.692424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:18.692881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:18.693792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:18.694352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:18.735526 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-484629ed-ae0c-4069-9a93-768376642459 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.055506 Nov 20 21:34:18.736207 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3835/7777] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:18 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:34:19.748250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:19.749260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:19.757217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:19.757679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:19.758501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:19.758954 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:19.798236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-03ebda2e-144b-4358-8c20-d48a5c5e573a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053874 Nov 20 21:34:19.798896 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3943/7778] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:19 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:20.810480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:20.811482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:20.819393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:20.819847 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:20.820636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:20.821077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:20.860105 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8cbbe214-db01-488d-9802-c951f7b5eaf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053564 Nov 20 21:34:20.860740 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3836/7779] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:20 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:21.873641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:21.874947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:21.882827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:21.883295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:21.884106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:21.884559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:21.923242 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9b1da006-05c1-4c23-a3a2-1219531ad35c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054281 Nov 20 21:34:21.923888 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3944/7780] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:21 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:22.935372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:22.936379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:22.944973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:22.945411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:22.946237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:22.946679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:22.985367 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ca7a48ee-42a4-4b98-b9a3-8ac72efe2352 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053936 Nov 20 21:34:22.986003 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3837/7781] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:22 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:23.998196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:23.999201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:24.007263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:24.007713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:24.008491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:24.008937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:24.048709 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6d5989a-0f3e-47be-8ff4-902d151c4f37 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054794 Nov 20 21:34:24.049367 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3945/7782] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:23 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:25.060375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:25.061310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:25.069433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:25.069955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:25.070777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:25.071225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:25.109638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42ef66ea-2dfd-43b2-8b87-3364a12397bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.053335 Nov 20 21:34:25.110299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3838/7783] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:25 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:26.121848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:26.122894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:26.130339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:26.131318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:26.132282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:26.132737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:26.177096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-072a5a17-95fa-4dd8-8e0f-c51bfb0c0c45 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.059164 Nov 20 21:34:26.177824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3946/7784] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:26 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:27.189561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:27.190588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:27.198028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:27.198496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:27.199274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:27.199710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:27.240259 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-69d3d546-3490-4857-8859-575f0842ecdf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054525 Nov 20 21:34:27.240885 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3839/7785] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:27 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:28.252768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:28.253793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:28.262110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:28.262585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:28.263390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:28.263844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:28.304920 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-183603e3-b03e-4f1e-8b9c-270d917cf3c7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.056178 Nov 20 21:34:28.305568 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3947/7786] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:28 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:29.316632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:29.317657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:29.325477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:29.325929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:29.326736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:29.327174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:29.367336 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-880dc7e5-9aa8-4f4e-b4ff-a30f7e037a33 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 32644 microversion: 2.1 time: 0.054651 Nov 20 21:34:29.367984 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3840/7787] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:29 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 32644 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:34:30.379784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:30.380973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:30.388075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.388539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.389327 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.389775 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.446665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b6463f6a-3400-48bf-a5f2-86b8fc9ca61e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 200 len: 40792 microversion: 2.1 time: 0.070975 Nov 20 21:34:30.447308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3948/7788] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:30 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 40792 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:34:30.458033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:30.459744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:30.467079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.467515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.468296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.468738 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.499311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:30.505348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Old instance type m1.heat2, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:34:30.511402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:34:30.511820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:34:30.512318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:34:30.512731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:34:30.513143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:34:30.575234 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d50c2e90-9571-4cdd-a8a8-c42046473712 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.120952 Nov 20 21:34:30.576086 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3841/7789] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:30 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:34:30.585676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:30.586793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:30.594657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.595122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.595966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:30.596442 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:30.735644 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:30.743957 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f10ff234-84bb-4733-87c4-43c4c055334e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1679 microversion: 2.1 time: 0.163315 Nov 20 21:34:30.744477 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3949/7790] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:30 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:31.760728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:31.761347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:31.769006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:31.769455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:31.770270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:31.770716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:31.992525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:32.000200 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cfca7ed1-7ddd-4640-81bd-18c702bf7d7b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1679 microversion: 2.1 time: 0.243152 Nov 20 21:34:32.000881 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3842/7791] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:31 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:33.017389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:33.018062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:33.024948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:33.025409 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:33.026240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:33.026691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:33.155448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:33.163379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c9fe108c-b136-4108-8712-285a304fffd8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.149659 Nov 20 21:34:33.163953 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3950/7792] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:33 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:34.181463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:34.182147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:34.188961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:34.189410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:34.190228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:34.190701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:34.324400 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:34.331693 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-789e069e-d7fb-4ba1-b0eb-58d167412be4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.154913 Nov 20 21:34:34.332268 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3843/7793] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:34 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:35.348749 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:35.349390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:35.356497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:35.356966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:35.357767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:35.358254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:35.496025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:35.504095 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73e91a54-1a40-46ac-9d51-f29dbe408467 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.159101 Nov 20 21:34:35.504675 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3951/7794] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:35 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:36.522227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:36.522874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:36.529626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:36.530123 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:36.530928 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:36.531371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:36.662219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:36.669691 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a44d215e-12bc-444b-80c9-75377a4ccbdc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.151617 Nov 20 21:34:36.670368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3844/7795] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:36 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:37.685859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:37.686532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:37.693586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:37.694043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:37.694858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:37.695305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:37.832565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:37.840510 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25fee122-bd50-4416-996b-33dab152c7a2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.158332 Nov 20 21:34:37.841099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3952/7796] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:37 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:38.858595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:38.859214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:38.867033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:38.867482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:38.868268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:38.868705 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:39.006698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:39.014286 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b9dd93a-e437-4a65-b9ab-9dbfa8325dc0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.159621 Nov 20 21:34:39.014865 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3845/7797] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:38 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:40.031560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:40.032146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:40.038958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:40.039418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:40.040209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:40.040653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:40.173126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:40.180901 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f56590b5-7eb5-4824-bdc0-20958f520a18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.153116 Nov 20 21:34:40.181481 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3953/7798] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:40 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:41.198345 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:41.199014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:41.205853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:41.206339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:41.207128 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:41.207565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:41.343240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:41.350473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-94eee663-a589-4c4e-b606-95022f14ac02 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.155759 Nov 20 21:34:41.351060 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3846/7799] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:41 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:42.368013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:42.368679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:42.375523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:42.375982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:42.376773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:42.377223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:42.512976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:42.520414 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a8b9a966-5a84-4370-9076-4e620bad0dfc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.156350 Nov 20 21:34:42.521563 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3954/7800] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:42 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:43.539110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:43.539755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:43.546518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:43.546977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:43.547773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:43.548218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:43.680428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:43.687695 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3de69b8c-3944-48b1-9fd0-1eac19775ca0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1684 microversion: 2.1 time: 0.152999 Nov 20 21:34:43.688260 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3847/7801] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:43 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:44.610983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "name": "network-vif-unplugged", "status": "completed", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:44.612518 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:34:44.612518 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:34:44.622585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:44.623050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:44.635723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] Creating event network-vif-unplugged:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch2-master-1 Nov 20 21:34:44.641036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:34:44.652103 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-6dbca625-46c7-459e-9b0c-58b0e78e3a0c req-de8de113-9e69-4dc1-b4bc-66cdf19804ab service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045204 Nov 20 21:34:44.652877 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3955/7802] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:34:44.704946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:44.705944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:44.713018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:44.713860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:44.714722 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:44.715191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:44.962987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:44.970395 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6fddbe6-8bce-45cc-8fa6-bc2d56fbea62 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1683 microversion: 2.1 time: 0.269371 Nov 20 21:34:44.970999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3848/7803] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:44 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:45.989533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:45.990181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:45.996381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:45.996847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:45.997642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:45.998122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:46.132597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:46.139927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc4ff06c-b900-4fc5-bcdc-38df76497bac tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1681 microversion: 2.1 time: 0.155614 Nov 20 21:34:46.140499 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3956/7804] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:45 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:46.670869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:46.672378 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:34:46.672378 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:34:46.680661 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:46.681116 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:46.692426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] Creating event network-changed:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch2-master-1 Nov 20 21:34:46.698625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:34:46.710555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-db358bb2-e85d-46e5-9a04-42b92e029583 req-b3ff30ea-829e-40e1-8d45-400027a02f1d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043309 Nov 20 21:34:46.711151 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3849/7805] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:34:47.158367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:47.159312 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:47.167471 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.168378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.169467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.170213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.324318 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:47.331928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d727171-0aa0-486f-957c-cab92bf4ebe4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1678 microversion: 2.1 time: 0.177560 Nov 20 21:34:47.332520 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3957/7806] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:47 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:47.349797 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:47.350605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:47.356861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.357381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.358265 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.358768 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.391591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.392037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.392852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.393287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.413565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:34:47.419455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:34:47.545588 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5d53699-0391-49e1-8231-89705fb0c19f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.199823 Nov 20 21:34:47.546876 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3850/7807] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:34:47 2021] POST /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:34:47.555530 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:47.556448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:47.573146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.573608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.574554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:47.575021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:47.816993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:47.825256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3f9cc0f3-11b6-4bb3-b140-42bddbc3ec2a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1677 microversion: 2.1 time: 0.274519 Nov 20 21:34:47.825997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3958/7808] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:47 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:34:48.843941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:48.844626 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:48.851911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:48.852363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:48.853146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:48.853585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:48.994474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:49.002482 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f8ac4be-c221-4dd9-a6b1-6f90cffa759f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1677 microversion: 2.1 time: 0.163444 Nov 20 21:34:49.003061 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3851/7809] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:48 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:50.020274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:50.020942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:50.027839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:50.028295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:50.029094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:50.029541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:50.176765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:50.184992 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c37069ee-f870-4cb4-a9a2-0db309a24ac9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1677 microversion: 2.1 time: 0.168373 Nov 20 21:34:50.185566 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3959/7810] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:50 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:34:51.053051 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:51.054892 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:34:51.054892 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:34:51.063942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:51.064500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:51.080123 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] Creating event network-changed:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:34:51.087988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:34:51.101255 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a4a47f87-e8a1-41cf-9722-1c1a5c0c9fb7 req-4b402bf1-23d7-4c1c-abc2-793cccb0aba8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052974 Nov 20 21:34:51.102205 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3852/7811] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:34:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:34:51.204020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:51.204647 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:51.213474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:51.213943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:51.215001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:51.215469 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:51.356624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:51.364217 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d6d9ad8-f18b-4ec9-bb50-0742345dca2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1677 microversion: 2.1 time: 0.164341 Nov 20 21:34:51.364834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3960/7812] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:51 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:52.381205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:52.381897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:52.389199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:52.389658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:52.390477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:52.390972 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:52.525999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:52.533599 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-513584c2-a45e-4b75-8feb-e618780a0a4a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1677 microversion: 2.1 time: 0.156575 Nov 20 21:34:52.534202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3853/7813] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:52 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:53.550893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:53.551516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:53.559286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.559748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:53.560549 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.561001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:53.696726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:53.704260 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0b5675a8-fc45-4f06-bfba-322a8bbd9a93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1670 microversion: 2.1 time: 0.157107 Nov 20 21:34:53.704841 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3961/7814] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:53 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:53.720790 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:53.721501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:53.730711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.731388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:53.732250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.732881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:53.870256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:53.877772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-888e7eb8-13d4-4b2f-b38c-918a97b02b0f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1670 microversion: 2.1 time: 0.160653 Nov 20 21:34:53.878377 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3854/7815] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:53 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:53.893558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:53.894225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:53.900529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.900993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:53.901792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:53.902274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:54.034349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:54.042663 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f506836f-be46-444f-9b19-9ebb2a78fb6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1670 microversion: 2.1 time: 0.152676 Nov 20 21:34:54.043245 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3962/7816] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:53 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:54.059524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:54.060121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:54.066164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:54.066703 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:54.067633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:54.068151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:54.094232 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:34:54.169535 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c615e1e3-4fcd-4b4a-9eb1-7a6ca5411f18 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 204 len: 0 microversion: 2.1 time: 0.113432 Nov 20 21:34:54.170478 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3855/7817] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:34:54 2021] DELETE /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:34:54.180065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:54.180695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:54.186741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:54.187209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:54.188002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:54.188538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:54.317295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:54.324653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f42ae880-20da-4fc0-b045-6e0ac04df9b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1676 microversion: 2.1 time: 0.149269 Nov 20 21:34:54.325223 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3963/7818] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:54 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:55.342816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:55.343521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:55.350757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:55.351276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:55.352196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:55.352639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:55.483654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:55.492029 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e644cc8d-f1b9-4479-a09e-2c232ef3e092 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1676 microversion: 2.1 time: 0.153331 Nov 20 21:34:55.492606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3856/7819] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:55 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:55.729036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5be88326-63f0-40ea-927d-4eb18f1e3c16 req-71ab36b4-17bc-42c3-9686-5b4da6c6607f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "name": "network-vif-plugged", "status": "completed", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:55.730822 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:34:55.730822 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:34:55.739772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5be88326-63f0-40ea-927d-4eb18f1e3c16 req-71ab36b4-17bc-42c3-9686-5b4da6c6607f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:55.740254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5be88326-63f0-40ea-927d-4eb18f1e3c16 req-71ab36b4-17bc-42c3-9686-5b4da6c6607f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:55.752634 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5be88326-63f0-40ea-927d-4eb18f1e3c16 req-71ab36b4-17bc-42c3-9686-5b4da6c6607f service nova] Creating event network-vif-plugged:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:34:55.758157 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5be88326-63f0-40ea-927d-4eb18f1e3c16 req-71ab36b4-17bc-42c3-9686-5b4da6c6607f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Nov 20 21:34:55.759085 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3964/7820] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:34:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:34:56.509036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:56.509594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:56.516726 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:56.517480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:56.518313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:56.518756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:56.599193 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:56.607355 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0e8dcaa9-0c1d-4775-82a8-8d71a2f17cbf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 200 len: 1609 microversion: 2.1 time: 0.102423 Nov 20 21:34:56.608712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3857/7821] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:56 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 1609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:56.716282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c41a08b3-5155-4737-aa73-57b5d5f18ab1 req-d041bd1b-1a02-4d0e-9c6b-ff322485946c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d138a6-d214-4ce9-9326-c8c06f206b5a", "name": "network-vif-deleted", "tag": "d9442a15-28f6-40f2-98a6-4861bcc90a8c"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:56.718416 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:34:56.718416 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:34:56.728512 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c41a08b3-5155-4737-aa73-57b5d5f18ab1 req-d041bd1b-1a02-4d0e-9c6b-ff322485946c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:56.728974 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c41a08b3-5155-4737-aa73-57b5d5f18ab1 req-d041bd1b-1a02-4d0e-9c6b-ff322485946c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:56.743555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c41a08b3-5155-4737-aa73-57b5d5f18ab1 req-d041bd1b-1a02-4d0e-9c6b-ff322485946c service nova] Creating event network-vif-deleted:d9442a15-28f6-40f2-98a6-4861bcc90a8c for instance d6d138a6-d214-4ce9-9326-c8c06f206b5a on nch1-master-1 Nov 20 21:34:56.748833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c41a08b3-5155-4737-aa73-57b5d5f18ab1 req-d041bd1b-1a02-4d0e-9c6b-ff322485946c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 Nov 20 21:34:56.749798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3965/7822] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:34:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:34:57.624574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:57.625182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:57.632487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:57.632995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:57.633796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:57.634261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:57.649189 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. Nov 20 21:34:57.649801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:34:57.650836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f842c0a4-157b-42ff-8738-130f3896550b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 404 len: 111 microversion: 2.1 time: 0.030020 Nov 20 21:34:57.651410 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3858/7823] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:57 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:34:57.705823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:57.706573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:57.712935 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:57.713393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:57.714223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:57.714670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:57.728581 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. Nov 20 21:34:57.729265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:34:57.730043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6f964844-134c-488b-a07a-0da99acc87ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 404 len: 111 microversion: 2.1 time: 0.028411 Nov 20 21:34:57.730827 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3966/7824] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:57 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:34:57.776747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-975915702", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "4c5f91b7-b565-4458-971f-538d019cd893"}], "security_groups": [{"name": "tempest-securitygroup--329218344"}], "key_name": "tempest-keypair-1679284054", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:34:57.883430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] validate_networks() for [('4c5f91b7-b565-4458-971f-538d019cd893', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:34:58.359124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:34:58.359577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:34:58.360060 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:34:58.360475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:34:58.360924 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:34:58.371026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:58.371488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:58.372310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:34:58.372754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:34:58.389749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:34:58.394795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:34:58.407334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:34:58.409647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:34:58.455547 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b31d6f3d-8ca5-43b2-a882-2938c2d0bd06 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.682695 Nov 20 21:34:58.456195 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3859/7825] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:34:57 2021] POST /compute/v2.1/servers => generated 405 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:34:58.466033 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3c45018-e07e-4f75-8445-38c2db694852 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:58.466963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3c45018-e07e-4f75-8445-38c2db694852 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:58.525263 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3c45018-e07e-4f75-8445-38c2db694852 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:58.532783 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3c45018-e07e-4f75-8445-38c2db694852 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1238 microversion: 2.1 time: 0.070439 Nov 20 21:34:58.533347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3967/7826] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:58 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:34:59.550838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3b930876-ab25-4aa9-a3e7-0cfb70c7b090 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:34:59.551447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3b930876-ab25-4aa9-a3e7-0cfb70c7b090 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:34:59.610185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3b930876-ab25-4aa9-a3e7-0cfb70c7b090 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:34:59.617894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3b930876-ab25-4aa9-a3e7-0cfb70c7b090 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1238 microversion: 2.1 time: 0.071649 Nov 20 21:34:59.618555 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3860/7827] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:34:59 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:00.636245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:00.636877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:00.643485 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:00.643950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:00.644743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:00.645191 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:00.706630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:00.714687 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7f988d0-e0ca-4c5c-8706-d9534358ec79 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1242 microversion: 2.1 time: 0.082437 Nov 20 21:35:00.715271 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3968/7828] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:00 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:01.732186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:01.732813 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:01.740033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:01.740501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:01.741811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:01.742277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:01.815754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:01.824226 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9c549ee6-8f7e-4966-961a-5204eaa50709 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1296 microversion: 2.1 time: 0.095707 Nov 20 21:35:01.824810 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3861/7829] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:01 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:02.737781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-69faf274-0d03-4b80-80c2-143ae6e3e8b4 req-b9ffc696-3b6e-44fa-a6a7-7cded041ea95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:02.739666 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:35:02.739666 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:35:02.754907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-69faf274-0d03-4b80-80c2-143ae6e3e8b4 req-b9ffc696-3b6e-44fa-a6a7-7cded041ea95 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:02.755783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-69faf274-0d03-4b80-80c2-143ae6e3e8b4 req-b9ffc696-3b6e-44fa-a6a7-7cded041ea95 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:02.770715 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-69faf274-0d03-4b80-80c2-143ae6e3e8b4 req-b9ffc696-3b6e-44fa-a6a7-7cded041ea95 service nova] Creating event network-changed:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:35:02.776236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-69faf274-0d03-4b80-80c2-143ae6e3e8b4 req-b9ffc696-3b6e-44fa-a6a7-7cded041ea95 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042465 Nov 20 21:35:02.776834 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3969/7830] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:35:02.841590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:02.842266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:02.849493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:02.850611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:02.851429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:02.851870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:03.064750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:03.073156 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-61af8075-d94f-414e-b976-87a72ed28375 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.235159 Nov 20 21:35:03.073749 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3862/7831] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:02 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:04.091790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:04.092502 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:04.098682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:04.099173 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:04.100124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:04.100578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:04.229777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:04.237081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d692e9b1-acbb-42a7-8b09-c89f3b931938 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.150176 Nov 20 21:35:04.237653 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3970/7832] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:04 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:05.254819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:05.255436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:05.262677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:05.263127 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:05.263907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:05.264341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:05.399449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:05.406890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-32de8203-2c1f-40a2-881a-f66d1c13caf4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.155718 Nov 20 21:35:05.407468 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3863/7833] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:05 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:06.424430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:06.425058 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:06.431791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:06.432248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:06.433044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:06.433498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:06.570457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:06.577735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f96d121d-ef8c-4294-af25-554b9bb01faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.157081 Nov 20 21:35:06.578329 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3971/7834] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:06 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:07.595346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:07.595961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:07.603177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:07.603637 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:07.604432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:07.604876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:07.736437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:07.744125 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fbeff827-ec8b-48aa-afe3-24a5e9c34190 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.152564 Nov 20 21:35:07.744699 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3864/7835] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:07 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:08.761374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:08.761998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:08.768947 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:08.769415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:08.770246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:08.770696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:08.900330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:08.907640 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed82535d-662e-43df-8d61-78f995e01dbb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.149988 Nov 20 21:35:08.908215 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3972/7836] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:08 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:09.079427 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-0248f226-0a8a-4be7-9e62-f320cf38e632 req-29d95b00-6977-4e07-85c9-e162df366a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-plugged", "status": "completed", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:09.081056 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:35:09.081056 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:35:09.090448 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0248f226-0a8a-4be7-9e62-f320cf38e632 req-29d95b00-6977-4e07-85c9-e162df366a34 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:09.090935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-0248f226-0a8a-4be7-9e62-f320cf38e632 req-29d95b00-6977-4e07-85c9-e162df366a34 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:09.102910 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-0248f226-0a8a-4be7-9e62-f320cf38e632 req-29d95b00-6977-4e07-85c9-e162df366a34 service nova] Creating event network-vif-plugged:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:35:09.108049 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-0248f226-0a8a-4be7-9e62-f320cf38e632 req-29d95b00-6977-4e07-85c9-e162df366a34 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032272 Nov 20 21:35:09.108846 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3865/7837] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:35:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:35:09.924811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:09.925444 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:09.933087 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:09.933580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:09.934402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:09.934860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:10.063699 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:10.071663 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b8a1867-e533-4c6f-bdad-de281ed42864 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1363 microversion: 2.1 time: 0.150555 Nov 20 21:35:10.072237 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3973/7838] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:09 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:11.090094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:11.090730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:11.097685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:11.098183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:11.098978 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:11.099429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:11.229794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:35:11.237116 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb5ce131-3d88-434f-98aa-ae5008840de7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1551 microversion: 2.1 time: 0.151274 Nov 20 21:35:11.237686 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3866/7839] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:35:11 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:11.254000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:35:11.254518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:11.261684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:11.262184 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:11.262973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:11.263414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:11.344740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc48e8e4-3328-4043-9407-9d38ea663cf8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094367 Nov 20 21:35:11.345352 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3974/7840] 10.222.0.41 () {58 vars in 1274 bytes} [Sat Nov 20 21:35:11 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:35:12.301816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-bce90c0b-0f52-4843-8808-e55c07b246e9 req-7160e3cb-60f6-405b-aeec-04f4300d51b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:12.305292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:12.306280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:12.310949 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:35:12.310949 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:35:12.313535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:12.314135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:12.315197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:12.315775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:12.318113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bce90c0b-0f52-4843-8808-e55c07b246e9 req-7160e3cb-60f6-405b-aeec-04f4300d51b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:12.318838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-bce90c0b-0f52-4843-8808-e55c07b246e9 req-7160e3cb-60f6-405b-aeec-04f4300d51b5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:12.330470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-bce90c0b-0f52-4843-8808-e55c07b246e9 req-7160e3cb-60f6-405b-aeec-04f4300d51b5 service nova] Creating event network-changed:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:35:12.336405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-bce90c0b-0f52-4843-8808-e55c07b246e9 req-7160e3cb-60f6-405b-aeec-04f4300d51b5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038970 Nov 20 21:35:12.337208 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3975/7841] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:35:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:35:12.356456 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb0fe883-a81d-43d0-a6aa-9f409171fa69 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.060966 Nov 20 21:35:12.357123 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3867/7842] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:12 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:13.368043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:13.369062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:13.376221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:13.376715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:13.377524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:13.377970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:13.417709 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-192c6d62-68e4-4df5-8888-83b4e3022962 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.053755 Nov 20 21:35:13.418378 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3976/7843] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:13 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:14.429975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:14.431010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:14.437882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:14.438381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:14.439174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:14.439614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:14.477015 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ae80c51-2c6d-4107-b593-b655093466ee tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.051901 Nov 20 21:35:14.477791 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3868/7844] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:14 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:35:15.487673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:15.488853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:15.496735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:15.497205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:15.497988 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:15.498453 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:15.536078 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-323cdea6-f042-465e-8e27-6e513d5fe3ba tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.052389 Nov 20 21:35:15.536878 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3977/7845] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:15 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:35:16.549234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:16.550286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:16.557788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:16.558275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:16.559059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:16.559500 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:16.595282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-037b762d-74b1-45e9-898c-4e2c611e1c3c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.050048 Nov 20 21:35:16.595908 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3869/7846] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:16 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:17.606509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:17.607536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:17.615067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:17.615523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:17.616302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:17.616797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:17.651916 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3cfe6816-4bab-4206-ab8c-eeca91196fc7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.049407 Nov 20 21:35:17.652521 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3978/7847] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:17 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:18.663910 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:18.664956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:18.672228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:18.672680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:18.673454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:18.673886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:18.710405 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fa6ad315-61c2-48e5-80dc-11ec8d5dba93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.050866 Nov 20 21:35:18.711332 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3870/7848] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:18 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:19.721584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:19.722733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:19.730399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:19.730857 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:19.731640 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:19.732114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:19.768925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b0e5b417-8284-44c0-9790-b758c2165834 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.051282 Nov 20 21:35:19.769573 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3979/7849] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:19 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:20.780653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:20.781665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:20.789464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:20.789859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:20.790687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:20.791135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:20.829656 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a3afdc1-4668-4d4a-a817-5d1cdff28aae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.053014 Nov 20 21:35:20.830330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3871/7850] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:20 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:35:21.841783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:21.842750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:21.849994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:21.850487 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:21.851281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:21.851726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:21.889008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b4b3a8b-5f3e-424c-b11f-fc467ebb3570 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 14 microversion: 2.1 time: 0.051320 Nov 20 21:35:21.889799 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3980/7851] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:21 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 20 21:35:22.901780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:22.903053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:22.910611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:22.911063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:22.911857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:22.912296 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:22.962924 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-07deb967-7a64-452c-8e7e-3e9362e5d336 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 8201 microversion: 2.1 time: 0.066436 Nov 20 21:35:22.963577 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3872/7852] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:22 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 8201 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:35:23.974634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:23.975637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:23.983475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:23.983934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:23.984713 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:23.985157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:24.031923 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6daf878c-86c6-40b8-9414-ab9722262381 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 16390 microversion: 2.1 time: 0.061328 Nov 20 21:35:24.032549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3981/7853] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:23 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 16390 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:25.043761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:25.044767 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:25.052066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:25.052519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:25.053310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:25.053755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:25.096121 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f37f3cf0-09fe-457c-8537-a82f6f7f4157 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 16390 microversion: 2.1 time: 0.056348 Nov 20 21:35:25.096716 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3873/7854] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:25 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 16390 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:26.107832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:26.108838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:26.116346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:26.117545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:26.118371 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:26.118795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:26.158103 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3afea15a-f92f-46ab-ad75-823e27eb4281 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 16390 microversion: 2.1 time: 0.054209 Nov 20 21:35:26.158734 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3982/7855] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:26 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 16390 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:27.169782 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:27.170805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:27.177968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:27.178454 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:27.179775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:27.180377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:27.220249 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3a5b970b-1a6d-4883-ab4c-0c0556688337 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 16390 microversion: 2.1 time: 0.054359 Nov 20 21:35:27.221105 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3874/7856] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:27 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 16390 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:28.232394 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:28.233399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:28.241070 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:28.241553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:28.242385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:28.242833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:28.280515 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-535f7b2f-7112-45d2-9f5f-39156449cb78 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 16390 microversion: 2.1 time: 0.052093 Nov 20 21:35:28.281147 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3983/7857] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:28 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 16390 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:29.292883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:29.293927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:29.301161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:29.301605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:29.302424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:29.302860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:29.350412 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3337920-e13b-4fa3-905e-f3b9a79cfea2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.061968 Nov 20 21:35:29.351639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3875/7858] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:29 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:30.363569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:30.364575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:30.371943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:30.372399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:30.373180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:30.373622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:30.414721 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c28122f4-744d-4995-8099-b6275a0621f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.055444 Nov 20 21:35:30.415366 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3984/7859] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:30 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:31.427035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:31.428078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:31.435807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:31.436269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:31.437062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:31.437511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:31.477312 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a46b0825-9534-467b-85ea-fcb61be1877c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.054271 Nov 20 21:35:31.477962 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3876/7860] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:31 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:32.488980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:32.490013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:32.497529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:32.497925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:32.498793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:32.499226 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:32.539239 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-30cc63bc-699a-47cb-87b6-2ce2b29385d2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.053688 Nov 20 21:35:32.539904 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3985/7861] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:32 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:33.551266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:33.552388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:33.559772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:33.560231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:33.561141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:33.561565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:33.601378 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d020db7-ca23-4bcb-a8bb-c56cfcf5947f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.053833 Nov 20 21:35:33.602015 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3877/7862] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:33 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:34.613691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:34.614743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:34.622380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:34.622845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:34.623645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:34.624096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:34.664912 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f86026bf-5fed-4390-8faf-faffad9f9f2c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.054772 Nov 20 21:35:34.665758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3986/7863] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:34 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:35.677085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:35.678096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:35.686122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:35.686576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:35.687366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:35.687802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:35.726379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-627f6448-a691-4ae9-8099-f5ac1daed763 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.053252 Nov 20 21:35:35.727202 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3878/7864] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:35 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:36.739050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:36.740091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:36.747437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:36.747900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:36.748696 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:36.749140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:36.788335 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-76c03aad-e943-4a22-9402-35eb11380000 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.053572 Nov 20 21:35:36.788937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3987/7865] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:36 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:37.800384 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:37.801299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:37.809339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:37.809786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:37.810627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:37.811068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:37.854098 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0add303b-7709-4a42-bba4-e8d3f209e460 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.057732 Nov 20 21:35:37.854754 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3879/7866] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:37 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:38.865466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:38.866508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:38.874073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:38.874533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:38.875329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:38.875776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:38.916611 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-752cd2a2-5ce8-4f9a-ab00-78c96c4351d6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.055355 Nov 20 21:35:38.917264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3988/7867] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:38 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:39.928417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:39.929474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:39.937106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:39.937577 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:39.938409 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:39.938848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:39.981570 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-73f5d0eb-7f54-45e6-b960-46f0453c71b8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 24556 microversion: 2.1 time: 0.057103 Nov 20 21:35:39.982268 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3880/7868] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:39 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 24556 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:40.994382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:40.995429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:41.002825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:41.003296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:41.004085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:41.004536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:41.055328 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f4b8b2b-9768-475f-9bb7-e60143eba726 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.064770 Nov 20 21:35:41.055977 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3989/7869] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:40 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:42.067474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:42.068469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:42.076256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:42.076704 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:42.077523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:42.077963 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:42.118152 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a5e09870-9be3-4706-80e8-e3ad4f146bd3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054142 Nov 20 21:35:42.119018 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3881/7870] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:42 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:43.129957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:43.131060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:43.139117 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:43.139580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:43.140398 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:43.140846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:43.182266 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b7e89026-898c-47bd-bf66-366aa1176e52 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056173 Nov 20 21:35:43.182933 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3990/7871] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:43 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:44.195410 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:44.196411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:44.203826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:44.204280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:44.205066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:44.205511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:44.245164 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-08bf8542-82a6-4c74-be79-2116ef44b238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053844 Nov 20 21:35:44.246042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3882/7872] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:44 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:45.256566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:45.257599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:45.264941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:45.265406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:45.266233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:45.266687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:45.307378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e54175f7-6a8f-44f4-8902-ec06ed63a74c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054784 Nov 20 21:35:45.308030 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3991/7873] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:45 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:46.319157 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:46.320187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:46.327526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:46.327980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:46.328761 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:46.329200 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:46.369856 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a9312b1b-fec2-446e-8e7b-0c5cdd5e5d7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053620 Nov 20 21:35:46.370527 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3883/7874] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:46 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:47.381366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:47.382422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:47.390314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:47.390774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:47.391555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:47.392003 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:47.431603 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fbfb384f-afd4-49d8-8173-74c7762c407f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053732 Nov 20 21:35:47.432493 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3992/7875] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:47 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:48.444277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:48.445272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:48.453091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:48.453535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:48.454342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:48.454787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:48.494209 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5fb904ac-89f6-4fe2-b9a8-0e9adff6ebbd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054029 Nov 20 21:35:48.494885 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3884/7876] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:48 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:49.506725 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:49.507743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:49.515189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:49.515650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:49.516443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:49.516886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:49.557680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dad4339f-3de1-4d52-afc8-2b8807ad7238 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054859 Nov 20 21:35:49.558279 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3993/7877] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:49 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:50.569882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:50.570901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:50.578919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:50.579372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:50.580150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:50.580585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:50.621263 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c6de159a-b88c-4515-bfb3-ff76fff4df14 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055361 Nov 20 21:35:50.621904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3885/7878] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:50 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:51.633533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:51.634586 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:51.641837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:51.642330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:51.643124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:51.643573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:51.686117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b3fd7d1b-b3b6-4090-b44b-d1e23f39b180 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056523 Nov 20 21:35:51.686781 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3994/7879] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:51 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:52.699268 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:52.700271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:52.707600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:52.708052 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:52.708837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:52.709280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:52.748287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef08481d-8d51-42d6-ae1c-2aa9a401b192 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053978 Nov 20 21:35:52.748936 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3886/7880] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:52 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:53.761129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:53.762208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:53.769463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:53.769929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:53.770742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:53.771188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:53.811268 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-478f3421-c1ed-4b36-821d-37b88b69828b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054493 Nov 20 21:35:53.811835 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3995/7881] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:53 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:54.822997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:54.823914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:54.831224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:54.832086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:54.832480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:54.832915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:54.874213 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-347d8440-f562-4be2-936e-e0496f0b6fb0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055204 Nov 20 21:35:54.874901 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3887/7882] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:54 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:55.332519 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:35:55.333061 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:35:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:35:55.887202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:55.888211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:55.895843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:55.896338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:55.897142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:55.897590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:55.937869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8589650c-f330-4081-bc1b-9d0e0c370699 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055380 Nov 20 21:35:55.938550 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3996/7883] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:55 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:35:56.738658 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:35:56.739185 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:35:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:35:56.950406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:56.951394 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:56.958785 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:56.959236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:56.960021 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:56.960463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:56.999807 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e6c4c76b-d475-424e-8aa2-e85cdaf1e009 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053656 Nov 20 21:35:57.000701 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3888/7884] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:56 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:58.013953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:58.015060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:58.023949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:58.024422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:58.025372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:58.025815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:58.068120 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b35f4c08-bc6f-4b35-ba11-a1233bfe28e0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.059474 Nov 20 21:35:58.068790 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3997/7885] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:58 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:35:59.080154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:35:59.081198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:35:59.088732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:59.089122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:59.089895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:35:59.090352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:35:59.130399 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6ba67e40-9757-42bc-b674-af54f35719bc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054064 Nov 20 21:35:59.131049 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3889/7886] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:35:59 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:00.142451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:00.143500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:00.150712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:00.151178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:00.151982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:00.152434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:00.191185 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-92bbb8e5-e5ef-46aa-9e12-d32f217a6e21 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.052755 Nov 20 21:36:00.191823 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3998/7887] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:00 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:01.203755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:01.204757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:01.211777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:01.212945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:01.213725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:01.214195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:01.253944 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2732747d-8737-4603-880f-ff0a87440445 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054203 Nov 20 21:36:01.254586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3890/7888] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:01 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:02.266165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:02.267172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:02.274400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:02.274862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:02.275648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:02.276090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:02.314615 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b88c991-0dbf-4262-9484-96e90e5025de tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.052415 Nov 20 21:36:02.315264 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 3999/7889] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:02 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:03.327991 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:03.328983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:03.336220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:03.336673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:03.337473 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:03.337908 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:03.379925 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b247f105-78b3-4ba5-a18c-bc00d3ce0123 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055764 Nov 20 21:36:03.380507 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3891/7890] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:03 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:04.392750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:04.393754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:04.401966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:04.402451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:04.403249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:04.403690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:04.444705 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5bf526f5-2172-4e2a-99dc-92c793da78b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055887 Nov 20 21:36:04.445415 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4000/7891] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:04 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:05.457587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:05.458642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:05.466578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:05.467028 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:05.467871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:05.468312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:05.508647 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-98ad74ad-61f3-4d11-904c-858f973f3f49 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054996 Nov 20 21:36:05.509401 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3892/7892] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:05 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:06.521110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:06.522146 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:06.529683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:06.530235 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:06.531032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:06.531478 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:06.572215 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ad46565d-357b-4acd-936b-36b5378dabf5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054988 Nov 20 21:36:06.573145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4001/7893] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:06 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:07.584645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:07.585674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:07.593906 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:07.594383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:07.595173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:07.595622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:07.635110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-525194fc-cae6-479d-8eee-5cf2dae283f3 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054437 Nov 20 21:36:07.635782 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3893/7894] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:07 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:08.646788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:08.647808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:08.655757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:08.656221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:08.657014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:08.657459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:08.696757 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-40fd232b-70c5-41a1-8d81-3ea2e5411f5a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053421 Nov 20 21:36:08.697454 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4002/7895] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:08 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:09.708867 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:09.709881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:09.717149 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:09.717609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:09.718421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:09.718868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:09.758784 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d481c906-9f75-44a4-9d29-a80ef425aa04 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053844 Nov 20 21:36:09.759421 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3894/7896] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:09 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:10.771024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:10.772032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:10.779651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:10.780115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:10.780904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:10.781353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:10.821792 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7351cc5e-5ba5-40f9-8071-c8a1a7577e0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054066 Nov 20 21:36:10.822439 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4003/7897] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:10 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:11.833881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:11.835595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:11.842935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:11.843386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:11.844170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:11.844613 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:11.884946 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d019e931-8a9d-4c11-811a-ab0a7c864f61 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054556 Nov 20 21:36:11.885596 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3895/7898] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:11 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:12.897144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:12.898177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:12.905946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:12.906429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:12.907209 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:12.907651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:12.948236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73e94767-0532-4dde-bda9-ad7000f035a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054966 Nov 20 21:36:12.949097 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4004/7899] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:12 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:13.960504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:13.961526 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:13.968902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:13.969351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:13.970161 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:13.970605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:14.015596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-426d3205-1dd9-48c7-9b6c-d5112b9a82ae tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.059020 Nov 20 21:36:14.016237 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3896/7900] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:13 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:15.028264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:15.029285 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:15.036593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:15.037061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:15.037860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:15.038375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:15.077856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f05cc62a-af7a-4160-899e-6deea5cd6eca tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053767 Nov 20 21:36:15.078785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4005/7901] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:15 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:16.090370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:16.091373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:16.098665 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:16.099114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:16.099895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:16.100329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:16.141679 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ea7b445-6c62-4fc0-be9e-9ff56bb39b00 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055560 Nov 20 21:36:16.142428 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3897/7902] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:16 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:17.154118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:17.155130 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:17.162386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:17.162845 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:17.163635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:17.164079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:17.206468 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4f6cb899-afd9-4a30-bdf7-8e227e82bb36 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056292 Nov 20 21:36:17.207130 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4006/7903] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:17 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:18.219233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:18.220222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:18.227989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:18.228436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:18.229211 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:18.229644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:18.269274 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a118ccf2-d703-4aab-9ffa-a46b7643a95e tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053892 Nov 20 21:36:18.269922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3898/7904] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:18 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:19.281353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:19.282393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:19.290245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:19.290758 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:19.291546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:19.291993 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:19.333263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1eeb18c5-b91b-471e-8390-e9dd1e222faf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055892 Nov 20 21:36:19.333902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4007/7905] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:19 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:20.345017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:20.346027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:20.354256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:20.354719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:20.355512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:20.355957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:20.395108 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4d1eecd5-76d5-43b4-94ce-c7dade27087c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054109 Nov 20 21:36:20.395763 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3899/7906] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:20 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:21.407957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:21.408971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:21.416685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:21.417152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:21.417949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:21.418448 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:21.460743 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c2886b27-f827-4400-b4f3-3fd8865edb3b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056709 Nov 20 21:36:21.461464 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4008/7907] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:21 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:22.473402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:22.474433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:22.481789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:22.482280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:22.483069 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:22.483510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:22.525874 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b1e9e85d-804f-4da7-bb56-8a0a34183bdb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056363 Nov 20 21:36:22.526562 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3900/7908] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:22 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:23.538114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:23.539195 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:23.547381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:23.547840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:23.548632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:23.549074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:23.588651 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8b295263-288b-42c6-8b2d-de311b28e480 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054558 Nov 20 21:36:23.589390 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4009/7909] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:23 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:24.600881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:24.601907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:24.609612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:24.610071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:24.610861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:24.611294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:24.650446 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-39bdfba4-c887-46b3-8674-584b27d58dc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053355 Nov 20 21:36:24.651101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3901/7910] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:24 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:25.662675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:25.663689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:25.671353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:25.671818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:25.672609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:25.673056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:25.713745 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8544ea09-b808-496e-be8d-b4a29b796dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055021 Nov 20 21:36:25.714406 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4010/7911] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:25 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:26.726120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:26.727143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:26.735222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:26.735681 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:26.736482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:26.736927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:26.777389 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b7c77cee-5c9d-4816-934a-f76858f3791b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055279 Nov 20 21:36:26.778039 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3902/7912] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:26 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:27.789756 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:27.791346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:27.798660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:27.799127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:27.799919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:27.800364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:27.839501 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0dcd2600-dfb3-4ac0-916d-4ace54236723 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053795 Nov 20 21:36:27.840440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4011/7913] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:27 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:28.851464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:28.852469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:28.860084 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:28.860532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:28.861323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:28.861769 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:28.904449 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3f0768b5-ea4a-49f7-b2a8-a84e856c87cf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056962 Nov 20 21:36:28.905127 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3903/7914] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:28 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:29.917210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:29.918248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:29.925118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:29.925575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:29.926390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:29.926831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:29.969097 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5f136b1-be52-42b6-b1a3-789ac3010a46 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056217 Nov 20 21:36:29.970043 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4012/7915] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:29 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:30.981973 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:30.982993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:30.990608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:30.991059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:30.991834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:30.992270 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:31.031112 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-14a9e797-40f2-4395-bc80-9be7fc7a3bbe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053872 Nov 20 21:36:31.031764 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3904/7916] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:30 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:32.044199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:32.045283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:32.052973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:32.053432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:32.054266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:32.054710 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:32.094638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-701beb14-2e19-45af-8b61-5e3d35e2a4f7 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055170 Nov 20 21:36:32.095292 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4013/7917] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:32 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:33.108138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:33.109133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:33.116804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:33.117254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:33.118030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:33.118487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:33.161412 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72f50e5b-3d4a-4abf-b020-c7d26af25d54 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.057171 Nov 20 21:36:33.162373 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3905/7918] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:33 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:34.173303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:34.174336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:34.181504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:34.181958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:34.182770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:34.183572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:34.224366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b760ffc8-0412-4cd7-86b6-64b9a4b66599 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055011 Nov 20 21:36:34.225016 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4014/7919] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:34 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:35.236735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:35.237995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:35.245272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:35.246257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:35.247048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:35.247483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:35.287055 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67b5697b-3107-430d-8dcb-59ccb4f0146a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054288 Nov 20 21:36:35.287693 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3906/7920] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:35 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:36.299506 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:36.300515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:36.307832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:36.308314 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:36.309111 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:36.309590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:36.350214 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4dbe5542-537e-4df5-a4d3-3d7fe82530f4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054650 Nov 20 21:36:36.350846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4015/7921] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:36 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:37.363068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:37.364057 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:37.372000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:37.372450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:37.373240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:37.373682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:37.413890 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f2b8e35-54f6-469d-afc4-ba239cc0e6fa tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055012 Nov 20 21:36:37.414571 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3907/7922] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:37 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:38.427026 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:38.428071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:38.435986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:38.436445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:38.437236 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:38.437685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:38.477769 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-66158260-67ce-43a4-b6db-22b5ce49b3df tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054773 Nov 20 21:36:38.478440 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4016/7923] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:38 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:39.489573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:39.490639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:39.498902 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:39.499387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:39.500181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:39.500627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:39.541372 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c79b195c-6536-4878-a600-9de42a082ac5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.056004 Nov 20 21:36:39.542101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3908/7924] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:39 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:40.554417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:40.555434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:40.563275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:40.563739 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:40.564605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:40.565051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:40.603906 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffd7c7b7-32cb-4437-aad9-a776df78c264 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053482 Nov 20 21:36:40.604742 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4017/7925] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:40 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:41.617699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:41.619315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:41.626262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:41.626709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:41.627493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:41.627934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:41.672949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-279eb588-92ce-4dc8-8dc1-f8d96b3909bb tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.059465 Nov 20 21:36:41.673666 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3909/7926] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:41 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:36:42.686443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:42.687490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:42.695069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:42.695531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:42.696335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:42.696784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:42.740794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a2f172d-b80d-4c8d-b72f-b2a6a607da0b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.059131 Nov 20 21:36:42.741455 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4018/7927] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:42 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:43.752988 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:43.753981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:43.761212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:43.761658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:43.762463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:43.762898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:43.803685 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7136b91a-fa80-490d-b9b3-d9b93b7db7b9 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.054581 Nov 20 21:36:43.804330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3910/7928] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:43 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:44.816422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:44.817364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:44.824546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:44.825014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:44.825774 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:44.826313 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:44.865928 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4e6831e3-b46e-4062-88bf-aefb9bd90640 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.053544 Nov 20 21:36:44.866666 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4019/7929] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:44 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:45.878481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:45.879515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:45.886812 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:45.887452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:45.888282 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:45.888759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:45.930160 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1dc1e516-35c6-4fc6-92a2-0f1144a582fe tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.055863 Nov 20 21:36:45.930851 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3911/7930] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:45 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:46.941997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:46.943045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:46.950941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:46.951401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:46.952199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:46.952675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:46.997534 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3eb01ff6-c9d7-4b7a-8aef-cd5e1a2053ff tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 32633 microversion: 2.1 time: 0.058999 Nov 20 21:36:46.998982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4020/7931] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:46 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 32633 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:48.010148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:48.011143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:48.018532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:48.018994 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:48.019789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:48.020260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:48.073786 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-facc6d6b-2b25-4d45-b867-e9a9e48d0f7a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 200 len: 40784 microversion: 2.1 time: 0.067727 Nov 20 21:36:48.074489 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3912/7932] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:48 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 40784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:36:49.404334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:49.405170 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:49.412514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:49.412978 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:49.413778 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:49.414258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:49.551279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:49.558736 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-489b5ec2-227e-41e0-8167-b1dcb3e31e3f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1670 microversion: 2.1 time: 0.159356 Nov 20 21:36:49.560128 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4021/7933] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:49 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:49.577086 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d577fb37-8efe-4a8c-9f30-0b2a4f7f7795"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:49.578253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:49.585452 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:49.585897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:49.586773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:49.587213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:49.812219 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7429f87d-6234-45f8-8ea7-8b27b2ff3bcf tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239886 Nov 20 21:36:49.812771 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3913/7934] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:36:49 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:36:53.071890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:36:53.072875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:53.080783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:53.081253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:53.082084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:53.082537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:53.122220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:53.128514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Old instance type m1.heat2, new instance type m1.heat {{(pid=140941) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:36:53.135138 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:36:53.135568 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:36:53.136050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:36:53.136467 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:36:53.136886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:36:53.202081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a57ec248-6133-41f0-98a4-1442f1d47c97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 202 len: 0 microversion: 2.1 time: 0.133974 Nov 20 21:36:53.202726 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4022/7935] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:36:53 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:36:53.212224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:53.213494 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:53.220321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:53.220853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:53.221714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:53.222277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:53.399310 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:53.410120 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92946f41-92f4-4af6-8145-924cec7261a6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1725 microversion: 2.1 time: 0.202939 Nov 20 21:36:53.411291 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3914/7936] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:53 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:54.429385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:54.429989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:54.436707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:54.437148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:54.437925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:54.438391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:54.572858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:54.580695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0aaa6c16-b077-4eb1-9930-8447094ede75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1725 microversion: 2.1 time: 0.155843 Nov 20 21:36:54.581275 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4023/7937] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:54 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:55.598202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:55.598960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:55.605647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:55.606129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:55.606923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:55.607930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:55.815110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:55.823043 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36e70818-078e-41ba-ac87-37d9c2dad097 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1725 microversion: 2.1 time: 0.228563 Nov 20 21:36:55.823636 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3915/7938] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:55 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:56.840126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:56.840671 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:56.847415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:56.847877 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:56.848664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:56.849106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:56.981536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:56.990159 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b8e87c2-f285-44cf-8288-dda2227f7ec4 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.153781 Nov 20 21:36:56.990754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4024/7939] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:56 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:58.008214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:58.008855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:58.016407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:58.016858 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:58.017630 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:58.018088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:58.148659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:58.156530 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ee823c0d-7791-45cc-96c7-eab540e473ab tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.152006 Nov 20 21:36:58.157110 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3916/7940] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:58 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:36:59.173624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:36:59.174197 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:36:59.180805 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:59.181259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:59.182040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:36:59.182500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:36:59.315153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:36:59.322836 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12a6023a-3da2-4944-a642-7b94d9543b6d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.153039 Nov 20 21:36:59.323410 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4025/7941] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:36:59 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:00.340686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:00.341807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:00.348861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:00.349312 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:00.350119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:00.350559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:00.479836 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:00.487973 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59317cc7-c439-4cc7-b969-6b480e0470f0 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.150959 Nov 20 21:37:00.488543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3917/7942] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:00 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:01.505244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:01.505894 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:01.512791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:01.513251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:01.514043 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:01.514521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:01.649791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:01.658241 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-64528f93-1d93-48b2-abaa-d8c193b0ad11 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.156856 Nov 20 21:37:01.658820 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4026/7943] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:01 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:02.676113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:02.677460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:02.684403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:02.684856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:02.686294 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:02.686742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:02.820734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:02.828627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a3863bef-4da3-4b33-9a2d-f8becdb83166 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.156297 Nov 20 21:37:02.829248 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3918/7944] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:02 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:03.845849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:03.846393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:03.853099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:03.853558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:03.854382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:03.854833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:03.987557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:03.995588 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f55dac59-2bbc-40c1-adee-1a2f0eebe168 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.153584 Nov 20 21:37:03.996163 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4027/7945] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:03 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:05.012678 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:05.013541 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:05.020178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:05.020623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:05.021408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:05.021844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:05.150233 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:05.158745 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c64d691e-54bf-4882-ae5b-06290b1fa543 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.149728 Nov 20 21:37:05.159327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3919/7946] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:05 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:06.176029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:06.176650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:06.183272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:06.183731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:06.184516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:06.185475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:06.321833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:06.329560 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b84a7b9b-53f4-411f-9601-94185b628c7c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.157249 Nov 20 21:37:06.330149 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4028/7947] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:06 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:07.346949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:07.347506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:07.354293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:07.354755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:07.355546 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:07.355995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:07.488432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:07.496360 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37168a36-a4c3-4274-b794-b787c7460d07 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.153161 Nov 20 21:37:07.496941 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3920/7948] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:07 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:08.514932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:08.515552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:08.521528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:08.521981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:08.522873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:08.523316 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:08.669929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:08.679071 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1bd32ec7-3f50-48a6-84ee-8fd7abb5d998 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1730 microversion: 2.1 time: 0.168974 Nov 20 21:37:08.679648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4029/7949] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:08 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:09.145741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-unplugged", "status": "completed", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:09.147418 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:09.147418 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:09.155827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:09.156280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:09.170271 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] Creating event network-vif-unplugged:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch1-master-1 Nov 20 21:37:09.175585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:37:09.187340 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-accac1b8-6093-437d-80ec-851c04280c37 req-d2bfcfbf-e3a9-499d-8ac2-4607956883af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046119 Nov 20 21:37:09.187966 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3921/7950] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:09.697122 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:09.697667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:09.705648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:09.706149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:09.706951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:09.707393 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:09.847029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:09.854853 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-dd5135e4-b56c-4ccb-bd1e-501a86511052 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1729 microversion: 2.1 time: 0.161544 Nov 20 21:37:09.855434 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4030/7951] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:09 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:10.874904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:10.875800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:10.883262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:10.883718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:10.884536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:10.885009 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:11.020999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:11.029493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-34241cb3-a4dd-43e2-9e7c-2926db5f493b tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1727 microversion: 2.1 time: 0.160039 Nov 20 21:37:11.030319 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3922/7952] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:10 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:11.203989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:11.205647 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:11.205647 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:11.213380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:11.213903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:11.226381 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] Creating event network-changed:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch1-master-1 Nov 20 21:37:11.231917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:37:11.243754 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-46ad191e-3f96-454a-82c2-56568edc0014 req-63c1677e-3948-43db-b9ea-5199f148b725 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043842 Nov 20 21:37:11.244479 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4031/7953] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:12.047556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:12.048179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:12.055089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:12.055475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:12.056266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:12.056709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:12.226911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:12.235497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49a0f4d4-a058-4ce0-a0cf-afd430f84d38 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1727 microversion: 2.1 time: 0.192376 Nov 20 21:37:12.236080 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3923/7954] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:12 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:13.253833 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:13.254580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:13.261755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:13.262270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:13.263203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:13.263664 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:13.398161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:13.406277 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a986d1c-6824-48f2-b23a-23f6927f6dfd tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1727 microversion: 2.1 time: 0.156499 Nov 20 21:37:13.406859 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4032/7955] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:13 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:14.422965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:14.423612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:14.430108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.430568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.431361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.431807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.573317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:14.581936 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ddf24651-7724-4845-9fe0-f483d3cf6f97 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1724 microversion: 2.1 time: 0.163071 Nov 20 21:37:14.582554 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3924/7956] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:14 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:14.598350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:14.598908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:14.605415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.605886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.607247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.607706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.640326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.640796 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.641630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.642110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.661670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:37:14.666669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Getting quotas for user fabb7e1475ed46099ff09d478ecb5333 and project 55bf4df5c73841dbb6507b288100a89d. Resources: {'cores', 'ram'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:37:14.770674 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1680d73b-6edd-4ad1-8677-1cb0dec80eb8 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action" status: 202 len: 0 microversion: 2.1 time: 0.175769 Nov 20 21:37:14.771204 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4033/7957] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:37:14 2021] POST /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:37:14.779323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:14.779936 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:14.785937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.786549 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.787376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:14.787791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:14.985222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:14.993410 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5614fe6e-7b1b-47a6-8b28-65b903ab352f tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.218018 Nov 20 21:37:14.994218 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3925/7958] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:14 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:16.012420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:16.013215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:16.019397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:16.019881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:16.020663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:16.021108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:16.155649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:16.163483 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cddaea65-1003-4b5a-be4b-f59be9f99b93 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.156042 Nov 20 21:37:16.164063 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4034/7959] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:16 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:16.226892 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-plugged", "status": "completed", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:16.228493 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:16.228493 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:16.236363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:16.236840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:16.249692 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] Creating event network-vif-plugged:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch1-master-1 Nov 20 21:37:16.255066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:37:16.266429 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-b247399b-ef13-413a-8c80-791a4c46dfb8 req-41734a6d-11a5-4f89-92e3-e8fbf084042e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043139 Nov 20 21:37:16.266999 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3926/7960] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:17.180701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:17.181445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:17.188826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:17.189292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:17.190112 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:17.190569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:17.329803 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:17.338010 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4356aa5f-7fec-462d-ba8d-243921163c8a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.161080 Nov 20 21:37:17.338618 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4035/7961] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:17 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:18.352896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-unplugged", "status": "completed", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:18.354522 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:18.354522 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:18.355528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:18.356270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:18.364715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:18.364896 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:18.365325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:18.365493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:18.366437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:18.366889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:18.379732 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] Creating event network-vif-unplugged:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:37:18.385322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:37:18.398949 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-8778c304-7270-4084-b1e4-02038028f8bb req-f032d486-7902-491f-9eb2-0e8da1e498bc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051014 Nov 20 21:37:18.399884 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3927/7962] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:18 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:18.519834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:18.528144 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-106b22fb-c4e3-4182-b961-04155efa3a1c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.176350 Nov 20 21:37:18.540145 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4036/7963] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:18 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:19.550609 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:19.551297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:19.558156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:19.558605 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:19.559385 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:19.559821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:19.755754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:19.763766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-04da152b-6dcc-4091-bae4-e6fc5b974171 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.217519 Nov 20 21:37:19.764339 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3928/7964] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:19 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:20.416427 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:20.417918 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:20.417918 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:20.426374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:20.426823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:20.438235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] Creating event network-changed:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:37:20.443435 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:37:20.453897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-88f8a9e9-6a2c-4fe5-bd08-d6fb16320c8a req-bd1fe93e-0a49-4c95-8d4e-5d6524339216 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041003 Nov 20 21:37:20.454540 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4037/7965] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:37:20.782465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:20.783088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:20.789775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:20.790543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:20.791297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:20.791737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:21.079488 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:21.087478 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7ba4b2f8-4f8e-4fb2-9121-7ec6517725e1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.309417 Nov 20 21:37:21.088072 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3929/7966] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:20 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:22.105736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:22.106523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:22.113367 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:22.113832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:22.114668 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:22.115127 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:22.411509 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:22.419680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4c945c48-59c6-4abf-aafa-21e31609ed51 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1723 microversion: 2.1 time: 0.318860 Nov 20 21:37:22.420257 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4038/7967] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:22 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:23.437185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:23.437875 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:23.444794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.445243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.446023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.446492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.583692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:23.591579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67556d07-3032-43ac-9537-d5eb162bcacc tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1716 microversion: 2.1 time: 0.158292 Nov 20 21:37:23.592154 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3930/7968] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:23 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:23.608166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:23.609032 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:23.616207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.616674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.617470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.617918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.752114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:23.759866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f530e084-0d42-4049-8dd9-9ef99ae9ac5d tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1716 microversion: 2.1 time: 0.155343 Nov 20 21:37:23.760445 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4039/7969] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:23 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:23.775999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:23.776694 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:23.782912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.783360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.784138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.784573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.915363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:23.923711 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad784a9d-bb52-4e9b-89a8-bc1ab36b9691 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1716 microversion: 2.1 time: 0.151384 Nov 20 21:37:23.924307 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3931/7970] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:23 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:23.939913 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:23.940447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:23.946423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.946807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.947595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:23.948041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:23.973012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:37:24.050107 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4b29386b-fd49-4ebb-8639-c48b8ce162a1 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 204 len: 0 microversion: 2.1 time: 0.114038 Nov 20 21:37:24.050709 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4040/7971] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:23 2021] DELETE /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:37:24.058766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:24.059387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:24.065803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:24.066292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:24.067083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:24.067518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:24.197136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:24.205612 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ebaa9ff3-4802-4c00-8e15-49be3de21323 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1722 microversion: 2.1 time: 0.150532 Nov 20 21:37:24.206216 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3932/7972] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:24 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:25.223995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:25.224613 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:25.231323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:25.231771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:25.232547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:25.232985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:25.367392 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:25.375383 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a9195429-e9bf-431a-a851-45794c1a8808 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1722 microversion: 2.1 time: 0.155466 Nov 20 21:37:25.375959 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4041/7973] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:25 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:25.717113 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5bf5586f-fb06-4a2c-9aaf-60ec0d1169ae req-e6b8b30b-49ca-4f38-a2ab-0e235bbf0b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-plugged", "status": "completed", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:25.719700 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:25.719700 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:25.727897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5bf5586f-fb06-4a2c-9aaf-60ec0d1169ae req-e6b8b30b-49ca-4f38-a2ab-0e235bbf0b50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:25.728571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5bf5586f-fb06-4a2c-9aaf-60ec0d1169ae req-e6b8b30b-49ca-4f38-a2ab-0e235bbf0b50 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:25.742182 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5bf5586f-fb06-4a2c-9aaf-60ec0d1169ae req-e6b8b30b-49ca-4f38-a2ab-0e235bbf0b50 service nova] Creating event network-vif-plugged:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:37:25.747563 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5bf5586f-fb06-4a2c-9aaf-60ec0d1169ae req-e6b8b30b-49ca-4f38-a2ab-0e235bbf0b50 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034209 Nov 20 21:37:25.748526 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3933/7974] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:26.393968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:26.394709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:26.402081 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:26.402555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:26.403387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:26.404007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:26.472124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fabb7e1475ed46099ff09d478ecb5333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55bf4df5c73841dbb6507b288100a89d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:26.480349 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4493420-20d9-4911-9af9-4b0387c00a47 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 200 len: 1655 microversion: 2.1 time: 0.091254 Nov 20 21:37:26.480953 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4042/7975] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:26 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:26.868185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-21423298-647b-4b4d-9bb6-0914f747b939 req-7c135340-a6b4-4654-966b-730a6603408d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3948b658-7d9f-4c4d-af20-ecde86a17dac", "name": "network-vif-deleted", "tag": "481b622d-d624-419e-8480-d83481b42b6e"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:26.871884 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:26.871884 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:26.883428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21423298-647b-4b4d-9bb6-0914f747b939 req-7c135340-a6b4-4654-966b-730a6603408d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:26.884358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-21423298-647b-4b4d-9bb6-0914f747b939 req-7c135340-a6b4-4654-966b-730a6603408d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:26.898127 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-21423298-647b-4b4d-9bb6-0914f747b939 req-7c135340-a6b4-4654-966b-730a6603408d service nova] Creating event network-vif-deleted:481b622d-d624-419e-8480-d83481b42b6e for instance 3948b658-7d9f-4c4d-af20-ecde86a17dac on nch2-master-1 Nov 20 21:37:26.902958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-21423298-647b-4b4d-9bb6-0914f747b939 req-7c135340-a6b4-4654-966b-730a6603408d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 Nov 20 21:37:26.903586 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3934/7976] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:27.498542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:27.499153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:27.505875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:27.506360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:27.507153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:27.507596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:27.522522 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. Nov 20 21:37:27.523114 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:27.523956 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c801793b-8c5e-46ec-a3fe-92b54c75ad0c tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 404 len: 111 microversion: 2.1 time: 0.029221 Nov 20 21:37:27.524519 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4043/7977] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:27 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:27.579764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:27.580771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:27.586824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:27.587272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:27.588053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:27.588487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:27.602489 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. Nov 20 21:37:27.603107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:27.603953 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-70bf2dfc-e933-4c00-85a3-ddeb1aaf038a tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028831 Nov 20 21:37:27.604531 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3935/7978] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:37:27 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:28.831807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.832310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:28.838979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.839438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.840341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.840795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.854552 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. Nov 20 21:37:28.855140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:28.855948 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e97cae0f-6b96-4251-8f2e-ddd4e6bfc8f5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 404 len: 111 microversion: 2.1 time: 0.027838 Nov 20 21:37:28.856486 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4044/7979] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:28 2021] DELETE /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:28.864961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.865566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 3948b658-7d9f-4c4d-af20-ecde86a17dac] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:28.872275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.872724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.873496 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.873931 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.886875 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. Nov 20 21:37:28.887475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 3948b658-7d9f-4c4d-af20-ecde86a17dac could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:28.888286 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cd7cba46-24ff-463c-b740-8730f3c501da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac" status: 404 len: 111 microversion: 2.1 time: 0.027645 Nov 20 21:37:28.888796 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3936/7980] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:28 2021] GET /compute/v2.1/servers/3948b658-7d9f-4c4d-af20-ecde86a17dac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:28.897266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.897823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:28.903694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.904149 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.904925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.906199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.919145 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. Nov 20 21:37:28.919738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:28.920545 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9aa6e201-9ed2-484f-9ca9-11ee02052300 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 404 len: 111 microversion: 2.1 time: 0.026932 Nov 20 21:37:28.921073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4045/7981] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:28 2021] DELETE /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:37:28.928603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.929210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: d6d138a6-d214-4ce9-9326-c8c06f206b5a] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:28.935079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.935529 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.936306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.936878 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.950620 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. Nov 20 21:37:28.951228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance d6d138a6-d214-4ce9-9326-c8c06f206b5a could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:28.952622 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1c0ec301-4564-447f-9801-b182183d61da tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a" status: 404 len: 111 microversion: 2.1 time: 0.027103 Nov 20 21:37:28.953076 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3937/7982] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:28 2021] GET /compute/v2.1/servers/d6d138a6-d214-4ce9-9326-c8c06f206b5a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:28.961145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.961659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:28.967622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.968973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.969810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:28.970301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:28.983293 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. Nov 20 21:37:28.984208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:28.985075 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e88250a8-0189-463e-9793-1cf701f4dc75 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 404 len: 111 microversion: 2.1 time: 0.027737 Nov 20 21:37:28.985599 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4046/7983] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:28 2021] DELETE /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:28.993458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:28.994115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: 15807139-1482-45f2-bba9-2c1fae724944] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:29.000196 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.000660 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.001450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.001896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.015737 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. Nov 20 21:37:29.016331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance 15807139-1482-45f2-bba9-2c1fae724944 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:29.017155 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dd5d3f59-b8f0-4492-a8e0-42e1201e8fc6 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944" status: 404 len: 111 microversion: 2.1 time: 0.027404 Nov 20 21:37:29.017692 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3938/7984] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:28 2021] GET /compute/v2.1/servers/15807139-1482-45f2-bba9-2c1fae724944 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:29.026339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:29.026859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:29.034089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.034566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.035372 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.035815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.049447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. Nov 20 21:37:29.050128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:29.050965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ecabd1db-2598-4bbb-86f4-57da19704498 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 404 len: 111 microversion: 2.1 time: 0.028346 Nov 20 21:37:29.051497 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4047/7985] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:29 2021] DELETE /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:29.059110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:29.059715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [instance: c1187118-c4d6-4cd7-81c9-b04213c8a1fe] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:29.065724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.066147 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.066923 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:29.067365 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:29.082217 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] HTTP exception thrown: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. Nov 20 21:37:29.082800 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Returning 404 to user: Instance c1187118-c4d6-4cd7-81c9-b04213c8a1fe could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:29.083604 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4bb995d-109b-429e-94dc-3f843bee61b5 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe" status: 404 len: 111 microversion: 2.1 time: 0.028116 Nov 20 21:37:29.084131 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3939/7986] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:29 2021] GET /compute/v2.1/servers/c1187118-c4d6-4cd7-81c9-b04213c8a1fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:29.091815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32bf0f4f-cdc5-4212-a4f3-302f341693f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] Calling method '.version_select at 0x7f3f87697ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:29.095693 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32bf0f4f-cdc5-4212-a4f3-302f341693f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [28696bb2-e50c-4fce-9953-ddeeb3a229a9] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:37:30.115732 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [None req-32bf0f4f-cdc5-4212-a4f3-302f341693f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] [28696bb2-e50c-4fce-9953-ddeeb3a229a9] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 48098. Nov 20 21:37:30.135055 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32bf0f4f-cdc5-4212-a4f3-302f341693f2 tempest-ServerActionsTestJSON-1681873499 tempest-ServerActionsTestJSON-1681873499-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679284054" status: 202 len: 0 microversion: 2.1 time: 1.046783 Nov 20 21:37:30.135643 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4048/7987] 10.222.0.41 () {58 vars in 1220 bytes} [Sat Nov 20 21:37:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679284054 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:37:36.012396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1256327390", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "ad0f68cf-fd8b-4c75-b661-ed8f88e3fcba"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:36.067938 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] validate_networks() for [('ad0f68cf-fd8b-4c75-b661-ed8f88e3fcba', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:37:36.421328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:37:36.421752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:37:36.422266 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:37:36.422677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:37:36.423085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:37:36.431845 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:36.432290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:36.433100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:36.433533 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:36.449638 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Getting quotas for project e0e366a8df1e4db69206428f71e9b628. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:37:36.455464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Getting quotas for user b0eb77e9680b44c18239648356c164f9 and project e0e366a8df1e4db69206428f71e9b628. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:37:36.467117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:37:36.470153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:37:36.512759 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-62a65156-9f31-4178-96c6-c7d98a1a8076 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621227 Nov 20 21:37:36.513715 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3940/7988] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:37:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:37:36.525976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-842f5c60-1557-4faa-b166-5360fa5a7869 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:36.526638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-842f5c60-1557-4faa-b166-5360fa5a7869 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:36.579678 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-842f5c60-1557-4faa-b166-5360fa5a7869 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:36.586341 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-842f5c60-1557-4faa-b166-5360fa5a7869 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1217 microversion: 2.1 time: 0.065929 Nov 20 21:37:36.587001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4049/7989] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:36 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:37.605834 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:37.606558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:37.617163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:37.618010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:37.619243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:37.619881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:37.700655 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:37.708240 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-683231ae-ba76-44d6-ab72-a22633d98093 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1287 microversion: 2.1 time: 0.108513 Nov 20 21:37:37.708814 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3941/7990] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:37 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:38.724622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:38.725266 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:38.731980 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:38.732438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:38.733767 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:38.734248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:38.871900 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:38.880642 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5917ae7b-3b68-4aa6-8604-ff1dd4ec6046 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.159446 Nov 20 21:37:38.881234 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4050/7991] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:38 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:37:38.952829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-23a87023-96ba-430f-bdc6-37054b0cc4ef req-4cc22450-001f-4105-9951-d18c5fbb02aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ef83420-de9c-4282-8103-b8ebecfce066", "tag": "e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:38.954398 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:38.954398 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:37:38.961561 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-23a87023-96ba-430f-bdc6-37054b0cc4ef req-4cc22450-001f-4105-9951-d18c5fbb02aa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:38.962103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-23a87023-96ba-430f-bdc6-37054b0cc4ef req-4cc22450-001f-4105-9951-d18c5fbb02aa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:38.973602 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-23a87023-96ba-430f-bdc6-37054b0cc4ef req-4cc22450-001f-4105-9951-d18c5fbb02aa service nova] Creating event network-changed:e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9 for instance 8ef83420-de9c-4282-8103-b8ebecfce066 on nch2-master-1 Nov 20 21:37:38.978901 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-23a87023-96ba-430f-bdc6-37054b0cc4ef req-4cc22450-001f-4105-9951-d18c5fbb02aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108693 Nov 20 21:37:38.979888 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3942/7992] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:37:39.897157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:39.897784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:39.904574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:39.905271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:39.906095 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:39.906551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:40.037305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:40.044652 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-117cae5c-ec54-459e-bc15-521344fe7ffa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.151191 Nov 20 21:37:40.045221 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4051/7993] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:39 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:41.062038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:41.062859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:41.069857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:41.070350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:41.071143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:41.071588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:41.204600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:41.211829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-793d8a69-a529-4ffe-b6ba-6d242be45298 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.153827 Nov 20 21:37:41.212395 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3943/7994] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:41 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:42.228451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:42.229091 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:42.236433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:42.237141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:42.237924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:42.238396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:42.372638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:42.379919 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-12a12599-e73d-44de-b917-d10dbb2f0748 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.155130 Nov 20 21:37:42.380470 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4052/7995] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:42 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:43.396487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:43.397107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:43.403824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:43.404317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:43.405329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:43.405853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:43.537583 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:43.545061 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9477c1ef-d239-4b40-a844-175821ea8fdf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.152294 Nov 20 21:37:43.546444 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3944/7996] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:43 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:43.842212 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0c4ca37d-56be-4ec2-a561-012041d29062 req-6707dd8a-514f-4bfb-8509-9f894b6a3533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef83420-de9c-4282-8103-b8ebecfce066", "name": "network-vif-plugged", "status": "completed", "tag": "e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:43.844571 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:43.844571 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:43.851979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c4ca37d-56be-4ec2-a561-012041d29062 req-6707dd8a-514f-4bfb-8509-9f894b6a3533 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:43.852765 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0c4ca37d-56be-4ec2-a561-012041d29062 req-6707dd8a-514f-4bfb-8509-9f894b6a3533 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:43.864512 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0c4ca37d-56be-4ec2-a561-012041d29062 req-6707dd8a-514f-4bfb-8509-9f894b6a3533 service nova] Creating event network-vif-plugged:e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9 for instance 8ef83420-de9c-4282-8103-b8ebecfce066 on nch2-master-1 Nov 20 21:37:43.869638 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0c4ca37d-56be-4ec2-a561-012041d29062 req-6707dd8a-514f-4bfb-8509-9f894b6a3533 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098831 Nov 20 21:37:43.870273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4053/7997] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:37:44.563747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:44.564367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:44.572013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:44.572507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:44.573302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:44.573739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:44.710828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:44.720523 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4f32f2c-7b2e-41c1-9029-8c0c1da9d9d3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1317 microversion: 2.1 time: 0.161387 Nov 20 21:37:44.721096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3945/7998] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:44 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:45.737624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:45.738413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:45.746005 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:45.746504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:45.747324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:45.747777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:45.884730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:45.892906 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d633c6e1-37f6-4586-8da0-329e486eb84a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.159900 Nov 20 21:37:45.893471 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4054/7999] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:45 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:45.945591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-984938371", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "ad0f68cf-fd8b-4c75-b661-ed8f88e3fcba"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:46.000174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] validate_networks() for [('ad0f68cf-fd8b-4c75-b661-ed8f88e3fcba', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:37:46.361362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:37:46.362039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:37:46.362534 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:37:46.362937 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:37:46.363342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:37:46.372519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:46.372965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:46.374414 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:46.374852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:46.390787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Getting quotas for project e0e366a8df1e4db69206428f71e9b628. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:37:46.395708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Getting quotas for user b0eb77e9680b44c18239648356c164f9 and project e0e366a8df1e4db69206428f71e9b628. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:37:46.407449 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:37:46.409740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:37:46.453068 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6704c5b2-9dcc-4ee3-b77d-0dab06890942 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511041 Nov 20 21:37:46.453714 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3946/8000] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:37:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:37:46.463501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-80de9c5c-f614-4858-a781-33c0fb451f4e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:46.464145 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-80de9c5c-f614-4858-a781-33c0fb451f4e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:46.517956 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-80de9c5c-f614-4858-a781-33c0fb451f4e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:46.524771 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-80de9c5c-f614-4858-a781-33c0fb451f4e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1216 microversion: 2.1 time: 0.065060 Nov 20 21:37:46.525356 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4055/8001] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:46 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:47.543173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:47.543781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:47.553376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:47.553827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:47.554651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:47.555088 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:47.629513 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:47.637117 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aadde141-ef3f-46e1-b857-22b2c62d2193 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1274 microversion: 2.1 time: 0.098404 Nov 20 21:37:47.637744 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3947/8002] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:47 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1274 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:48.648628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f619a4c5-1265-461c-8804-75cfaab6f798 req-b6625328-8e83-42e7-b606-9b3686b91a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4921c8fc-c5df-4aec-907f-47b18030ad7f", "tag": "01a0453d-c56e-4f66-ad90-0a7167613e61"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:48.651213 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:48.651213 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:48.653568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:48.654203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:48.661261 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:48.661711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:48.662576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:48.663191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:48.669742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f619a4c5-1265-461c-8804-75cfaab6f798 req-b6625328-8e83-42e7-b606-9b3686b91a9c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:48.670866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f619a4c5-1265-461c-8804-75cfaab6f798 req-b6625328-8e83-42e7-b606-9b3686b91a9c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:48.684031 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f619a4c5-1265-461c-8804-75cfaab6f798 req-b6625328-8e83-42e7-b606-9b3686b91a9c service nova] Creating event network-changed:01a0453d-c56e-4f66-ad90-0a7167613e61 for instance 4921c8fc-c5df-4aec-907f-47b18030ad7f on nch1-master-1 Nov 20 21:37:48.690122 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f619a4c5-1265-461c-8804-75cfaab6f798 req-b6625328-8e83-42e7-b606-9b3686b91a9c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045872 Nov 20 21:37:48.691293 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4056/8003] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:48.879802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:48.887220 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52680b3d-eff6-4007-bca6-212f504e3461 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.237178 Nov 20 21:37:48.890369 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3948/8004] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:48 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:49.905865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:49.906605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:49.913210 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:49.913670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:49.914531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:49.914984 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:50.049010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:50.056661 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea76076b-3348-4aea-b2e8-e862a057e08e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.155736 Nov 20 21:37:50.057242 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4057/8005] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:49 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:51.073581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:51.074245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:51.081650 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:51.082134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:51.082915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:51.083351 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:51.216350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:51.223651 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b9c43e12-64e8-4d06-8353-6d7845eb5a12 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.153709 Nov 20 21:37:51.224222 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3949/8006] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:51 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:52.240437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:52.241094 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:52.247848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:52.248334 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:52.249556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:52.250014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:52.383133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:52.390994 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4add6c6-ce4b-4ccd-844f-befe3c2c8ebb tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.154567 Nov 20 21:37:52.391506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4058/8007] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:52 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:53.408303 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:53.408891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:53.415862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:53.416372 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:53.417162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:53.417610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:53.549012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:53.556520 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b4018ab-4b38-4f9c-8a23-6884c1062b61 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.152470 Nov 20 21:37:53.557093 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3950/8008] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:53 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:54.308624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fe431b09-e0b1-497b-a768-c584caabb04d req-162733f3-ed38-45b6-9f0f-1886dac3ebaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4921c8fc-c5df-4aec-907f-47b18030ad7f", "name": "network-vif-plugged", "status": "completed", "tag": "01a0453d-c56e-4f66-ad90-0a7167613e61"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:54.310169 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:54.310169 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:54.318741 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fe431b09-e0b1-497b-a768-c584caabb04d req-162733f3-ed38-45b6-9f0f-1886dac3ebaa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:54.319204 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fe431b09-e0b1-497b-a768-c584caabb04d req-162733f3-ed38-45b6-9f0f-1886dac3ebaa service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:54.330342 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fe431b09-e0b1-497b-a768-c584caabb04d req-162733f3-ed38-45b6-9f0f-1886dac3ebaa service nova] Creating event network-vif-plugged:01a0453d-c56e-4f66-ad90-0a7167613e61 for instance 4921c8fc-c5df-4aec-907f-47b18030ad7f on nch1-master-1 Nov 20 21:37:54.335045 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fe431b09-e0b1-497b-a768-c584caabb04d req-162733f3-ed38-45b6-9f0f-1886dac3ebaa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030110 Nov 20 21:37:54.335846 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4059/8009] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:37:54.573179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:54.573799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:54.580788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:54.581292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:54.582133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:54.582578 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:54.717061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:54.724809 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21f67f6a-f018-461f-ad88-8e1684bd78da tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1316 microversion: 2.1 time: 0.155300 Nov 20 21:37:54.725378 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3951/8010] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:54 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:55.742791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:55.743495 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:55.750329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:55.750982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:55.751773 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:55.752223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:55.881336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:55.888695 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ed6b33c4-a419-4ee5-8cdf-8cd61c7d151c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1505 microversion: 2.1 time: 0.150781 Nov 20 21:37:55.889252 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4060/8011] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:55 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:55.904477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:55.904998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:55.911889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:55.912347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:55.913143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:55.913588 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:55.938706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:37:56.014855 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ef35bb90-ec8c-4a08-9f39-b714756356b0 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 204 len: 0 microversion: 2.1 time: 0.113799 Nov 20 21:37:56.015599 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3952/8012] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:55 2021] DELETE /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 20 21:37:56.023481 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:56.024099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:56.029979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:56.030464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:56.031447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:56.031829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:56.166201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:56.174191 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-df314b64-88fe-49df-adff-75f0855595a3 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1511 microversion: 2.1 time: 0.154342 Nov 20 21:37:56.174777 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4061/8013] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:56 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:57.192295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:57.192930 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:57.199287 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:57.199742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:57.200525 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:57.200964 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:57.354441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:57.362748 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fbd00858-f3ed-4ac9-bfe7-87c9e4960b11 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 200 len: 1511 microversion: 2.1 time: 0.174706 Nov 20 21:37:57.363590 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3953/8014] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:57 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:57.779979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-8f344571-f071-4b44-970c-113429821d9a req-99edfcbb-0cbc-45f1-ab51-1342184e4a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4921c8fc-c5df-4aec-907f-47b18030ad7f", "name": "network-vif-deleted", "tag": "01a0453d-c56e-4f66-ad90-0a7167613e61"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:57.782911 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:37:57.782911 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:37:57.793673 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8f344571-f071-4b44-970c-113429821d9a req-99edfcbb-0cbc-45f1-ab51-1342184e4a71 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:57.794165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-8f344571-f071-4b44-970c-113429821d9a req-99edfcbb-0cbc-45f1-ab51-1342184e4a71 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:57.809514 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-8f344571-f071-4b44-970c-113429821d9a req-99edfcbb-0cbc-45f1-ab51-1342184e4a71 service nova] Creating event network-vif-deleted:01a0453d-c56e-4f66-ad90-0a7167613e61 for instance 4921c8fc-c5df-4aec-907f-47b18030ad7f on nch1-master-1 Nov 20 21:37:57.815330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-8f344571-f071-4b44-970c-113429821d9a req-99edfcbb-0cbc-45f1-ab51-1342184e4a71 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039629 Nov 20 21:37:57.815958 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4062/8015] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:37:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:37:58.379730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:58.380288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.386954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.387405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.388208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.388641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.401579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. Nov 20 21:37:58.402187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 404 to user: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:58.402987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-356ac3f2-1afa-492e-a900-8bf0b4bcac55 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 404 len: 111 microversion: 2.1 time: 0.027368 Nov 20 21:37:58.403509 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3954/8016] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:58 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:58.413010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:58.413723 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.419821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.420284 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.421098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.422207 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.554948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:58.562224 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2acd4415-9f5b-42fe-9b68-19687c29e19a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.153241 Nov 20 21:37:58.562795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4063/8017] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:58 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:58.578481 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50f2fc5d-68b1-4a6c-88bc-174df95d870e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:58.579510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-50f2fc5d-68b1-4a6c-88bc-174df95d870e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: d577df01-d9d7-4707-80ed-b4fa37fce67d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.584861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-50f2fc5d-68b1-4a6c-88bc-174df95d870e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Instance d577df01-d9d7-4707-80ed-b4fa37fce67d could not be found. Nov 20 21:37:58.585417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-50f2fc5d-68b1-4a6c-88bc-174df95d870e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 404 to user: Instance d577df01-d9d7-4707-80ed-b4fa37fce67d could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:58.586334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-50f2fc5d-68b1-4a6c-88bc-174df95d870e tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "POST /compute/v2.1/servers/d577df01-d9d7-4707-80ed-b4fa37fce67d/action" status: 404 len: 111 microversion: 2.1 time: 0.011716 Nov 20 21:37:58.586887 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3955/8018] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:37:58 2021] POST /compute/v2.1/servers/d577df01-d9d7-4707-80ed-b4fa37fce67d/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:58.594951 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:58.595630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.601971 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.602466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.603248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.603691 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.738801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:58.746120 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3a7070c7-690c-4576-bf01-29631ba5cdbd tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.155325 Nov 20 21:37:58.746690 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4064/8019] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:58 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:58.764440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:58.765097 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.771805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.772258 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.773038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.773471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.903490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:58.911502 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fc9c010e-f95c-4b7b-ab41-55706be22aaf tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.150672 Nov 20 21:37:58.912063 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3956/8020] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:58 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:58.927497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "93a74cca-ef82-45ef-bf43-36f6d40214e7"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:58.928458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.935007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.935460 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.936238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.936680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.964102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:58.969914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Flavor 93a74cca-ef82-45ef-bf43-36f6d40214e7 could not be found. Nov 20 21:37:58.970548 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 400 to user: Flavor 93a74cca-ef82-45ef-bf43-36f6d40214e7 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:58.971385 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffa3982d-c0ac-48cd-a0e9-af67272127f7 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "POST /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066/action" status: 400 len: 107 microversion: 2.1 time: 0.047784 Nov 20 21:37:58.972037 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4065/8021] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:37:58 2021] POST /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066/action => generated 107 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 20 21:37:58.980041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:58.980659 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:58.986980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.987430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:58.988212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:58.988651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.118140 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:59.125608 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b6ed1f2a-03a6-4b6e-8e7f-0440ebd801ad tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.149305 Nov 20 21:37:59.126199 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3957/8022] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:58 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:59.143018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.143637 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.149330 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.149791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.150652 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.151102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.282564 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:59.289915 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-150367e0-0f84-405e-a185-b57e65950178 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.151226 Nov 20 21:37:59.290525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4066/8023] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:59 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:59.306041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30076eca-bf82-4b2f-a002-b29402421b20 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:37:59.307251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-30076eca-bf82-4b2f-a002-b29402421b20 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:59.308044 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-30076eca-bf82-4b2f-a002-b29402421b20 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "POST /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066/action" status: 400 len: 113 microversion: 2.1 time: 0.005866 Nov 20 21:37:59.308556 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3958/8024] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:37:59 2021] POST /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 20 21:37:59.316129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.316751 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.322679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.323139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.323929 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.324379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.456369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:59.463764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ba090b5a-cf4c-4d43-bfd9-d68e549ab482 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1507 microversion: 2.1 time: 0.151575 Nov 20 21:37:59.464333 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4067/8025] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:59 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:37:59.484027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.484527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.491763 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.492226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.493038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.493477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.506629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. Nov 20 21:37:59.507212 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 404 to user: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:59.508023 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68d348c1-ac72-4c71-91c9-772e2fe9759a tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 404 len: 111 microversion: 2.1 time: 0.028617 Nov 20 21:37:59.508553 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3959/8026] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:59 2021] DELETE /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:59.517793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.518446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 4921c8fc-c5df-4aec-907f-47b18030ad7f] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.524490 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.524953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.525750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.526229 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.540440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. Nov 20 21:37:59.541036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 404 to user: Instance 4921c8fc-c5df-4aec-907f-47b18030ad7f could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:37:59.541856 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0440fb07-dee8-447a-acfb-a4a5f03066e2 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f" status: 404 len: 111 microversion: 2.1 time: 0.029012 Nov 20 21:37:59.542433 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4068/8027] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:59 2021] GET /compute/v2.1/servers/4921c8fc-c5df-4aec-907f-47b18030ad7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:37:59.551348 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.551840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.557666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.558145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.558922 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.559356 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.583701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:37:59.654494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-386a56be-bd2c-4f0e-ab33-6283223d9d1c tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 204 len: 0 microversion: 2.1 time: 0.107462 Nov 20 21:37:59.655095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3960/8028] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:37:59 2021] DELETE /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:37:59.664224 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:37:59.664868 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:37:59.670831 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.671446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.672238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:37:59.672683 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:37:59.806215 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:37:59.814208 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-989ee435-debb-48e3-bd60-277b2b3fccaa tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1513 microversion: 2.1 time: 0.153639 Nov 20 21:37:59.814882 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4069/8029] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:37:59 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:00.831246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:00.831854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:00.838490 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:00.838940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:00.839715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:00.840151 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:00.974507 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:00.981834 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4f4259f8-2a8b-46eb-a727-0c0d5c85028d tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1513 microversion: 2.1 time: 0.154691 Nov 20 21:38:00.982450 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3961/8030] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:00 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:01.878943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ce5e55ce-0fc8-4396-86c7-b77187a92fd0 req-4209133c-91ec-4f3f-ad71-e28314366f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ef83420-de9c-4282-8103-b8ebecfce066", "name": "network-vif-deleted", "tag": "e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:38:01.882270 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:38:01.882270 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:38:01.890596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ce5e55ce-0fc8-4396-86c7-b77187a92fd0 req-4209133c-91ec-4f3f-ad71-e28314366f41 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:01.891194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ce5e55ce-0fc8-4396-86c7-b77187a92fd0 req-4209133c-91ec-4f3f-ad71-e28314366f41 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:01.904604 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ce5e55ce-0fc8-4396-86c7-b77187a92fd0 req-4209133c-91ec-4f3f-ad71-e28314366f41 service nova] Creating event network-vif-deleted:e39d2c16-1e92-41d4-b6e3-9e1d7aa082b9 for instance 8ef83420-de9c-4282-8103-b8ebecfce066 on nch2-master-1 Nov 20 21:38:01.910203 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ce5e55ce-0fc8-4396-86c7-b77187a92fd0 req-4209133c-91ec-4f3f-ad71-e28314366f41 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034903 Nov 20 21:38:01.910798 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4070/8031] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:38:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:38:01.999014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:01.999970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:02.006751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:02.007208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:02.008033 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:02.008477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:02.039643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:02.040094 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:02.040603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lazy-loading 'fault' on Instance uuid 8ef83420-de9c-4282-8103-b8ebecfce066 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:38:02.079480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0eb77e9680b44c18239648356c164f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e366a8df1e4db69206428f71e9b628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:02.086783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6f369c82-d2f4-43b8-be05-055e3fdb953f tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 200 len: 1307 microversion: 2.1 time: 0.091535 Nov 20 21:38:02.087354 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3962/8032] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:01 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:03.105473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:03.106201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] [instance: 8ef83420-de9c-4282-8103-b8ebecfce066] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:03.113788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:03.114300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:03.115169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:03.115690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:03.129484 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] HTTP exception thrown: Instance 8ef83420-de9c-4282-8103-b8ebecfce066 could not be found. Nov 20 21:38:03.130118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] Returning 404 to user: Instance 8ef83420-de9c-4282-8103-b8ebecfce066 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:38:03.131117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b216a565-caf0-4619-9a82-15794c15d425 tempest-ServersNegativeTestJSON-1501262046 tempest-ServersNegativeTestJSON-1501262046-project] 10.222.0.41 "GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066" status: 404 len: 111 microversion: 2.1 time: 0.030559 Nov 20 21:38:03.131676 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4071/8033] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:03 2021] GET /compute/v2.1/servers/8ef83420-de9c-4282-8103-b8ebecfce066 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:38:40.532653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'create', calling method: .version_select at 0x7f3f869e5700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-322903231"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:38:40.547693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:38:40.552042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for user 3a7159b6f2da4ed9be05f40ca1350065 and project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:38:40.676476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:38:40.681250 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for user 3a7159b6f2da4ed9be05f40ca1350065 and project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:38:40.695494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-593ee14b-4520-4c98-b400-24ac5beb98a0 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.166911 Nov 20 21:38:40.696301 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3963/8034] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:38:40 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:40.747781 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-850122769", "imageRef": "03571814-9bfe-41b6-aea5-b6db59bcf776", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-322903231", "networks": [{"uuid": "af2ba9c3-3c44-4e20-a12e-1b657dc72441"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:38:40.798244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] validate_networks() for [('af2ba9c3-3c44-4e20-a12e-1b657dc72441', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:38:41.259408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:38:41.259839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:38:41.260321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:38:41.260733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:38:41.261150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:38:41.269782 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:41.270287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:41.271101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:41.271543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:41.289387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:38:41.294567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Getting quotas for user 3a7159b6f2da4ed9be05f40ca1350065 and project f906d7e9f9d3403cb293a7003cdcdfaa. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:38:41.307053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:38:41.309287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03571814-9bfe-41b6-aea5-b6db59bcf776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:38:41.352665 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-68636812-7a45-4333-b335-51c28aa80836 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608492 Nov 20 21:38:41.353308 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4072/8035] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:38:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:38:41.363590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-20e19d7e-e6f0-4858-b131-0f285cc267ab tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:41.364197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-20e19d7e-e6f0-4858-b131-0f285cc267ab tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:41.415082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-20e19d7e-e6f0-4858-b131-0f285cc267ab tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:41.422780 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-20e19d7e-e6f0-4858-b131-0f285cc267ab tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1257 microversion: 2.1 time: 0.063056 Nov 20 21:38:41.423335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3964/8036] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:41 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:42.440341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:42.440958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:42.447451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:42.447912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:42.448709 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:42.449328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:42.512552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:42.532840 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-88712584-e8b5-47ea-93b6-aa075d993524 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1315 microversion: 2.1 time: 0.097051 Nov 20 21:38:42.533748 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4073/8037] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:42 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:43.550599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:43.551251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:43.559093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:43.559560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:43.560460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:43.561000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:43.703985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:43.712070 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2d95de92-0cbf-4bc2-9aef-e092ade840a8 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.165119 Nov 20 21:38:43.712654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3965/8038] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:43 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:44.730012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:44.730702 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:44.738560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:44.739016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:44.739811 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:44.740261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:44.886128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:44.895339 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3bf04b27-3ae0-4d0a-91a7-bc6ccaeb3e6e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.168885 Nov 20 21:38:44.896371 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4074/8039] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:44 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:45.913182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:45.913796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:45.922453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:45.923423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:45.924511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:45.925182 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:46.068622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:46.077179 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-21cf4e3a-1017-4bec-90c9-26027b38380d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.167371 Nov 20 21:38:46.078101 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3966/8040] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:45 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:47.098001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:47.098987 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:47.106715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:47.107270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:47.108933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:47.109458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:47.259531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:47.268502 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-87b06801-c5b3-4545-9ee5-18bacc8551ee tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.176979 Nov 20 21:38:47.269328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4075/8041] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:47 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:48.285277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:48.285935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:48.292695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:48.293148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:48.293929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:48.294392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:48.436468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:48.445747 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0f249117-d48d-4d30-adba-a3dffd916d52 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.163177 Nov 20 21:38:48.450264 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3967/8042] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:48 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:49.463449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:49.464067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:49.471324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:49.471772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:49.472554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:49.473078 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:49.618701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:49.626263 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-43f55cda-64b7-4cee-bdc1-223c0791d68a tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.166552 Nov 20 21:38:49.626838 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4076/8043] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:49 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:50.642982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:50.643628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:50.650724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:50.651184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:50.651987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:50.652434 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:50.797437 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:50.806218 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c8f56cc7-1004-4c03-aa37-32a71058977c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.166848 Nov 20 21:38:50.814082 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3968/8044] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:50 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:51.824024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:51.824605 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:51.832253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:51.832712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:51.833501 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:51.833949 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:51.988272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:51.995674 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-be181c39-0f0c-4ad0-a555-c1ec7f7989fe tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.175574 Nov 20 21:38:51.996261 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4077/8045] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:51 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:53.012566 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:53.013262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:53.020720 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:53.021199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:53.021993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:53.022465 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:53.622072 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:53.632137 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0182362c-e11d-4094-af15-95fdb301db61 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.623167 Nov 20 21:38:53.633593 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3969/8046] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:53 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:53.778362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-63f40d4b-2d67-4b5d-b6f5-a4c1684023b7 req-7446bb77-0891-4472-b846-1efc5a007479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:38:53.780289 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:38:53.780289 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:38:53.791413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63f40d4b-2d67-4b5d-b6f5-a4c1684023b7 req-7446bb77-0891-4472-b846-1efc5a007479 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:53.792147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-63f40d4b-2d67-4b5d-b6f5-a4c1684023b7 req-7446bb77-0891-4472-b846-1efc5a007479 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:53.804889 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-63f40d4b-2d67-4b5d-b6f5-a4c1684023b7 req-7446bb77-0891-4472-b846-1efc5a007479 service nova] Creating event network-changed:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:38:53.810250 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-63f40d4b-2d67-4b5d-b6f5-a4c1684023b7 req-7446bb77-0891-4472-b846-1efc5a007479 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035787 Nov 20 21:38:53.811889 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4078/8047] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:38:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:38:54.650796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:54.651406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:54.659017 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:54.659468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:54.660253 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:54.660686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:54.809744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:54.820204 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4e25e2ab-cab6-482b-bd79-69a89ee1033f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.172994 Nov 20 21:38:54.821113 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3970/8048] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:54 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:55.839137 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:55.839753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:55.846983 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:55.847445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:55.848233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:55.848677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:55.983722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:55.991290 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4d662d69-9837-4f42-83d8-46fbb8b3dd09 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.157116 Nov 20 21:38:55.991851 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4079/8049] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:55 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:57.008692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:57.009306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:57.016731 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:57.017192 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:57.017993 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:57.018463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:57.151431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:57.159033 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-551c4bfc-0081-486c-a1ab-4751e05d5107 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.154102 Nov 20 21:38:57.159606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3971/8050] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:57 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:58.175886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:58.176628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:58.184052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:58.184515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:58.185354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:58.185832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:58.324582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:58.332345 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1cea649-f4a1-4efc-a33e-06714ec402e6 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.160159 Nov 20 21:38:58.332904 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4080/8051] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:58 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:38:59.348614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:38:59.349190 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:38:59.355965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:59.356419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:59.358001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:38:59.358518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:38:59.489710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:38:59.497244 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47656808-7f3b-43fb-93ec-ab67d27fafb7 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.152428 Nov 20 21:38:59.497905 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3972/8052] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:38:59 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:00.144248 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3d266baf-27d8-4e25-8281-a2b1df160881 req-1abb055a-7a16-4243-9a86-b56e6cf5cbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "name": "network-vif-plugged", "status": "completed", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:00.145816 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:39:00.145816 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:39:00.153368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3d266baf-27d8-4e25-8281-a2b1df160881 req-1abb055a-7a16-4243-9a86-b56e6cf5cbe0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:00.153828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3d266baf-27d8-4e25-8281-a2b1df160881 req-1abb055a-7a16-4243-9a86-b56e6cf5cbe0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:00.165081 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3d266baf-27d8-4e25-8281-a2b1df160881 req-1abb055a-7a16-4243-9a86-b56e6cf5cbe0 service nova] Creating event network-vif-plugged:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:39:00.169927 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3d266baf-27d8-4e25-8281-a2b1df160881 req-1abb055a-7a16-4243-9a86-b56e6cf5cbe0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030358 Nov 20 21:39:00.170647 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4081/8053] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:39:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:39:00.514636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:00.515342 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:00.522166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:00.522619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:00.523416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:00.524170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:00.655509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:00.662936 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2c0d35dd-9b18-4056-a561-21b1a21477c5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1357 microversion: 2.1 time: 0.152570 Nov 20 21:39:00.663511 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3973/8054] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:00 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:01.681633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:01.682365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:01.689037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:01.689494 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:01.690385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:01.690839 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:01.827440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:01.834881 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-de0b439c-f144-4834-bc59-26de99705a48 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1547 microversion: 2.1 time: 0.158067 Nov 20 21:39:01.835460 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4082/8055] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:01 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:01.850692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:01.851332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:01.857935 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:01.858903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:01.859677 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:01.860110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:01.994807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:02.003075 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4a6280c1-ff3c-4136-99a6-e07f701d0269 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1547 microversion: 2.1 time: 0.156033 Nov 20 21:39:02.003647 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3974/8056] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:01 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:02.018446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:02.021707 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:39:02.021707 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:39:02.022744 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:02.023493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Searching by: {'deleted': False, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa'} {{(pid=140941) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 20 21:39:02.028989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:02.029504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:02.030419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:02.030862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:02.053737 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.multi_cell_list [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140941) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 20 21:39:02.080395 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e8f83f3-a9df-4c61-bd3b-7e27e3d1279f tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.065403 Nov 20 21:39:02.080898 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4083/8057] 10.222.0.41 () {58 vars in 1124 bytes} [Sat Nov 20 21:39:02 2021] GET /compute/v2.1/servers => generated 342 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:39:02.090739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:02.091347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:02.101548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:02.102001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:02.102809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:02.103245 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:02.232404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:02.240333 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8736cd9-6b58-41f4-9ea3-a75dc99fdd76 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1547 microversion: 2.1 time: 0.153166 Nov 20 21:39:02.240967 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3975/8058] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:02 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:03.723322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c01d06e1-04b2-415f-8356-72ef323aafd4"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:03.724390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:03.731110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:03.731769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:03.732561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:03.733595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:03.960600 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e5e91402-1e9c-48e9-8384-02bbf09a12f5 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.241021 Nov 20 21:39:03.961245 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4084/8059] 10.222.0.41 () {60 vars in 1322 bytes} [Sat Nov 20 21:39:03 2021] POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:39:07.270730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:07.271344 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:07.278025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:07.278528 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:07.279313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:07.279758 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:07.411568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:07.419430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a158a0c2-4bd0-4645-a79b-703a0454e2b1 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1593 microversion: 2.1 time: 0.152292 Nov 20 21:39:07.420012 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3976/8060] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:07 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:09.103123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-131e02ca-a8ed-4047-852a-0aebab3145dc req-8919346a-1edf-4188-8783-3878cfe5bfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:09.104744 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:39:09.104744 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:39:09.113300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-131e02ca-a8ed-4047-852a-0aebab3145dc req-8919346a-1edf-4188-8783-3878cfe5bfc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:09.113753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-131e02ca-a8ed-4047-852a-0aebab3145dc req-8919346a-1edf-4188-8783-3878cfe5bfc7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:09.124819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-131e02ca-a8ed-4047-852a-0aebab3145dc req-8919346a-1edf-4188-8783-3878cfe5bfc7 service nova] Creating event network-changed:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:39:09.129723 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-131e02ca-a8ed-4047-852a-0aebab3145dc req-8919346a-1edf-4188-8783-3878cfe5bfc7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031520 Nov 20 21:39:09.130984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4085/8061] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:39:10.095308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2096921102"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:10.096581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:10.104019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:10.104522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:10.105273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:10.105715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:10.241244 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.network.security_group_api [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Adding security group ca420aff-59dc-432f-b81a-4d5584573b04 to port 016e2b25-da18-4de5-9665-d9aa89ce3e98 Nov 20 21:39:10.586144 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-49e0c9cf-8e73-4abb-b2cb-285815d5a517 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action" status: 202 len: 0 microversion: 2.1 time: 0.494498 Nov 20 21:39:10.586346 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3977/8062] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:39:10 2021] POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:39:10.598800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:10.599607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:10.608100 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:10.613061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:10.614222 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:10.615061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:10.790352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:10.798926 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a3a60748-d33a-415c-887e-39627de73dc4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1759 microversion: 2.1 time: 0.207233 Nov 20 21:39:10.799654 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4086/8063] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:10 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1759 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:39:11.147860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1408d840-66ce-4808-8a53-5d90ea88b230 req-cbb72558-999f-407b-9c5b-0d09b2333961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:11.149434 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:39:11.149434 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:39:11.156624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1408d840-66ce-4808-8a53-5d90ea88b230 req-cbb72558-999f-407b-9c5b-0d09b2333961 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:11.157061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1408d840-66ce-4808-8a53-5d90ea88b230 req-cbb72558-999f-407b-9c5b-0d09b2333961 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:11.168188 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1408d840-66ce-4808-8a53-5d90ea88b230 req-cbb72558-999f-407b-9c5b-0d09b2333961 service nova] Creating event network-changed:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:39:11.173247 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1408d840-66ce-4808-8a53-5d90ea88b230 req-cbb72558-999f-407b-9c5b-0d09b2333961 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029801 Nov 20 21:39:11.173844 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3978/8064] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:39:36.188337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:39:36.189701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:36.196144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:36.196603 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:36.197410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:36.197861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:36.270632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60a81686-d2f3-4368-a928-8011ccfa841c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action" status: 202 len: 0 microversion: 2.1 time: 0.087786 Nov 20 21:39:36.271281 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4087/8065] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:39:36 2021] POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:39:36.280711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:36.281440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:36.287418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:36.287891 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:36.288736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:36.289695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:36.527173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:36.540214 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a409aa63-db06-421f-99c4-1761f8b68c5d tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1751 microversion: 2.1 time: 0.263595 Nov 20 21:39:36.540916 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3979/8066] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:36 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:37.559750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:37.560459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:37.566638 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:37.567102 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:37.567892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:37.568333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:37.715633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:37.723447 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-31b6a7c2-2ca9-49fd-806e-3757fa027cec tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.169408 Nov 20 21:39:37.724014 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4088/8067] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:37 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:38.740799 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:38.741413 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:38.748668 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:38.749117 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:38.749895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:38.750370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:38.891527 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:38.899829 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9b814947-5b8b-48f7-9764-14f491452d7b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.162727 Nov 20 21:39:38.900406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3980/8068] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:38 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:39.916795 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:39.917390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:39.924038 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:39.924523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:39.925308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:39.925769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:40.068160 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:40.076689 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-90ddcbb5-c6ee-4286-9198-023d350493df tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.163915 Nov 20 21:39:40.077253 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4089/8069] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:39 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:41.094251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:41.094860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:41.101514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:41.102807 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:41.103591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:41.104027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:41.247274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:41.255166 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eab7e8da-aa59-4abb-93bd-c92d85277176 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.164586 Nov 20 21:39:41.255711 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3981/8070] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:41 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:42.272382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:42.272982 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:42.279884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:42.280332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:42.281119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:42.281559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:42.429044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:42.437520 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-73819584-706d-46f5-a4ca-924ba7f7a940 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.168794 Nov 20 21:39:42.438108 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4090/8071] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:42 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:39:43.454404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:43.455014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:43.461962 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:43.462478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:43.463275 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:43.463714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:43.610781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:43.619335 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8d883757-ee2b-466e-9cdf-3b024f4b9437 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.168615 Nov 20 21:39:43.619915 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3982/8072] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:43 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:44.637238 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:44.637875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:44.644588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:44.645045 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:44.645832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:44.646310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:44.791115 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:44.798995 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a4c3c75b-2727-4af7-8f82-54563ea36276 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.166220 Nov 20 21:39:44.799561 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4091/8073] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:44 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:45.816765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:45.817302 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:45.824027 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:45.824475 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:45.825251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:45.825686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:45.967492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:45.975272 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2302ba05-a4d2-4593-a29c-1cd9d41b3680 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.162259 Nov 20 21:39:45.975834 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3983/8074] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:45 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:46.994532 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:46.995152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:47.002012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:47.002486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:47.003271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:47.003711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:47.150607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:47.158408 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c1c39db-a826-4511-b00c-d0239f9b6fbc tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1756 microversion: 2.1 time: 0.168453 Nov 20 21:39:47.158970 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4092/8075] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:46 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:39:48.175651 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:39:48.176256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:39:48.183106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:48.183557 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:48.184340 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:39:48.184789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:39:48.672411 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:39:48.680691 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6e9dc676-54f0-4468-9792-8deaa555d4c4 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1759 microversion: 2.1 time: 0.508770 Nov 20 21:39:48.681275 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3984/8076] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:39:48 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1759 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:21.054912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2096921102"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:21.055720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:21.061915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:21.062426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:21.063220 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:21.063656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:21.199998 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.network.security_group_api [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Removing security group ca420aff-59dc-432f-b81a-4d5584573b04 from port 016e2b25-da18-4de5-9665-d9aa89ce3e98 Nov 20 21:40:21.538182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1155910d-8621-4189-accd-ca269b52cd35 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action" status: 202 len: 0 microversion: 2.1 time: 0.486987 Nov 20 21:40:21.539318 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4093/8077] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:40:21 2021] POST /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:40:21.709019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-627adee7-e7f5-45de-9703-6ddfb4d1d874 req-1bc1b76e-6b16-4b96-ac08-2303878b65be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:21.711935 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:40:21.711935 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:40:21.720293 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-627adee7-e7f5-45de-9703-6ddfb4d1d874 req-1bc1b76e-6b16-4b96-ac08-2303878b65be service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:21.720743 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-627adee7-e7f5-45de-9703-6ddfb4d1d874 req-1bc1b76e-6b16-4b96-ac08-2303878b65be service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:21.743881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-627adee7-e7f5-45de-9703-6ddfb4d1d874 req-1bc1b76e-6b16-4b96-ac08-2303878b65be service nova] Creating event network-changed:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:40:21.749950 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-627adee7-e7f5-45de-9703-6ddfb4d1d874 req-1bc1b76e-6b16-4b96-ac08-2303878b65be service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207032 Nov 20 21:40:21.752923 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3985/8078] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:40:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:40:22.662001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:22.662582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:22.669075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:22.669536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:22.670361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:22.670810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:22.755546 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lazy-loading 'services' on Instance uuid 2fce0832-de87-44c8-b13f-8852fec63e20 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:40:22.828047 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cb31ada8-9613-475f-9f94-37d6d4f2cc5c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments/c01d06e1-04b2-415f-8356-72ef323aafd4" status: 202 len: 0 microversion: 2.1 time: 0.170506 Nov 20 21:40:22.828651 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4094/8079] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:40:22 2021] DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments/c01d06e1-04b2-415f-8356-72ef323aafd4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:40:22.840798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:22.842115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:22.850543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:22.851884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:22.853068 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:22.854941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:22.893627 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9aa4a52c-a507-4474-97fa-e05a66d7e3ff tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059573 Nov 20 21:40:22.894340 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3986/8080] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:40:22 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:40:23.769383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-08d407be-7ba4-4ac2-b960-b8d291d4d5a4 req-c5739892-4500-46e7-b014-703897a3842d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:23.771054 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:40:23.771054 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:40:23.779118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-08d407be-7ba4-4ac2-b960-b8d291d4d5a4 req-c5739892-4500-46e7-b014-703897a3842d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:23.779567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-08d407be-7ba4-4ac2-b960-b8d291d4d5a4 req-c5739892-4500-46e7-b014-703897a3842d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:23.791544 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-08d407be-7ba4-4ac2-b960-b8d291d4d5a4 req-c5739892-4500-46e7-b014-703897a3842d service nova] Creating event network-changed:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:40:23.796351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-08d407be-7ba4-4ac2-b960-b8d291d4d5a4 req-c5739892-4500-46e7-b014-703897a3842d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032658 Nov 20 21:40:23.796958 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4095/8081] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:40:23.905153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:23.906091 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:23.912997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:23.913542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:23.914900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:23.915362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:23.943294 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8267191-413d-4c61-aaf5-bba49739707e tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041804 Nov 20 21:40:23.943788 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3987/8082] 10.222.0.41 () {58 vars in 1301 bytes} [Sat Nov 20 21:40:23 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 20 21:40:23.954624 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:23.955293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:23.962375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:23.962952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:23.963755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:23.964208 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:24.038384 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] HTTP exception thrown: Instance 2fce0832-de87-44c8-b13f-8852fec63e20 is not attached to volume c01d06e1-04b2-415f-8356-72ef323aafd4 Nov 20 21:40:24.039595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Returning 404 to user: Instance 2fce0832-de87-44c8-b13f-8852fec63e20 is not attached to volume c01d06e1-04b2-415f-8356-72ef323aafd4 {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:40:24.040441 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-756cd499-e4c9-45e4-a618-20eebb316515 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments/c01d06e1-04b2-415f-8356-72ef323aafd4" status: 404 len: 154 microversion: 2.1 time: 0.090024 Nov 20 21:40:24.040999 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4096/8083] 10.222.0.41 () {58 vars in 1415 bytes} [Sat Nov 20 21:40:23 2021] DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20/os-volume_attachments/c01d06e1-04b2-415f-8356-72ef323aafd4 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:40:25.175148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:25.175647 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:25.182918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:25.183373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:25.184156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:25.184595 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:25.209198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:40:25.280090 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec49a669-51c6-4e27-840a-7b4430116c11 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 204 len: 0 microversion: 2.1 time: 0.108149 Nov 20 21:40:25.280595 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3988/8084] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:40:25 2021] DELETE /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:40:25.289011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:25.289729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:25.297505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:25.298004 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:25.298812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:25.299254 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:25.433582 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:25.441788 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b567d78c-5e18-4d1f-a1b3-8856a2276512 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1553 microversion: 2.1 time: 0.156115 Nov 20 21:40:25.442990 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4097/8085] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:25 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:26.460829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:26.462221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:26.468657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:26.469103 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:26.469877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:26.470338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:26.610856 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:26.618674 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-57f81264-e609-43df-a7ad-ea7ff9b39231 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1553 microversion: 2.1 time: 0.161841 Nov 20 21:40:26.619240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3989/8086] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:26 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:27.429826 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e1acbdeb-2ba7-40cd-af60-abfaed620d1e req-23518a91-7b7a-4c23-8f5d-251e451511a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fce0832-de87-44c8-b13f-8852fec63e20", "name": "network-vif-deleted", "tag": "016e2b25-da18-4de5-9665-d9aa89ce3e98"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:27.431490 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:40:27.431490 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:40:27.439413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e1acbdeb-2ba7-40cd-af60-abfaed620d1e req-23518a91-7b7a-4c23-8f5d-251e451511a3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:27.439863 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e1acbdeb-2ba7-40cd-af60-abfaed620d1e req-23518a91-7b7a-4c23-8f5d-251e451511a3 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:27.453071 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e1acbdeb-2ba7-40cd-af60-abfaed620d1e req-23518a91-7b7a-4c23-8f5d-251e451511a3 service nova] Creating event network-vif-deleted:016e2b25-da18-4de5-9665-d9aa89ce3e98 for instance 2fce0832-de87-44c8-b13f-8852fec63e20 on nch2-master-1 Nov 20 21:40:27.457897 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e1acbdeb-2ba7-40cd-af60-abfaed620d1e req-23518a91-7b7a-4c23-8f5d-251e451511a3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031806 Nov 20 21:40:27.458532 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4098/8087] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:40:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:40:27.635450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:27.636093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:27.642953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:27.643343 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:27.644114 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:27.644548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:27.677144 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:27.677591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:27.678038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lazy-loading 'fault' on Instance uuid 2fce0832-de87-44c8-b13f-8852fec63e20 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:40:27.719407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a7159b6f2da4ed9be05f40ca1350065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f906d7e9f9d3403cb293a7003cdcdfaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:27.727079 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e815cf1a-3b67-4db6-ba22-3fab232ae69b tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 200 len: 1347 microversion: 2.1 time: 0.095207 Nov 20 21:40:27.727723 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3990/8088] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:27 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:28.745827 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:28.746562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] [instance: 2fce0832-de87-44c8-b13f-8852fec63e20] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:28.752715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:28.753172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:28.753948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:28.754418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:28.767865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] HTTP exception thrown: Instance 2fce0832-de87-44c8-b13f-8852fec63e20 could not be found. Nov 20 21:40:28.768451 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Returning 404 to user: Instance 2fce0832-de87-44c8-b13f-8852fec63e20 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:40:28.769368 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d50d4d8-728f-4a77-972b-4aec0ee5db9c tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20" status: 404 len: 111 microversion: 2.1 time: 0.028481 Nov 20 21:40:28.769918 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4099/8089] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:28 2021] GET /compute/v2.1/servers/2fce0832-de87-44c8-b13f-8852fec63e20 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:40:28.778996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d205e761-1e5c-4b37-88c5-dbea09f4ce14 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] Calling method '.version_select at 0x7f3f85c78670>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:28.797411 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d205e761-1e5c-4b37-88c5-dbea09f4ce14 tempest-TestMinimumBasicScenario-599005410 tempest-TestMinimumBasicScenario-599005410-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-322903231" status: 202 len: 0 microversion: 2.1 time: 0.022338 Nov 20 21:40:28.797906 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3991/8090] 10.222.0.41 () {58 vars in 1268 bytes} [Sat Nov 20 21:40:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-322903231 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:40:38.122959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: .version_select at 0x7f3f86eabc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-375113498"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:38.137118 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:40:38.141998 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:40:38.430544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:40:38.435840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:40:38.450008 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ffad71d9-e419-442e-9873-cc5d15df13b1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.492817 Nov 20 21:40:38.450649 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4100/8091] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:40:37 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:44.284074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1139731280", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "ba76b200-1560-491e-b86c-2da4ae193399"}], "key_name": "tempest-TestNetworkAdvancedServerOps-375113498", "security_groups": [{"name": "tempest-secgroup-smoke-1474768641"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:44.401589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] validate_networks() for [('ba76b200-1560-491e-b86c-2da4ae193399', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:40:44.885286 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:40:44.885710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:40:44.886217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:40:44.888292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:40:44.888707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:40:44.900699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:44.901145 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:44.901951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:44.902420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:44.921297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:40:44.926440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:40:44.939912 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:40:44.942368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:40:44.989123 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [52e6491c-9311-4838-a373-9f2b3650022a] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:40:46.013474 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [52e6491c-9311-4838-a373-9f2b3650022a] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 49072. Nov 20 21:40:46.021610 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1bc5a7e5-15d7-46a2-97d9-5360f197e028 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.742746 Nov 20 21:40:46.022614 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3992/8092] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:40:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:40:46.034806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-faa15fdc-d45e-4b51-b3d5-7ed1de1b9ba8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:46.036193 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-faa15fdc-d45e-4b51-b3d5-7ed1de1b9ba8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:46.093606 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-faa15fdc-d45e-4b51-b3d5-7ed1de1b9ba8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:46.100454 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-faa15fdc-d45e-4b51-b3d5-7ed1de1b9ba8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1266 microversion: 2.1 time: 0.071148 Nov 20 21:40:46.101386 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4101/8093] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:46 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:47.119667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f905d221-6909-4ef7-80b4-d70c50e2068a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:47.120851 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f905d221-6909-4ef7-80b4-d70c50e2068a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:47.192831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f905d221-6909-4ef7-80b4-d70c50e2068a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:47.200422 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f905d221-6909-4ef7-80b4-d70c50e2068a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1266 microversion: 2.1 time: 0.086606 Nov 20 21:40:47.201160 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3993/8094] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:47 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:48.217959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61bf029d-4bc6-466c-b7e7-4b0aece0b8bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:48.218633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61bf029d-4bc6-466c-b7e7-4b0aece0b8bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:48.278331 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61bf029d-4bc6-466c-b7e7-4b0aece0b8bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:48.285049 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61bf029d-4bc6-466c-b7e7-4b0aece0b8bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1266 microversion: 2.1 time: 0.071603 Nov 20 21:40:48.285632 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4102/8095] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:48 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:49.302403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fdd00a44-a2ef-4487-857d-026f6400c253 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:49.302998 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fdd00a44-a2ef-4487-857d-026f6400c253 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:49.360868 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fdd00a44-a2ef-4487-857d-026f6400c253 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:49.368328 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fdd00a44-a2ef-4487-857d-026f6400c253 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1266 microversion: 2.1 time: 0.069604 Nov 20 21:40:49.369010 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3994/8096] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:49 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:50.385567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:50.386211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:50.393466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:50.393937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:50.394738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:50.395189 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:50.453676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:50.461869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-79745ebe-2ed6-4caf-9153-71d15522dfaa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1270 microversion: 2.1 time: 0.080564 Nov 20 21:40:50.462584 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4103/8097] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:50 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:51.479175 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:51.479915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:51.486818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:51.487276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:51.488074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:51.488512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:51.567362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:51.575076 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0305e1d-0278-48a0-9f1f-9bb53132f295 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1324 microversion: 2.1 time: 0.100169 Nov 20 21:40:51.575809 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3995/8098] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:51 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1324 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:52.376870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-705ea4fa-1751-47a4-bf9a-8827c2480251 req-c3a63374-6d3c-4910-b6ad-269ab73aa866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd4c451-3599-4657-8c80-1fae6d3d03f0", "tag": "bf427519-6391-43d8-bbd8-dbbf87acba66"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:52.380326 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:40:52.380326 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:40:52.393918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-705ea4fa-1751-47a4-bf9a-8827c2480251 req-c3a63374-6d3c-4910-b6ad-269ab73aa866 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:52.394406 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-705ea4fa-1751-47a4-bf9a-8827c2480251 req-c3a63374-6d3c-4910-b6ad-269ab73aa866 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:52.408206 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-705ea4fa-1751-47a4-bf9a-8827c2480251 req-c3a63374-6d3c-4910-b6ad-269ab73aa866 service nova] Creating event network-changed:bf427519-6391-43d8-bbd8-dbbf87acba66 for instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 on nch2-master-1 Nov 20 21:40:52.414570 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-705ea4fa-1751-47a4-bf9a-8827c2480251 req-c3a63374-6d3c-4910-b6ad-269ab73aa866 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046941 Nov 20 21:40:52.415189 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4104/8099] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:40:52.592558 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:52.593181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:52.600684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:52.601146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:52.602658 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:52.603108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:52.850603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:52.858461 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-abe28a8e-3c69-4378-a174-197fa3bfe1fb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.269650 Nov 20 21:40:52.859042 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3996/8100] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:52 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:53.876552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:53.877265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:53.885067 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:53.885533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:53.886366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:53.886821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:54.018866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:54.026223 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f5e6ee76-610d-4ad7-a17a-3bf5f24c0b9e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.153687 Nov 20 21:40:54.026801 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4105/8101] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:53 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:55.042913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:55.043521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:55.050438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:55.050889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:55.051830 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:55.052273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:55.190493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:55.198597 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d06e196d-7a6f-4163-919a-3d29f5c840cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.159460 Nov 20 21:40:55.199169 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3997/8102] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:55 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:56.215270 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:56.215893 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:56.222614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:56.223075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:56.223867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:56.224315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:56.362714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:56.370925 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-37f1baa5-d681-4fef-8e62-4373e8325dac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.159280 Nov 20 21:40:56.371504 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4106/8103] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:56 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:57.387896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:57.388493 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:57.394971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:57.395417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:57.396187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:57.396621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:57.528986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:57.536638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d83fbba7-317a-415f-a312-e7fcbdf63068 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.152378 Nov 20 21:40:57.537211 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3998/8104] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:57 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:58.554904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:58.555515 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:58.562177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:58.562636 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:58.563418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:58.563864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:58.698650 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:58.706349 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ecd4bc70-2d5b-4d5b-8a64-c0ba80e15a7a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.155379 Nov 20 21:40:58.707154 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4107/8105] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:58 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:40:58.819329 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-7cc8e669-0d26-4ab8-98d4-57c20d99fda5 req-0f811c9d-c742-44e7-bbd5-47086b583ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd4c451-3599-4657-8c80-1fae6d3d03f0", "name": "network-vif-plugged", "status": "completed", "tag": "bf427519-6391-43d8-bbd8-dbbf87acba66"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:40:58.821191 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:40:58.821191 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:40:58.829053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7cc8e669-0d26-4ab8-98d4-57c20d99fda5 req-0f811c9d-c742-44e7-bbd5-47086b583ca9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:58.830146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-7cc8e669-0d26-4ab8-98d4-57c20d99fda5 req-0f811c9d-c742-44e7-bbd5-47086b583ca9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:58.843948 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-7cc8e669-0d26-4ab8-98d4-57c20d99fda5 req-0f811c9d-c742-44e7-bbd5-47086b583ca9 service nova] Creating event network-vif-plugged:bf427519-6391-43d8-bbd8-dbbf87acba66 for instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 on nch2-master-1 Nov 20 21:40:58.848907 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-7cc8e669-0d26-4ab8-98d4-57c20d99fda5 req-0f811c9d-c742-44e7-bbd5-47086b583ca9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033175 Nov 20 21:40:58.849708 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 3999/8106] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:40:59.722602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:40:59.723221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:40:59.729676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:59.730159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:59.730942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:40:59.731384 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:40:59.864201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:40:59.873243 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ea2bb7a7-671c-41ab-a968-d72270948bf7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1392 microversion: 2.1 time: 0.154269 Nov 20 21:40:59.873870 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4108/8107] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:40:59 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:00.891883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:00.892571 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:00.899683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:00.900166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:00.900946 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:00.901380 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:01.037227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:01.045322 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a17514c1-0257-4f32-b53f-9ccb3ab20288 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1564 microversion: 2.1 time: 0.157449 Nov 20 21:41:01.045894 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4000/8108] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:00 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:01.061722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:01.062369 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:01.068976 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:01.069434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:01.070656 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:01.071108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:01.205244 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:01.213121 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51f7e7dc-798b-49d4-a883-c94f37c6960a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1564 microversion: 2.1 time: 0.154952 Nov 20 21:41:01.213722 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4109/8109] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:01 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:02.825887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:02.826544 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:02.830772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c966f9ef-558e-4a8d-994c-98cb1f840247 req-268a606f-8373-4fd3-9579-a2d05a0f98c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd4c451-3599-4657-8c80-1fae6d3d03f0", "tag": "bf427519-6391-43d8-bbd8-dbbf87acba66"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:02.832402 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:41:02.832402 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:41:02.834386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:02.834840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:02.836666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:02.837115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:02.841029 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c966f9ef-558e-4a8d-994c-98cb1f840247 req-268a606f-8373-4fd3-9579-a2d05a0f98c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:02.841484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c966f9ef-558e-4a8d-994c-98cb1f840247 req-268a606f-8373-4fd3-9579-a2d05a0f98c8 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:02.852682 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c966f9ef-558e-4a8d-994c-98cb1f840247 req-268a606f-8373-4fd3-9579-a2d05a0f98c8 service nova] Creating event network-changed:bf427519-6391-43d8-bbd8-dbbf87acba66 for instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 on nch2-master-1 Nov 20 21:41:02.858071 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c966f9ef-558e-4a8d-994c-98cb1f840247 req-268a606f-8373-4fd3-9579-a2d05a0f98c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032229 Nov 20 21:41:02.859099 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4110/8110] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:41:03.065218 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:03.074042 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3da6175a-f81e-44c5-99c1-4f0b0e01e147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1564 microversion: 2.1 time: 0.251926 Nov 20 21:41:03.075006 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4001/8111] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:02 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:26.333727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:26.334804 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:26.341110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:26.341561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:26.342374 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:26.342817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:26.393165 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da42b979-bbef-4fd3-a59c-3f2b6de0d22b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action" status: 200 len: 24547 microversion: 2.1 time: 0.064485 Nov 20 21:41:26.393780 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4111/8112] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:41:26 2021] POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action => generated 24547 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:41:32.834826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:32.835412 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:32.841693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:32.842177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:32.842960 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:32.843396 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:32.909063 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-146e180f-50ba-48b1-8350-31357835cfe9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action" status: 202 len: 0 microversion: 2.1 time: 0.078165 Nov 20 21:41:32.912955 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4002/8113] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:41:32 2021] POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:41:32.918816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:32.919885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:32.927233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:32.927912 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:32.928575 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:32.929030 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:33.068096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:33.077362 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-13477382-098c-4cb5-822b-63926a331694 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1688 microversion: 2.1 time: 0.162798 Nov 20 21:41:33.077949 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4112/8114] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:32 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:34.095854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:34.096559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:34.103701 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:34.104160 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:34.104949 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:34.105398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:34.239433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:34.246726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-859b77a5-dcd6-441e-ac16-fc4cd8e79af8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1668 microversion: 2.1 time: 0.154997 Nov 20 21:41:34.247469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4003/8115] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:34 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:35.339109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:35.339963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:35.347785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.348249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.349047 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.349498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.399391 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-06f3dfc7-e427-4afe-b444-582357073187 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action" status: 200 len: 32619 microversion: 2.1 time: 0.063963 Nov 20 21:41:35.400053 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4113/8116] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:41:35 2021] POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action => generated 32619 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:41:35.411053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:35.411631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:35.419276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.419754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.420570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.421038 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.490689 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b3b5aec7-cd41-4ca1-b056-34a8320a8c0c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action" status: 202 len: 0 microversion: 2.1 time: 0.083155 Nov 20 21:41:35.491335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4004/8117] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:41:35 2021] POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:41:35.500383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:35.501174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:35.509293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.509883 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.510718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:35.511194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:35.650809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:35.659444 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-848c5470-f849-4e1f-a044-d8e3db131516 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1675 microversion: 2.1 time: 0.163349 Nov 20 21:41:35.671609 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4114/8118] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:35 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:36.679523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:36.680219 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:36.687771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:36.688227 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:36.689019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:36.689460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:36.824339 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:36.831908 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9160235a-395f-42b8-8d58-ad3ff04c01ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1683 microversion: 2.1 time: 0.156398 Nov 20 21:41:36.832472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4005/8119] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:36 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:36.927844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:36.928771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:36.938812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:36.939354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:36.940147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:36.940596 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:36.989821 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f7d89b8b-65a8-4c03-aac4-f665779c1f41 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action" status: 200 len: 35740 microversion: 2.1 time: 0.065520 Nov 20 21:41:36.990593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4115/8120] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:41:36 2021] POST /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0/action => generated 35740 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:41:38.030789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-30bea6f9-2bcf-470e-b71e-60e81564a039 req-0ecebba0-33df-46ef-86c9-fa214367d6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd4c451-3599-4657-8c80-1fae6d3d03f0", "tag": "bf427519-6391-43d8-bbd8-dbbf87acba66"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:38.032253 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:41:38.032253 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:41:38.036779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:38.037277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:38.047098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:38.047594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:38.048417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:38.048854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:38.056809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-30bea6f9-2bcf-470e-b71e-60e81564a039 req-0ecebba0-33df-46ef-86c9-fa214367d6e5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:38.057264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-30bea6f9-2bcf-470e-b71e-60e81564a039 req-0ecebba0-33df-46ef-86c9-fa214367d6e5 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:38.068789 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-30bea6f9-2bcf-470e-b71e-60e81564a039 req-0ecebba0-33df-46ef-86c9-fa214367d6e5 service nova] Creating event network-changed:bf427519-6391-43d8-bbd8-dbbf87acba66 for instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 on nch2-master-1 Nov 20 21:41:38.073608 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-30bea6f9-2bcf-470e-b71e-60e81564a039 req-0ecebba0-33df-46ef-86c9-fa214367d6e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047443 Nov 20 21:41:38.074439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:41:38.074635 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4116/8121] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:41:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:41:38.157876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4335ebfb-4509-46db-ac09-de2f0f13c548 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 204 len: 0 microversion: 2.1 time: 0.133772 Nov 20 21:41:38.166150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4006/8122] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:41:38 2021] DELETE /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:41:38.169598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:38.170593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:38.176940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:38.177646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:38.178651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:38.179267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:38.327531 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:38.335590 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1c0c9911-4815-4f70-a35d-2cf83106e8bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1689 microversion: 2.1 time: 0.170783 Nov 20 21:41:38.336494 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4117/8123] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:38 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:39.354482 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:39.355099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:39.362618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:39.363077 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:39.363837 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:39.364273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:39.502828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:39.510149 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bef9a329-4ba2-4198-b1db-ee2c9637e041 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1570 microversion: 2.1 time: 0.159786 Nov 20 21:41:39.510719 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4007/8124] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:39 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:40.334793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ae94d8e9-120e-4a51-ad44-971d3550e31c req-fe1e29e5-15b0-4713-b515-e9057fe7ed27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd4c451-3599-4657-8c80-1fae6d3d03f0", "name": "network-vif-deleted", "tag": "bf427519-6391-43d8-bbd8-dbbf87acba66"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:40.336296 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:41:40.336296 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:41:40.345142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ae94d8e9-120e-4a51-ad44-971d3550e31c req-fe1e29e5-15b0-4713-b515-e9057fe7ed27 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:40.346416 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ae94d8e9-120e-4a51-ad44-971d3550e31c req-fe1e29e5-15b0-4713-b515-e9057fe7ed27 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:40.357978 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ae94d8e9-120e-4a51-ad44-971d3550e31c req-fe1e29e5-15b0-4713-b515-e9057fe7ed27 service nova] Creating event network-vif-deleted:bf427519-6391-43d8-bbd8-dbbf87acba66 for instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 on nch2-master-1 Nov 20 21:41:40.362984 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ae94d8e9-120e-4a51-ad44-971d3550e31c req-fe1e29e5-15b0-4713-b515-e9057fe7ed27 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Nov 20 21:41:40.363660 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4118/8125] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:41:40.529150 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:40.529773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:40.536915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:40.537367 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:40.538178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:40.538618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:40.569178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:40.569625 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:40.570100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lazy-loading 'fault' on Instance uuid fbd4c451-3599-4657-8c80-1fae6d3d03f0 {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:41:40.610169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:40.617802 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f93d0e81-5256-4558-87e6-82b9e0f3ebcf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 200 len: 1356 microversion: 2.1 time: 0.093238 Nov 20 21:41:40.618422 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4008/8126] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:40 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 1356 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:41.635576 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:41.639071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: fbd4c451-3599-4657-8c80-1fae6d3d03f0] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:41.644134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:41.644592 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:41.645377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:41.645819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:41.658538 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] HTTP exception thrown: Instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 could not be found. Nov 20 21:41:41.659134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Returning 404 to user: Instance fbd4c451-3599-4657-8c80-1fae6d3d03f0 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:41:41.659947 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-17363d6c-3c5d-4956-97dd-305d0d371d7d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0" status: 404 len: 111 microversion: 2.1 time: 0.029413 Nov 20 21:41:41.660476 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4119/8127] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:41 2021] GET /compute/v2.1/servers/fbd4c451-3599-4657-8c80-1fae6d3d03f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:41:45.020980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-82708f23-4848-4bd4-bc9c-b2b08438fd72 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '.version_select at 0x7f3f85d47820>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:45.045001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-82708f23-4848-4bd4-bc9c-b2b08438fd72 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375113498" status: 202 len: 0 microversion: 2.1 time: 0.027684 Nov 20 21:41:45.045438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4009/8128] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:41:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-375113498 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:41:45.073553 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: .version_select at 0x7f3f841d69d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1121892445"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:45.094801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:41:45.101981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:41:45.363243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:41:45.367992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:41:45.381562 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1de06089-0adc-410b-bc4a-1f87714d55a0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.312615 Nov 20 21:41:45.382179 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4120/8129] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:41:45 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:50.925246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-570872109", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "573b7893-c788-4b4a-ac00-87db0a292b5c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1121892445", "security_groups": [{"name": "tempest-secgroup-smoke-1757982967"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:51.036843 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] validate_networks() for [('573b7893-c788-4b4a-ac00-87db0a292b5c', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:41:51.529603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:41:51.530594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:41:51.531279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:41:51.532012 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:41:51.532606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:41:51.545301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:51.546335 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:51.547523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:51.548139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:51.573146 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:41:51.580176 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:41:51.592947 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:41:51.595368 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:41:51.648497 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-00e69d3e-bf3e-4ffa-b599-e97373690664 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.726881 Nov 20 21:41:51.649370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4010/8130] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:41:50 2021] POST /compute/v2.1/servers => generated 406 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:41:51.659716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c4f1d8b6-ced8-4342-b818-3c4984f2a938 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:51.660344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c4f1d8b6-ced8-4342-b818-3c4984f2a938 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:51.719088 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c4f1d8b6-ced8-4342-b818-3c4984f2a938 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:51.727366 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c4f1d8b6-ced8-4342-b818-3c4984f2a938 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1266 microversion: 2.1 time: 0.070814 Nov 20 21:41:51.738986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4121/8131] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:51 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:41:52.745240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:52.745852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:52.754770 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:52.755532 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:52.756539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:52.757831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:52.843864 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:52.854397 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80dcb34d-f257-47aa-9948-9aa7bfd974f9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1324 microversion: 2.1 time: 0.112819 Nov 20 21:41:52.856130 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4011/8132] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:52 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:53.872903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:53.874922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:53.882939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:53.883523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:53.884488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:53.885140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:54.050217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:54.058304 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f3da685f-85c5-48bb-a984-ce347327d0ec tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.189987 Nov 20 21:41:54.058936 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4122/8133] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:53 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:54.204333 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ae83dd21-1660-4f5a-8b12-c51da0d2e5d5 req-13e661df-56f7-49d4-9d29-56ad64683e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4e09c-d601-4029-ad9c-093eab484eee", "tag": "7e610779-8e3e-4f60-8650-999855c2c8bb"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:54.207521 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:41:54.207521 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:41:54.217956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ae83dd21-1660-4f5a-8b12-c51da0d2e5d5 req-13e661df-56f7-49d4-9d29-56ad64683e31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:54.218433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ae83dd21-1660-4f5a-8b12-c51da0d2e5d5 req-13e661df-56f7-49d4-9d29-56ad64683e31 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:54.233932 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ae83dd21-1660-4f5a-8b12-c51da0d2e5d5 req-13e661df-56f7-49d4-9d29-56ad64683e31 service nova] Creating event network-changed:7e610779-8e3e-4f60-8650-999855c2c8bb for instance 93a4e09c-d601-4029-ad9c-093eab484eee on nch2-master-1 Nov 20 21:41:54.245937 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ae83dd21-1660-4f5a-8b12-c51da0d2e5d5 req-13e661df-56f7-49d4-9d29-56ad64683e31 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045182 Nov 20 21:41:54.258825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4012/8134] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:41:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:41:55.077113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:55.078295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:55.085007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:55.085718 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:55.086654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:55.087098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:55.243341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:55.250740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e30703d8-c4eb-4b18-9163-5ff319f66e2c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.178627 Nov 20 21:41:55.251323 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4123/8135] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:55 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:41:56.268732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:56.269415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:56.275598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:56.276047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:56.277016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:56.277628 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:56.416185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:56.423998 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1183bcdd-34ba-45c6-946d-95c80c32039a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.160255 Nov 20 21:41:56.424583 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4013/8136] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:56 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:57.440675 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:57.441407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:57.448164 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:57.448625 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:57.449419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:57.450098 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:57.592567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:57.599847 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-609e755b-6f58-41be-8a37-0309d05d6c54 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.162907 Nov 20 21:41:57.600430 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4124/8137] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:57 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:58.617280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:58.617890 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:58.624899 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:58.625362 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:58.626225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:58.626667 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:58.759142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:58.767245 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-458efa2b-2fe7-4f74-a97e-8cbd21af4844 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.153978 Nov 20 21:41:58.767847 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4014/8138] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:58 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:41:59.097194 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b4dbfb6f-ff68-446a-8750-22e24809acb6 req-46c36aeb-0cb2-4815-ad5b-ee945ce303fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4e09c-d601-4029-ad9c-093eab484eee", "name": "network-vif-plugged", "status": "completed", "tag": "7e610779-8e3e-4f60-8650-999855c2c8bb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:41:59.098872 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:41:59.098872 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:41:59.108231 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b4dbfb6f-ff68-446a-8750-22e24809acb6 req-46c36aeb-0cb2-4815-ad5b-ee945ce303fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:59.109124 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b4dbfb6f-ff68-446a-8750-22e24809acb6 req-46c36aeb-0cb2-4815-ad5b-ee945ce303fc service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:59.120230 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b4dbfb6f-ff68-446a-8750-22e24809acb6 req-46c36aeb-0cb2-4815-ad5b-ee945ce303fc service nova] Creating event network-vif-plugged:7e610779-8e3e-4f60-8650-999855c2c8bb for instance 93a4e09c-d601-4029-ad9c-093eab484eee on nch2-master-1 Nov 20 21:41:59.125774 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b4dbfb6f-ff68-446a-8750-22e24809acb6 req-46c36aeb-0cb2-4815-ad5b-ee945ce303fc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Nov 20 21:41:59.126603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4125/8139] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:41:59.784370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:41:59.785029 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:41:59.791787 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:59.792242 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:59.793699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:41:59.794172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:41:59.924592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:41:59.931772 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-42fdbe1c-421b-4350-bd02-a23151ad0895 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1392 microversion: 2.1 time: 0.151101 Nov 20 21:41:59.932345 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4015/8140] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:41:59 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:00.949242 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:00.950186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:00.956981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:00.957449 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:00.958275 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:00.958732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:01.099027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:01.106985 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-787f7516-0278-4b9e-a549-bef1cca62083 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1564 microversion: 2.1 time: 0.161845 Nov 20 21:42:01.107547 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4126/8141] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:00 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:01.122918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:01.123591 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:01.130406 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:01.130859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:01.131645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:01.132089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:01.263058 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:01.270326 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aca3835b-ec0d-48d6-b388-3c7067ea7263 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1564 microversion: 2.1 time: 0.151135 Nov 20 21:42:01.270904 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4016/8142] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:01 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:03.187634 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:03.188326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:03.189317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-bf0f50f6-256a-44f4-b9fe-cdd73084b23c req-4806a5bd-1833-415c-a870-932fdce65b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4e09c-d601-4029-ad9c-093eab484eee", "tag": "7e610779-8e3e-4f60-8650-999855c2c8bb"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:42:03.191367 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:42:03.191367 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:42:03.197251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:03.197729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:03.198566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:03.199530 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bf0f50f6-256a-44f4-b9fe-cdd73084b23c req-4806a5bd-1833-415c-a870-932fdce65b4d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:03.199981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-bf0f50f6-256a-44f4-b9fe-cdd73084b23c req-4806a5bd-1833-415c-a870-932fdce65b4d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:03.200536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:03.211093 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-bf0f50f6-256a-44f4-b9fe-cdd73084b23c req-4806a5bd-1833-415c-a870-932fdce65b4d service nova] Creating event network-changed:7e610779-8e3e-4f60-8650-999855c2c8bb for instance 93a4e09c-d601-4029-ad9c-093eab484eee on nch2-master-1 Nov 20 21:42:03.219511 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-bf0f50f6-256a-44f4-b9fe-cdd73084b23c req-4806a5bd-1833-415c-a870-932fdce65b4d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033555 Nov 20 21:42:03.221076 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4017/8143] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:42:03.358995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:03.366863 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8bd7bff7-a6fa-463c-b657-d091d8a1146e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1564 microversion: 2.1 time: 0.184080 Nov 20 21:42:03.367664 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4127/8144] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:03 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:26.612718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:42:26.613712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:26.619900 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:26.620357 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:26.621138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:26.621579 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:26.670906 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1a77ac5e-5190-4d3f-a643-6651d7833e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action" status: 200 len: 24575 microversion: 2.1 time: 0.063397 Nov 20 21:42:26.671520 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4018/8145] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:42:26 2021] POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action => generated 24575 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:42:33.098867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:42:33.099854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:33.106979 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:33.107440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:33.108497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:33.108945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:33.178931 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e7d0b521-8abb-4ccb-8639-79f877d814b7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action" status: 202 len: 0 microversion: 2.1 time: 0.083538 Nov 20 21:42:33.179570 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4128/8146] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:42:33 2021] POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:42:33.188730 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:33.189425 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:33.196986 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:33.197433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:33.198257 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:33.198696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:33.510118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:33.517865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-044dec02-3236-4a7d-afdd-0afc62e8470b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1675 microversion: 2.1 time: 0.333679 Nov 20 21:42:33.518479 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4019/8147] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:33 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1675 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:34.536296 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:34.537021 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:34.544049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:34.544507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:34.545291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:34.545735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:34.738686 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:34.745970 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-15b5dd5f-3a7e-4a71-be45-3dbefd38fb93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.213703 Nov 20 21:42:34.747239 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4129/8148] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:34 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:35.764019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:35.764618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:35.772222 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:35.772673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:35.773458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:35.773896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:35.914138 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:35.921506 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0a604c6b-00e2-49f7-8480-3c92e237cff9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.161152 Nov 20 21:42:35.922096 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4020/8149] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:35 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:36.939225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:36.939843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:36.946287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:36.946743 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:36.947524 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:36.947966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:37.087915 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:37.095842 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60915b15-02d9-4f28-8bbd-b0bf275917ab tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.160457 Nov 20 21:42:37.096400 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4130/8150] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:36 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:38.113134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:38.113742 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:38.120390 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:38.120838 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:38.122307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:38.122745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:38.254509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:38.261791 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a0ca9900-b73f-4dc3-b285-3b1298eae865 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.152470 Nov 20 21:42:38.262480 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4021/8151] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:38 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:39.278639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:39.279253 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:39.285990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:39.286542 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:39.287272 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:39.287711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:39.422789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:39.430122 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf6ff4da-6876-4c84-a946-7327d394f194 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.155131 Nov 20 21:42:39.430696 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4131/8152] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:39 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:40.447987 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:40.448593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:40.456172 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:40.456631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:40.457419 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:40.457854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:40.595431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:40.602840 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dec4ba19-cedb-49e2-8d65-bacc87dd216d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.158587 Nov 20 21:42:40.603408 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4022/8153] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:40 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:41.620291 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:41.620924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:41.628093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:41.628560 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:41.629360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:41.629808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:41.769580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:41.777007 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-25c0f6ab-1905-477c-b49c-5eebb02f6ad6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.160508 Nov 20 21:42:41.777569 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4132/8154] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:41 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:42.793814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:42.794645 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:42.801167 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:42.801642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:42.802460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:42.802904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:42.935203 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:42.942564 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-705ab97f-14ce-4ce1-b920-74319341b6e2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.152537 Nov 20 21:42:42.943133 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4023/8155] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:42 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:43.959889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:43.960561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:43.968200 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:43.968697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:43.969492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:43.969932 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:44.103377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:44.111229 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-51b96716-71a4-4e11-94b8-1e7cb8329eb7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1680 microversion: 2.1 time: 0.155094 Nov 20 21:42:44.111795 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4133/8156] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:43 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:42:45.128199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:42:45.128805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:42:45.135090 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:45.135539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:45.136315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:42:45.136754 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:42:45.272631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:42:45.280686 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e3545a3-3e61-4620-9749-586aa742991c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1683 microversion: 2.1 time: 0.156393 Nov 20 21:42:45.281255 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4024/8157] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:42:45 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:09.479848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:09.480777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:09.487303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:09.487768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:09.488556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:09.489016 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:09.546616 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f26bd069-5f9b-4d2f-8ca7-158cb87fc2b0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action" status: 200 len: 69085 microversion: 2.1 time: 0.070242 Nov 20 21:43:09.547278 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4134/8158] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:43:09 2021] POST /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee/action => generated 69085 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:43:16.583501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:16.584055 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:16.590951 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:16.591515 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:16.592429 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:16.593063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:16.624431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:43:16.661598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d20b6efd-9a3f-4682-8eb7-7bb4f5cb3cbc req-0dd755df-71a3-4541-8d8d-6e39d3910bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a4e09c-d601-4029-ad9c-093eab484eee", "tag": "7e610779-8e3e-4f60-8650-999855c2c8bb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:16.664104 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:43:16.664104 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:43:16.672937 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d20b6efd-9a3f-4682-8eb7-7bb4f5cb3cbc req-0dd755df-71a3-4541-8d8d-6e39d3910bdf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:16.674082 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d20b6efd-9a3f-4682-8eb7-7bb4f5cb3cbc req-0dd755df-71a3-4541-8d8d-6e39d3910bdf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:16.686433 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d20b6efd-9a3f-4682-8eb7-7bb4f5cb3cbc req-0dd755df-71a3-4541-8d8d-6e39d3910bdf service nova] Creating event network-changed:7e610779-8e3e-4f60-8650-999855c2c8bb for instance 93a4e09c-d601-4029-ad9c-093eab484eee on nch2-master-1 Nov 20 21:43:16.693680 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d20b6efd-9a3f-4682-8eb7-7bb4f5cb3cbc req-0dd755df-71a3-4541-8d8d-6e39d3910bdf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104701 Nov 20 21:43:16.694528 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4135/8159] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:43:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:43:16.963034 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-83f83f94-1fd7-4aaf-89d0-bf2256f71aaf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 204 len: 0 microversion: 2.1 time: 0.383287 Nov 20 21:43:16.967021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4025/8160] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:43:16 2021] DELETE /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:43:16.976388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:16.977172 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:16.987159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:16.988163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:16.988970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:16.989997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:17.152402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:17.160910 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cd8fa6b7-6085-484b-8076-e4c31dedb1c2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1689 microversion: 2.1 time: 0.190757 Nov 20 21:43:17.161484 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4136/8161] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:16 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:18.179436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:18.180129 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:18.187352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:18.187805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:18.188582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:18.189026 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:18.326228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:18.333735 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-05b0c2e9-07dc-4c31-a0de-e35cef116775 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1570 microversion: 2.1 time: 0.158299 Nov 20 21:43:18.334330 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4026/8162] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:18 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:18.951633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-d857b2d9-82ca-43ee-8354-4d3a193dad27 req-48ba62f6-0b56-4001-83bb-ebd9075b84f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a4e09c-d601-4029-ad9c-093eab484eee", "name": "network-vif-deleted", "tag": "7e610779-8e3e-4f60-8650-999855c2c8bb"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:18.953123 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:43:18.953123 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:43:18.961585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d857b2d9-82ca-43ee-8354-4d3a193dad27 req-48ba62f6-0b56-4001-83bb-ebd9075b84f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:18.962041 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-d857b2d9-82ca-43ee-8354-4d3a193dad27 req-48ba62f6-0b56-4001-83bb-ebd9075b84f0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:18.972999 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-d857b2d9-82ca-43ee-8354-4d3a193dad27 req-48ba62f6-0b56-4001-83bb-ebd9075b84f0 service nova] Creating event network-vif-deleted:7e610779-8e3e-4f60-8650-999855c2c8bb for instance 93a4e09c-d601-4029-ad9c-093eab484eee on nch2-master-1 Nov 20 21:43:18.977758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-d857b2d9-82ca-43ee-8354-4d3a193dad27 req-48ba62f6-0b56-4001-83bb-ebd9075b84f0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029759 Nov 20 21:43:18.978384 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4137/8163] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:43:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:43:19.353771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:19.354648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:19.366982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:19.367608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:19.369169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:19.369866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:19.420074 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:19.420540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:19.421002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lazy-loading 'fault' on Instance uuid 93a4e09c-d601-4029-ad9c-093eab484eee {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:43:19.461071 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:19.467742 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c70dc1f3-8127-4342-a5d2-d20fe39a3c93 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 200 len: 1356 microversion: 2.1 time: 0.120210 Nov 20 21:43:19.468293 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4027/8164] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:19 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:20.486413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:20.487144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 93a4e09c-d601-4029-ad9c-093eab484eee] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:20.493274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:20.493736 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:20.494567 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:20.495011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:20.510028 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] HTTP exception thrown: Instance 93a4e09c-d601-4029-ad9c-093eab484eee could not be found. Nov 20 21:43:20.510645 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Returning 404 to user: Instance 93a4e09c-d601-4029-ad9c-093eab484eee could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:43:20.511470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0a5949f8-014a-4b3c-9818-55bffc413deb tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee" status: 404 len: 111 microversion: 2.1 time: 0.030327 Nov 20 21:43:20.512004 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4138/8165] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:20 2021] GET /compute/v2.1/servers/93a4e09c-d601-4029-ad9c-093eab484eee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:43:23.570976 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-72f934f4-81e7-4e79-9b27-d37baf209f4f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '.version_select at 0x7f3f85c35160>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:23.597315 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-72f934f4-81e7-4e79-9b27-d37baf209f4f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1121892445" status: 202 len: 0 microversion: 2.1 time: 0.029977 Nov 20 21:43:23.598116 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4028/8166] 10.222.0.41 () {58 vars in 1283 bytes} [Sat Nov 20 21:43:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1121892445 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:43:23.624110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: .version_select at 0x7f3f84186ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-591831802"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:23.638563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:43:23.643660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:43:23.939806 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:43:23.945355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:43:23.959625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-226c35e5-bc88-4fb9-a01a-89948c147970 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.339513 Nov 20 21:43:23.960216 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4139/8167] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:43:23 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:30.214974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2076097362", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "d864d6ec-2cea-44d6-872f-20cd5ffa56ef"}], "key_name": "tempest-TestNetworkAdvancedServerOps-591831802", "security_groups": [{"name": "tempest-secgroup-smoke-1095988044"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:30.333424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] validate_networks() for [('d864d6ec-2cea-44d6-872f-20cd5ffa56ef', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:43:30.762163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:43:30.762811 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:43:30.763291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:43:30.763698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:43:30.764106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:43:30.778010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:30.778862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:30.779920 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:30.780592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:30.811788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:43:30.819459 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:43:30.833393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:43:30.835840 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:43:30.884539 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9581fc40-2fa7-493d-8506-4118081d9e66 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.675190 Nov 20 21:43:30.885398 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4029/8168] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:43:30 2021] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:43:30.895496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-121feaa8-de8b-49fc-ad59-cbdeeb56895e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:30.896225 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-121feaa8-de8b-49fc-ad59-cbdeeb56895e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:30.985050 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-121feaa8-de8b-49fc-ad59-cbdeeb56895e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:30.992866 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-121feaa8-de8b-49fc-ad59-cbdeeb56895e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1266 microversion: 2.1 time: 0.101250 Nov 20 21:43:30.994001 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4140/8169] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:30 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:32.012955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:32.014289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:32.021216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:32.021740 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:32.022855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:32.023477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:32.130784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:32.142694 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4734cd8b-7f13-4dc4-a23b-503890b00665 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1318 microversion: 2.1 time: 0.133799 Nov 20 21:43:32.143910 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4030/8170] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:32 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1318 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:33.161541 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:33.162332 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:33.182584 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:33.183307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:33.184417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:33.185669 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:33.366715 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:33.382244 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ca9aa66-6581-408c-8dd2-27c98f743f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.225272 Nov 20 21:43:33.383991 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4141/8171] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:33 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:33.592789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-073e630b-c110-40a5-a228-76cb8dbf6158 req-00e47ea7-d783-49bf-ba09-8d90cd00fc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:33.594285 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:43:33.594285 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:43:33.603240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-073e630b-c110-40a5-a228-76cb8dbf6158 req-00e47ea7-d783-49bf-ba09-8d90cd00fc98 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:33.603699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-073e630b-c110-40a5-a228-76cb8dbf6158 req-00e47ea7-d783-49bf-ba09-8d90cd00fc98 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:33.615436 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-073e630b-c110-40a5-a228-76cb8dbf6158 req-00e47ea7-d783-49bf-ba09-8d90cd00fc98 service nova] Creating event network-changed:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch2-master-1 Nov 20 21:43:33.620246 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-073e630b-c110-40a5-a228-76cb8dbf6158 req-00e47ea7-d783-49bf-ba09-8d90cd00fc98 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 Nov 20 21:43:33.621162 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4031/8172] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:43:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:43:34.400239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:34.400867 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:34.408619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:34.409090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:34.409903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:34.410383 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:34.550346 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:34.558658 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a90e3d7-218d-4c65-8086-0ae099186e57 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.162119 Nov 20 21:43:34.559525 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4142/8173] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:34 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:35.576945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:35.577635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:35.584491 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:35.584966 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:35.585741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:35.586216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:35.717762 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:35.725006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-182ca6c4-a09f-4a7b-872e-d8abee647c46 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.152813 Nov 20 21:43:35.725564 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4032/8174] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:35 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:36.741689 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:36.742342 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:36.749083 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:36.749545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:36.750364 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:36.750814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:36.882376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:36.889643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-07ea097e-a939-47fb-9e74-f8ebb6b222c6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.151586 Nov 20 21:43:36.890248 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4143/8175] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:36 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:37.906905 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:37.908202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:37.915023 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:37.915479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:37.916273 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:37.916713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:38.059432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:38.066688 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84b7e5a0-f69b-460c-bf48-04ff13a181b4 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.163445 Nov 20 21:43:38.067216 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4033/8176] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:37 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:39.083389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:39.084014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:39.090898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:39.091475 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:39.092433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:39.092917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:39.226990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:39.234431 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9a93e3e2-0d68-4e67-a924-d8905a7e94cf tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.154683 Nov 20 21:43:39.234992 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4144/8177] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:39 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:39.680983 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cef0eae5-4ec3-45ba-9024-7e3b9e2f5476 req-f5ba2c61-d08f-4959-8d4c-0fb5ad07cb96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "name": "network-vif-plugged", "status": "completed", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:39.682522 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:43:39.682522 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:43:39.689805 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cef0eae5-4ec3-45ba-9024-7e3b9e2f5476 req-f5ba2c61-d08f-4959-8d4c-0fb5ad07cb96 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:39.690288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cef0eae5-4ec3-45ba-9024-7e3b9e2f5476 req-f5ba2c61-d08f-4959-8d4c-0fb5ad07cb96 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:39.700836 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cef0eae5-4ec3-45ba-9024-7e3b9e2f5476 req-f5ba2c61-d08f-4959-8d4c-0fb5ad07cb96 service nova] Creating event network-vif-plugged:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch2-master-1 Nov 20 21:43:39.706489 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cef0eae5-4ec3-45ba-9024-7e3b9e2f5476 req-f5ba2c61-d08f-4959-8d4c-0fb5ad07cb96 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099088 Nov 20 21:43:39.707150 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4034/8178] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:43:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:43:40.250762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:40.251931 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:40.259547 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:40.260013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:40.260838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:40.261283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:40.398508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:40.405659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9791c2c6-7331-49da-8f0d-fb0a2321bc20 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1392 microversion: 2.1 time: 0.158633 Nov 20 21:43:40.406287 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4145/8179] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:40 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:41.424641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:41.425346 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:41.431569 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:41.432020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:41.432810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:41.433260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:41.569871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:41.577296 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-326e5142-3043-4ed2-a77d-033f96b84e9a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1564 microversion: 2.1 time: 0.158380 Nov 20 21:43:41.577856 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4035/8180] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:41 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:41.593065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:41.593679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:41.600952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:41.601402 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:41.602223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:41.602667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:41.738918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:41.746174 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4467622e-e4d5-4dab-bf8e-821f6f5db375 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1564 microversion: 2.1 time: 0.156685 Nov 20 21:43:41.746758 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4146/8181] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:41 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:43:43.366556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-e610c1fc-eb19-4a92-a60b-483adfd67c7c req-860836c6-e4fe-4aca-a283-73995e3ed763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:43:43.368104 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:43:43.368104 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:43:43.370829 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:43:43.371445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:43:43.378721 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:43.379195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:43.380183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:43.380641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:43.383464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e610c1fc-eb19-4a92-a60b-483adfd67c7c req-860836c6-e4fe-4aca-a283-73995e3ed763 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:43:43.384294 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-e610c1fc-eb19-4a92-a60b-483adfd67c7c req-860836c6-e4fe-4aca-a283-73995e3ed763 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:43:43.400849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-e610c1fc-eb19-4a92-a60b-483adfd67c7c req-860836c6-e4fe-4aca-a283-73995e3ed763 service nova] Creating event network-changed:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch2-master-1 Nov 20 21:43:43.406096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-e610c1fc-eb19-4a92-a60b-483adfd67c7c req-860836c6-e4fe-4aca-a283-73995e3ed763 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043065 Nov 20 21:43:43.406902 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4147/8182] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:43:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:43:43.588653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:43:43.596431 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9f8e04ab-3a32-4e71-8900-f3c48e4c229c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1564 microversion: 2.1 time: 0.236652 Nov 20 21:43:43.610240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4036/8183] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:43:43 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1564 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:06.839333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:06.840301 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:06.847292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:06.847755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:06.848545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:06.848995 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:06.903617 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42af7d6b-75f9-41e7-8b04-99521d734cfd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action" status: 200 len: 24565 microversion: 2.1 time: 0.068529 Nov 20 21:44:06.904246 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4148/8184] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:44:06 2021] POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action => generated 24565 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:44:13.277781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:13.278774 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:13.284810 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:13.285264 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:13.286063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:13.286518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:13.325995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:13.332179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Old instance type m1.heat2, new instance type m1.heat {{(pid=140942) resize /opt/stack/nova/nova/compute/api.py:4097}} Nov 20 21:44:13.338336 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:44:13.338764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:44:13.339236 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:44:13.339649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:44:13.340062 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:44:13.401194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8af2e9bc-4cb6-4b47-a438-ef89513735ed tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action" status: 202 len: 0 microversion: 2.1 time: 0.127457 Nov 20 21:44:13.401803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4037/8185] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:44:13 2021] POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:44:13.410458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:13.411165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:13.418658 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:13.419119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:13.419917 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:13.420370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:13.996345 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:14.004124 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c73332ab-741f-49b5-840e-b641011673c8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1692 microversion: 2.1 time: 0.597888 Nov 20 21:44:14.004694 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4149/8186] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:13 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1692 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:15.022600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:15.023220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:15.029292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:15.029752 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:15.030594 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:15.031040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:15.289642 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:15.300632 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a1880c71-6332-4992-af5c-73c9d4f40220 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1692 microversion: 2.1 time: 0.282282 Nov 20 21:44:15.301229 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4038/8187] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:15 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1692 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:15.356099 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:44:15.356547 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:44:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:44:16.318619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:16.319259 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:16.326821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:16.327277 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:16.328057 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:16.328500 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:16.459198 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:16.467130 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-089aa098-d301-4097-a99c-6b93b8a681af tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1692 microversion: 2.1 time: 0.152991 Nov 20 21:44:16.476806 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4150/8188] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:16 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:44:17.485784 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:17.486424 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:17.493415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:17.493869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:17.494736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:17.495179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:17.651136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:17.658899 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f57d168d-a16f-4c9d-b901-852a377d3eb3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1692 microversion: 2.1 time: 0.176837 Nov 20 21:44:17.659231 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4039/8189] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:17 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:18.676401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:18.677056 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:18.683784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:18.684246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:18.685036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:18.685482 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:18.823977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:18.831764 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1b1c1be3-6e3c-42ac-9d68-db9be30fd23a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.159690 Nov 20 21:44:18.832331 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4151/8190] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:18 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:19.849024 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:19.849686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:19.856781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:19.857510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:19.858317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:19.858755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:19.996779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:20.004382 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f0655237-7e95-4cde-82f7-fef2e6bebf74 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.159592 Nov 20 21:44:20.004938 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4040/8191] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:19 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:21.020938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:21.021563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:21.028328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:21.028785 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:21.029574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:21.030018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:21.161861 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:21.169182 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c36a8a83-7fdb-4b42-b623-9d030b816aad tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.151947 Nov 20 21:44:21.169748 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4152/8192] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:21 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:22.185617 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:22.186234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:22.192953 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:22.193439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:22.194271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:22.194719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:22.327047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:22.335232 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c59949c7-b6fd-4f4f-bae7-ea77d48a1949 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.153273 Nov 20 21:44:22.335802 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4041/8193] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:22 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:23.352886 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:23.353433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:23.360554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:23.361019 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:23.361823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:23.362307 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:23.499836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:23.507234 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1f7a51b9-7194-416d-88cb-76f9aa23d96c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.158157 Nov 20 21:44:23.507814 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4153/8194] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:23 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:24.524221 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:24.524855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:24.531679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:24.532133 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:24.532919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:24.533360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:24.670779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:24.678669 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c2d16568-9785-42b3-b31d-3f79dffe1330 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.158135 Nov 20 21:44:24.679240 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4042/8195] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:24 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:25.695562 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:25.696181 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:25.702856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:25.703317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:25.704110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:25.704559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:25.839904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:25.847894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3c1f1b4c-7b31-4033-845c-aa953f33b29d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.156029 Nov 20 21:44:25.848464 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4154/8196] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:25 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:44:26.865326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:26.865980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:26.872317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:26.872779 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:26.873567 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:26.874037 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:27.006276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:27.013548 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-88415d4c-7ff0-4f55-9744-b60b9bab4c07 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.152658 Nov 20 21:44:27.014139 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4043/8197] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:26 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:28.029663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:28.030306 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:28.037228 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:28.037682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:28.038498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:28.038939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:28.176865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:28.184280 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a202f73d-e031-4b43-9685-5a57270102e1 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.158342 Nov 20 21:44:28.184842 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4155/8198] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:28 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:29.201684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:29.202332 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:29.209719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:29.210279 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:29.211078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:29.211521 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:29.346788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:29.354141 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b476d9c3-7fb2-4ecc-825c-a138d0551f62 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.156084 Nov 20 21:44:29.354653 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4044/8199] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:29 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:30.371950 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:30.372597 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:30.379040 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:30.379538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:30.380337 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:30.380799 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:30.513685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:30.522039 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7fe57691-8a5a-437e-9c83-d3c532e73b84 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.153921 Nov 20 21:44:30.522636 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4156/8200] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:30 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:31.539587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:31.540206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:31.546942 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:31.547399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:31.548189 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:31.548632 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:31.685042 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:31.692726 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a24ac424-154c-458b-be06-46482c34928c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.156890 Nov 20 21:44:31.693305 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4045/8201] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:31 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:32.709871 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:32.710654 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:32.717303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:32.717755 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:32.718632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:32.719076 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:32.851788 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:32.859538 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-199ebd00-1904-4731-9b00-02fa65ef9c98 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.153867 Nov 20 21:44:32.860194 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4157/8202] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:32 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:33.877620 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:33.878803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:33.885570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:33.886078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:33.886877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:33.887325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:34.019539 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:34.026822 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-637cf901-c180-4e94-9593-3e00eda6ba4b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1697 microversion: 2.1 time: 0.152900 Nov 20 21:44:34.027395 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4046/8203] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:33 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:35.043965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:35.045314 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:35.047970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "name": "network-vif-unplugged", "status": "completed", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:35.050465 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:44:35.050465 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:44:35.054386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:35.055240 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:35.056321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:35.057020 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:35.058007 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:35.058533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:35.078153 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] Creating event network-vif-unplugged:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch1-master-1 Nov 20 21:44:35.086555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] Instance ec2af18b-6869-4634-b2d3-21df4081a90b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140941) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:44:35.105378 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-91114892-5945-483c-9e09-394586b33d6c req-76770df7-7cb2-4b1c-9af4-ecf57d4f8718 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119327 Nov 20 21:44:35.106496 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4158/8204] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:44:34 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:44:35.323943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:35.331334 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aa2b0291-f015-4028-859b-2ab3e5b4e1f8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1696 microversion: 2.1 time: 0.291241 Nov 20 21:44:35.331916 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4047/8205] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:35 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1696 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:44:36.349152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:36.349889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:36.357093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:36.357554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:36.358370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:36.358813 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:36.500970 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:36.509019 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-39aa571a-9d53-4d74-9ee6-1dc255c6ec55 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1694 microversion: 2.1 time: 0.163998 Nov 20 21:44:36.509597 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4159/8206] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:36 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:37.122759 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:37.124315 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:44:37.124315 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:44:37.131992 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.132438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.144006 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] Creating event network-changed:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch1-master-1 Nov 20 21:44:37.149110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] Instance ec2af18b-6869-4634-b2d3-21df4081a90b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=140942) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Nov 20 21:44:37.160332 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4131e388-7092-43f7-84bc-608e0fe940cb req-b37627e0-b9cc-4f27-b14b-4d5c3049d631 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041064 Nov 20 21:44:37.160921 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4048/8207] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:44:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:44:37.527211 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:37.527828 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:37.540150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.540859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.542381 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.543000 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.769809 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:37.779771 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c515f738-4e6d-4006-ae1d-fcda4ab827e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1691 microversion: 2.1 time: 0.256424 Nov 20 21:44:37.780593 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4160/8208] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:37 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:37.798005 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:37.798671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:37.805392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.805853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.806699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.807143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.868706 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7b830d55-022c-41a4-9a06-94bac1139d8d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action" status: 204 len: 0 microversion: 2.1 time: 0.074605 Nov 20 21:44:37.869372 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4049/8209] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:44:37 2021] POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:44:37.880180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:37.880909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:37.887474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.888099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:37.889167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:37.890061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:38.123340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:38.132398 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6bf5b048-feba-4fae-921f-ae68d9aa20ef tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1691 microversion: 2.1 time: 0.258386 Nov 20 21:44:38.133183 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4161/8210] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:37 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:38.151894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:38.153246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:38.160686 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:38.161148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:38.161956 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:38.162423 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:38.354099 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:38.362795 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3e01715-b619-4033-b26f-aa2a43cee5bc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1691 microversion: 2.1 time: 0.216841 Nov 20 21:44:38.364654 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4050/8211] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:38 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:44:39.380534 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:44:39.381157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:44:39.387789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:39.388245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:39.389024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:39.389466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:39.522488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:44:39.529963 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5642ae3d-b7fa-4c15-952f-c79a7e4dd637 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1683 microversion: 2.1 time: 0.153117 Nov 20 21:44:39.530771 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4162/8212] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:44:39 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:44:42.335989 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-ba868dce-e156-4311-959a-23072ea2b621 req-59c066da-4dba-4caa-97f8-1e6e7b295848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "name": "network-vif-plugged", "status": "completed", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:44:42.337537 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:44:42.337537 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:44:42.344387 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ba868dce-e156-4311-959a-23072ea2b621 req-59c066da-4dba-4caa-97f8-1e6e7b295848 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:44:42.344827 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-ba868dce-e156-4311-959a-23072ea2b621 req-59c066da-4dba-4caa-97f8-1e6e7b295848 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:44:42.355513 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-ba868dce-e156-4311-959a-23072ea2b621 req-59c066da-4dba-4caa-97f8-1e6e7b295848 service nova] Creating event network-vif-plugged:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch1-master-1 Nov 20 21:44:42.360710 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-ba868dce-e156-4311-959a-23072ea2b621 req-59c066da-4dba-4caa-97f8-1e6e7b295848 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078309 Nov 20 21:44:42.361306 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4051/8213] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:44:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:45:03.713214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:03.714166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:03.720659 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:03.721113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:03.721904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:03.722419 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:03.777379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7749bc9c-48d5-41e7-a7c7-54b29a940174 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action" status: 200 len: 24579 microversion: 2.1 time: 0.068552 Nov 20 21:45:03.778029 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4163/8214] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:45:03 2021] POST /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b/action => generated 24579 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:45:11.151018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:11.151729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:11.152174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-5f8d4456-c02c-410d-a1ea-21ec41863479 req-adf8f26a-6ee6-422b-a751-9a6125a70b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:11.153860 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:45:11.153860 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:45:11.158358 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:11.158824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:11.159634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:11.160093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:11.162565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5f8d4456-c02c-410d-a1ea-21ec41863479 req-adf8f26a-6ee6-422b-a751-9a6125a70b1b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:11.163028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-5f8d4456-c02c-410d-a1ea-21ec41863479 req-adf8f26a-6ee6-422b-a751-9a6125a70b1b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:11.174277 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-5f8d4456-c02c-410d-a1ea-21ec41863479 req-adf8f26a-6ee6-422b-a751-9a6125a70b1b service nova] Creating event network-changed:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch1-master-1 Nov 20 21:45:11.179463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-5f8d4456-c02c-410d-a1ea-21ec41863479 req-adf8f26a-6ee6-422b-a751-9a6125a70b1b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032305 Nov 20 21:45:11.180598 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4164/8215] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:45:11.192680 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:45:11.278737 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cc1a2602-49f1-422d-91bc-87ef778d01db tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 204 len: 0 microversion: 2.1 time: 0.133422 Nov 20 21:45:11.279940 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4052/8216] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:45:11 2021] DELETE /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:45:11.290434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:11.291239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:11.297967 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:11.298476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:11.299286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:11.299734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:11.440491 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:11.448737 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-459b4919-1c94-474d-802f-128729200bba tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1689 microversion: 2.1 time: 0.164247 Nov 20 21:45:11.454093 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4165/8217] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:11 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:45:12.467153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:12.467853 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:12.474432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:12.474886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:12.475672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:12.476115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:12.612048 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:12.619504 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a763187a-bff1-4051-b6c2-dc12a35631a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 200 len: 1570 microversion: 2.1 time: 0.156370 Nov 20 21:45:12.620071 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4053/8218] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:12 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:13.197186 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ca814c7f-4576-4e4d-b6d0-617f5378f332 req-ef91c8d9-6177-4f8b-b0f6-a414043c2264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec2af18b-6869-4634-b2d3-21df4081a90b", "name": "network-vif-deleted", "tag": "5fc5c948-8502-49aa-95f9-d0c3516ff0f3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:13.198948 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:45:13.198948 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:45:13.207150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ca814c7f-4576-4e4d-b6d0-617f5378f332 req-ef91c8d9-6177-4f8b-b0f6-a414043c2264 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:13.207415 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ca814c7f-4576-4e4d-b6d0-617f5378f332 req-ef91c8d9-6177-4f8b-b0f6-a414043c2264 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:13.223069 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ca814c7f-4576-4e4d-b6d0-617f5378f332 req-ef91c8d9-6177-4f8b-b0f6-a414043c2264 service nova] Creating event network-vif-deleted:5fc5c948-8502-49aa-95f9-d0c3516ff0f3 for instance ec2af18b-6869-4634-b2d3-21df4081a90b on nch1-master-1 Nov 20 21:45:13.227944 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ca814c7f-4576-4e4d-b6d0-617f5378f332 req-ef91c8d9-6177-4f8b-b0f6-a414043c2264 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035222 Nov 20 21:45:13.228563 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4166/8219] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:45:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:45:13.636589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:13.637142 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: ec2af18b-6869-4634-b2d3-21df4081a90b] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:13.646041 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:13.646519 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:13.647308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:13.647750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:13.662992 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] HTTP exception thrown: Instance ec2af18b-6869-4634-b2d3-21df4081a90b could not be found. Nov 20 21:45:13.663582 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Returning 404 to user: Instance ec2af18b-6869-4634-b2d3-21df4081a90b could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:45:13.664974 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e6699615-ad68-440c-aaed-c99f55ed786e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b" status: 404 len: 111 microversion: 2.1 time: 0.032244 Nov 20 21:45:13.665508 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4054/8220] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:13 2021] GET /compute/v2.1/servers/ec2af18b-6869-4634-b2d3-21df4081a90b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:45:17.049239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93b9bb4c-afdb-49ab-81f6-e3d0c3b9ddb0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '.version_select at 0x7f3f841d6f70>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:17.080199 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93b9bb4c-afdb-49ab-81f6-e3d0c3b9ddb0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-591831802" status: 202 len: 0 microversion: 2.1 time: 0.039489 Nov 20 21:45:17.081175 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4167/8221] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:45:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-591831802 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:45:17.105486 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: .version_select at 0x7f3f863a7e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-981068000"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:17.122903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:45:17.127927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:45:17.546999 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:45:17.551739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:45:17.565626 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1da490b8-404f-4674-8af5-0e7fabac1d1d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.464553 Nov 20 21:45:17.566269 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4055/8222] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:45:17 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:23.049977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1669035636", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "7eaf7bb7-f66e-455b-9afd-56c69e49f42e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-981068000", "security_groups": [{"name": "tempest-secgroup-smoke-1740584713"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:23.191633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] validate_networks() for [('7eaf7bb7-f66e-455b-9afd-56c69e49f42e', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:45:23.745810 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:45:23.746510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:45:23.746999 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:45:23.747424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:45:23.747880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:45:23.759034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:23.759985 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:23.760821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:23.761287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:23.780816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:45:23.785934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:45:23.798819 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:45:23.801258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:45:23.850466 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bf17a97d-abfc-459a-9734-0991e60ec699 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804190 Nov 20 21:45:23.851300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4168/8223] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:45:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:45:23.862749 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-953085f9-6d47-4a68-8b28-ae93aaf7835d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:23.863354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-953085f9-6d47-4a68-8b28-ae93aaf7835d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:23.919297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-953085f9-6d47-4a68-8b28-ae93aaf7835d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:23.931630 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-953085f9-6d47-4a68-8b28-ae93aaf7835d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1266 microversion: 2.1 time: 0.072644 Nov 20 21:45:23.942413 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4056/8224] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:23 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:24.950838 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:24.951458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:24.958333 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:24.959044 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:24.959846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:24.960292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:25.029052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:25.036624 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83da1019-49e9-4aef-8d92-031638e143a6 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1324 microversion: 2.1 time: 0.090450 Nov 20 21:45:25.048291 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4169/8225] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:24 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1324 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:26.058846 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:26.059469 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:26.067328 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:26.068573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:26.069592 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:26.070249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:26.308783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:26.317286 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d396756c-e5d8-45e9-8768-64a782eeb889 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.263453 Nov 20 21:45:26.319547 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4057/8226] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:26 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:26.377735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7397eab1-d4f0-4c79-bb95-e8a97380b833 req-1f6e6c09-f98b-4085-b65f-ec977f08d693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4506b083-5104-4ea3-ae4c-d50be293eecd", "tag": "2143d9a7-b8dd-484c-b9f2-bffd93a93c27"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:26.380565 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:45:26.380565 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:45:26.389365 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7397eab1-d4f0-4c79-bb95-e8a97380b833 req-1f6e6c09-f98b-4085-b65f-ec977f08d693 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:26.389891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7397eab1-d4f0-4c79-bb95-e8a97380b833 req-1f6e6c09-f98b-4085-b65f-ec977f08d693 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:26.403043 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-7397eab1-d4f0-4c79-bb95-e8a97380b833 req-1f6e6c09-f98b-4085-b65f-ec977f08d693 service nova] Creating event network-changed:2143d9a7-b8dd-484c-b9f2-bffd93a93c27 for instance 4506b083-5104-4ea3-ae4c-d50be293eecd on nch1-master-1 Nov 20 21:45:26.408207 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7397eab1-d4f0-4c79-bb95-e8a97380b833 req-1f6e6c09-f98b-4085-b65f-ec977f08d693 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034407 Nov 20 21:45:26.408919 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4170/8227] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:45:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:45:27.335353 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:27.336063 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:27.344711 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:27.345169 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:27.345959 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:27.346422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:27.486548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:27.494725 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3510d00c-9ae9-4f29-817b-7cfad56bd600 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.162762 Nov 20 21:45:27.495291 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4058/8228] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:27 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:28.513463 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:28.514106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:28.520262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:28.520720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:28.521516 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:28.521963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:28.660151 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:28.667487 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fb1ad3fc-f19d-4a45-b643-69e182833143 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.159790 Nov 20 21:45:28.668055 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4171/8229] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:28 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:29.684205 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:29.684818 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:29.691446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:29.691901 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:29.692682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:29.693120 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:29.827324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:29.834548 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-3be5b031-fd2c-40ed-b268-1a43fc583afc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.154178 Nov 20 21:45:29.835114 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4059/8230] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:29 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:30.851905 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:30.853068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:30.859815 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:30.860269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:30.861062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:30.861789 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:30.996528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:31.004271 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-36fc2be1-d53d-4fb9-9299-918473b321fa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.156066 Nov 20 21:45:31.004842 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4172/8231] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:30 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:32.020965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:32.021597 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:32.028441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:32.028898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:32.029688 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:32.030163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:32.166464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:32.173958 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bb0f89b4-05be-4d66-a9fb-2f536e052424 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.156739 Nov 20 21:45:32.174639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4060/8232] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:32 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:32.584646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-9202c613-aeda-48e0-887b-ffe25f6af596 req-be9d8bb3-da9b-49c8-b9ba-6ef7a5437686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4506b083-5104-4ea3-ae4c-d50be293eecd", "name": "network-vif-plugged", "status": "completed", "tag": "2143d9a7-b8dd-484c-b9f2-bffd93a93c27"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:32.586238 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:45:32.586238 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:45:32.594963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9202c613-aeda-48e0-887b-ffe25f6af596 req-be9d8bb3-da9b-49c8-b9ba-6ef7a5437686 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:32.595420 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-9202c613-aeda-48e0-887b-ffe25f6af596 req-be9d8bb3-da9b-49c8-b9ba-6ef7a5437686 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:32.607621 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-9202c613-aeda-48e0-887b-ffe25f6af596 req-be9d8bb3-da9b-49c8-b9ba-6ef7a5437686 service nova] Creating event network-vif-plugged:2143d9a7-b8dd-484c-b9f2-bffd93a93c27 for instance 4506b083-5104-4ea3-ae4c-d50be293eecd on nch1-master-1 Nov 20 21:45:32.612470 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-9202c613-aeda-48e0-887b-ffe25f6af596 req-be9d8bb3-da9b-49c8-b9ba-6ef7a5437686 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031614 Nov 20 21:45:32.613073 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4173/8233] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:45:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:45:33.191679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:33.192300 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:33.199872 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:33.200334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:33.201134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:33.201584 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:33.335985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:33.343509 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e017db71-003b-4053-892f-0e602882745a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1392 microversion: 2.1 time: 0.155509 Nov 20 21:45:33.344081 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4061/8234] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:33 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:34.361989 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:34.362711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:34.369039 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:34.369496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:34.370310 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:34.370760 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:34.505757 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:34.513516 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89294f98-d5f6-42f0-904e-8fc88d11d222 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1563 microversion: 2.1 time: 0.156441 Nov 20 21:45:34.514113 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4174/8235] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:34 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:34.530331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:34.530952 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:34.537696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:34.538195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:34.538997 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:34.539444 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:34.671804 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:34.679196 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-053501dd-fe75-484e-9ec4-ca847136e32c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1563 microversion: 2.1 time: 0.152598 Nov 20 21:45:34.679765 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4062/8236] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:34 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:36.832355 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:45:36.833093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:36.837108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5f97d4dc-68c5-4f33-9ebb-6f8fecca577e req-29b0f2dd-8a3c-4b63-b8c0-f1e0ca83bd07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4506b083-5104-4ea3-ae4c-d50be293eecd", "tag": "2143d9a7-b8dd-484c-b9f2-bffd93a93c27"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:36.841801 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:36.842361 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:36.842798 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:45:36.842798 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:45:36.843258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:36.843953 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:36.858162 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f97d4dc-68c5-4f33-9ebb-6f8fecca577e req-29b0f2dd-8a3c-4b63-b8c0-f1e0ca83bd07 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:36.858611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5f97d4dc-68c5-4f33-9ebb-6f8fecca577e req-29b0f2dd-8a3c-4b63-b8c0-f1e0ca83bd07 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:36.881546 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5f97d4dc-68c5-4f33-9ebb-6f8fecca577e req-29b0f2dd-8a3c-4b63-b8c0-f1e0ca83bd07 service nova] Creating event network-changed:2143d9a7-b8dd-484c-b9f2-bffd93a93c27 for instance 4506b083-5104-4ea3-ae4c-d50be293eecd on nch1-master-1 Nov 20 21:45:36.888660 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5f97d4dc-68c5-4f33-9ebb-6f8fecca577e req-29b0f2dd-8a3c-4b63-b8c0-f1e0ca83bd07 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060640 Nov 20 21:45:36.889895 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4063/8237] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:45:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:45:37.006486 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:45:37.022492 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4548d638-d041-4c14-9b0f-f1ed5a511453 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1563 microversion: 2.1 time: 0.197335 Nov 20 21:45:37.023379 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4175/8238] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:45:36 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:45:58.343420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:45:58.344574 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:45:58.354324 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:58.354783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:58.355581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:45:58.356272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:45:58.405470 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7a80d2ce-b6fa-494d-a288-0e74e7f8200e tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action" status: 200 len: 24566 microversion: 2.1 time: 0.066904 Nov 20 21:45:58.406167 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4064/8239] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:45:58 2021] POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action => generated 24566 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:46:09.450920 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5e7b5483-c35c-469f-b1df-0642b83ad4f7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:46:09.458880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e7b5483-c35c-469f-b1df-0642b83ad4f7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:09.459339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5e7b5483-c35c-469f-b1df-0642b83ad4f7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:09.481232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5e7b5483-c35c-469f-b1df-0642b83ad4f7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Going to try to stop instance {{(pid=140941) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 20 21:46:09.521234 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5e7b5483-c35c-469f-b1df-0642b83ad4f7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.074023 Nov 20 21:46:09.521830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4176/8240] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:46:09 2021] POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:46:09.531153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:09.531712 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:09.538715 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:09.540112 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:09.540929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:09.541376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:09.685436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:09.692769 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-388a26fc-523f-4866-98bb-ceca48f03bac tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.166298 Nov 20 21:46:09.693335 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4065/8241] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:09 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:10.712265 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:10.712973 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:10.719092 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:10.719551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:10.720339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:10.720786 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:10.863002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:10.871016 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b29aac3f-abc6-4946-a7a3-d7230d34e653 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.163961 Nov 20 21:46:10.871582 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4177/8242] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:10 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:11.888079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:11.888716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:11.898550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:11.899006 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:11.899792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:11.900228 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:12.031366 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:12.038770 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5d0b1c96-7b8a-42e6-9d80-9e18a094b91d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.154400 Nov 20 21:46:12.040141 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4066/8243] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:11 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:46:13.056726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:13.057399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:13.064221 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:13.064682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:13.065476 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:13.065922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:13.202302 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:13.209636 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-60514265-161c-4b47-a4a3-484897b5296a tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.157181 Nov 20 21:46:13.210225 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4178/8244] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:13 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:14.227164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:14.227781 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:14.234556 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:14.235022 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:14.235822 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:14.236267 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:14.366700 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:14.374109 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1b50377f-22e0-4228-9bfc-57a3b6bdfa36 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.150851 Nov 20 21:46:14.374685 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4067/8245] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:14 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:46:15.391750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:15.392368 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:15.399880 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:15.400341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:15.401139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:15.401593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:15.538165 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:15.546257 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-edd7fe9d-afbe-4112-8197-c45b1f6631ae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.158232 Nov 20 21:46:15.546826 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4179/8246] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:15 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:16.562732 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:16.563373 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:16.571707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:16.572210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:16.573143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:16.573639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:16.709464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:16.716909 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-163bc5d7-aab5-4dc8-b514-bcdb0815a956 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.157998 Nov 20 21:46:16.717486 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4068/8247] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:16 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:17.733646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:17.734375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:17.740914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:17.741375 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:17.742232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:17.742687 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:17.873075 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:17.880554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b89e9fec-0be4-4603-b942-6938b38f0bfa tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.150846 Nov 20 21:46:17.881146 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4180/8248] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:17 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:18.898573 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:18.899376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:18.905943 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:18.906435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:18.907216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:18.907657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:19.037487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:19.045221 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9afb1ef6-6f05-49d3-a44d-76c6c0ba59d8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.150864 Nov 20 21:46:19.045822 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4069/8249] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:18 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:20.061944 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:20.062720 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:20.069385 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:20.069847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:20.071219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:20.071682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:20.216790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:20.224541 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8f2f49bd-be12-40ea-baab-a1745372c4a5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.166253 Nov 20 21:46:20.225133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4181/8250] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:20 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:21.241883 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:21.242657 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:21.249456 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:21.249915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:21.250729 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:21.251177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:21.384934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:21.392263 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c565c7e7-e3fb-4a32-acb0-d33581953b2d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.154104 Nov 20 21:46:21.392836 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4070/8251] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:21 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:22.409933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:22.410588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:22.418013 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:22.418510 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:22.419295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:22.419738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:22.553680 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:22.562000 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b1392a5-72de-4029-ade5-802514d152bd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.155785 Nov 20 21:46:22.562604 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4182/8252] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:22 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:23.579982 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:23.580709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:23.588639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:23.589185 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:23.590164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:23.590708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:23.721183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:23.728496 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-948c122d-d604-4f37-a92d-abc049e885a7 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.152274 Nov 20 21:46:23.729069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4071/8253] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:23 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:24.745780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:24.746559 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:24.753252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:24.753708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:24.754528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:24.754972 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:24.889821 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:24.897125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d63e1aab-0520-488a-a39d-6c7fb3087603 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1692 microversion: 2.1 time: 0.155727 Nov 20 21:46:24.897697 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4183/8254] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:24 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:25.914716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:25.915327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:25.922002 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:25.922524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:25.923313 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:25.923751 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:26.059802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:26.067379 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c0ffe402-05a4-405b-8a23-04828c61b5a8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1669 microversion: 2.1 time: 0.156327 Nov 20 21:46:26.067962 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4072/8255] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:25 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:27.159590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:46:27.160615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:27.167286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:27.167745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:27.168569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:27.169020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:27.219766 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3b9a4ab9-141b-43b9-89f7-afa2b7f968e0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action" status: 200 len: 38374 microversion: 2.1 time: 0.063800 Nov 20 21:46:27.220390 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4184/8256] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:46:27 2021] POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action => generated 38374 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:46:27.231778 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4652fe87-2ba9-4ef5-9249-aa9ebf085f6f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:46:27.238453 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4652fe87-2ba9-4ef5-9249-aa9ebf085f6f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:27.238917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4652fe87-2ba9-4ef5-9249-aa9ebf085f6f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:27.261478 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4652fe87-2ba9-4ef5-9249-aa9ebf085f6f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Going to try to start instance {{(pid=140942) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 20 21:46:27.302192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4652fe87-2ba9-4ef5-9249-aa9ebf085f6f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.074224 Nov 20 21:46:27.302944 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4073/8257] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:46:27 2021] POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:46:27.312159 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:27.312866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:27.319808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:27.320889 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:27.321728 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:27.322216 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:27.465948 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:27.473430 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d8dfacf-2e04-4443-8b72-bc3b00ac7932 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1678 microversion: 2.1 time: 0.165252 Nov 20 21:46:27.474023 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4185/8258] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:27 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:28.493220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:46:28.494035 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:28.500159 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:28.500622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:28.501417 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:28.501866 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:28.639121 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:46:28.646571 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-215f5c4c-15c9-4c3f-a792-7c584b45394b tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1682 microversion: 2.1 time: 0.158700 Nov 20 21:46:28.647140 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4074/8259] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:46:28 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:46:52.828527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:46:52.829376 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:46:52.836808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:52.837274 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:52.838099 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:46:52.838552 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:46:52.893405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2b7c1a9c-176f-4927-951a-bc8b0a28d246 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action" status: 200 len: 62939 microversion: 2.1 time: 0.068465 Nov 20 21:46:52.894125 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4186/8260] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:46:52 2021] POST /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd/action => generated 62939 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 20 21:47:00.116848 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:00.117371 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:00.123914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:00.124568 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:00.125435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:00.125948 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:00.153224 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:47:00.216721 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fb8e8e4f-edc4-45c6-a5c6-ee09e46d1219 req-a0b6e12d-1d4d-4ded-b49d-4d11fe851509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4506b083-5104-4ea3-ae4c-d50be293eecd", "tag": "2143d9a7-b8dd-484c-b9f2-bffd93a93c27"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:00.217273 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:47:00.217273 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:47:00.225497 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fb8e8e4f-edc4-45c6-a5c6-ee09e46d1219 req-a0b6e12d-1d4d-4ded-b49d-4d11fe851509 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:00.226037 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fb8e8e4f-edc4-45c6-a5c6-ee09e46d1219 req-a0b6e12d-1d4d-4ded-b49d-4d11fe851509 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:00.238951 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fb8e8e4f-edc4-45c6-a5c6-ee09e46d1219 req-a0b6e12d-1d4d-4ded-b49d-4d11fe851509 service nova] Creating event network-changed:2143d9a7-b8dd-484c-b9f2-bffd93a93c27 for instance 4506b083-5104-4ea3-ae4c-d50be293eecd on nch1-master-1 Nov 20 21:47:00.244282 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b5caf4f7-ce80-4b08-9afa-c848cab19265 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 204 len: 0 microversion: 2.1 time: 0.132174 Nov 20 21:47:00.248299 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4075/8261] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:47:00 2021] DELETE /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:47:00.248493 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fb8e8e4f-edc4-45c6-a5c6-ee09e46d1219 req-a0b6e12d-1d4d-4ded-b49d-4d11fe851509 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092956 Nov 20 21:47:00.248493 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4187/8262] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:47:00.254158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:00.254860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:00.260735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:00.261199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:00.262004 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:00.262483 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:00.484814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:00.492805 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e4a8c6e4-8583-4611-aed6-248a0f66a316 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1688 microversion: 2.1 time: 0.242405 Nov 20 21:47:00.493507 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4076/8263] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:00 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:01.510426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:01.511196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:01.518147 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:01.518609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:01.519428 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:01.519872 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:01.664738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:01.672996 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-95694824-6e9f-467f-ac70-066c0e15a631 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1569 microversion: 2.1 time: 0.167025 Nov 20 21:47:01.683987 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4188/8264] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:01 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:02.299903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-979bc2d6-d978-43b9-acc2-52f2663e0ce3 req-208d06b6-8729-4431-be16-832cc3e622c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4506b083-5104-4ea3-ae4c-d50be293eecd", "name": "network-vif-deleted", "tag": "2143d9a7-b8dd-484c-b9f2-bffd93a93c27"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:02.301620 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:47:02.301620 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:47:02.311269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-979bc2d6-d978-43b9-acc2-52f2663e0ce3 req-208d06b6-8729-4431-be16-832cc3e622c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:02.311802 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-979bc2d6-d978-43b9-acc2-52f2663e0ce3 req-208d06b6-8729-4431-be16-832cc3e622c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:02.324776 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-979bc2d6-d978-43b9-acc2-52f2663e0ce3 req-208d06b6-8729-4431-be16-832cc3e622c0 service nova] Creating event network-vif-deleted:2143d9a7-b8dd-484c-b9f2-bffd93a93c27 for instance 4506b083-5104-4ea3-ae4c-d50be293eecd on nch1-master-1 Nov 20 21:47:02.329827 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-979bc2d6-d978-43b9-acc2-52f2663e0ce3 req-208d06b6-8729-4431-be16-832cc3e622c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Nov 20 21:47:02.331016 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4077/8265] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:47:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:47:02.695051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:02.696169 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:02.707609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:02.708073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:02.708890 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:02.709446 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:02.757909 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:02.758425 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:02.758891 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lazy-loading 'fault' on Instance uuid 4506b083-5104-4ea3-ae4c-d50be293eecd {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:47:02.800144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:02.807725 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2050aadc-eda1-4456-9d61-964b9f85f356 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 200 len: 1356 microversion: 2.1 time: 0.119107 Nov 20 21:47:02.808289 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4189/8266] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:02 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 1356 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:03.825187 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:03.825795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 4506b083-5104-4ea3-ae4c-d50be293eecd] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:03.832663 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:03.833118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:03.833897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:03.834360 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:03.847132 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] HTTP exception thrown: Instance 4506b083-5104-4ea3-ae4c-d50be293eecd could not be found. Nov 20 21:47:03.847717 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Returning 404 to user: Instance 4506b083-5104-4ea3-ae4c-d50be293eecd could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:47:03.848523 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-738bf776-d923-41ad-aa57-9e3670d73d4c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd" status: 404 len: 111 microversion: 2.1 time: 0.027554 Nov 20 21:47:03.849046 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4078/8267] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:03 2021] GET /compute/v2.1/servers/4506b083-5104-4ea3-ae4c-d50be293eecd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:47:07.188174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2620a039-62a0-40bc-b5c6-073721ec5cb9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '.version_select at 0x7f3f86e353a0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:07.207828 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2620a039-62a0-40bc-b5c6-073721ec5cb9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981068000" status: 202 len: 0 microversion: 2.1 time: 0.023422 Nov 20 21:47:07.208768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4190/8268] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:47:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-981068000 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:47:07.246653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: .version_select at 0x7f3f98d59940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-187495393"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:07.263036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:47:07.272272 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:47:07.384828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:47:07.389640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:47:07.403382 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-89e9548d-0e98-4af4-a81e-8b320e6a2e3f tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.160599 Nov 20 21:47:07.404002 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4079/8269] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:47:07 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:13.347873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1374411506", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "networks": [{"uuid": "0cf8ca84-7fc0-40fc-a27d-30b72faeddbf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-187495393", "security_groups": [{"name": "tempest-secgroup-smoke-1913533013"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:13.470437 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] validate_networks() for [('0cf8ca84-7fc0-40fc-a27d-30b72faeddbf', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:47:13.950925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:47:13.951353 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:47:13.951866 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:47:13.952282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:47:13.952700 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:47:13.962590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:13.963293 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:13.964339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:13.965105 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:13.984461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:47:13.990205 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Getting quotas for user b7c953eb7c86418fa1cb0257829f23b7 and project a671b29208764a018b1936b75389117b. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:47:14.003966 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:47:14.006569 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:47:14.065635 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-619e9841-6615-4ad7-ba38-896c27329bfc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722210 Nov 20 21:47:14.066961 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4191/8270] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:47:13 2021] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:47:14.077764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-64f9cc00-c147-4a6e-91d8-6081368fd738 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:14.078504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-64f9cc00-c147-4a6e-91d8-6081368fd738 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:14.158295 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-64f9cc00-c147-4a6e-91d8-6081368fd738 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:14.165865 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-64f9cc00-c147-4a6e-91d8-6081368fd738 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1266 microversion: 2.1 time: 0.092283 Nov 20 21:47:14.166496 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4080/8271] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:14 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:15.185341 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:15.185936 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:15.205627 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:15.206121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:15.206945 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:15.207400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:15.311685 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:15.322179 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2eb2f49e-05f8-497d-8dc3-1734f3a387f0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1336 microversion: 2.1 time: 0.142240 Nov 20 21:47:15.323018 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4192/8272] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:15 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1336 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:16.340458 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:16.341695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:16.352118 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:16.352575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:16.353381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:16.353821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:16.511699 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:16.526309 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e8c29e56-acea-467d-9c63-f1cace2210e9 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.190142 Nov 20 21:47:16.534720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4081/8273] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:16 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:47:16.681964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1509ab9c-4ea8-44c1-90de-98beaaa7f4ab req-ee623a00-8397-4fbb-a3c1-4787311f868a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af50e49-4476-4063-b69d-450a637564f5", "tag": "034920d2-bff9-42cd-9504-4d9cb13382ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:16.684779 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:47:16.684779 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:47:16.696219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1509ab9c-4ea8-44c1-90de-98beaaa7f4ab req-ee623a00-8397-4fbb-a3c1-4787311f868a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:16.697400 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1509ab9c-4ea8-44c1-90de-98beaaa7f4ab req-ee623a00-8397-4fbb-a3c1-4787311f868a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:16.719036 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1509ab9c-4ea8-44c1-90de-98beaaa7f4ab req-ee623a00-8397-4fbb-a3c1-4787311f868a service nova] Creating event network-changed:034920d2-bff9-42cd-9504-4d9cb13382ce for instance 1af50e49-4476-4063-b69d-450a637564f5 on nch2-master-1 Nov 20 21:47:16.724586 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1509ab9c-4ea8-44c1-90de-98beaaa7f4ab req-ee623a00-8397-4fbb-a3c1-4787311f868a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046238 Nov 20 21:47:16.728797 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4193/8274] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:47:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:47:17.544234 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:17.544852 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:17.551671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:17.552125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:17.552929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:17.553369 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:17.687794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:17.695307 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac45a106-2728-455c-8520-80ea8f092af2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.154868 Nov 20 21:47:17.695882 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4082/8275] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:17 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:18.714315 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:18.715031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:18.721140 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:18.721604 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:18.722417 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:18.722864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:18.863910 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:18.871894 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-087de1f9-77b5-41f4-b928-7c341e84fa87 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.163384 Nov 20 21:47:18.872471 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4194/8276] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:18 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:19.888487 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:19.889092 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:19.895795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:19.896248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:19.897229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:19.897664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:20.027692 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:20.035071 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-84fc153d-eb2e-4ffd-99c2-af48e23da6cc tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.150264 Nov 20 21:47:20.035677 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4083/8277] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:19 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:21.052543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:21.053862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:21.060565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:21.061068 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:21.061859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:21.062322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:21.195247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:21.202554 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0bc2413-1a5c-4e13-9c39-8529ba902dae tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.153777 Nov 20 21:47:21.203127 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4195/8278] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:21 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:22.220078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:22.220623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:22.228186 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:22.228643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:22.229430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:22.230168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:22.364135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:22.371415 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d3e4733f-4c04-4a4b-baf4-21296e02e5df tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.155164 Nov 20 21:47:22.371986 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4084/8279] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:22 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:22.620470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-13563605-626d-4cf8-9eaf-fa979f9bc652 req-a54f0593-bf83-4d85-a996-b550e782c01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af50e49-4476-4063-b69d-450a637564f5", "name": "network-vif-plugged", "status": "completed", "tag": "034920d2-bff9-42cd-9504-4d9cb13382ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:22.621982 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:47:22.621982 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:47:22.629754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-13563605-626d-4cf8-9eaf-fa979f9bc652 req-a54f0593-bf83-4d85-a996-b550e782c01d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:22.630281 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-13563605-626d-4cf8-9eaf-fa979f9bc652 req-a54f0593-bf83-4d85-a996-b550e782c01d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:22.641829 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-13563605-626d-4cf8-9eaf-fa979f9bc652 req-a54f0593-bf83-4d85-a996-b550e782c01d service nova] Creating event network-vif-plugged:034920d2-bff9-42cd-9504-4d9cb13382ce for instance 1af50e49-4476-4063-b69d-450a637564f5 on nch2-master-1 Nov 20 21:47:22.647424 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-13563605-626d-4cf8-9eaf-fa979f9bc652 req-a54f0593-bf83-4d85-a996-b550e782c01d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029971 Nov 20 21:47:22.648021 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4196/8280] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:47:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:47:23.387451 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:23.388067 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:23.394757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:23.395210 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:23.396030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:23.397231 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:23.527181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:23.534596 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-06fa5c0b-863c-464c-99d0-7cdb74824a23 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1392 microversion: 2.1 time: 0.150787 Nov 20 21:47:23.535333 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4085/8281] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:23 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:24.554250 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:24.554957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:24.561128 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:24.561585 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:24.562408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:24.562854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:24.698621 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:24.705941 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9fc1e941-81ee-4e67-8969-f47dcc1fb84c tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1562 microversion: 2.1 time: 0.157475 Nov 20 21:47:24.706549 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4197/8282] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:24 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:24.721975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:24.722636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:24.730255 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:24.730716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:24.731509 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:24.731954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:24.869940 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:24.877228 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-22f26aee-c000-49dc-96a5-8108a82d5476 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1562 microversion: 2.1 time: 0.158887 Nov 20 21:47:24.878156 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4086/8283] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:24 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:26.475648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:26.476268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:26.478374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-3467f82c-c426-4cd6-aec8-25e1d5a13b47 req-578f0a89-58be-42c8-adac-fdb635aa43a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af50e49-4476-4063-b69d-450a637564f5", "tag": "034920d2-bff9-42cd-9504-4d9cb13382ce"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:26.480146 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:47:26.480146 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:47:26.483283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:26.484089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:26.484892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:26.485338 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:26.488832 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3467f82c-c426-4cd6-aec8-25e1d5a13b47 req-578f0a89-58be-42c8-adac-fdb635aa43a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:26.489277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-3467f82c-c426-4cd6-aec8-25e1d5a13b47 req-578f0a89-58be-42c8-adac-fdb635aa43a2 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:26.500512 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-3467f82c-c426-4cd6-aec8-25e1d5a13b47 req-578f0a89-58be-42c8-adac-fdb635aa43a2 service nova] Creating event network-changed:034920d2-bff9-42cd-9504-4d9cb13382ce for instance 1af50e49-4476-4063-b69d-450a637564f5 on nch2-master-1 Nov 20 21:47:26.505582 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-3467f82c-c426-4cd6-aec8-25e1d5a13b47 req-578f0a89-58be-42c8-adac-fdb635aa43a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031380 Nov 20 21:47:26.506406 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4087/8284] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:47:27.030009 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:27.038190 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-63c22856-fd9e-4ca2-b230-e2d6bc258359 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1562 microversion: 2.1 time: 0.567020 Nov 20 21:47:27.046203 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4198/8285] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:26 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1562 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:47:48.548887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:48.549896 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:48.556750 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:48.557204 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:48.558010 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:48.558472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:48.608769 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-294ed567-651b-4982-b384-56e0a3c5de25 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action" status: 200 len: 24568 microversion: 2.1 time: 0.064650 Nov 20 21:47:48.609397 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4088/8286] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:47:48 2021] POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action => generated 24568 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:47:59.717578 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:47:59.718217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:59.724163 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:59.724609 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:59.725407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:59.725865 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:59.748694 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lazy-loading 'flavor' on Instance uuid 1af50e49-4476-4063-b69d-450a637564f5 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:47:59.813930 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-405999e4-0d70-4e43-a7c9-9a4b29f96910 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action" status: 202 len: 0 microversion: 2.1 time: 0.100138 Nov 20 21:47:59.814550 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4199/8287] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:47:59 2021] POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:47:59.823297 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:47:59.823990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:47:59.831480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:59.832108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:59.833011 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:47:59.833610 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:47:59.974170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:47:59.981781 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-501f0bb2-4fc7-498c-85f0-0d069a440531 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1689 microversion: 2.1 time: 0.162619 Nov 20 21:47:59.982375 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4089/8288] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:47:59 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:01.003188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:01.003878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:01.010025 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:01.010513 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:01.011303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:01.011742 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:01.144986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:01.152823 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5613fc56-3802-4b26-b4fa-c455c888579d tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1672 microversion: 2.1 time: 0.154790 Nov 20 21:48:01.153387 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4200/8289] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:00 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:02.246510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:02.247436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:02.255616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.256168 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.256968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.257418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.305701 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-44097fe4-5628-43d9-a204-dbe906781cc8 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action" status: 200 len: 38373 microversion: 2.1 time: 0.062715 Nov 20 21:48:02.306386 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4090/8290] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:48:02 2021] POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action => generated 38373 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:48:02.318020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:02.318587 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:02.325202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.325660 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.326465 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.326907 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.389625 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0350bab2-d34e-4727-9469-3c1993201416 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action" status: 202 len: 0 microversion: 2.1 time: 0.075665 Nov 20 21:48:02.393306 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4201/8291] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:48:02 2021] POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:48:02.400246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:02.400971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:02.408601 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.409148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.410689 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:02.411306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:02.558289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:02.565579 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9e823913-d67a-4815-ac4d-c7728a8d0843 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1678 microversion: 2.1 time: 0.170020 Nov 20 21:48:02.566168 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4091/8292] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:02 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:03.586178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:03.586885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:03.593217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:03.593679 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:03.594525 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:03.595001 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:03.733918 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:03.743397 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6d2e249b-0d2c-4e0d-846b-5901c0928ad5 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1678 microversion: 2.1 time: 0.162516 Nov 20 21:48:03.743966 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4202/8293] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:03 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:04.760612 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:04.761229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:04.768640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:04.769098 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:04.769886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:04.770895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:04.905464 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:04.913522 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-01636d51-bd86-4e60-8594-c305bb39aff2 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1681 microversion: 2.1 time: 0.156668 Nov 20 21:48:04.914117 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4092/8294] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:04 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:05.002326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:05.003279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:05.009820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:05.010321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:05.011135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:05.011573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:05.054410 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-93a534c8-254d-478a-8bed-fe999bfad081 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action" status: 200 len: 38373 microversion: 2.1 time: 0.055639 Nov 20 21:48:05.055038 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4203/8295] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:48:04 2021] POST /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5/action => generated 38373 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 20 21:48:06.049148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:06.049719 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:06.055792 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-1763ab12-344b-4154-953e-c5e705b66c72 req-3936ec92-adcb-424f-b975-387174a730c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af50e49-4476-4063-b69d-450a637564f5", "tag": "034920d2-bff9-42cd-9504-4d9cb13382ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:06.057214 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:48:06.057214 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:48:06.057789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:06.058317 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:06.059122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:06.059565 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:06.065251 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1763ab12-344b-4154-953e-c5e705b66c72 req-3936ec92-adcb-424f-b975-387174a730c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:06.065714 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-1763ab12-344b-4154-953e-c5e705b66c72 req-3936ec92-adcb-424f-b975-387174a730c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:06.076758 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-1763ab12-344b-4154-953e-c5e705b66c72 req-3936ec92-adcb-424f-b975-387174a730c0 service nova] Creating event network-changed:034920d2-bff9-42cd-9504-4d9cb13382ce for instance 1af50e49-4476-4063-b69d-450a637564f5 on nch2-master-1 Nov 20 21:48:06.081649 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-1763ab12-344b-4154-953e-c5e705b66c72 req-3936ec92-adcb-424f-b975-387174a730c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030536 Nov 20 21:48:06.083064 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4204/8296] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:48:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:48:06.088693 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:48:06.178475 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ba5a78b4-965f-4806-bddf-1ff11d6eb147 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 204 len: 0 microversion: 2.1 time: 0.132668 Nov 20 21:48:06.179333 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4093/8297] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:48:06 2021] DELETE /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:48:06.190295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:06.191581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:06.197922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:06.198422 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:06.200295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:06.200295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:06.429670 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:06.437722 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-61834825-bf8b-4165-b8a9-5b34f595b4ca tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1687 microversion: 2.1 time: 0.253709 Nov 20 21:48:06.438982 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4205/8298] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:06 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1687 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:07.457154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:07.457965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:07.464587 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:07.465039 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:07.465821 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:07.466319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:07.607104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7c953eb7c86418fa1cb0257829f23b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a671b29208764a018b1936b75389117b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:07.615239 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6d0e6723-0a6c-4f1b-865c-9349d991cdd0 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 200 len: 1568 microversion: 2.1 time: 0.162143 Nov 20 21:48:07.615825 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4094/8299] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:07 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:08.183295 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c0823a8c-e1fb-4827-ac96-1b6599c5d656 req-86a50a4e-30e4-4e1c-a49a-7dd1fd85d0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af50e49-4476-4063-b69d-450a637564f5", "name": "network-vif-deleted", "tag": "034920d2-bff9-42cd-9504-4d9cb13382ce"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:08.185206 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:48:08.185206 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:48:08.195391 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c0823a8c-e1fb-4827-ac96-1b6599c5d656 req-86a50a4e-30e4-4e1c-a49a-7dd1fd85d0b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:08.195844 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c0823a8c-e1fb-4827-ac96-1b6599c5d656 req-86a50a4e-30e4-4e1c-a49a-7dd1fd85d0b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:08.208618 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c0823a8c-e1fb-4827-ac96-1b6599c5d656 req-86a50a4e-30e4-4e1c-a49a-7dd1fd85d0b6 service nova] Creating event network-vif-deleted:034920d2-bff9-42cd-9504-4d9cb13382ce for instance 1af50e49-4476-4063-b69d-450a637564f5 on nch2-master-1 Nov 20 21:48:08.213491 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c0823a8c-e1fb-4827-ac96-1b6599c5d656 req-86a50a4e-30e4-4e1c-a49a-7dd1fd85d0b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Nov 20 21:48:08.214107 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4206/8300] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:48:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:48:08.633209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:08.633939 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] [instance: 1af50e49-4476-4063-b69d-450a637564f5] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:08.640753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:08.641523 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:08.642441 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:08.642955 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:08.657002 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] HTTP exception thrown: Instance 1af50e49-4476-4063-b69d-450a637564f5 could not be found. Nov 20 21:48:08.657608 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Returning 404 to user: Instance 1af50e49-4476-4063-b69d-450a637564f5 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:48:08.658473 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-59e93a4d-06f1-4f0a-8598-7d18f27f29e3 tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5" status: 404 len: 111 microversion: 2.1 time: 0.029921 Nov 20 21:48:08.659031 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4095/8301] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:08 2021] GET /compute/v2.1/servers/1af50e49-4476-4063-b69d-450a637564f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 20 21:48:11.998888 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ccdbae7b-1c7c-4781-9c55-41c25f5bb1dd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] Calling method '.version_select at 0x7f3f84171ee0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:12.017909 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ccdbae7b-1c7c-4781-9c55-41c25f5bb1dd tempest-TestNetworkAdvancedServerOps-146897682 tempest-TestNetworkAdvancedServerOps-146897682-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-187495393" status: 202 len: 0 microversion: 2.1 time: 0.022996 Nov 20 21:48:12.018876 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4207/8302] 10.222.0.41 () {58 vars in 1280 bytes} [Sat Nov 20 21:48:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-187495393 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:48:23.656708 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'create', calling method: .version_select at 0x7f3f85d50af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-950170257"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:23.673389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:48:23.681135 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:48:23.799607 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:48:23.806139 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:48:23.821089 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2631abb4-1a19-4c77-8b4d-34cad7b749ba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.452097 Nov 20 21:48:23.822288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4096/8303] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:48:23 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:24.786504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-311887182", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-950170257", "security_groups": [{"name": "tempest-secgroup-smoke-1744898319"}], "networks": [{"uuid": "739d6e75-f194-41c4-8d4c-877de8611ef7"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:24.921994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] validate_networks() for [('739d6e75-f194-41c4-8d4c-877de8611ef7', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:48:25.342121 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:48:25.342566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:48:25.343051 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:48:25.343474 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:48:25.344077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:48:25.354539 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:25.355002 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:25.355834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:25.356279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:25.376139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:48:25.382129 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:48:25.395730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:48:25.398283 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:48:25.456361 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-45dd300c-345d-4dbf-84c1-5b3ae4776958 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674881 Nov 20 21:48:25.458213 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4208/8304] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:48:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:48:25.467622 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac601458-ea70-4a62-9366-ee127493a91f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:25.468246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac601458-ea70-4a62-9366-ee127493a91f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:25.534903 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac601458-ea70-4a62-9366-ee127493a91f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:25.542344 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac601458-ea70-4a62-9366-ee127493a91f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1245 microversion: 2.1 time: 0.078660 Nov 20 21:48:25.543657 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4097/8305] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:25 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:26.559847 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:26.560466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:26.572994 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:26.573750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:26.575493 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:26.576241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:26.650188 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:26.657488 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fe610901-a8b8-4473-8b26-06518ab4865c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1303 microversion: 2.1 time: 0.101308 Nov 20 21:48:26.658080 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4209/8306] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:26 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:27.676879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:27.677504 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:27.685398 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:27.685850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:27.686685 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:27.687125 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:27.861246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:27.875300 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fdc5fad-a9f2-4f51-a0da-02764fdd2e11 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.202098 Nov 20 21:48:27.877095 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4098/8307] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:27 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:28.230213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-44027409-3f7e-428e-b370-b78b249e8b05 req-2bdaf009-15ef-4efe-b6a6-c495b9f7d7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:28.232975 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:48:28.232975 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:48:28.245260 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-44027409-3f7e-428e-b370-b78b249e8b05 req-2bdaf009-15ef-4efe-b6a6-c495b9f7d7bf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:28.245722 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-44027409-3f7e-428e-b370-b78b249e8b05 req-2bdaf009-15ef-4efe-b6a6-c495b9f7d7bf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:28.264489 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-44027409-3f7e-428e-b370-b78b249e8b05 req-2bdaf009-15ef-4efe-b6a6-c495b9f7d7bf service nova] Creating event network-changed:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:48:28.270363 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-44027409-3f7e-428e-b370-b78b249e8b05 req-2bdaf009-15ef-4efe-b6a6-c495b9f7d7bf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045147 Nov 20 21:48:28.271506 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4210/8308] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:48:28.894089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:28.895445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:28.902562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:28.903016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:28.903819 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:28.904445 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:29.054714 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:29.062734 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8036d2cc-9b03-4efe-aa96-bf23c8694d65 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.172321 Nov 20 21:48:29.063675 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4099/8309] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:28 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:30.081143 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:30.082031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:30.088148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:30.088635 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:30.089418 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:30.089864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:30.224561 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:30.232663 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-cfef70a8-3d11-489f-a497-2e2929f99b94 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.156450 Nov 20 21:48:30.233227 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4211/8310] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:30 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:31.248624 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:31.249246 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:31.256941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:31.257407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:31.258311 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:31.258764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:31.398315 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:31.405718 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-37380d47-198c-436f-9083-ab4741dfadcb tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.160826 Nov 20 21:48:31.406612 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4100/8311] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:31 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:32.422521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:32.423148 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:32.430864 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:32.431599 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:32.432401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:32.432852 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:32.835133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:32.842794 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e6240d17-54a3-47db-b93d-d85f083d03d9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.423887 Nov 20 21:48:32.843379 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4212/8312] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:32 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:32.987334 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-eef00971-f86a-4325-904f-5eddf38b3a65 req-100492d4-0d4b-4511-b5f1-13e9c0e90cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "name": "network-vif-plugged", "status": "completed", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:32.990246 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:48:32.990246 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:48:32.999229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eef00971-f86a-4325-904f-5eddf38b3a65 req-100492d4-0d4b-4511-b5f1-13e9c0e90cf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:32.999690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-eef00971-f86a-4325-904f-5eddf38b3a65 req-100492d4-0d4b-4511-b5f1-13e9c0e90cf9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:33.012646 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-eef00971-f86a-4325-904f-5eddf38b3a65 req-100492d4-0d4b-4511-b5f1-13e9c0e90cf9 service nova] Creating event network-vif-plugged:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:48:33.018457 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-eef00971-f86a-4325-904f-5eddf38b3a65 req-100492d4-0d4b-4511-b5f1-13e9c0e90cf9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Nov 20 21:48:33.019064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4101/8313] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:48:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:48:33.859329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:33.859957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:33.867325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:33.867791 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:33.868594 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:33.869049 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:34.003203 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:34.010508 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7ea77788-a805-4f72-85dc-abe61df1a8ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1371 microversion: 2.1 time: 0.154819 Nov 20 21:48:34.011069 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4213/8314] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:33 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:35.028512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:35.029124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:35.036627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:35.037073 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:35.037857 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:35.038321 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:35.171907 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:35.179881 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-791d14fe-a337-477f-ba16-b8a8af827541 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1555 microversion: 2.1 time: 0.155557 Nov 20 21:48:35.180475 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4102/8315] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:35 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:35.195776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:48:35.196404 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:48:35.203053 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:35.203518 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:35.204317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:35.204768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:35.338537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:48:35.345819 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7dc47a26-1e89-4d7a-826c-25a96955e317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1555 microversion: 2.1 time: 0.153727 Nov 20 21:48:35.346414 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4214/8316] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:48:35 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:48:37.021713 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-38e7a4e5-0342-4615-b23c-6ffa2a4d1fdb req-374d3b8d-7276-4b9c-acde-5eb1412ffe3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:48:37.023249 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:48:37.023249 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:48:37.031237 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-38e7a4e5-0342-4615-b23c-6ffa2a4d1fdb req-374d3b8d-7276-4b9c-acde-5eb1412ffe3a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:48:37.031691 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-38e7a4e5-0342-4615-b23c-6ffa2a4d1fdb req-374d3b8d-7276-4b9c-acde-5eb1412ffe3a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:48:37.043362 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-38e7a4e5-0342-4615-b23c-6ffa2a4d1fdb req-374d3b8d-7276-4b9c-acde-5eb1412ffe3a service nova] Creating event network-changed:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:48:37.048900 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-38e7a4e5-0342-4615-b23c-6ffa2a4d1fdb req-374d3b8d-7276-4b9c-acde-5eb1412ffe3a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Nov 20 21:48:37.049536 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4103/8317] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:48:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:49:15.794595 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:49:15.795167 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:49:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:50:32.151986 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 20 21:50:32.155797 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:50:32.156336 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:32.162581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:32.163351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:32.164370 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:32.164825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:32.187396 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lazy-loading 'flavor' on Instance uuid a275356b-0d93-4aff-8f8a-22909e2c9d05 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:50:32.635650 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-af27c203-0103-451f-a8ca-390c2c792c98 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05/action" status: 202 len: 0 microversion: 2.1 time: 0.485263 Nov 20 21:50:32.636298 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4215/8318] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:50:32 2021] POST /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:50:32.643633 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] AMQP server on 10.222.0.41:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 20 21:50:32.646646 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] AMQP server on 10.222.0.41:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 20 21:50:32.650772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:32.651576 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:32.657977 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:32.658431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:32.659238 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:32.659687 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:32.849540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:32.857248 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-cb9670be-6669-4477-8e16-a34acceda123 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.216400 Nov 20 21:50:32.857819 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4104/8319] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:32 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:33.885783 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:33.886523 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:33.893651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:33.894141 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:33.895706 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:33.896178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:33.899631 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50432. Nov 20 21:50:34.034505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:34.042459 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-99b3f810-4949-4d3b-bba7-219af3111d24 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.171339 Nov 20 21:50:34.043023 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4216/8320] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:33 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:35.059547 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:35.060178 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:35.088679 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:35.089134 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:35.089917 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:35.090389 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:35.096693 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50436. Nov 20 21:50:35.100761 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 50438. Nov 20 21:50:35.230831 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:35.238867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-aadfe73a-a948-4d4a-929c-15a083d219ed tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.182398 Nov 20 21:50:35.239452 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4105/8321] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:35 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:36.256964 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:36.257583 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:36.264303 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:36.264768 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:36.265574 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:36.266031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:36.398177 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:36.405402 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-974d41e7-e446-46a8-a4d6-99e2ac43a3e5 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.153197 Nov 20 21:50:36.405962 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4217/8322] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:36 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:37.422550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:37.423095 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:37.430018 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:37.430498 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:37.431276 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:37.431710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:37.564249 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:37.572287 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80ac1670-5c28-4b82-8fe8-f19d45ecfdbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.153538 Nov 20 21:50:37.572841 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4106/8323] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:37 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:38.590233 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:38.590860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:38.597666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:38.598708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:38.599533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:38.599977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:38.736719 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:38.744286 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-acf67f20-b495-4810-bb72-c73f3188a1a7 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.158721 Nov 20 21:50:38.744838 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4218/8324] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:38 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:39.761535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:39.762695 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:39.772919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:39.773377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:39.774213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:39.774664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:39.909124 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:39.917099 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-95d52491-4de7-4d6d-b7bf-060c7f79a754 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.159769 Nov 20 21:50:39.917679 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4107/8325] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:39 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:40.934168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:40.934829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:40.942192 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:40.942665 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:40.943470 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:40.943922 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:41.074563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:41.081900 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c1a3125a-4124-4be9-9191-997b1dca5c9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.151401 Nov 20 21:50:41.082491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4219/8326] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:40 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:50:42.097990 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:42.098765 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:42.105788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:42.106292 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:42.107082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:42.107522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:42.255126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:42.262529 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-fb88825d-2c13-413f-9ffb-7a96136d55d4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.168327 Nov 20 21:50:42.263113 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4108/8327] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:42 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:43.279024 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:43.279651 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:43.286762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:43.287252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:43.288036 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:43.288488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:43.429688 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:43.437176 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-aae5b17c-d6fa-49dc-b926-2cd54bbc3313 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1701 microversion: 2.1 time: 0.161896 Nov 20 21:50:43.437754 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4220/8328] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:43 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1701 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:44.454542 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:44.455155 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:44.462323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:44.462780 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:44.463559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:44.464000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:44.595585 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:44.605387 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a190225e-7c69-4b9c-9b18-28392ed1c80a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1701 microversion: 2.1 time: 0.154468 Nov 20 21:50:44.605969 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4109/8329] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:44 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1701 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:45.623012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:45.623648 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:45.633287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:45.635322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:45.636466 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:45.637096 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:45.819156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:45.829252 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-89666cd7-29f6-4be9-ba5f-d1e344c36e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.210289 Nov 20 21:50:45.840651 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4221/8330] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:45 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:46.849174 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:46.849725 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:46.859170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:46.859975 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:46.861271 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:46.861919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:47.048107 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:47.059876 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-922dd486-669b-49e1-a9c2-ab976b53210b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.215165 Nov 20 21:50:47.060553 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4110/8331] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:46 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:47.688282 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-c3e7a773-d72d-49a1-8d73-d6c033a1e566 req-30bea17d-0796-4fda-8a33-a48e1271e0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "name": "network-vif-plugged", "status": "completed", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:50:47.690033 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:50:47.690033 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:50:47.698854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c3e7a773-d72d-49a1-8d73-d6c033a1e566 req-30bea17d-0796-4fda-8a33-a48e1271e0b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:47.699322 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-c3e7a773-d72d-49a1-8d73-d6c033a1e566 req-30bea17d-0796-4fda-8a33-a48e1271e0b6 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:47.712197 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-c3e7a773-d72d-49a1-8d73-d6c033a1e566 req-30bea17d-0796-4fda-8a33-a48e1271e0b6 service nova] Creating event network-vif-plugged:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:50:47.717934 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-c3e7a773-d72d-49a1-8d73-d6c033a1e566 req-30bea17d-0796-4fda-8a33-a48e1271e0b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120590 Nov 20 21:50:47.718603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4222/8332] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:50:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:50:48.077756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:48.078501 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:48.086154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:48.086616 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:48.087404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:48.088154 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:48.248392 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:48.257295 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1d89ec9b-6e55-4c13-8419-e4e3443e6143 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.183353 Nov 20 21:50:48.258074 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4111/8333] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:48 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:49.276885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:49.277598 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:49.285997 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:49.286701 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:49.287848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:49.288480 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:49.450062 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:49.458532 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c46e600b-5aa6-4544-b276-6cb0320b03df tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.186857 Nov 20 21:50:49.459450 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4223/8334] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:49 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:50.476214 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:50.476828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:50.485433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:50.485887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:50.486755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:50.487201 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:50.653918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:50.661687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-623bff2d-fe91-4c3f-b726-eab87625f885 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.189270 Nov 20 21:50:50.670288 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4112/8335] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:50 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:51.679321 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:51.680011 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:51.686943 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:51.687410 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:51.688213 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:51.688667 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:51.850607 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:51.859946 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d097230d-4206-4206-86ea-412e450917fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.184707 Nov 20 21:50:51.860925 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4224/8336] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:51 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:50:52.877777 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:52.879879 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:52.887152 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:52.887914 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:52.888981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:52.889820 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:53.049874 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:53.059528 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9dd4771a-4f51-4c77-933e-8e17624a6014 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.185331 Nov 20 21:50:53.060127 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4113/8337] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:52 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:54.076653 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:54.077349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:54.084958 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:54.085335 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:54.086214 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:54.086657 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:54.220908 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:54.229254 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-83957805-3984-4406-b080-6887d28d2809 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1696 microversion: 2.1 time: 0.156283 Nov 20 21:50:54.229830 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4225/8338] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:54 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:55.246844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:55.247443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:55.254141 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:55.254599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:55.255383 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:55.255825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:55.341457 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:50:55.341915 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:50:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:50:55.390349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:55.397858 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-02c6e5ea-d2cd-4ca4-aa7a-c8ae29ed13cd tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1678 microversion: 2.1 time: 0.154733 Nov 20 21:50:55.398460 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4114/8339] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:55 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:56.289133 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:50:56.289815 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:50:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:50:56.415175 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:56.415776 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:56.422473 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:56.422933 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:56.423707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:56.424156 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:56.568261 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:56.575653 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-252c06a6-4fb9-4697-a742-a5dd54c34847 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1678 microversion: 2.1 time: 0.164388 Nov 20 21:50:56.576267 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4226/8340] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:56 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:50:56.768341 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:50:56.768657 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:50:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:50:57.592968 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:57.593635 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:57.600974 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.601438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.602536 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.603076 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.608457 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-7e79da88-70bd-4152-93e2-9e9189ff0c75 req-c2751ac4-d00a-4591-8bbd-ff4bd2149e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "name": "network-vif-unplugged", "status": "completed", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:50:57.610274 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:50:57.610274 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:50:57.619379 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7e79da88-70bd-4152-93e2-9e9189ff0c75 req-c2751ac4-d00a-4591-8bbd-ff4bd2149e80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.621227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-7e79da88-70bd-4152-93e2-9e9189ff0c75 req-c2751ac4-d00a-4591-8bbd-ff4bd2149e80 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.634246 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.compute.server_external_events [req-7e79da88-70bd-4152-93e2-9e9189ff0c75 req-c2751ac4-d00a-4591-8bbd-ff4bd2149e80 service nova] Unable to find a host for instance a275356b-0d93-4aff-8f8a-22909e2c9d05. Dropping event network-vif-unplugged {{(pid=140941) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 20 21:50:57.635392 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-7e79da88-70bd-4152-93e2-9e9189ff0c75 req-c2751ac4-d00a-4591-8bbd-ff4bd2149e80 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031254 Nov 20 21:50:57.636075 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4227/8341] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:50:57 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 20 21:50:57.741773 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:57.749268 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1816ebfe-c49a-4e3a-8f7d-c1407283e2a1 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1621 microversion: 2.1 time: 0.160518 Nov 20 21:50:57.749840 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4115/8342] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:57 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1621 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:50:57.765968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:50:57.766580 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:57.772554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.773022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.773817 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.774309 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.904188 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8d08ea17-1a63-4966-a223-014dc51adb12 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05/action" status: 202 len: 0 microversion: 2.1 time: 0.141903 Nov 20 21:50:57.904848 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4228/8343] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:50:57 2021] POST /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:50:57.913492 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:57.914208 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:57.920115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.920564 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:57.921350 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:57.921786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:58.059985 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:58.068624 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-519268ae-da23-4f67-896e-328f01125c22 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1629 microversion: 2.1 time: 0.159529 Nov 20 21:50:58.069601 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4116/8344] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:57 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:50:59.087807 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:50:59.088377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:50:59.094557 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:59.095031 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:59.095851 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:50:59.096438 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:50:59.320320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:50:59.327735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-db082e7d-862b-4683-a594-24b9be802d36 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.244648 Nov 20 21:50:59.328300 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4229/8345] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:50:59 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:00.345894 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:00.346581 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:00.354747 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:00.355206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:00.356016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:00.356455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:00.508331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:00.519687 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d951131b-3870-4e0c-83fb-b6a8dc8bf401 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.177590 Nov 20 21:51:00.520472 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4117/8346] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:00 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:01.536853 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:01.537479 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:01.543798 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:01.544201 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:01.544986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:01.545434 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:01.687292 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:01.695295 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b05ed8b1-814f-490b-82c6-8e3c0e74762b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.162529 Nov 20 21:51:01.695911 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4230/8347] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:01 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:02.714322 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:02.715476 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:02.723860 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:02.724407 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:02.725285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:02.725736 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:03.161855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:03.176124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ca61e66-eaad-42ea-beb3-a5811e4bdc74 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.466350 Nov 20 21:51:03.178092 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4118/8348] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:02 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:04.194472 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:04.195150 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:04.201666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:04.202161 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:04.203073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:04.203527 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:04.356023 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:04.364497 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-effb6152-d35b-41ff-8666-0317a050b058 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.174795 Nov 20 21:51:04.365295 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4231/8349] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:04 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:05.382706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:05.383319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:05.389522 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:05.389979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:05.390803 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:05.391248 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:05.537552 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:05.545558 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ad777eaa-1fe7-485f-a2aa-33738a25e214 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.167289 Nov 20 21:51:05.546411 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4119/8350] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:05 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:06.566730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:06.567733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:06.575034 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:06.575507 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:06.576320 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:06.576772 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:06.714942 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:06.724632 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8e7a6691-e50f-4eba-a025-0e625c0e39d2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.164698 Nov 20 21:51:06.725421 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4232/8351] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:06 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:07.742796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:07.743438 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:07.750402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:07.750861 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:07.751673 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:07.752110 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:07.909474 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:07.926623 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d0513a7c-7e1e-441e-84f0-e61938182077 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.187444 Nov 20 21:51:07.936803 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4120/8352] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:07 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:51:08.945196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:08.945924 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:08.953286 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:08.953750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:08.954808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:08.955256 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:09.103533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:09.111103 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3d0a0f3b-1c93-4475-afc2-1fde6ce0ef7a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.170652 Nov 20 21:51:09.111873 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4233/8353] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:08 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:10.128572 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:10.129217 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:10.136053 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:10.136512 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:10.137291 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:10.137733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:10.269289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:10.277270 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-437ee6e7-eaa7-4772-8d57-c429c2ac8317 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.152426 Nov 20 21:51:10.277834 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4121/8354] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:10 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:11.294267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:11.294267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:11.300859 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:11.301328 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:11.302157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:11.302608 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:11.433545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:11.440914 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1d86638c-0708-43b2-bb1d-bf5e3c0bb8ca tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.151050 Nov 20 21:51:11.441469 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4234/8355] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:11 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:12.459320 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:12.459929 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:12.466697 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:12.467156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:12.467945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:12.468386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:12.604325 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:12.611629 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-7623da8c-6238-488d-8c38-3e2a7ee7eb93 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.156989 Nov 20 21:51:12.612228 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4122/8356] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:12 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:13.628770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:13.629754 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:13.636412 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:13.636878 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:13.637862 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:13.638339 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:13.773071 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:13.780380 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d3ccb2e4-85c2-4a17-8c6f-6eb826688862 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.155349 Nov 20 21:51:13.780948 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4235/8357] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:13 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:14.798690 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:14.799229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:14.806710 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:14.807163 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:14.807954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:14.808391 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:14.938764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:14.946118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-36bb3806-3f81-423d-8456-f1bd507ef7b8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.151176 Nov 20 21:51:14.946696 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4123/8358] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:14 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:15.728505 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-0cdf38dc-1551-4cb6-bfb7-0a53fca17caf req-7defc1af-7735-485c-9c52-95b726368129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "name": "network-vif-plugged", "status": "completed", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:51:15.730008 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:51:15.730008 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:51:15.737784 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0cdf38dc-1551-4cb6-bfb7-0a53fca17caf req-7defc1af-7735-485c-9c52-95b726368129 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:15.738199 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-0cdf38dc-1551-4cb6-bfb7-0a53fca17caf req-7defc1af-7735-485c-9c52-95b726368129 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:15.750226 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-0cdf38dc-1551-4cb6-bfb7-0a53fca17caf req-7defc1af-7735-485c-9c52-95b726368129 service nova] Creating event network-vif-plugged:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:51:15.756057 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-0cdf38dc-1551-4cb6-bfb7-0a53fca17caf req-7defc1af-7735-485c-9c52-95b726368129 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Nov 20 21:51:15.756648 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4236/8359] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:51:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:51:15.963393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:15.964013 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:15.970733 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:15.971191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:15.971980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:15.972420 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:16.104849 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:16.112494 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d1f95e21-b287-4bf8-88cb-11c83630e6fc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.152866 Nov 20 21:51:16.113069 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4124/8360] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:15 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:17.132628 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:17.133382 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:17.139403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:17.139870 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:17.140682 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:17.141135 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:17.283508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:17.291330 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c6b10b7c-752f-49f6-8d39-31d0b22c0dbc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1687 microversion: 2.1 time: 0.165056 Nov 20 21:51:17.291912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4237/8361] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:17 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:51:18.308251 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:51:18.308897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:51:18.315550 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:18.316003 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:18.316865 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:51:18.317298 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:51:18.452065 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:51:18.460393 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-547c6bf1-853e-4254-b4ce-9b2cbf4838a4 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1674 microversion: 2.1 time: 0.155837 Nov 20 21:51:18.460963 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4125/8362] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:51:18 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:30.955769 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:30.956901 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:30.964359 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:30.964834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:30.965849 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:30.966324 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:30.992649 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:52:31.015897 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1c23c44c-89a6-4ce3-ae68-12aacf00b791 req-e5509c08-254e-4fc2-ad6a-d9fb2b1d7cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:31.017605 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:52:31.017605 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:52:31.025354 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c23c44c-89a6-4ce3-ae68-12aacf00b791 req-e5509c08-254e-4fc2-ad6a-d9fb2b1d7cc4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:31.025801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1c23c44c-89a6-4ce3-ae68-12aacf00b791 req-e5509c08-254e-4fc2-ad6a-d9fb2b1d7cc4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:31.039756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1c23c44c-89a6-4ce3-ae68-12aacf00b791 req-e5509c08-254e-4fc2-ad6a-d9fb2b1d7cc4 service nova] Creating event network-changed:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:52:31.046394 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1c23c44c-89a6-4ce3-ae68-12aacf00b791 req-e5509c08-254e-4fc2-ad6a-d9fb2b1d7cc4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091110 Nov 20 21:52:31.047545 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4126/8363] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:52:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:52:31.077827 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5508803c-df16-4067-992c-17ee7812b223 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 204 len: 0 microversion: 2.1 time: 0.127220 Nov 20 21:52:31.078912 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4238/8364] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:52:30 2021] DELETE /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:52:31.087671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:31.088395 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:31.094889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:31.095741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:31.096671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:31.097418 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:31.253886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:31.263545 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-eb879ad4-ece9-4755-a1f7-cdd7f5e67f9d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1680 microversion: 2.1 time: 0.180294 Nov 20 21:52:31.268488 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4127/8365] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:31 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:32.282550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:32.283178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:32.290106 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:32.290565 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:32.291352 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:32.291957 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:32.438252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:32.446526 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cd0d0bd-6c5c-4aab-a049-2d4b187f695b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 200 len: 1561 microversion: 2.1 time: 0.168217 Nov 20 21:52:32.447115 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4239/8366] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:32 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:32.962337 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-73556cf1-ad30-45c7-9127-ca4c6993ea23 req-5c163d78-f673-4a62-8ac2-cb97e92c3eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a275356b-0d93-4aff-8f8a-22909e2c9d05", "name": "network-vif-deleted", "tag": "777a6c0a-c80d-4489-9810-e64dd3e6398d"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:32.963826 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:52:32.963826 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:52:32.971288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-73556cf1-ad30-45c7-9127-ca4c6993ea23 req-5c163d78-f673-4a62-8ac2-cb97e92c3eda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:32.971734 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-73556cf1-ad30-45c7-9127-ca4c6993ea23 req-5c163d78-f673-4a62-8ac2-cb97e92c3eda service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:32.986194 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-73556cf1-ad30-45c7-9127-ca4c6993ea23 req-5c163d78-f673-4a62-8ac2-cb97e92c3eda service nova] Creating event network-vif-deleted:777a6c0a-c80d-4489-9810-e64dd3e6398d for instance a275356b-0d93-4aff-8f8a-22909e2c9d05 on nch2-master-1 Nov 20 21:52:32.992699 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-73556cf1-ad30-45c7-9127-ca4c6993ea23 req-5c163d78-f673-4a62-8ac2-cb97e92c3eda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093476 Nov 20 21:52:32.993304 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4128/8367] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:52:33.464766 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:33.465323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: a275356b-0d93-4aff-8f8a-22909e2c9d05] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:33.471952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:33.472413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:33.473202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:33.473674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:33.486845 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] HTTP exception thrown: Instance a275356b-0d93-4aff-8f8a-22909e2c9d05 could not be found. Nov 20 21:52:33.487443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Returning 404 to user: Instance a275356b-0d93-4aff-8f8a-22909e2c9d05 could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:52:33.488264 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b4ad11bf-5ca6-4da0-9529-23b40d1d31aa tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05" status: 404 len: 111 microversion: 2.1 time: 0.027435 Nov 20 21:52:33.488787 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4240/8368] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:33 2021] GET /compute/v2.1/servers/a275356b-0d93-4aff-8f8a-22909e2c9d05 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:52:33.652433 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-26aee1f0-2dd9-4936-b8d0-47afc676b3ab tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '.version_select at 0x7f3f86280ee0>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:33.680124 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-26aee1f0-2dd9-4936-b8d0-47afc676b3ab tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-950170257" status: 202 len: 0 microversion: 2.1 time: 0.031510 Nov 20 21:52:33.680922 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4129/8369] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:52:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-950170257 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:52:33.701077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'create', calling method: .version_select at 0x7f3f864cc1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-484152285"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:33.715642 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:52:33.720545 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:52:33.876152 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:52:33.881615 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:52:33.895735 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e0b21265-4c2e-428a-b908-736b00733fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.198404 Nov 20 21:52:33.896328 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4241/8370] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:52:33 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:35.813262 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:52:35.813735 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:52:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:52:37.300728 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-567748073", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-484152285", "security_groups": [{"name": "tempest-secgroup-smoke-2078840048"}], "networks": [{"uuid": "739d6e75-f194-41c4-8d4c-877de8611ef7"}], "block_device_mapping_v2": [{"uuid": "9820fef1-336c-4a78-9fb3-205790bf830e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:37.411764 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] validate_networks() for [('739d6e75-f194-41c4-8d4c-877de8611ef7', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:52:37.862083 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:52:37.862510 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:52:37.862979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:52:37.863381 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:52:37.863791 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:52:37.872882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:37.873327 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:37.874166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:37.874603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:37.893378 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:52:37.898889 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Getting quotas for user abadefc5bbcf4a56824ddce05adfffd1 and project f8bf19e13d444cd0b7a0fe3565ae7e67. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:52:37.953771 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:52:37.956078 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9820fef1-336c-4a78-9fb3-205790bf830e',volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:52:38.077727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-67c23db1-6236-4bbc-9b6e-bac13f63ca9b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781568 Nov 20 21:52:38.078416 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4130/8371] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:52:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:52:38.089073 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-fc0276fb-7d4c-4458-9d18-ed20c796c635 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:38.089707 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-fc0276fb-7d4c-4458-9d18-ed20c796c635 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:38.143110 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-fc0276fb-7d4c-4458-9d18-ed20c796c635 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:38.149859 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-fc0276fb-7d4c-4458-9d18-ed20c796c635 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1087 microversion: 2.1 time: 0.065261 Nov 20 21:52:38.150463 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4242/8372] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:38 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:39.167593 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:39.168215 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:39.174684 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:39.175709 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:39.176166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:39.177252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:39.244586 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:39.252758 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dc6f3ca6-6cc6-4faf-8a1b-81de9f6e9770 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1203 microversion: 2.1 time: 0.089461 Nov 20 21:52:39.253438 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4131/8373] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:39 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1203 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:40.271227 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:40.272620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:40.279380 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:40.280123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:40.280934 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:40.281377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:40.454122 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5b7c2e5f-bcd7-46ea-9131-cb15b13d462e req-48968475-eb70-408e-be99-d2c802c67877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:40.459781 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:52:40.459781 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:52:40.477683 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5b7c2e5f-bcd7-46ea-9131-cb15b13d462e req-48968475-eb70-408e-be99-d2c802c67877 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:40.482766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5b7c2e5f-bcd7-46ea-9131-cb15b13d462e req-48968475-eb70-408e-be99-d2c802c67877 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:40.499242 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5b7c2e5f-bcd7-46ea-9131-cb15b13d462e req-48968475-eb70-408e-be99-d2c802c67877 service nova] Creating event network-changed:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch2-master-1 Nov 20 21:52:40.505756 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5b7c2e5f-bcd7-46ea-9131-cb15b13d462e req-48968475-eb70-408e-be99-d2c802c67877 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055924 Nov 20 21:52:40.506712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4132/8374] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:52:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:52:40.551708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:40.562085 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-47ae08e3-0772-44ce-a7a5-3b2741f14355 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.295034 Nov 20 21:52:40.562860 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4243/8375] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:40 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:41.581184 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:41.581886 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:41.588826 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:41.589299 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:41.590089 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:41.590535 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:41.732202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:41.740765 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-0ab97163-1507-4c83-a3a7-02374a94075d tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.164470 Nov 20 21:52:41.741368 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4133/8376] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:41 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:52:42.757079 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:42.757793 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:42.764537 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:42.765010 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:42.765808 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:42.766287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:42.897458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:42.904848 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-38f8c3e4-6435-49a6-b825-55750c7da250 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.151568 Nov 20 21:52:42.905420 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4244/8377] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:42 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:43.922361 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:43.922996 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:43.930290 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:43.930744 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:43.931548 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:43.931984 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:44.062825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:44.071013 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4215ba03-a62f-4ad9-9358-2be494b7891c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.152359 Nov 20 21:52:44.071890 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4134/8378] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:43 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:45.087077 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:45.087735 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:45.094551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:45.095015 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:45.095812 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:45.096267 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:45.230271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:45.237589 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-389c9da0-d392-432a-9dc0-9c84f118f938 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.154243 Nov 20 21:52:45.238200 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4245/8379] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:45 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:46.213308 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-5c7976cf-bb58-4fad-b330-3258056be955 req-143c5d5d-c8f2-42f0-8126-ae41a8248044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "name": "network-vif-plugged", "status": "completed", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:46.214877 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:52:46.214877 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:52:46.223104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5c7976cf-bb58-4fad-b330-3258056be955 req-143c5d5d-c8f2-42f0-8126-ae41a8248044 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:46.223654 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-5c7976cf-bb58-4fad-b330-3258056be955 req-143c5d5d-c8f2-42f0-8126-ae41a8248044 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:46.234766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-5c7976cf-bb58-4fad-b330-3258056be955 req-143c5d5d-c8f2-42f0-8126-ae41a8248044 service nova] Creating event network-vif-plugged:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch2-master-1 Nov 20 21:52:46.240592 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-5c7976cf-bb58-4fad-b330-3258056be955 req-143c5d5d-c8f2-42f0-8126-ae41a8248044 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Nov 20 21:52:46.241425 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4135/8380] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:52:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:52:46.255378 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:46.256816 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:46.263620 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:46.264084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:46.264884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:46.265674 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:46.467351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:46.475595 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f8d59a2a-716e-4841-ba78-d3dd75bcfb4b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.224544 Nov 20 21:52:46.476424 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4246/8381] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:46 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:47.493143 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:47.493842 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:47.501289 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:47.501737 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:47.502766 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:47.503209 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:47.648696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:47.656146 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-92c2e8df-5ff1-4a94-8c31-ccfcde38d700 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1259 microversion: 2.1 time: 0.167088 Nov 20 21:52:47.656732 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4136/8382] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:47 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:48.672787 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:48.673397 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:48.680498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:48.680963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:48.681761 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:48.682241 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:48.819762 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:48.827405 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6a35c117-8791-4b83-bff5-db3af3356d30 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1444 microversion: 2.1 time: 0.158352 Nov 20 21:52:48.827986 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4247/8383] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:48 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:48.844672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:52:48.845306 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:52:48.852918 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:48.853375 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:48.854216 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:48.854664 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:48.986497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:52:48.994867 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f80e9256-b049-4930-9017-49bfdb107fba tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1444 microversion: 2.1 time: 0.153898 Nov 20 21:52:48.995441 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4137/8384] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:52:48 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:52:50.606443 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f51f257e-17e9-4c80-bd7d-65ff1aa3cb2e req-913edb9b-8405-4792-931f-d28891f33be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:52:50.608091 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:52:50.608091 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:52:50.616264 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f51f257e-17e9-4c80-bd7d-65ff1aa3cb2e req-913edb9b-8405-4792-931f-d28891f33be9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:52:50.616730 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f51f257e-17e9-4c80-bd7d-65ff1aa3cb2e req-913edb9b-8405-4792-931f-d28891f33be9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:52:50.627620 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f51f257e-17e9-4c80-bd7d-65ff1aa3cb2e req-913edb9b-8405-4792-931f-d28891f33be9 service nova] Creating event network-changed:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch2-master-1 Nov 20 21:52:50.633379 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f51f257e-17e9-4c80-bd7d-65ff1aa3cb2e req-913edb9b-8405-4792-931f-d28891f33be9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Nov 20 21:52:50.633984 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4248/8385] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:52:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:54:15.382609 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:54:15.383322 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:54:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:54:55.650072 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 20 21:54:55.650974 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 20 21:54:55.701789 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:54:55.702363 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:54:55.708499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:55.708941 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:55.709718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:55.710181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:55.732854 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lazy-loading 'flavor' on Instance uuid 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:54:55.804893 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-afea0572-2de4-4908-b173-201ae3996618 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d/action" status: 202 len: 0 microversion: 2.1 time: 0.156584 Nov 20 21:54:55.805507 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4138/8386] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:54:55 2021] POST /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:54:55.811849 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1c61818-9bcb-4ec8-b66e-e60037d6df08] AMQP server on 10.222.0.41:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 20 21:54:55.812664 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:54:55.816695 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:54:55.818202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:54:55.824348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:55.824818 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:55.825632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:55.826126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:55.967514 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:54:55.975484 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-374ed0ae-1e26-4f7f-b098-f61f34684139 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.165563 Nov 20 21:54:55.976041 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4249/8387] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:54:55 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:54:57.013036 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:54:57.013745 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:54:57.023213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:57.023707 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:57.024497 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:57.024954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:57.029244 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51010. Nov 20 21:54:57.032067 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51008. Nov 20 21:54:57.165262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:54:57.173426 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-c80e47c2-b574-4cf9-a00e-a966177654af tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.184039 Nov 20 21:54:57.173974 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4139/8388] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:54:56 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:54:58.192239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:54:58.193572 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:54:58.222168 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:58.222825 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:58.223445 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:58.223925 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:58.230743 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1c61818-9bcb-4ec8-b66e-e60037d6df08] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51016. Nov 20 21:54:58.241570 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51018. Nov 20 21:54:58.358498 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:54:58.366433 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f12d83e4-2bd5-4b87-85cc-616d09661f9f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.178673 Nov 20 21:54:58.366997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4250/8389] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:54:58 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:54:59.383639 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:54:59.384262 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:54:59.390980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:59.391431 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:59.392213 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:54:59.392649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:54:59.528816 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:54:59.536413 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1e0e6938-30fd-40db-b4d8-b3bf791505bc tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.157263 Nov 20 21:54:59.536942 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4140/8390] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:54:59 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:00.553676 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:00.554344 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:00.561119 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:00.561591 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:00.562423 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:00.562875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:00.694403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:00.701740 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-23e2755c-128e-4f12-989b-64811d4aa25a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.152521 Nov 20 21:55:00.702338 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4251/8391] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:00 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:01.718457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:01.719082 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:01.726422 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:01.726876 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:01.727666 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:01.728108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:01.864096 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:01.872983 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-52289275-3d50-4590-98b9-7301842f7b29 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.158274 Nov 20 21:55:01.873570 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4141/8392] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:01 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:02.890940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:02.891566 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:02.898986 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:02.899447 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:02.900268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:02.900740 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:03.035426 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:03.042833 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-bd331a85-4845-4995-946d-191cc3dcbf84 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.155641 Nov 20 21:55:03.043396 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4252/8393] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:02 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:04.059379 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:04.060025 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:04.066801 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:04.067254 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:04.068148 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:04.068589 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:04.205702 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:04.214168 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-68ab2896-9a44-4bfb-af55-cfd76c5e026e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.158435 Nov 20 21:55:04.214742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4142/8394] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:04 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:05.231856 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:05.232454 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:05.239113 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:05.240133 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:05.240941 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:05.241390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:05.371268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:05.378594 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-50ecf69d-7040-42be-9717-4dc6fc371907 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.150411 Nov 20 21:55:05.379164 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4253/8395] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:05 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:06.395735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:06.396415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:06.403514 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:06.403971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:06.404783 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:06.405229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:06.547480 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:06.555967 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bcfb3d19-c39d-46e2-9da1-9fd2bd1158c2 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.163911 Nov 20 21:55:06.556490 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4143/8396] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:06 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:07.572704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:07.573360 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:07.580217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:07.580684 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:07.581484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:07.581939 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:07.717573 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:07.725849 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-6c0ec92b-a88f-4fec-b970-9efc1a3a5668 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.156889 Nov 20 21:55:07.726437 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4254/8397] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:07 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:08.741795 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:08.742446 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:08.749137 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:08.749596 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:08.750430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:08.750880 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:08.891377 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:08.899448 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-80d5eaab-3d9b-4607-90bd-43f419146103 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1570 microversion: 2.1 time: 0.161408 Nov 20 21:55:08.900021 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4144/8398] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:08 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:08.915708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:55:08.916289 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:08.923027 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:08.923488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:08.924279 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:08.924729 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:08.999297 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-2cd90701-7d99-4431-a017-d34f40323689 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "POST /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d/action" status: 202 len: 0 microversion: 2.1 time: 0.087305 Nov 20 21:55:08.999913 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4255/8399] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:55:08 2021] POST /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 20 21:55:09.008611 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:09.009239 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:09.015170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:09.015636 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:09.016432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:09.016882 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:09.448735 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:09.456430 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-4c9bf96a-c63d-4c8e-9868-700dc53b350c tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1518 microversion: 2.1 time: 0.452322 Nov 20 21:55:09.457014 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4145/8400] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:09 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:55:10.475632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:10.476258 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:10.482347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:10.482911 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:10.483712 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:10.484157 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:10.626538 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:10.635673 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d4990c34-641b-4d97-862f-0f54e9170d16 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1520 microversion: 2.1 time: 0.165508 Nov 20 21:55:10.636182 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4256/8401] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:10 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:10.916562 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1ffaa03e-e677-4ce9-b649-7ffda45d60a5 req-7de0e3a6-4c98-4e21-ab73-f10b6e8431c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "name": "network-vif-unplugged", "status": "completed", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:55:10.918202 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:55:10.918202 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:55:10.926388 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1ffaa03e-e677-4ce9-b649-7ffda45d60a5 req-7de0e3a6-4c98-4e21-ab73-f10b6e8431c7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:10.927786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1ffaa03e-e677-4ce9-b649-7ffda45d60a5 req-7de0e3a6-4c98-4e21-ab73-f10b6e8431c7 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:10.940163 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1ffaa03e-e677-4ce9-b649-7ffda45d60a5 req-7de0e3a6-4c98-4e21-ab73-f10b6e8431c7 service nova] Creating event network-vif-unplugged:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch1-master-1 Nov 20 21:55:10.946093 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1ffaa03e-e677-4ce9-b649-7ffda45d60a5 req-7de0e3a6-4c98-4e21-ab73-f10b6e8431c7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033170 Nov 20 21:55:10.946712 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4146/8402] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:55:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:55:11.654084 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:11.654959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:11.661881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:11.662377 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:11.663218 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:11.663697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:11.808171 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:11.814881 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-00e166a8-9d3c-4719-b796-38b642f0a8eb req-48d624ec-65b3-4951-8f01-75c021060816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:55:11.816455 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:55:11.816455 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:55:11.825351 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-32bf31ae-2653-424c-bd7a-883289dd118b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.174955 Nov 20 21:55:11.827718 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-00e166a8-9d3c-4719-b796-38b642f0a8eb req-48d624ec-65b3-4951-8f01-75c021060816 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:11.828640 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-00e166a8-9d3c-4719-b796-38b642f0a8eb req-48d624ec-65b3-4951-8f01-75c021060816 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:11.836880 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4257/8403] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:11 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:11.842879 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-00e166a8-9d3c-4719-b796-38b642f0a8eb req-48d624ec-65b3-4951-8f01-75c021060816 service nova] Creating event network-changed:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch1-master-1 Nov 20 21:55:11.847861 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-00e166a8-9d3c-4719-b796-38b642f0a8eb req-48d624ec-65b3-4951-8f01-75c021060816 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037043 Nov 20 21:55:11.848481 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4147/8404] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:55:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:55:12.842726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:12.843356 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:12.851060 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:12.851529 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:12.852325 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:12.852777 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:12.986619 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:12.995003 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9e6999c0-31c8-4b3b-ab3b-ef7879458e75 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.156055 Nov 20 21:55:12.995587 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4258/8405] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:12 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:14.012408 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:14.013108 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:14.019957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:14.020416 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:14.021195 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:14.021634 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:14.157347 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:14.165493 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ff6ffdba-bc90-4119-819d-805e0989641a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.157259 Nov 20 21:55:14.166091 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4148/8406] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:14 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:15.183390 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:15.184014 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:15.190734 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:15.191182 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:15.192012 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:15.192790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:15.334020 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:15.341463 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-064ab4bf-5b4a-4549-a82f-7a0d2c727f1a tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.161819 Nov 20 21:55:15.342035 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4259/8407] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:15 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:16.359202 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:16.359823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:16.367188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:16.367649 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:16.368442 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:16.368884 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:16.501079 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:16.508638 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ec02bfa9-6e5c-4d55-baeb-ce7502201d80 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.153212 Nov 20 21:55:16.509212 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4149/8408] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:16 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:17.524759 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:17.525386 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:17.532131 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:17.532602 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:17.533407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:17.533854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:17.666823 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:17.674359 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8bff59d8-22eb-4864-8ffd-2eb2643881ef tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.153378 Nov 20 21:55:17.674938 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4260/8409] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:17 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:18.691814 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:18.692499 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:18.699399 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:18.699850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:18.700631 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:18.701100 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:18.837757 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:18.845616 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b482296c-327d-40d5-a9e4-5e13e0b27d63 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.157496 Nov 20 21:55:18.846232 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4150/8410] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:18 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:19.183249 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-ce8df9c0-8eb1-43b9-b567-f456c390cd1c req-1773d355-4143-4e38-9758-44a2f297554d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "name": "network-vif-plugged", "status": "completed", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:55:19.184762 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:55:19.184762 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:55:19.193770 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ce8df9c0-8eb1-43b9-b567-f456c390cd1c req-1773d355-4143-4e38-9758-44a2f297554d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:19.194305 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-ce8df9c0-8eb1-43b9-b567-f456c390cd1c req-1773d355-4143-4e38-9758-44a2f297554d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:19.206393 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-ce8df9c0-8eb1-43b9-b567-f456c390cd1c req-1773d355-4143-4e38-9758-44a2f297554d service nova] Creating event network-vif-plugged:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch1-master-1 Nov 20 21:55:19.212256 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-ce8df9c0-8eb1-43b9-b567-f456c390cd1c req-1773d355-4143-4e38-9758-44a2f297554d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Nov 20 21:55:19.212851 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4261/8411] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:55:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:55:19.863435 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:19.864045 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:19.871014 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:19.871472 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:19.872280 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:19.872724 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:20.002850 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:20.010345 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-be4c887e-ded3-4e97-9462-02530c81c9e9 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1576 microversion: 2.1 time: 0.150615 Nov 20 21:55:20.010920 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4151/8412] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:19 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:21.027528 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:55:21.028262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:55:21.035120 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:21.035663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:21.036618 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:55:21.037069 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:55:21.168869 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:55:21.176387 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-4fe8bfb4-32a7-49fc-ab57-7dcc1733618e tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1563 microversion: 2.1 time: 0.152758 Nov 20 21:55:21.176989 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4262/8413] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:55:21 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:55:55.830519 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:55:55.831105 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:55:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:56:46.109262 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-521805b7-4c02-476a-a7bd-013235254d77 req-d3965a35-2176-4d59-a9a0-b99467f8b051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:56:46.113230 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:46.113775 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:56:46.116555 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:56:46.116555 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:56:46.120524 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:46.121054 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:46.121927 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:46.122600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:46.123484 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-521805b7-4c02-476a-a7bd-013235254d77 req-d3965a35-2176-4d59-a9a0-b99467f8b051 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:46.123946 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-521805b7-4c02-476a-a7bd-013235254d77 req-d3965a35-2176-4d59-a9a0-b99467f8b051 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:46.136439 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-521805b7-4c02-476a-a7bd-013235254d77 req-d3965a35-2176-4d59-a9a0-b99467f8b051 service nova] Creating event network-changed:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch1-master-1 Nov 20 21:56:46.142096 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-521805b7-4c02-476a-a7bd-013235254d77 req-d3965a35-2176-4d59-a9a0-b99467f8b051 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037256 Nov 20 21:56:46.142768 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4263/8414] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:56:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 21:56:46.148621 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 21:56:46.245387 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-913c9d03-3448-4e04-abb1-f563c58ad68b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "DELETE /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 204 len: 0 microversion: 2.1 time: 0.142587 Nov 20 21:56:46.246711 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4152/8415] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 21:56:46 2021] DELETE /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 21:56:46.255533 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:46.256269 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:56:46.262745 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:46.263196 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:46.264093 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:46.264641 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:46.469990 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:56:46.478947 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7950c071-080c-4cd5-923e-d896ca3ce08b tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1569 microversion: 2.1 time: 0.227673 Nov 20 21:56:46.482089 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4264/8416] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:56:46 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:56:47.498455 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:47.499158 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:56:47.506794 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:47.507256 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:47.508040 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:47.508479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:47.693696 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:56:47.701206 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9646a445-54a2-42c9-81e9-04df0c36690f tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1450 microversion: 2.1 time: 0.206839 Nov 20 21:56:47.701794 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4153/8417] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:56:47 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1450 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:56:48.242134 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-f8dde1c8-638a-4dfa-a695-d2704c736af9 req-24c5cdb9-dc01-42f3-ba96-6d4757be54f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa7e192-dc01-4c39-9b2b-9ac12f52d58d", "name": "network-vif-deleted", "tag": "7f09557d-066d-4b83-b366-ee69a3ad0142"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:56:48.244256 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:56:48.244256 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:56:48.257104 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8dde1c8-638a-4dfa-a695-d2704c736af9 req-24c5cdb9-dc01-42f3-ba96-6d4757be54f9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:48.257563 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-f8dde1c8-638a-4dfa-a695-d2704c736af9 req-24c5cdb9-dc01-42f3-ba96-6d4757be54f9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:48.272481 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-f8dde1c8-638a-4dfa-a695-d2704c736af9 req-24c5cdb9-dc01-42f3-ba96-6d4757be54f9 service nova] Creating event network-vif-deleted:7f09557d-066d-4b83-b366-ee69a3ad0142 for instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d on nch1-master-1 Nov 20 21:56:48.277799 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-f8dde1c8-638a-4dfa-a695-d2704c736af9 req-24c5cdb9-dc01-42f3-ba96-6d4757be54f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040317 Nov 20 21:56:48.278447 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4265/8418] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:56:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:56:48.718479 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:48.719199 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:56:48.727104 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:48.727643 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:48.728450 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:48.728893 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:48.764115 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:48.764796 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:48.765252 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.objects.instance [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lazy-loading 'fault' on Instance uuid 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d {{(pid=140942) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 21:56:48.808798 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abadefc5bbcf4a56824ddce05adfffd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8bf19e13d444cd0b7a0fe3565ae7e67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:56:48.825338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ffab77bb-a451-4926-86f3-72fc49f263d0 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 200 len: 1223 microversion: 2.1 time: 0.111011 Nov 20 21:56:48.826284 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4154/8419] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:56:48 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:56:49.845837 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:49.846458 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] [instance: 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:56:49.854232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:49.854727 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:49.855496 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:56:49.855938 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:56:49.870582 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.wsgi [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] HTTP exception thrown: Instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d could not be found. Nov 20 21:56:49.871174 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Returning 404 to user: Instance 8fa7e192-dc01-4c39-9b2b-9ac12f52d58d could not be found. {{(pid=140941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 21:56:49.871990 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7a2809de-5ccb-4df0-994d-1ca8b09914e8 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d" status: 404 len: 111 microversion: 2.1 time: 0.030385 Nov 20 21:56:49.872514 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4266/8420] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:56:49 2021] GET /compute/v2.1/servers/8fa7e192-dc01-4c39-9b2b-9ac12f52d58d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 21:56:50.027330 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-46b5e2d6-1301-4dfa-8efd-53e6b34c7439 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] Calling method '.version_select at 0x7f3f8619e280>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:56:50.046709 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-46b5e2d6-1301-4dfa-8efd-53e6b34c7439 tempest-TestShelveInstance-1713581458 tempest-TestShelveInstance-1713581458-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-484152285" status: 202 len: 0 microversion: 2.1 time: 0.023140 Nov 20 21:56:50.047720 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4155/8421] 10.222.0.41 () {58 vars in 1250 bytes} [Sat Nov 20 21:56:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-484152285 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 21:57:07.910731 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Action: 'create', calling method: .version_select at 0x7f3f98e9faf0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1103114198"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:57:07.928061 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:57:07.934753 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for user 7504128aa7314a478a46ccd8306bd535 and project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:57:07.949161 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [28696bb2-e50c-4fce-9953-ddeeb3a229a9] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:57:08.966984 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [28696bb2-e50c-4fce-9953-ddeeb3a229a9] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51310. Nov 20 21:57:09.181854 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:57:09.186690 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for user 7504128aa7314a478a46ccd8306bd535 and project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'key_pairs'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:57:09.201644 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-f4176306-9d3e-4221-9cea-3cbebd4ee7d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.540241 Nov 20 21:57:09.202276 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4267/8422] 10.222.0.41 () {60 vars in 1157 bytes} [Sat Nov 20 21:57:07 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:57:10.153543 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-686621103", "imageRef": "89603187-210f-4d54-a40f-71dfff8bc059", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1103114198", "security_groups": [{"name": "tempest-secgroup-smoke-291546169"}], "networks": [{"uuid": "218d2210-da49-4543-9fed-a4412f2fb9fa"}]}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:57:10.260225 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.network.neutron [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] validate_networks() for [('218d2210-da49-4543-9fed-a4412f2fb9fa', None, None, None, None, None)] {{(pid=140942) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:57:10.705061 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Flavor limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:57:10.705957 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Image limits 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:57:10.706460 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Flavor pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:57:10.706934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Image pref 0:0:0 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:57:10.707376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.virt.hardware [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140942) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:57:10.716855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:10.717331 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:10.718177 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:10.718614 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:10.738682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:57:10.744164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.quota [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for user 7504128aa7314a478a46ccd8306bd535 and project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140942) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:57:10.756599 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Going to run 1 instances... {{(pid=140942) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:57:10.758961 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='89603187-210f-4d54-a40f-71dfff8bc059',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140942) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:57:10.806284 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f042d60b-18d7-40bd-8f1e-690a2a72df56 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.657347 Nov 20 21:57:10.811608 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4156/8423] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:57:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:57:10.816623 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-a0bf3a93-1210-41be-8cee-e2f40db24cde tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:10.817247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-a0bf3a93-1210-41be-8cee-e2f40db24cde tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:10.872593 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-a0bf3a93-1210-41be-8cee-e2f40db24cde tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:10.881965 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-a0bf3a93-1210-41be-8cee-e2f40db24cde tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1248 microversion: 2.1 time: 0.068947 Nov 20 21:57:10.882606 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4268/8424] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:10 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:11.900440 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-e0601b83-fc2e-4a6e-ba14-638962611851 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:11.901059 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-e0601b83-fc2e-4a6e-ba14-638962611851 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:11.959166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-e0601b83-fc2e-4a6e-ba14-638962611851 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:11.966110 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-e0601b83-fc2e-4a6e-ba14-638962611851 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1248 microversion: 2.1 time: 0.070492 Nov 20 21:57:11.966710 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4157/8425] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:11 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:12.983348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3ff7a5eb-35ca-497b-bbde-c513fe40eb32 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:12.983977 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3ff7a5eb-35ca-497b-bbde-c513fe40eb32 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:13.039455 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3ff7a5eb-35ca-497b-bbde-c513fe40eb32 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:13.046065 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3ff7a5eb-35ca-497b-bbde-c513fe40eb32 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1248 microversion: 2.1 time: 0.066391 Nov 20 21:57:13.046669 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4269/8426] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:12 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:14.062919 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-f15f0dad-e417-4230-8627-f5a06efbe8db tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:14.063646 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-f15f0dad-e417-4230-8627-f5a06efbe8db tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:14.126443 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-f15f0dad-e417-4230-8627-f5a06efbe8db tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:14.135094 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-f15f0dad-e417-4230-8627-f5a06efbe8db tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1248 microversion: 2.1 time: 0.076017 Nov 20 21:57:14.135775 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4158/8427] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:14 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:15.152521 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:15.153142 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:15.159892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:15.160349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:15.161167 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:15.161848 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:15.225202 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:15.232519 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-5f8f4e93-87c4-427d-859e-7b61b41835de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1252 microversion: 2.1 time: 0.083745 Nov 20 21:57:15.233088 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4270/8428] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:15 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1252 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:16.249606 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:16.250511 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:16.257598 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:16.258066 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:16.258877 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:16.259316 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:16.323887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:16.331175 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5135eb55-663c-4518-95d1-5b8de104a62b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1306 microversion: 2.1 time: 0.085308 Nov 20 21:57:16.331740 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4159/8429] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:16 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:17.132326 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-18687f31-0501-4312-9f79-6ae71fc723a4 req-4b41c1ee-460d-45ed-96e6-6dcd1076b816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:57:17.134524 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:57:17.134524 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:57:17.143992 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-18687f31-0501-4312-9f79-6ae71fc723a4 req-4b41c1ee-460d-45ed-96e6-6dcd1076b816 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:17.144614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-18687f31-0501-4312-9f79-6ae71fc723a4 req-4b41c1ee-460d-45ed-96e6-6dcd1076b816 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:17.156235 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-18687f31-0501-4312-9f79-6ae71fc723a4 req-4b41c1ee-460d-45ed-96e6-6dcd1076b816 service nova] Creating event network-changed:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 21:57:17.166869 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-18687f31-0501-4312-9f79-6ae71fc723a4 req-4b41c1ee-460d-45ed-96e6-6dcd1076b816 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038402 Nov 20 21:57:17.167485 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4271/8430] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:57:17.349426 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:17.350405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:17.357559 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:17.358016 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:17.358870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:17.359307 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:17.495554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:17.502894 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-8355a9d5-6bf0-4151-a88d-9a408f2febe2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1373 microversion: 2.1 time: 0.158041 Nov 20 21:57:17.503469 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4160/8431] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:17 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:18.522508 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:18.523240 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:18.529399 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:18.529860 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:18.530693 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:18.531139 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:18.667550 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:18.674782 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-9d8c4caa-ab0f-4761-bb9a-48b8ccef4a1e tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1373 microversion: 2.1 time: 0.158015 Nov 20 21:57:18.675347 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4272/8432] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:18 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:19.692341 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:19.693788 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:19.700753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:19.701318 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:19.706220 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:19.706672 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:19.849776 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:19.857247 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-79e74615-f26c-41fd-9386-49a78c66421a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1373 microversion: 2.1 time: 0.168810 Nov 20 21:57:19.858226 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4161/8433] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:19 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:20.874832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:20.875461 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:20.882919 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:20.883388 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:20.884180 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:20.884632 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:21.015704 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:21.023659 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-44fdc8e3-3d6e-453c-8475-27b9e47486d1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1373 microversion: 2.1 time: 0.152543 Nov 20 21:57:21.024228 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4273/8434] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:20 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:21.647772 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-cd9c6955-faad-4a61-9f95-c1d8ef58307a req-82e72a37-b0d1-4824-bf94-e786c6f40121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "name": "network-vif-plugged", "status": "completed", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:57:21.650304 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:57:21.650304 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:57:21.657560 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd9c6955-faad-4a61-9f95-c1d8ef58307a req-82e72a37-b0d1-4824-bf94-e786c6f40121 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:21.658198 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-cd9c6955-faad-4a61-9f95-c1d8ef58307a req-82e72a37-b0d1-4824-bf94-e786c6f40121 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:21.670831 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-cd9c6955-faad-4a61-9f95-c1d8ef58307a req-82e72a37-b0d1-4824-bf94-e786c6f40121 service nova] Creating event network-vif-plugged:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 21:57:21.675987 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-cd9c6955-faad-4a61-9f95-c1d8ef58307a req-82e72a37-b0d1-4824-bf94-e786c6f40121 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091168 Nov 20 21:57:21.676543 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4162/8435] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:57:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:57:22.040914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:22.041459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:22.048153 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:22.048612 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:22.049403 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:22.049846 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:22.184217 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:22.191596 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-e4c671d0-7060-45f5-98b6-f2a27e28004c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1373 microversion: 2.1 time: 0.155072 Nov 20 21:57:22.192161 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4274/8436] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:22 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:23.208828 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:23.209871 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:23.217001 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:23.217457 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:23.218288 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:23.218739 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:23.356662 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:23.364040 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-dcf98578-a09f-4e0d-b86a-2ae25fff682f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1557 microversion: 2.1 time: 0.159500 Nov 20 21:57:23.364606 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4163/8437] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:23 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:57:23.380697 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:57:23.381317 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:57:23.387914 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:23.388459 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:23.389252 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:23.389698 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:23.524413 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:57:23.531873 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7d3e01cf-8ffb-44d5-91ff-4121eb9cf5d4 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1557 microversion: 2.1 time: 0.154931 Nov 20 21:57:23.532463 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4275/8438] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:57:23 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 20 21:57:25.204226 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-22778420-a477-4dd8-a068-25b948e7972a req-a3f99be7-3116-4a7f-9e4a-3fc902e3a00d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:57:25.206063 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:57:25.206063 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:57:25.217269 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-22778420-a477-4dd8-a068-25b948e7972a req-a3f99be7-3116-4a7f-9e4a-3fc902e3a00d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:57:25.218191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-22778420-a477-4dd8-a068-25b948e7972a req-a3f99be7-3116-4a7f-9e4a-3fc902e3a00d service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:57:25.237273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-22778420-a477-4dd8-a068-25b948e7972a req-a3f99be7-3116-4a7f-9e4a-3fc902e3a00d service nova] Creating event network-changed:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 21:57:25.243001 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-22778420-a477-4dd8-a068-25b948e7972a req-a3f99be7-3116-4a7f-9e4a-3fc902e3a00d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044791 Nov 20 21:57:25.243608 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4164/8439] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:57:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:57:35.399836 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:57:35.400359 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 21:57:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:59:16.793967 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 21:59:16.794521 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 21:59:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 21:59:22.783221 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e1c61818-9bcb-4ec8-b66e-e60037d6df08] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 20 21:59:22.784182 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] AMQP server on 10.222.0.41:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 20 21:59:22.788708 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-970685318"}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:22.789733 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:22.795646 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:22.796108 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:22.796904 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:22.797354 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:23.052595 ncdv-master-1 devstack@n-api.service[140941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [eb90cd37-c729-4ac7-88b7-86f426ec81d8] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:59:23.812244 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] [e1c61818-9bcb-4ec8-b66e-e60037d6df08] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51480. Nov 20 21:59:23.812942 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] [1767df3a-0cca-4501-b7c8-6d0f94d36fe9] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51482. Nov 20 21:59:24.068528 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [eb90cd37-c729-4ac7-88b7-86f426ec81d8] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51484. Nov 20 21:59:24.074449 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-ff5f970f-1a8e-4060-9d0f-0247070f8636 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "POST /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958/action" status: 202 len: 0 microversion: 2.1 time: 1.292992 Nov 20 21:59:24.075121 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4276/8440] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 21:59:22 2021] POST /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958/action => generated 0 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 21:59:28.344377 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:59:28.346569 ncdv-master-1 devstack@n-api.service[140942]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 20 21:59:28.351570 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-1a374141-a417-42aa-93dc-a59ec0afbc26 req-b6fb0a87-a2f0-4299-9c82-a21bca36e1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "name": "network-vif-plugged", "status": "completed", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:28.353804 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:59:28.353804 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 21:59:28.366540 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a374141-a417-42aa-93dc-a59ec0afbc26 req-b6fb0a87-a2f0-4299-9c82-a21bca36e1d4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:28.367376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-1a374141-a417-42aa-93dc-a59ec0afbc26 req-b6fb0a87-a2f0-4299-9c82-a21bca36e1d4 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:28.382580 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-1a374141-a417-42aa-93dc-a59ec0afbc26 req-b6fb0a87-a2f0-4299-9c82-a21bca36e1d4 service nova] Creating event network-vif-plugged:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 21:59:28.388118 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-1a374141-a417-42aa-93dc-a59ec0afbc26 req-b6fb0a87-a2f0-4299-9c82-a21bca36e1d4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046083 Nov 20 21:59:28.389087 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4165/8441] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:59:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:59:36.559622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-451224437", "imageRef": "55e8474a-c218-4500-b0d8-c954feee828f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1103114198", "security_groups": [{"name": "tempest-secgroup-smoke-291546169"}], "networks": [{"uuid": "218d2210-da49-4543-9fed-a4412f2fb9fa"}]}} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:36.670028 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.network.neutron [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] validate_networks() for [('218d2210-da49-4543-9fed-a4412f2fb9fa', None, None, None, None, None)] {{(pid=140941) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 20 21:59:37.114968 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Flavor limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 20 21:59:37.115401 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Image limits 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 20 21:59:37.115881 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Flavor pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 20 21:59:37.116299 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Image pref 0:0:0 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 20 21:59:37.116750 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.virt.hardware [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140941) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 20 21:59:37.125832 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:37.126323 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:37.127144 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:37.127589 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:37.144387 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 20 21:59:37.149952 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.quota [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Getting quotas for user 7504128aa7314a478a46ccd8306bd535 and project 8a521bfbeaca4e3ab513ff90f1caa0a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140941) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 20 21:59:37.161581 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Going to run 1 instances... {{(pid=140941) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 20 21:59:37.164389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55e8474a-c218-4500-b0d8-c954feee828f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140941) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 20 21:59:37.209236 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-c3955c5e-8d53-4b1a-ab98-65903e1dd612 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.654747 Nov 20 21:59:37.209881 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4277/8442] 10.222.0.41 () {60 vars in 1146 bytes} [Sat Nov 20 21:59:36 2021] POST /compute/v2.1/servers => generated 405 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 20 21:59:37.242085 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6fe5caa7-096e-4253-ab71-293a32287b9a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:37.242792 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6fe5caa7-096e-4253-ab71-293a32287b9a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:37.255097 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f70f1d8-f836-4a81-87f9-85c4ee3a2481] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51616. Nov 20 21:59:37.256627 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] [2ab04022-102a-4343-bf4a-2a3aa5a6e99f] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 51618. Nov 20 21:59:37.303554 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6fe5caa7-096e-4253-ab71-293a32287b9a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:37.310730 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6fe5caa7-096e-4253-ab71-293a32287b9a tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1248 microversion: 2.1 time: 0.093683 Nov 20 21:59:37.311297 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4166/8443] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:37 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:38.329219 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:38.329843 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:38.336042 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:38.336633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:38.337440 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:38.337892 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:38.403407 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:38.412440 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-1e8be970-3360-4bfd-922e-be8f5a1bcefb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1306 microversion: 2.1 time: 0.087754 Nov 20 21:59:38.413333 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4278/8444] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:38 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:39.430285 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:39.431183 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:39.438352 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:39.439319 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:39.440386 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:39.441156 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:39.593970 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:39.602810 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2a698825-156d-42c5-a003-a6f6b7cb6c8f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.176985 Nov 20 21:59:39.603978 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4167/8445] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:39 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:40.310780 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-705389a4-f83e-400d-ba34-980355e7897a req-12905341-6690-43e8-ad83-af0039d96b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "name": "network-vif-unplugged", "status": "completed", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:40.313323 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:59:40.313323 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:59:40.321824 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-705389a4-f83e-400d-ba34-980355e7897a req-12905341-6690-43e8-ad83-af0039d96b99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:40.322483 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-705389a4-f83e-400d-ba34-980355e7897a req-12905341-6690-43e8-ad83-af0039d96b99 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:40.333904 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-705389a4-f83e-400d-ba34-980355e7897a req-12905341-6690-43e8-ad83-af0039d96b99 service nova] Creating event network-vif-unplugged:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 21:59:40.339125 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-705389a4-f83e-400d-ba34-980355e7897a req-12905341-6690-43e8-ad83-af0039d96b99 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032937 Nov 20 21:59:40.339875 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4279/8446] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:59:40 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:59:40.619954 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:40.621981 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:40.629405 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:40.629859 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:40.630698 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:40.631136 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:40.777432 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:40.785663 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-a296230c-3d67-4005-843c-5de8f720ea0c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.169572 Nov 20 21:59:40.786201 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4168/8447] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:40 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:41.805232 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:41.805873 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:41.813536 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:41.814239 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:41.815230 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:41.815898 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:41.962351 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:41.969679 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-da61b6d8-28e3-4db0-942e-b31a8b283322 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.170423 Nov 20 21:59:41.970273 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4280/8448] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:41 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:42.987119 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:42.987727 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:42.995153 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:42.995600 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:42.996376 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:42.996823 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:43.140653 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:43.148563 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-2558c8e0-e0b0-419a-ad7f-7ba1554ae43d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.165028 Nov 20 21:59:43.149370 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4169/8449] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:42 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:44.215588 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:44.216247 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:44.223085 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:44.223554 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:44.224348 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:44.224800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:44.385633 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:44.393086 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-7360c866-468f-49a6-8d36-0d7d891fa332 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.181322 Nov 20 21:59:44.393654 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4281/8450] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:44 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:45.409855 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:45.411403 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:45.419430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:45.419898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:45.420706 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:45.421349 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:45.590019 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:45.604465 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-ac2cf801-7b8d-4a77-b20b-007a1db4a3b2 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.198166 Nov 20 21:59:45.605064 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4170/8451] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:45 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:46.621065 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:46.621748 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:46.628556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:46.629022 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:46.629814 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:46.630308 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:46.770903 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:46.778751 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-b10fc3e5-c4f7-439b-aaca-8766da1504de tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.161306 Nov 20 21:59:46.779336 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4282/8452] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:46 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:47.795590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:47.796126 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:47.802869 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:47.803323 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:47.804179 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:47.804623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:47.956080 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:47.964087 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-929a293d-0af8-4db5-bdf7-37d0f09c85a7 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.172292 Nov 20 21:59:47.964641 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4171/8453] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:47 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:48.991738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:48.992666 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:48.999414 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:48.999874 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:49.000663 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:49.001109 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:49.137271 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:49.144836 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-642ed5c1-c5ba-45fe-a561-677cd1439ad3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.165593 Nov 20 21:59:49.145425 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4283/8454] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:48 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:50.162575 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:50.163753 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:50.170756 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:50.171402 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:50.172206 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:50.172644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:50.420170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:50.427727 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bdce94ce-310c-4b46-af3b-b23304226633 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.268942 Nov 20 21:59:50.428327 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4172/8455] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:50 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:50.622166 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-fa8af0ad-ef19-4e6c-b48b-e8c543735708 req-dbb795aa-f85c-4b4d-8df6-bf9f2bb1d01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:50.623775 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:59:50.623775 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:59:50.631089 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fa8af0ad-ef19-4e6c-b48b-e8c543735708 req-dbb795aa-f85c-4b4d-8df6-bf9f2bb1d01f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:50.631558 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-fa8af0ad-ef19-4e6c-b48b-e8c543735708 req-dbb795aa-f85c-4b4d-8df6-bf9f2bb1d01f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:50.644374 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-fa8af0ad-ef19-4e6c-b48b-e8c543735708 req-dbb795aa-f85c-4b4d-8df6-bf9f2bb1d01f service nova] Creating event network-changed:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 21:59:50.650643 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-fa8af0ad-ef19-4e6c-b48b-e8c543735708 req-dbb795aa-f85c-4b4d-8df6-bf9f2bb1d01f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127189 Nov 20 21:59:50.651824 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4284/8456] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:59:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:59:51.444904 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:51.445682 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:51.452393 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:51.452870 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:51.453648 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:51.454106 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:51.592786 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:51.600273 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-5df64f68-a578-4aaa-b134-e12c6b94ec2d tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.159271 Nov 20 21:59:51.600873 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4173/8457] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:51 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:52.618639 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:52.619350 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:52.625556 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:52.626018 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:52.626836 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:52.627287 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:52.767052 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:52.775117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-8ecee3dc-63d0-4d13-8665-33d01e868d95 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.161655 Nov 20 21:59:52.775688 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4285/8458] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:52 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:53.791913 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:53.792439 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:53.799173 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:53.799627 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:53.800404 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:53.800844 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:53.933971 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:53.941338 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-45aca8e6-8424-4d5e-8c64-5f0716ad50b1 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.153775 Nov 20 21:59:53.941900 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4174/8459] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:53 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:54.958790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:54.959340 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:54.966074 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:54.966544 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:54.967366 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:54.967820 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:55.099738 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:55.107555 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-42a9c238-e94f-4b33-8c62-916bbd18faf6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.152640 Nov 20 21:59:55.108133 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4286/8460] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:54 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:56.124862 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:56.125468 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:56.132741 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:56.133197 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:56.133979 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:56.134430 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:56.270164 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:56.278114 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-9ef92a53-7ab4-468e-ac7d-7cd4fe3aceb8 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.157063 Nov 20 21:59:56.278686 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4175/8461] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:56 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:56.551717 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-368b8aa9-ab2a-4692-b199-9fc63b0d2ca5 req-f36829f3-d7d9-4253-b01d-a880897d7ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "name": "network-vif-plugged", "status": "completed", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 21:59:56.553247 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 21:59:56.553247 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 21:59:56.561223 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-368b8aa9-ab2a-4692-b199-9fc63b0d2ca5 req-f36829f3-d7d9-4253-b01d-a880897d7ed9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:56.561677 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-368b8aa9-ab2a-4692-b199-9fc63b0d2ca5 req-f36829f3-d7d9-4253-b01d-a880897d7ed9 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:56.575451 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-368b8aa9-ab2a-4692-b199-9fc63b0d2ca5 req-f36829f3-d7d9-4253-b01d-a880897d7ed9 service nova] Creating event network-vif-plugged:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 21:59:56.580857 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-368b8aa9-ab2a-4692-b199-9fc63b0d2ca5 req-f36829f3-d7d9-4253-b01d-a880897d7ed9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032805 Nov 20 21:59:56.581491 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4287/8462] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 21:59:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 21:59:57.294619 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:57.295243 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:57.301934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:57.302415 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:57.303191 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:57.304188 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:57.437326 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:57.444700 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6591a039-8317-4bd8-b00a-cf7f6cce260f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1373 microversion: 2.1 time: 0.153784 Nov 20 21:59:57.445266 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4176/8463] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:57 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:58.464408 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:58.465790 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:58.477504 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:58.478389 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:58.479829 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:58.480630 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:58.628959 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:58.637640 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-59501c80-b65b-4405-9e2d-3a1e940c441b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1558 microversion: 2.1 time: 0.180585 Nov 20 21:59:58.638261 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4288/8464] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:58 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 21:59:58.653965 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 21:59:58.654603 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 21:59:58.661887 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:58.662644 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:58.663506 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 21:59:58.663944 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 21:59:58.810825 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 21:59:58.818992 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-bd59c0ea-7ee5-4bd5-87c1-c91b6bdbdd1f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1558 microversion: 2.1 time: 0.168768 Nov 20 21:59:58.820436 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4177/8465] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 21:59:58 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:00:00.477329 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-27ae0667-6bdb-473b-9396-b91dc863fc06 req-4a0cdf7d-c0ef-4c35-ba60-6e15e67ffeac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:00:00.478869 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:00:00.478869 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 22:00:00.487101 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-27ae0667-6bdb-473b-9396-b91dc863fc06 req-4a0cdf7d-c0ef-4c35-ba60-6e15e67ffeac service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:00:00.487711 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-27ae0667-6bdb-473b-9396-b91dc863fc06 req-4a0cdf7d-c0ef-4c35-ba60-6e15e67ffeac service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:00:00.499815 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-27ae0667-6bdb-473b-9396-b91dc863fc06 req-4a0cdf7d-c0ef-4c35-ba60-6e15e67ffeac service nova] Creating event network-changed:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 22:00:00.504905 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-27ae0667-6bdb-473b-9396-b91dc863fc06 req-4a0cdf7d-c0ef-4c35-ba60-6e15e67ffeac service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Nov 20 22:00:00.505625 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4289/8466] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 22:01:39.361980 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-312373930"}} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:39.363047 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:39.369945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:39.370436 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:39.371229 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:39.371674 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:39.649555 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-6b671f73-162d-4ac3-9068-c0e50ee03bdf tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "POST /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6/action" status: 202 len: 0 microversion: 2.1 time: 0.292368 Nov 20 22:01:39.650236 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4178/8467] 10.222.0.41 () {60 vars in 1277 bytes} [Sat Nov 20 22:01:39 2021] POST /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 20 22:01:45.175492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-b69a8a10-ddf0-4da0-94b5-26d754c82fef req-ab7c661d-a51e-47fa-8132-fd719b7245c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "name": "network-vif-plugged", "status": "completed", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:45.178374 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:01:45.178374 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 22:01:45.192257 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b69a8a10-ddf0-4da0-94b5-26d754c82fef req-ab7c661d-a51e-47fa-8132-fd719b7245c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:45.192716 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-b69a8a10-ddf0-4da0-94b5-26d754c82fef req-ab7c661d-a51e-47fa-8132-fd719b7245c0 service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:45.223117 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-b69a8a10-ddf0-4da0-94b5-26d754c82fef req-ab7c661d-a51e-47fa-8132-fd719b7245c0 service nova] Creating event network-vif-plugged:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 22:01:45.230323 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-b69a8a10-ddf0-4da0-94b5-26d754c82fef req-ab7c661d-a51e-47fa-8132-fd719b7245c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061087 Nov 20 22:01:45.231287 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4290/8468] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 22:01:53.265301 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:53.265898 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:53.266800 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-a4c62b66-673c-4c2d-b981-079b405aa76e req-2b546db0-fedb-4803-9549-401901b92c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:53.269306 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:01:53.269306 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 22:01:53.272824 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:53.273277 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:53.275000 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:53.275590 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:53.277726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a4c62b66-673c-4c2d-b981-079b405aa76e req-2b546db0-fedb-4803-9549-401901b92c0c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:53.278488 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-a4c62b66-673c-4c2d-b981-079b405aa76e req-2b546db0-fedb-4803-9549-401901b92c0c service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:53.290178 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-a4c62b66-673c-4c2d-b981-079b405aa76e req-2b546db0-fedb-4803-9549-401901b92c0c service nova] Creating event network-changed:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 22:01:53.295622 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-a4c62b66-673c-4c2d-b981-079b405aa76e req-2b546db0-fedb-4803-9549-401901b92c0c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032739 Nov 20 22:01:53.296594 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4291/8469] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:01:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 22:01:53.304671 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Going to try to terminate instance {{(pid=140942) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 22:01:53.394852 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-47819580-01c9-4f68-a7f2-9e282bc53a98 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "DELETE /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 204 len: 0 microversion: 2.1 time: 0.135165 Nov 20 22:01:53.395639 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4179/8470] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 22:01:53 2021] DELETE /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 22:01:53.404858 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:53.405617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:53.412617 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:53.413347 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:53.414349 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:53.415017 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:53.631432 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:01:53.639098 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-3e8dad22-eb04-4b23-ae84-4dd1c3d23f78 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1682 microversion: 2.1 time: 0.238281 Nov 20 22:01:53.639785 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4292/8471] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:53 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:01:54.658503 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:54.659170 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:54.666241 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:54.667260 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:54.667477 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:54.667911 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:54.852755 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:01:54.860168 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-1238720e-a05a-4e5f-8fa0-8dc4063c0fb3 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1564 microversion: 2.1 time: 0.206376 Nov 20 22:01:54.860742 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4180/8472] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:54 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:01:55.141962 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [req-3deb82b0-3b70-41c3-b9c0-ba181f5a10fc req-0badbd7f-3b9c-4e7f-8c66-1f17f42dff1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "name": "network-vif-unplugged", "status": "completed", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:55.143905 ncdv-master-1 devstack@n-api.service[140941]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:01:55.143905 ncdv-master-1 devstack@n-api.service[140941]: warnings.warn(msg) Nov 20 22:01:55.152278 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3deb82b0-3b70-41c3-b9c0-ba181f5a10fc req-0badbd7f-3b9c-4e7f-8c66-1f17f42dff1f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:55.152885 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [req-3deb82b0-3b70-41c3-b9c0-ba181f5a10fc req-0badbd7f-3b9c-4e7f-8c66-1f17f42dff1f service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:55.167054 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.compute.server_external_events [req-3deb82b0-3b70-41c3-b9c0-ba181f5a10fc req-0badbd7f-3b9c-4e7f-8c66-1f17f42dff1f service nova] Creating event network-vif-unplugged:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 22:01:55.172565 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [req-3deb82b0-3b70-41c3-b9c0-ba181f5a10fc req-0badbd7f-3b9c-4e7f-8c66-1f17f42dff1f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034362 Nov 20 22:01:55.173567 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4293/8473] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:01:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 22:01:55.430809 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-a88a6096-4202-43f6-bed8-720024b37af1 req-ff0f942a-e7c1-47e0-9434-75d1800711cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d3163c-4c1c-42cd-b17d-f54f8b9548a6", "name": "network-vif-deleted", "tag": "0bb159de-5b3e-4afe-b042-4aa426dfc1c3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:55.432478 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:01:55.432478 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 22:01:55.439471 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a88a6096-4202-43f6-bed8-720024b37af1 req-ff0f942a-e7c1-47e0-9434-75d1800711cf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:55.439915 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-a88a6096-4202-43f6-bed8-720024b37af1 req-ff0f942a-e7c1-47e0-9434-75d1800711cf service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:55.451794 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-a88a6096-4202-43f6-bed8-720024b37af1 req-ff0f942a-e7c1-47e0-9434-75d1800711cf service nova] Creating event network-vif-deleted:0bb159de-5b3e-4afe-b042-4aa426dfc1c3 for instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 on nch1-master-1 Nov 20 22:01:55.457192 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-a88a6096-4202-43f6-bed8-720024b37af1 req-ff0f942a-e7c1-47e0-9434-75d1800711cf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030747 Nov 20 22:01:55.457793 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4181/8474] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:01:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 22:01:55.878464 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:55.879178 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:55.886875 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:55.887362 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:55.888158 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:55.888614 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:55.923492 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:55.923963 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:55.924429 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lazy-loading 'fault' on Instance uuid 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 22:01:55.966732 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:01:55.975865 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-0d451446-0b0b-4aa2-bbe7-ba331d02325f tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 200 len: 1338 microversion: 2.1 time: 0.101625 Nov 20 22:01:55.976603 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4294/8475] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:55 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:01:56.994374 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:56.994995 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: 35d3163c-4c1c-42cd-b17d-f54f8b9548a6] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:57.001166 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:57.001623 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:57.002447 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:57.002895 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:57.016048 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] HTTP exception thrown: Instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 could not be found. Nov 20 22:01:57.016641 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Returning 404 to user: Instance 35d3163c-4c1c-42cd-b17d-f54f8b9548a6 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 22:01:57.017462 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-d033fed9-7545-4452-b5de-1f81072bb04b tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6" status: 404 len: 111 microversion: 2.1 time: 0.028456 Nov 20 22:01:57.017998 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4182/8476] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:56 2021] GET /compute/v2.1/servers/35d3163c-4c1c-42cd-b17d-f54f8b9548a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 22:01:58.374981 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:58.375551 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:58.378338 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-f8340d38-10e8-4b6e-90cc-8d4a87d4b342 req-78101ec6-f65b-413d-9cb7-a53a6bc27b8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:01:58.380949 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:01:58.380949 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 22:01:58.384779 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:58.385245 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:58.386090 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:58.386543 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:58.390463 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f8340d38-10e8-4b6e-90cc-8d4a87d4b342 req-78101ec6-f65b-413d-9cb7-a53a6bc27b8b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:58.391171 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-f8340d38-10e8-4b6e-90cc-8d4a87d4b342 req-78101ec6-f65b-413d-9cb7-a53a6bc27b8b service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:58.404412 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-f8340d38-10e8-4b6e-90cc-8d4a87d4b342 req-78101ec6-f65b-413d-9cb7-a53a6bc27b8b service nova] Creating event network-changed:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 22:01:58.410783 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-f8340d38-10e8-4b6e-90cc-8d4a87d4b342 req-78101ec6-f65b-413d-9cb7-a53a6bc27b8b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037179 Nov 20 22:01:58.412080 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4183/8477] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:01:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 20 22:01:58.419268 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Going to try to terminate instance {{(pid=140941) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 20 22:01:58.508681 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d656a1c3-27de-44c2-91d6-4dbcb824bbe6 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 204 len: 0 microversion: 2.1 time: 0.136750 Nov 20 22:01:58.510589 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4295/8478] 10.222.0.41 () {58 vars in 1238 bytes} [Sat Nov 20 22:01:58 2021] DELETE /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 20 22:01:58.520030 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:58.522618 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:58.532716 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:58.533518 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:58.534428 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:58.535093 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:58.709421 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.policy [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140942) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:01:58.718188 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-b8591f37-fdc7-40bb-9d15-c4d3c938316c tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1682 microversion: 2.1 time: 0.202556 Nov 20 22:01:58.723213 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4184/8479] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:58 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:01:59.737622 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:01:59.738424 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:01:59.745126 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:59.745595 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:59.746433 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:01:59.746884 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:01:59.881555 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:01:59.890180 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-595e721a-800e-48af-94af-6c808c63dd90 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1563 microversion: 2.1 time: 0.156150 Nov 20 22:01:59.890937 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4296/8480] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:01:59 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:02:00.640274 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [req-4e73e8f0-5aa8-40c6-917a-6a6e7bddf768 req-8b42412c-a35f-4e32-abd1-860affbb5c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6b796a-3c8d-478b-bc2f-b28405afe958", "name": "network-vif-deleted", "tag": "ec694dec-bf1d-4b98-bec9-88ad1f50a4a3"}]} {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 20 22:02:00.641977 ncdv-master-1 devstack@n-api.service[140942]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 20 22:02:00.641977 ncdv-master-1 devstack@n-api.service[140942]: warnings.warn(msg) Nov 20 22:02:00.650181 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4e73e8f0-5aa8-40c6-917a-6a6e7bddf768 req-8b42412c-a35f-4e32-abd1-860affbb5c1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:00.650633 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [req-4e73e8f0-5aa8-40c6-917a-6a6e7bddf768 req-8b42412c-a35f-4e32-abd1-860affbb5c1a service nova] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:00.663613 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.compute.server_external_events [req-4e73e8f0-5aa8-40c6-917a-6a6e7bddf768 req-8b42412c-a35f-4e32-abd1-860affbb5c1a service nova] Creating event network-vif-deleted:ec694dec-bf1d-4b98-bec9-88ad1f50a4a3 for instance ed6b796a-3c8d-478b-bc2f-b28405afe958 on nch2-master-1 Nov 20 22:02:00.668766 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [req-4e73e8f0-5aa8-40c6-917a-6a6e7bddf768 req-8b42412c-a35f-4e32-abd1-860affbb5c1a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090643 Nov 20 22:02:00.669391 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4185/8481] 10.222.0.41 () {64 vars in 1317 bytes} [Sat Nov 20 22:02:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 20 22:02:00.908726 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:02:00.909462 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.compute.api [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140941) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:02:00.917123 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:00.917590 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:00.918430 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:00.918940 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:00.954300 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:00.954771 ncdv-master-1 devstack@n-api.service[140941]: DEBUG oslo_concurrency.lockutils [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:00.955243 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.objects.instance [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lazy-loading 'fault' on Instance uuid ed6b796a-3c8d-478b-bc2f-b28405afe958 {{(pid=140941) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 20 22:02:01.008834 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.policy [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7504128aa7314a478a46ccd8306bd535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a521bfbeaca4e3ab513ff90f1caa0a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140941) authorize /opt/stack/nova/nova/policy.py:199}} Nov 20 22:02:01.016418 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d07620b4-f134-48d6-b541-8c9a18f68941 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 200 len: 1338 microversion: 2.1 time: 0.111622 Nov 20 22:02:01.016997 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4297/8482] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:02:00 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 1338 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 20 22:02:02.035247 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '>' {{(pid=140942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:02:02.035945 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.compute.api [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] [instance: ed6b796a-3c8d-478b-bc2f-b28405afe958] Fetching instance by UUID {{(pid=140942) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 20 22:02:02.042207 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:02.042670 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:02.043462 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 20 22:02:02.043934 ncdv-master-1 devstack@n-api.service[140942]: DEBUG oslo_concurrency.lockutils [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Lock "547b6cf2-091d-4227-ac40-56296ab1bf90" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 20 22:02:02.056776 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.wsgi [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] HTTP exception thrown: Instance ed6b796a-3c8d-478b-bc2f-b28405afe958 could not be found. Nov 20 22:02:02.057370 ncdv-master-1 devstack@n-api.service[140942]: DEBUG nova.api.openstack.wsgi [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Returning 404 to user: Instance ed6b796a-3c8d-478b-bc2f-b28405afe958 could not be found. {{(pid=140942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 20 22:02:02.058235 ncdv-master-1 devstack@n-api.service[140942]: INFO nova.api.openstack.requestlog [None req-75c69934-9f6b-4d24-beef-992ebb2d59bb tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958" status: 404 len: 111 microversion: 2.1 time: 0.027938 Nov 20 22:02:02.058779 ncdv-master-1 devstack@n-api.service[140942]: [pid: 140942|app: 0|req: 4186/8483] 10.222.0.41 () {58 vars in 1235 bytes} [Sat Nov 20 22:02:02 2021] GET /compute/v2.1/servers/ed6b796a-3c8d-478b-bc2f-b28405afe958 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 20 22:02:02.216840 ncdv-master-1 devstack@n-api.service[140941]: DEBUG nova.api.openstack.wsgi [None req-d7997dff-4a9c-4eb9-b462-7c7705772e67 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] Calling method '.version_select at 0x7f3f87731ca0>' {{(pid=140941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 20 22:02:02.239349 ncdv-master-1 devstack@n-api.service[140941]: INFO nova.api.openstack.requestlog [None req-d7997dff-4a9c-4eb9-b462-7c7705772e67 tempest-TestSnapshotPattern-1493861168 tempest-TestSnapshotPattern-1493861168-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1103114198" status: 202 len: 0 microversion: 2.1 time: 0.026172 Nov 20 22:02:02.240029 ncdv-master-1 devstack@n-api.service[140941]: [pid: 140941|app: 0|req: 4298/8484] 10.222.0.41 () {58 vars in 1256 bytes} [Sat Nov 20 22:02:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1103114198 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 20 22:02:35.419754 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 20 22:02:35.420455 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:02:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:02:35.851327 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:02:35.851767 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:02:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:02:36.811081 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:02:36.811252 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:02:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:04:15.369917 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:04:15.370552 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:04:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:04:38.952719 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:04:38.953373 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:04:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:05:55.437275 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:05:55.437956 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:05:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:05:55.869221 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:05:55.869670 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:05:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:05:56.828745 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:05:56.828924 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:05:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:07:35.387589 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:07:35.388179 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:07:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:07:36.320233 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:07:36.320789 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:07:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:07:58.969975 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:07:58.970526 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:07:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:09:15.455046 ncdv-master-1 devstack@n-api.service[140941]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:09:15.455673 ncdv-master-1 devstack@n-api.service[140941]: Sat Nov 20 22:09:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:09:15.886766 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:09:15.887228 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:09:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 20 22:09:16.846459 ncdv-master-1 devstack@n-api.service[140942]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 20 22:09:16.846631 ncdv-master-1 devstack@n-api.service[140942]: Sat Nov 20 22:09:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!